2026-02-17T05:19:57.817 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T05:19:57.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:19:57.915 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002 branch: wip-bharath18-testing-2026-02-13-0856 description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{1M} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51002' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath18-testing-2026-02-13-0856 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 30 debug ms: 20 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 1024K bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - \(MON_NETSPLIT) - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(POOL_APP_NOT_ENABLED\) mon_bind_msgr2: false sha1: 325850157d309f65985eea9ec9bb9f1d56726fee ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 325850157d309f65985eea9ec9bb9f1d56726fee thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath18-testing-2026-02-13-0856 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 7109 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath18-testing-2026-02-13-0856 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 325850157d309f65985eea9ec9bb9f1d56726fee targets: trial106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGv21XoMGp4ZlmKoBflQnC66fTKcwflu5wwpbLaoPUJecgvYDJK4xa1WaVXF4BLKuqflZZQn8w9XBXeOaAjbPkM= trial118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6MW++Vv+NeLzST5mculpQ1NZ2DABYq9iJAMtMME1o17E72/dMBf0fEmNwEV35wmYicnjfqDrzuJmxKA9rdleg= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_03:53:03 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T05:19:57.915 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa; will attempt to use it 2026-02-17T05:19:57.915 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks 2026-02-17T05:19:57.915 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T05:19:57.917 INFO:teuthology.task.internal:Checking packages... 2026-02-17T05:19:57.917 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '325850157d309f65985eea9ec9bb9f1d56726fee' 2026-02-17T05:19:57.917 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T05:19:57.917 INFO:teuthology.packaging:ref: None 2026-02-17T05:19:57.917 INFO:teuthology.packaging:tag: None 2026-02-17T05:19:57.917 INFO:teuthology.packaging:branch: wip-bharath18-testing-2026-02-13-0856 2026-02-17T05:19:57.917 INFO:teuthology.packaging:sha1: 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:19:57.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath18-testing-2026-02-13-0856 2026-02-17T05:19:58.032 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.g32585015 2026-02-17T05:19:58.033 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T05:19:58.045 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T05:19:58.045 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T05:19:58.058 INFO:teuthology.task.internal:Saving configuration 2026-02-17T05:19:58.070 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T05:19:58.081 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T05:19:58.156 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial106.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 05:16:31.310917', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGv21XoMGp4ZlmKoBflQnC66fTKcwflu5wwpbLaoPUJecgvYDJK4xa1WaVXF4BLKuqflZZQn8w9XBXeOaAjbPkM='} 2026-02-17T05:19:58.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial118.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 05:16:31.310277', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6MW++Vv+NeLzST5mculpQ1NZ2DABYq9iJAMtMME1o17E72/dMBf0fEmNwEV35wmYicnjfqDrzuJmxKA9rdleg='} 2026-02-17T05:19:58.213 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T05:19:58.226 INFO:teuthology.task.internal:roles: ubuntu@trial106.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-17T05:19:58.226 INFO:teuthology.task.internal:roles: ubuntu@trial118.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-17T05:19:58.226 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T05:19:58.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x768d89fc82c0>, signals=[15]) 2026-02-17T05:19:58.363 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T05:19:58.374 INFO:teuthology.task.internal:Opening connections... 2026-02-17T05:19:58.374 DEBUG:teuthology.task.internal:connecting to ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:19:58.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:19:58.438 DEBUG:teuthology.task.internal:connecting to ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:19:58.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:19:58.500 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T05:19:58.512 DEBUG:teuthology.orchestra.run.trial106:> uname -m 2026-02-17T05:19:58.527 INFO:teuthology.orchestra.run.trial106.stdout:x86_64 2026-02-17T05:19:58.527 DEBUG:teuthology.orchestra.run.trial106:> cat /etc/os-release 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:NAME="CentOS Stream" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:VERSION="9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:ID="centos" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:ID_LIKE="rhel fedora" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:VERSION_ID="9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:PLATFORM_ID="platform:el9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:ANSI_COLOR="0;31" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:LOGO="fedora-logo-icon" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:HOME_URL="https://centos.org/" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T05:19:58.583 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T05:19:58.584 INFO:teuthology.lock.ops:Updating trial106.front.sepia.ceph.com on lock server 2026-02-17T05:19:58.652 DEBUG:teuthology.orchestra.run.trial118:> uname -m 2026-02-17T05:19:58.667 INFO:teuthology.orchestra.run.trial118.stdout:x86_64 2026-02-17T05:19:58.667 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T05:19:58.722 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T05:19:58.723 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server 2026-02-17T05:19:58.785 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T05:19:58.798 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T05:19:58.810 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T05:19:58.810 DEBUG:teuthology.orchestra.run.trial106:> test '!' -e /home/ubuntu/cephtest 2026-02-17T05:19:58.811 DEBUG:teuthology.orchestra.run.trial118:> test '!' -e /home/ubuntu/cephtest 2026-02-17T05:19:58.826 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T05:19:58.839 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T05:19:58.840 DEBUG:teuthology.orchestra.run.trial106:> test -z $(ls -A /var/lib/ceph) 2026-02-17T05:19:58.867 DEBUG:teuthology.orchestra.run.trial118:> test -z $(ls -A /var/lib/ceph) 2026-02-17T05:19:58.884 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T05:19:59.046 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T05:19:59.068 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T05:19:59.068 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T05:19:59.069 DEBUG:teuthology.orchestra.run.trial106:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T05:19:59.069 DEBUG:teuthology.orchestra.run.trial118:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T05:19:59.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:19:59.084 DEBUG:teuthology.orchestra.run.trial106:> uname -r 2026-02-17T05:19:59.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:19:59.085 DEBUG:teuthology.orchestra.run.trial118:> uname -r 2026-02-17T05:19:59.139 INFO:teuthology.orchestra.run.trial106.stdout:5.14.0-645.el9.x86_64 2026-02-17T05:19:59.140 INFO:teuthology.task.kernel:Running kernel on trial106: 5.14.0-645.el9.x86_64 2026-02-17T05:19:59.140 DEBUG:teuthology.orchestra.run.trial106:> sudo yum install -y kernel 2026-02-17T05:19:59.140 INFO:teuthology.orchestra.run.trial118.stdout:5.14.0-645.el9.x86_64 2026-02-17T05:19:59.140 INFO:teuthology.task.kernel:Running kernel on trial118: 5.14.0-645.el9.x86_64 2026-02-17T05:19:59.140 DEBUG:teuthology.orchestra.run.trial118:> sudo yum install -y kernel 2026-02-17T05:19:59.747 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 37 MB/s | 8.9 MB 00:00 2026-02-17T05:20:00.173 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T05:20:03.328 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T05:20:07.266 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-17T05:20:08.815 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-17T05:20:12.094 INFO:teuthology.orchestra.run.trial118.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 20 MB 00:03 2026-02-17T05:20:15.296 INFO:teuthology.orchestra.run.trial118.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-17T05:20:16.309 INFO:teuthology.orchestra.run.trial118.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T05:20:16.329 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:20:16.330 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:20:16.330 INFO:teuthology.orchestra.run.trial118.stdout: Package Architecture Version Repository Size 2026-02-17T05:20:16.330 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:20:16.330 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:20:16.330 INFO:teuthology.orchestra.run.trial118.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:Install 4 Packages 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 88 M 2026-02-17T05:20:16.331 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 135 M 2026-02-17T05:20:16.332 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:20:17.971 INFO:teuthology.orchestra.run.trial118.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 519 kB/s | 803 kB 00:01 2026-02-17T05:20:28.741 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 965 kB/s | 27 MB 00:28 2026-02-17T05:20:37.488 INFO:teuthology.orchestra.run.trial118.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 831 kB/s | 17 MB 00:21 2026-02-17T05:20:40.008 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 900 kB/s | 7.8 MB 00:08 2026-02-17T05:20:40.884 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 140 kB/s | 20 kB 00:00 2026-02-17T05:20:55.217 INFO:teuthology.orchestra.run.trial118.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 848 kB/s | 31 MB 00:37 2026-02-17T05:20:59.901 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 20 MB 00:18 2026-02-17T05:21:03.139 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-17T05:21:04.135 INFO:teuthology.orchestra.run.trial118.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 850 kB/s | 40 MB 00:47 2026-02-17T05:21:04.137 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:21:04.137 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.8 MB/s | 88 MB 00:47 2026-02-17T05:21:04.160 INFO:teuthology.orchestra.run.trial106.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T05:21:04.180 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:21:04.181 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:21:04.182 INFO:teuthology.orchestra.run.trial106.stdout:Install 4 Packages 2026-02-17T05:21:04.182 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:04.182 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 88 M 2026-02-17T05:21:04.182 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 135 M 2026-02-17T05:21:04.182 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:21:04.325 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:21:04.525 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:21:04.525 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:21:04.871 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:21:04.871 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:21:04.891 INFO:teuthology.orchestra.run.trial106.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2026-02-17T05:21:05.436 INFO:teuthology.orchestra.run.trial106.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 15 MB/s | 17 MB 00:01 2026-02-17T05:21:05.961 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:21:05.964 INFO:teuthology.orchestra.run.trial106.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T05:21:06.100 INFO:teuthology.orchestra.run.trial106.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 22 MB/s | 40 MB 00:01 2026-02-17T05:21:06.101 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:21:06.101 INFO:teuthology.orchestra.run.trial106.stdout:Total 46 MB/s | 88 MB 00:01 2026-02-17T05:21:06.243 INFO:teuthology.orchestra.run.trial118.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:21:06.262 INFO:teuthology.orchestra.run.trial118.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:06.289 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:21:06.490 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:21:06.490 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:21:06.837 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:21:06.837 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:21:07.927 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:21:08.046 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:08.075 INFO:teuthology.orchestra.run.trial118.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:08.210 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:21:08.229 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:10.017 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:10.045 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:11.162 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:11.168 INFO:teuthology.orchestra.run.trial118.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:13.067 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:13.073 INFO:teuthology.orchestra.run.trial106.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:14.269 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:16.126 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:44.515 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:44.536 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:44.599 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:44.599 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:21:44.599 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:44.599 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:44.652 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:44.652 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:21:44.652 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:21:44.652 INFO:teuthology.orchestra.run.trial118.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.652 INFO:teuthology.orchestra.run.trial118.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.653 INFO:teuthology.orchestra.run.trial118.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.653 INFO:teuthology.orchestra.run.trial118.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.653 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:21:44.653 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:21:44.710 DEBUG:teuthology.orchestra.run.trial118:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:21:44.736 INFO:teuthology.orchestra.run.trial118.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:21:44.737 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T05:21:44.738 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T05:21:44.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T05:21:44.738 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T05:21:44.738 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial118.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T05:21:44.738 DEBUG:teuthology.orchestra.run.trial118:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:21:44.800 INFO:teuthology.orchestra.run.trial118.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:44.801 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:21:44.801 DEBUG:teuthology.orchestra.run.trial118:> sudo rpm -qi grub2-tools 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Name : grub2-tools 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Epoch : 1 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Version : 2.06 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Release : 118.el9 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Architecture: x86_64 2026-02-17T05:21:44.870 INFO:teuthology.orchestra.run.trial118.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Group : Unspecified 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Size : 8393909 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:License : GPLv3+ 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Packager : builder@centos.org 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Vendor : CentOS 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Summary : Support tools for GRUB. 2026-02-17T05:21:44.871 INFO:teuthology.orchestra.run.trial118.stdout:Description : 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout:hardware devices. 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:21:44.872 INFO:teuthology.orchestra.run.trial118.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T05:21:44.873 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T05:21:44.873 INFO:teuthology.task.kernel:Updating grub on trial118 to boot 5.14.0-681.el9.x86_64 2026-02-17T05:21:44.873 DEBUG:teuthology.orchestra.run.trial118:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T05:21:44.937 INFO:teuthology.orchestra.run.trial118.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:21:44.939 DEBUG:teuthology.orchestra.run.trial118:> sudo command -v grubby && echo yes || echo no 2026-02-17T05:21:45.005 INFO:teuthology.orchestra.run.trial118.stdout:/sbin/grubby 2026-02-17T05:21:45.006 INFO:teuthology.orchestra.run.trial118.stdout:yes 2026-02-17T05:21:45.006 DEBUG:teuthology.orchestra.run.trial118:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T05:21:45.070 INFO:teuthology.orchestra.run.trial118.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:21:45.071 DEBUG:teuthology.orchestra.run.trial118:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T05:21:45.144 DEBUG:teuthology.orchestra.run.trial118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T05:21:45.353 INFO:teuthology.orchestra.run.trial118.stderr:Generating grub configuration file ... 2026-02-17T05:21:45.417 INFO:teuthology.orchestra.run.trial118.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T05:21:45.423 INFO:teuthology.orchestra.run.trial118.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T05:21:45.677 INFO:teuthology.orchestra.run.trial118.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T05:21:45.683 INFO:teuthology.orchestra.run.trial118.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T05:21:45.715 INFO:teuthology.orchestra.run.trial118.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T05:21:45.721 INFO:teuthology.orchestra.run.trial118.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T05:21:45.745 INFO:teuthology.orchestra.run.trial118.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T05:21:45.751 INFO:teuthology.orchestra.run.trial118.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T05:21:45.832 INFO:teuthology.orchestra.run.trial118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T05:21:45.840 INFO:teuthology.orchestra.run.trial118.stderr:done 2026-02-17T05:21:45.843 DEBUG:teuthology.orchestra.run.trial118:> test -d /sys/firmware/efi 2026-02-17T05:21:45.858 DEBUG:teuthology.orchestra.run.trial118:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T05:21:45.923 INFO:teuthology.orchestra.run.trial118.stdout:/boot/efi/EFI/BOOT 2026-02-17T05:21:45.924 INFO:teuthology.orchestra.run.trial118.stdout:/boot/efi/EFI/centos 2026-02-17T05:21:45.925 DEBUG:teuthology.orchestra.run.trial118:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T05:21:45.991 INFO:teuthology.orchestra.run.trial118.stdout:no 2026-02-17T05:21:45.992 DEBUG:teuthology.orchestra.run.trial118:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T05:21:46.056 INFO:teuthology.orchestra.run.trial118.stdout:yes 2026-02-17T05:21:46.056 DEBUG:teuthology.orchestra.run.trial118:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T05:21:46.123 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial118 2026-02-17T05:21:46.123 DEBUG:teuthology.orchestra.run.trial118:> sudo bash -c ' 2026-02-17T05:21:46.124 DEBUG:teuthology.orchestra.run.trial118:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T05:21:46.124 DEBUG:teuthology.orchestra.run.trial118:> ' 2026-02-17T05:21:46.684 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:46.706 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:46.772 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:46.772 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:21:46.772 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:21:46.772 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:21:46.824 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:21:46.824 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:46.825 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:21:46.882 DEBUG:teuthology.orchestra.run.trial106:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:21:46.908 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.909 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:21:46.909 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T05:21:46.909 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T05:21:46.909 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T05:21:46.909 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T05:21:46.910 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial106.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T05:21:46.910 DEBUG:teuthology.orchestra.run.trial106:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:21:46.974 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:21:46.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:21:46.976 DEBUG:teuthology.orchestra.run.trial106:> sudo rpm -qi grub2-tools 2026-02-17T05:21:47.044 INFO:teuthology.orchestra.run.trial106.stdout:Name : grub2-tools 2026-02-17T05:21:47.044 INFO:teuthology.orchestra.run.trial106.stdout:Epoch : 1 2026-02-17T05:21:47.044 INFO:teuthology.orchestra.run.trial106.stdout:Version : 2.06 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Release : 118.el9 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Architecture: x86_64 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Group : Unspecified 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Size : 8393909 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:License : GPLv3+ 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Packager : builder@centos.org 2026-02-17T05:21:47.045 INFO:teuthology.orchestra.run.trial106.stdout:Vendor : CentOS 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:Summary : Support tools for GRUB. 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:Description : 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:hardware devices. 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:21:47.046 INFO:teuthology.orchestra.run.trial106.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T05:21:47.047 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T05:21:47.048 INFO:teuthology.task.kernel:Updating grub on trial106 to boot 5.14.0-681.el9.x86_64 2026-02-17T05:21:47.048 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T05:21:47.110 INFO:teuthology.orchestra.run.trial106.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:21:47.111 DEBUG:teuthology.orchestra.run.trial106:> sudo command -v grubby && echo yes || echo no 2026-02-17T05:21:47.176 INFO:teuthology.orchestra.run.trial106.stdout:/sbin/grubby 2026-02-17T05:21:47.178 INFO:teuthology.orchestra.run.trial106.stdout:yes 2026-02-17T05:21:47.178 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T05:21:47.241 INFO:teuthology.orchestra.run.trial106.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:21:47.242 DEBUG:teuthology.orchestra.run.trial106:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T05:21:47.315 DEBUG:teuthology.orchestra.run.trial106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T05:21:47.522 INFO:teuthology.orchestra.run.trial106.stderr:Generating grub configuration file ... 2026-02-17T05:21:47.585 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T05:21:47.591 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T05:21:47.843 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T05:21:47.850 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T05:21:47.882 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T05:21:47.889 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T05:21:47.913 INFO:teuthology.orchestra.run.trial106.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T05:21:47.920 INFO:teuthology.orchestra.run.trial106.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T05:21:48.002 INFO:teuthology.orchestra.run.trial106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T05:21:48.010 INFO:teuthology.orchestra.run.trial106.stderr:done 2026-02-17T05:21:48.012 DEBUG:teuthology.orchestra.run.trial106:> test -d /sys/firmware/efi 2026-02-17T05:21:48.028 DEBUG:teuthology.orchestra.run.trial106:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T05:21:48.094 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi/EFI/BOOT 2026-02-17T05:21:48.094 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi/EFI/centos 2026-02-17T05:21:48.097 DEBUG:teuthology.orchestra.run.trial106:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T05:21:48.163 INFO:teuthology.orchestra.run.trial106.stdout:no 2026-02-17T05:21:48.163 DEBUG:teuthology.orchestra.run.trial106:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T05:21:48.229 INFO:teuthology.orchestra.run.trial106.stdout:yes 2026-02-17T05:21:48.229 DEBUG:teuthology.orchestra.run.trial106:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T05:21:48.296 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial106 2026-02-17T05:21:48.296 DEBUG:teuthology.orchestra.run.trial106:> sudo bash -c ' 2026-02-17T05:21:48.296 DEBUG:teuthology.orchestra.run.trial106:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T05:21:48.296 DEBUG:teuthology.orchestra.run.trial106:> ' 2026-02-17T05:22:16.167 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T05:22:16.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-17T05:22:16.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:22:18.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T05:22:18.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-17T05:22:18.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:22:30.464 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-17T05:22:32.640 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.106 2026-02-17T05:22:39.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-17T05:22:39.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:22:41.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-17T05:22:41.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:23:15.587 DEBUG:teuthology.orchestra.run.trial118:> true 2026-02-17T05:23:15.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-17T05:23:15.753 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T05:23:15.754 DEBUG:teuthology.orchestra.run.trial118:> uname -r 2026-02-17T05:23:15.810 INFO:teuthology.orchestra.run.trial118.stdout:5.14.0-681.el9.x86_64 2026-02-17T05:23:15.811 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T05:23:15.811 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T05:23:15.811 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T05:23:16.812 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T05:23:16.812 DEBUG:teuthology.orchestra.run.trial118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T05:23:16.841 INFO:teuthology.orchestra.run.trial118.stdout:ttyS1 2026-02-17T05:23:16.863 DEBUG:teuthology.parallel:result is None 2026-02-17T05:23:17.639 DEBUG:teuthology.orchestra.run.trial106:> true 2026-02-17T05:23:17.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-17T05:23:17.791 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T05:23:17.791 DEBUG:teuthology.orchestra.run.trial106:> uname -r 2026-02-17T05:23:17.848 INFO:teuthology.orchestra.run.trial106.stdout:5.14.0-681.el9.x86_64 2026-02-17T05:23:17.848 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T05:23:17.848 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T05:23:17.848 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T05:23:18.849 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T05:23:18.849 DEBUG:teuthology.orchestra.run.trial106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T05:23:18.879 INFO:teuthology.orchestra.run.trial106.stdout:ttyS1 2026-02-17T05:23:18.903 DEBUG:teuthology.parallel:result is None 2026-02-17T05:23:18.903 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T05:23:18.916 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T05:23:18.916 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T05:23:18.945 DEBUG:teuthology.orchestra.run.trial118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T05:23:18.964 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T05:23:18.976 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T05:23:18.989 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T05:23:18.989 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T05:23:19.003 DEBUG:teuthology.orchestra.run.trial118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T05:23:19.025 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T05:23:19.036 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T05:23:19.037 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T05:23:19.062 DEBUG:teuthology.orchestra.run.trial118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T05:23:19.086 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:23:19.086 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:23:19.095 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:23:19.096 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:23:19.097 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T05:23:19.109 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T05:23:19.109 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T05:23:19.139 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T05:23:19.165 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T05:23:19.182 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T05:23:19.183 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T05:23:19.204 DEBUG:teuthology.orchestra.run.trial118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T05:23:19.223 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:23:19.338 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:23:19.363 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:23:19.501 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:23:19.526 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:23:19.526 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T05:23:19.590 DEBUG:teuthology.orchestra.run.trial118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:23:19.677 DEBUG:teuthology.orchestra.run.trial118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:23:19.702 DEBUG:teuthology.orchestra.run.trial118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:23:19.819 DEBUG:teuthology.orchestra.run.trial118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:23:19.844 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:23:19.844 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T05:23:19.908 DEBUG:teuthology.orchestra.run.trial106:> sudo service rsyslog restart 2026-02-17T05:23:19.910 DEBUG:teuthology.orchestra.run.trial118:> sudo service rsyslog restart 2026-02-17T05:23:19.938 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:23:19.977 INFO:teuthology.orchestra.run.trial118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:23:20.503 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T05:23:20.519 INFO:teuthology.task.internal:Starting timer... 2026-02-17T05:23:20.519 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T05:23:20.548 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T05:23:20.569 DEBUG:teuthology.orchestra.run.trial106:> sudo service auditd rotate 2026-02-17T05:23:20.599 INFO:teuthology.orchestra.run.trial106.stdout:Rotating logs: 2026-02-17T05:23:20.601 DEBUG:teuthology.orchestra.run.trial118:> sudo service auditd rotate 2026-02-17T05:23:20.631 INFO:teuthology.orchestra.run.trial118.stdout:Rotating logs: 2026-02-17T05:23:20.633 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T05:23:20.633 DEBUG:teuthology.orchestra.run.trial106:> /usr/sbin/getenforce 2026-02-17T05:23:20.658 INFO:teuthology.orchestra.run.trial106.stdout:Permissive 2026-02-17T05:23:20.659 DEBUG:teuthology.orchestra.run.trial118:> /usr/sbin/getenforce 2026-02-17T05:23:20.689 INFO:teuthology.orchestra.run.trial118.stdout:Permissive 2026-02-17T05:23:20.689 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial106.front.sepia.ceph.com': 'permissive', 'ubuntu@trial118.front.sepia.ceph.com': 'permissive'} 2026-02-17T05:23:20.690 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T05:23:20.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:23:20.724 DEBUG:teuthology.orchestra.run.trial118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T05:23:20.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:23:20.754 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T05:23:20.754 DEBUG:teuthology.orchestra.run.trial106:> sudo /usr/sbin/setenforce permissive 2026-02-17T05:23:20.788 DEBUG:teuthology.orchestra.run.trial118:> sudo /usr/sbin/setenforce permissive 2026-02-17T05:23:20.817 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T05:23:20.830 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T05:23:20.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T05:23:20.839 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial106.front.sepia.ceph.com,trial118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T05:26:22.869 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial106.front.sepia.ceph.com'), Remote(name='ubuntu@trial118.front.sepia.ceph.com')] 2026-02-17T05:26:22.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-17T05:26:22.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:26:22.982 DEBUG:teuthology.orchestra.run.trial106:> true 2026-02-17T05:26:23.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-17T05:26:23.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-17T05:26:23.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:26:23.151 DEBUG:teuthology.orchestra.run.trial118:> true 2026-02-17T05:26:23.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-17T05:26:23.224 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T05:26:23.237 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T05:26:23.237 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T05:26:23.238 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:26:23.240 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T05:26:23.240 DEBUG:teuthology.orchestra.run.trial118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:26:23.265 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T05:26:23.277 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T05:26:23.292 INFO:teuthology.orchestra.run.trial118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T05:26:23.299 INFO:teuthology.orchestra.run.trial106.stderr:sudo: ntpd: command not found 2026-02-17T05:26:23.304 INFO:teuthology.orchestra.run.trial118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T05:26:23.308 INFO:teuthology.orchestra.run.trial106.stdout:506 Cannot talk to daemon 2026-02-17T05:26:23.320 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T05:26:23.325 INFO:teuthology.orchestra.run.trial118.stderr:sudo: ntpd: command not found 2026-02-17T05:26:23.331 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T05:26:23.335 INFO:teuthology.orchestra.run.trial118.stdout:506 Cannot talk to daemon 2026-02-17T05:26:23.346 INFO:teuthology.orchestra.run.trial118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T05:26:23.358 INFO:teuthology.orchestra.run.trial118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T05:26:23.375 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:26:23.397 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:26:23.397 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-17T05:26:23.397 INFO:teuthology.orchestra.run.trial106.stdout:^? li1150-42.members.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.397 INFO:teuthology.orchestra.run.trial106.stdout:^? LAX.CALTICK.NET 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.397 INFO:teuthology.orchestra.run.trial106.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.398 INFO:teuthology.orchestra.run.trial106.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.404 INFO:teuthology.orchestra.run.trial118.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:26:23.624 INFO:teuthology.orchestra.run.trial118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:26:23.625 INFO:teuthology.orchestra.run.trial118.stdout:=============================================================================== 2026-02-17T05:26:23.625 INFO:teuthology.orchestra.run.trial118.stdout:^? ntp.speculation.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.625 INFO:teuthology.orchestra.run.trial118.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.625 INFO:teuthology.orchestra.run.trial118.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.625 INFO:teuthology.orchestra.run.trial118.stdout:^? 23.157.160.168 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:26:23.626 INFO:teuthology.run_tasks:Running task install... 2026-02-17T05:26:23.640 DEBUG:teuthology.task.install:project ceph 2026-02-17T05:26:23.641 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}} 2026-02-17T05:26:23.641 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'} 2026-02-17T05:26:23.641 INFO:teuthology.task.install:Using flavor: default 2026-02-17T05:26:23.650 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T05:26:23.650 INFO:teuthology.task.install:extra packages: [] 2026-02-17T05:26:23.651 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'tag': None, 'wait_for_package': False} 2026-02-17T05:26:23.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:26:23.654 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'tag': None, 'wait_for_package': False} 2026-02-17T05:26:23.654 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:26:23.852 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/ 2026-02-17T05:26:23.852 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5271.g32585015 2026-02-17T05:26:23.861 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/ 2026-02-17T05:26:23.861 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5271.g32585015 2026-02-17T05:26:24.001 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T05:26:24.001 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:26:24.001 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T05:26:24.013 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T05:26:24.013 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:26:24.014 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T05:26:24.026 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T05:26:24.026 DEBUG:teuthology.orchestra.run.trial106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/325850157d309f65985eea9ec9bb9f1d56726fee/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T05:26:24.039 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T05:26:24.039 DEBUG:teuthology.orchestra.run.trial118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/325850157d309f65985eea9ec9bb9f1d56726fee/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T05:26:24.091 DEBUG:teuthology.orchestra.run.trial106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T05:26:24.103 DEBUG:teuthology.orchestra.run.trial118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T05:26:24.165 DEBUG:teuthology.orchestra.run.trial106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T05:26:24.176 DEBUG:teuthology.orchestra.run.trial118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T05:26:24.228 INFO:teuthology.orchestra.run.trial106.stdout:check_obsoletes = 1 2026-02-17T05:26:24.229 DEBUG:teuthology.orchestra.run.trial106:> sudo yum clean all 2026-02-17T05:26:24.241 INFO:teuthology.orchestra.run.trial118.stdout:check_obsoletes = 1 2026-02-17T05:26:24.242 DEBUG:teuthology.orchestra.run.trial118:> sudo yum clean all 2026-02-17T05:26:24.379 INFO:teuthology.orchestra.run.trial106.stdout:41 files removed 2026-02-17T05:26:24.393 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-radosgw 2026-02-17T05:26:24.393 INFO:teuthology.orchestra.run.trial118.stdout:41 files removed 2026-02-17T05:26:24.408 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-radosgw 2026-02-17T05:26:24.665 INFO:teuthology.orchestra.run.trial106.stdout:ceph packages for x86_64 734 kB/s | 93 kB 00:00 2026-02-17T05:26:24.680 INFO:teuthology.orchestra.run.trial118.stdout:ceph packages for x86_64 747 kB/s | 93 kB 00:00 2026-02-17T05:26:24.805 INFO:teuthology.orchestra.run.trial106.stdout:ceph noarch packages 214 kB/s | 24 kB 00:00 2026-02-17T05:26:24.822 INFO:teuthology.orchestra.run.trial118.stdout:ceph noarch packages 212 kB/s | 24 kB 00:00 2026-02-17T05:26:24.933 INFO:teuthology.orchestra.run.trial106.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-17T05:26:24.948 INFO:teuthology.orchestra.run.trial118.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-17T05:26:25.637 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T05:26:25.649 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T05:26:28.981 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-17T05:26:29.226 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 27 MB 00:03 2026-02-17T05:26:34.918 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 7.8 MB 00:03 2026-02-17T05:26:36.815 INFO:teuthology.orchestra.run.trial118.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-17T05:26:38.404 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 7.8 MB 00:07 2026-02-17T05:26:40.273 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-17T05:26:40.297 INFO:teuthology.orchestra.run.trial118.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 20 MB 00:03 2026-02-17T05:26:40.865 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 38 MB/s | 20 MB 00:00 2026-02-17T05:26:43.487 INFO:teuthology.orchestra.run.trial118.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T05:26:44.047 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T05:26:44.705 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repository Size 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout: ceph-radosgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 13 M 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout:Upgrading: 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout: librados2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 3.5 M 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout: librbd1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.8 M 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-17T05:26:44.707 INFO:teuthology.orchestra.run.trial118.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: ceph-base x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.2 M 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 24 M 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: ceph-selinux x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 909 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: libradosstriper1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 248 k 2026-02-17T05:26:44.708 INFO:teuthology.orchestra.run.trial118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: librgw2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 M 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-argparse x86_64 2:20.3.0-5271.g32585015.el9 ceph 45 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 185 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: python3-cephfs x86_64 2:20.3.0-5271.g32585015.el9 ceph 204 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: python3-rados x86_64 2:20.3.0-5271.g32585015.el9 ceph 324 k 2026-02-17T05:26:44.709 INFO:teuthology.orchestra.run.trial118.stdout: python3-rbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 306 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: python3-rgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 100 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout:Installing weak dependencies: 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-daemon x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:44.710 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout:Install 35 Packages 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout:Upgrade 2 Packages 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 68 M 2026-02-17T05:26:44.711 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:26:45.281 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 13 M 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout:Upgrading: 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout: librados2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 3.5 M 2026-02-17T05:26:45.283 INFO:teuthology.orchestra.run.trial106.stdout: librbd1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.8 M 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.2 M 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 24 M 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 909 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T05:26:45.284 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 248 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: librgw2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 M 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse x86_64 2:20.3.0-5271.g32585015.el9 ceph 45 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 185 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs x86_64 2:20.3.0-5271.g32585015.el9 ceph 204 k 2026-02-17T05:26:45.285 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados x86_64 2:20.3.0-5271.g32585015.el9 ceph 324 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 306 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 100 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-daemon x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T05:26:45.286 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:45.287 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:26:45.287 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:45.287 INFO:teuthology.orchestra.run.trial106.stdout:Install 35 Packages 2026-02-17T05:26:45.287 INFO:teuthology.orchestra.run.trial106.stdout:Upgrade 2 Packages 2026-02-17T05:26:45.287 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:45.288 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 68 M 2026-02-17T05:26:45.288 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:26:45.516 INFO:teuthology.orchestra.run.trial118.stdout:(1/37): ceph-base-20.3.0-5271.g32585015.el9.x86 18 MB/s | 5.2 MB 00:00 2026-02-17T05:26:45.553 INFO:teuthology.orchestra.run.trial118.stdout:(2/37): ceph-selinux-20.3.0-5271.g32585015.el9. 672 kB/s | 25 kB 00:00 2026-02-17T05:26:45.589 INFO:teuthology.orchestra.run.trial118.stdout:(3/37): libcephfs-daemon-20.3.0-5271.g32585015. 1.0 MB/s | 37 kB 00:00 2026-02-17T05:26:45.626 INFO:teuthology.orchestra.run.trial118.stdout:(4/37): libcephfs-proxy2-20.3.0-5271.g32585015. 669 kB/s | 25 kB 00:00 2026-02-17T05:26:45.682 INFO:teuthology.orchestra.run.trial118.stdout:(5/37): libcephfs2-20.3.0-5271.g32585015.el9.x8 16 MB/s | 909 kB 00:00 2026-02-17T05:26:45.728 INFO:teuthology.orchestra.run.trial118.stdout:(6/37): libradosstriper1-20.3.0-5271.g32585015. 5.3 MB/s | 248 kB 00:00 2026-02-17T05:26:46.067 INFO:teuthology.orchestra.run.trial118.stdout:(7/37): ceph-radosgw-20.3.0-5271.g32585015.el9. 16 MB/s | 13 MB 00:00 2026-02-17T05:26:46.082 INFO:teuthology.orchestra.run.trial118.stdout:(8/37): librgw2-20.3.0-5271.g32585015.el9.x86_6 18 MB/s | 6.5 MB 00:00 2026-02-17T05:26:46.089 INFO:teuthology.orchestra.run.trial118.stdout:(9/37): python3-ceph-argparse-20.3.0-5271.g3258 2.0 MB/s | 45 kB 00:00 2026-02-17T05:26:46.108 INFO:teuthology.orchestra.run.trial118.stdout:(10/37): python3-ceph-common-20.3.0-5271.g32585 7.1 MB/s | 185 kB 00:00 2026-02-17T05:26:46.118 INFO:teuthology.orchestra.run.trial118.stdout:(11/37): python3-cephfs-20.3.0-5271.g32585015.e 7.0 MB/s | 204 kB 00:00 2026-02-17T05:26:46.140 INFO:teuthology.orchestra.run.trial118.stdout:(12/37): python3-rados-20.3.0-5271.g32585015.el 10 MB/s | 324 kB 00:00 2026-02-17T05:26:46.150 INFO:teuthology.orchestra.run.trial118.stdout:(13/37): python3-rbd-20.3.0-5271.g32585015.el9. 9.3 MB/s | 306 kB 00:00 2026-02-17T05:26:46.169 INFO:teuthology.orchestra.run.trial118.stdout:(14/37): python3-rgw-20.3.0-5271.g32585015.el9. 3.3 MB/s | 100 kB 00:00 2026-02-17T05:26:46.175 INFO:teuthology.orchestra.run.trial118.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-17T05:26:46.196 INFO:teuthology.orchestra.run.trial118.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 4.4 MB/s | 93 kB 00:00 2026-02-17T05:26:46.213 INFO:teuthology.orchestra.run.trial118.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 6.0 MB/s | 104 kB 00:00 2026-02-17T05:26:46.221 INFO:teuthology.orchestra.run.trial118.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-17T05:26:46.228 INFO:teuthology.orchestra.run.trial118.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 24 MB/s | 160 kB 00:00 2026-02-17T05:26:46.264 INFO:teuthology.orchestra.run.trial118.stdout:(20/37): ceph-common-20.3.0-5271.g32585015.el9. 23 MB/s | 24 MB 00:01 2026-02-17T05:26:46.264 INFO:teuthology.orchestra.run.trial118.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.2 MB/s | 45 kB 00:00 2026-02-17T05:26:46.266 INFO:teuthology.orchestra.run.trial118.stdout:(22/37): nvme-cli-2.13-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2026-02-17T05:26:46.270 INFO:teuthology.orchestra.run.trial118.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 46 MB/s | 292 kB 00:00 2026-02-17T05:26:46.275 INFO:teuthology.orchestra.run.trial118.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 8.8 MB/s | 37 kB 00:00 2026-02-17T05:26:46.279 INFO:teuthology.orchestra.run.trial118.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-17T05:26:46.287 INFO:teuthology.orchestra.run.trial118.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-17T05:26:46.289 INFO:teuthology.orchestra.run.trial118.stdout:(27/37): librdkafka-1.6.1-102.el9.x86_64.rpm 26 MB/s | 662 kB 00:00 2026-02-17T05:26:46.301 INFO:teuthology.orchestra.run.trial118.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.0 MB/s | 25 kB 00:00 2026-02-17T05:26:46.305 INFO:teuthology.orchestra.run.trial118.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 12 MB/s | 308 kB 00:00 2026-02-17T05:26:46.310 INFO:teuthology.orchestra.run.trial118.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 5.7 MB/s | 49 kB 00:00 2026-02-17T05:26:46.311 INFO:teuthology.orchestra.run.trial118.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 13 MB/s | 67 kB 00:00 2026-02-17T05:26:46.320 INFO:teuthology.orchestra.run.trial118.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 20 MB/s | 191 kB 00:00 2026-02-17T05:26:46.331 INFO:teuthology.orchestra.run.trial118.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 101 MB/s | 4.4 MB 00:00 2026-02-17T05:26:46.333 INFO:teuthology.orchestra.run.trial118.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 35 MB/s | 838 kB 00:00 2026-02-17T05:26:46.358 INFO:teuthology.orchestra.run.trial118.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 42 MB/s | 1.6 MB 00:00 2026-02-17T05:26:46.457 INFO:teuthology.orchestra.run.trial118.stdout:(36/37): librbd1-20.3.0-5271.g32585015.el9.x86_ 23 MB/s | 2.8 MB 00:00 2026-02-17T05:26:46.464 INFO:teuthology.orchestra.run.trial118.stdout:(37/37): librados2-20.3.0-5271.g32585015.el9.x8 26 MB/s | 3.5 MB 00:00 2026-02-17T05:26:46.465 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:26:46.466 INFO:teuthology.orchestra.run.trial118.stdout:Total 39 MB/s | 68 MB 00:01 2026-02-17T05:26:46.561 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:26:46.579 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:26:46.579 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:26:46.599 INFO:teuthology.orchestra.run.trial106.stdout:(1/37): ceph-base-20.3.0-5271.g32585015.el9.x86 4.9 MB/s | 5.2 MB 00:01 2026-02-17T05:26:46.611 INFO:teuthology.orchestra.run.trial106.stdout:(2/37): ceph-selinux-20.3.0-5271.g32585015.el9. 2.1 MB/s | 25 kB 00:00 2026-02-17T05:26:46.623 INFO:teuthology.orchestra.run.trial106.stdout:(3/37): libcephfs-daemon-20.3.0-5271.g32585015. 3.1 MB/s | 37 kB 00:00 2026-02-17T05:26:46.634 INFO:teuthology.orchestra.run.trial106.stdout:(4/37): libcephfs-proxy2-20.3.0-5271.g32585015. 2.1 MB/s | 25 kB 00:00 2026-02-17T05:26:46.671 INFO:teuthology.orchestra.run.trial106.stdout:(5/37): libcephfs2-20.3.0-5271.g32585015.el9.x8 24 MB/s | 909 kB 00:00 2026-02-17T05:26:46.685 INFO:teuthology.orchestra.run.trial106.stdout:(6/37): libradosstriper1-20.3.0-5271.g32585015. 18 MB/s | 248 kB 00:00 2026-02-17T05:26:46.831 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:26:46.831 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:26:46.966 INFO:teuthology.orchestra.run.trial106.stdout:(7/37): librgw2-20.3.0-5271.g32585015.el9.x86_6 23 MB/s | 6.5 MB 00:00 2026-02-17T05:26:46.987 INFO:teuthology.orchestra.run.trial106.stdout:(8/37): python3-ceph-argparse-20.3.0-5271.g3258 2.1 MB/s | 45 kB 00:00 2026-02-17T05:26:47.008 INFO:teuthology.orchestra.run.trial106.stdout:(9/37): python3-ceph-common-20.3.0-5271.g325850 8.8 MB/s | 185 kB 00:00 2026-02-17T05:26:47.030 INFO:teuthology.orchestra.run.trial106.stdout:(10/37): python3-cephfs-20.3.0-5271.g32585015.e 9.2 MB/s | 204 kB 00:00 2026-02-17T05:26:47.055 INFO:teuthology.orchestra.run.trial106.stdout:(11/37): python3-rados-20.3.0-5271.g32585015.el 13 MB/s | 324 kB 00:00 2026-02-17T05:26:47.081 INFO:teuthology.orchestra.run.trial106.stdout:(12/37): python3-rbd-20.3.0-5271.g32585015.el9. 11 MB/s | 306 kB 00:00 2026-02-17T05:26:47.104 INFO:teuthology.orchestra.run.trial106.stdout:(13/37): python3-rgw-20.3.0-5271.g32585015.el9. 4.2 MB/s | 100 kB 00:00 2026-02-17T05:26:47.145 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:26:47.165 INFO:teuthology.orchestra.run.trial106.stdout:(14/37): ceph-common-20.3.0-5271.g32585015.el9. 15 MB/s | 24 MB 00:01 2026-02-17T05:26:47.273 INFO:teuthology.orchestra.run.trial106.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 196 kB/s | 33 kB 00:00 2026-02-17T05:26:47.297 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T05:26:47.299 INFO:teuthology.orchestra.run.trial106.stdout:(16/37): nvme-cli-2.13-1.el9.x86_64.rpm 8.2 MB/s | 1.1 MB 00:00 2026-02-17T05:26:47.302 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:47.304 INFO:teuthology.orchestra.run.trial106.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.9 MB/s | 93 kB 00:00 2026-02-17T05:26:47.354 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:47.355 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:47.367 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:47.369 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 4/39 2026-02-17T05:26:47.370 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:47.398 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:47.400 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 6/39 2026-02-17T05:26:47.407 INFO:teuthology.orchestra.run.trial106.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 971 kB/s | 104 kB 00:00 2026-02-17T05:26:47.407 INFO:teuthology.orchestra.run.trial118.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T05:26:47.410 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T05:26:47.411 INFO:teuthology.orchestra.run.trial106.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2026-02-17T05:26:47.413 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T05:26:47.417 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T05:26:47.428 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 11/39 2026-02-17T05:26:47.439 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T05:26:47.440 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T05:26:47.461 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T05:26:47.465 INFO:teuthology.orchestra.run.trial118.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T05:26:47.495 INFO:teuthology.orchestra.run.trial118.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T05:26:47.498 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T05:26:47.504 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T05:26:47.507 INFO:teuthology.orchestra.run.trial118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T05:26:47.511 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T05:26:47.551 INFO:teuthology.orchestra.run.trial106.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 322 kB/s | 45 kB 00:00 2026-02-17T05:26:47.573 INFO:teuthology.orchestra.run.trial106.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 966 kB/s | 160 kB 00:00 2026-02-17T05:26:47.631 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T05:26:47.632 INFO:teuthology.orchestra.run.trial118.stdout: Upgrading : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T05:26:47.660 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T05:26:47.663 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 22/39 2026-02-17T05:26:47.669 INFO:teuthology.orchestra.run.trial118.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T05:26:47.671 INFO:teuthology.orchestra.run.trial106.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2026-02-17T05:26:47.689 INFO:teuthology.orchestra.run.trial106.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 4.7 MB/s | 662 kB 00:00 2026-02-17T05:26:47.695 INFO:teuthology.orchestra.run.trial106.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.8 MB/s | 240 kB 00:00 2026-02-17T05:26:47.711 INFO:teuthology.orchestra.run.trial106.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-17T05:26:47.732 INFO:teuthology.orchestra.run.trial106.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.7 MB/s | 66 kB 00:00 2026-02-17T05:26:47.737 INFO:teuthology.orchestra.run.trial106.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 12 MB/s | 308 kB 00:00 2026-02-17T05:26:47.742 INFO:teuthology.orchestra.run.trial106.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 5.4 MB/s | 25 kB 00:00 2026-02-17T05:26:47.747 INFO:teuthology.orchestra.run.trial106.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 9.8 MB/s | 49 kB 00:00 2026-02-17T05:26:47.752 INFO:teuthology.orchestra.run.trial106.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 13 MB/s | 67 kB 00:00 2026-02-17T05:26:47.763 INFO:teuthology.orchestra.run.trial106.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 72 MB/s | 838 kB 00:00 2026-02-17T05:26:47.775 INFO:teuthology.orchestra.run.trial106.stdout:(32/37): libarrow-9.0.0-15.el9.x86_64.rpm 103 MB/s | 4.4 MB 00:00 2026-02-17T05:26:47.776 INFO:teuthology.orchestra.run.trial106.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 15 MB/s | 191 kB 00:00 2026-02-17T05:26:47.786 INFO:teuthology.orchestra.run.trial106.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 156 MB/s | 1.6 MB 00:00 2026-02-17T05:26:47.878 INFO:teuthology.orchestra.run.trial106.stdout:(35/37): librbd1-20.3.0-5271.g32585015.el9.x86_ 31 MB/s | 2.8 MB 00:00 2026-02-17T05:26:47.918 INFO:teuthology.orchestra.run.trial106.stdout:(36/37): librados2-20.3.0-5271.g32585015.el9.x8 24 MB/s | 3.5 MB 00:00 2026-02-17T05:26:47.951 INFO:teuthology.orchestra.run.trial106.stdout:(37/37): ceph-radosgw-20.3.0-5271.g32585015.el9 5.5 MB/s | 13 MB 00:02 2026-02-17T05:26:47.951 INFO:teuthology.orchestra.run.trial118.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T05:26:47.952 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T05:26:47.953 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:26:47.953 INFO:teuthology.orchestra.run.trial106.stdout:Total 26 MB/s | 68 MB 00:02 2026-02-17T05:26:47.969 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T05:26:47.972 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 26/39 2026-02-17T05:26:47.977 INFO:teuthology.orchestra.run.trial118.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T05:26:47.979 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T05:26:47.980 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T05:26:47.997 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T05:26:48.048 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:26:48.067 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:26:48.067 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:26:48.110 INFO:teuthology.orchestra.run.trial118.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T05:26:48.112 INFO:teuthology.orchestra.run.trial118.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T05:26:48.321 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:26:48.321 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:26:48.395 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T05:26:48.395 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T05:26:48.395 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:48.439 INFO:teuthology.orchestra.run.trial118.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T05:26:48.441 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 33/39 2026-02-17T05:26:48.633 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:26:48.789 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T05:26:48.793 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:48.844 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:48.845 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:48.859 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:48.861 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 4/39 2026-02-17T05:26:48.862 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:48.888 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:48.891 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 6/39 2026-02-17T05:26:48.898 INFO:teuthology.orchestra.run.trial106.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T05:26:48.902 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T05:26:48.905 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T05:26:48.910 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T05:26:48.921 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 11/39 2026-02-17T05:26:48.932 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T05:26:48.933 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T05:26:48.954 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T05:26:48.958 INFO:teuthology.orchestra.run.trial106.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T05:26:48.988 INFO:teuthology.orchestra.run.trial106.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T05:26:48.993 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T05:26:48.999 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T05:26:49.002 INFO:teuthology.orchestra.run.trial106.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T05:26:49.006 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T05:26:49.130 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T05:26:49.130 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T05:26:49.157 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T05:26:49.161 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 22/39 2026-02-17T05:26:49.167 INFO:teuthology.orchestra.run.trial106.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T05:26:49.454 INFO:teuthology.orchestra.run.trial106.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T05:26:49.455 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T05:26:49.472 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T05:26:49.475 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 26/39 2026-02-17T05:26:49.481 INFO:teuthology.orchestra.run.trial106.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T05:26:49.483 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T05:26:49.484 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T05:26:49.503 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T05:26:49.525 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:49.527 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:49.615 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T05:26:49.617 INFO:teuthology.orchestra.run.trial106.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T05:26:49.787 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:49.791 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T05:26:49.831 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T05:26:49.831 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T05:26:49.831 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T05:26:49.832 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:49.834 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:49.888 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T05:26:49.888 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T05:26:49.889 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:49.934 INFO:teuthology.orchestra.run.trial106.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T05:26:49.936 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 33/39 2026-02-17T05:26:51.047 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:51.049 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:51.315 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T05:26:51.318 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T05:26:51.360 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T05:26:51.360 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T05:26:51.360 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T05:26:51.360 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:51.363 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:54.398 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:54.398 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /sys 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /proc 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /mnt 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /var/tmp 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /home 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /root 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout:skipping the directory /tmp 2026-02-17T05:26:54.399 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:54.971 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:26:54.995 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:54.997 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T05:26:55.009 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T05:26:55.009 INFO:teuthology.orchestra.run.trial118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:55.064 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:55.064 INFO:teuthology.orchestra.run.trial118.stdout:Creating group 'qat' with GID 992. 2026-02-17T05:26:55.064 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 1/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 4/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 6/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 7/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 8/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 9/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 10/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 11/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 13/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 14/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 15/39 2026-02-17T05:26:55.340 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T05:26:55.341 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T05:26:55.342 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T05:26:55.343 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T05:26:55.343 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T05:26:55.343 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados2-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:55.343 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T05:26:55.343 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 38/39 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout:Upgraded: 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.403 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.404 INFO:teuthology.orchestra.run.trial118.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T05:26:55.405 INFO:teuthology.orchestra.run.trial118.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-argparse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T05:26:55.406 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:55.407 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:26:55.443 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-test 2026-02-17T05:26:55.753 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repository Size 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:26:55.836 INFO:teuthology.orchestra.run.trial118.stdout: ceph-test x86_64 2:20.3.0-5271.g32585015.el9 ceph 78 M 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: libcephsqlite x86_64 2:20.3.0-5271.g32585015.el9 ceph 159 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Install 10 Packages 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 82 M 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 339 M 2026-02-17T05:26:55.837 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:26:55.893 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /sys 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /proc 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /mnt 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /var/tmp 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /home 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /root 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /tmp 2026-02-17T05:26:55.894 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:56.111 INFO:teuthology.orchestra.run.trial118.stdout:(1/10): libcephsqlite-20.3.0-5271.g32585015.el9 1.8 MB/s | 159 kB 00:00 2026-02-17T05:26:56.178 INFO:teuthology.orchestra.run.trial118.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 344 kB/s | 23 kB 00:00 2026-02-17T05:26:56.203 INFO:teuthology.orchestra.run.trial118.stdout:(3/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2026-02-17T05:26:56.483 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T05:26:56.506 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T05:26:56.506 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:26:56.506 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T05:26:56.507 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:26:56.507 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:26:56.507 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:56.507 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T05:26:56.519 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T05:26:56.519 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:56.575 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:56.576 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'qat' with GID 992. 2026-02-17T05:26:56.576 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:56.640 INFO:teuthology.orchestra.run.trial118.stdout:(4/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 203 kB/s | 94 kB 00:00 2026-02-17T05:26:56.699 INFO:teuthology.orchestra.run.trial118.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 471 kB/s | 233 kB 00:00 2026-02-17T05:26:56.862 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 1/39 2026-02-17T05:26:56.862 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T05:26:56.862 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T05:26:56.862 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 4/39 2026-02-17T05:26:56.862 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 6/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 7/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 8/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 9/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 10/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 11/39 2026-02-17T05:26:56.863 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 13/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 14/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 15/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T05:26:56.864 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T05:26:56.865 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T05:26:56.866 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T05:26:56.867 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T05:26:56.867 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 38/39 2026-02-17T05:26:56.868 INFO:teuthology.orchestra.run.trial118.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-17T05:26:56.920 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout:Upgraded: 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.921 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T05:26:56.922 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.923 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:56.924 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:26:56.953 INFO:teuthology.orchestra.run.trial118.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 754 kB/s | 64 kB 00:00 2026-02-17T05:26:56.963 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-test 2026-02-17T05:26:56.984 INFO:teuthology.orchestra.run.trial118.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.9 MB/s | 122 kB 00:00 2026-02-17T05:26:57.280 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:26:57.293 INFO:teuthology.orchestra.run.trial118.stdout:(9/10): protobuf-3.14.0-17.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-02-17T05:26:57.363 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test x86_64 2:20.3.0-5271.g32585015.el9 ceph 78 M 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T05:26:57.364 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite x86_64 2:20.3.0-5271.g32585015.el9 ceph 159 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout:Install 10 Packages 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:26:57.365 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 82 M 2026-02-17T05:26:57.366 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 339 M 2026-02-17T05:26:57.366 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:26:57.564 INFO:teuthology.orchestra.run.trial118.stdout:(10/10): ceph-test-20.3.0-5271.g32585015.el9.x8 51 MB/s | 78 MB 00:01 2026-02-17T05:26:57.566 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:26:57.566 INFO:teuthology.orchestra.run.trial118.stdout:Total 48 MB/s | 82 MB 00:01 2026-02-17T05:26:57.631 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:26:57.642 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:26:57.642 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:26:57.924 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:26:57.924 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:26:57.961 INFO:teuthology.orchestra.run.trial106.stdout:(1/10): libcephsqlite-20.3.0-5271.g32585015.el9 1.8 MB/s | 159 kB 00:00 2026-02-17T05:26:58.232 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:26:58.241 INFO:teuthology.orchestra.run.trial118.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-17T05:26:58.249 INFO:teuthology.orchestra.run.trial118.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-17T05:26:58.254 INFO:teuthology.orchestra.run.trial118.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-17T05:26:58.258 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-17T05:26:58.264 INFO:teuthology.orchestra.run.trial118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-17T05:26:58.266 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-17T05:26:58.275 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-17T05:26:58.283 INFO:teuthology.orchestra.run.trial118.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-17T05:26:58.284 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T05:26:58.450 INFO:teuthology.orchestra.run.trial106.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 47 kB/s | 23 kB 00:00 2026-02-17T05:26:58.657 INFO:teuthology.orchestra.run.trial106.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 455 kB/s | 94 kB 00:00 2026-02-17T05:26:58.706 INFO:teuthology.orchestra.run.trial106.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 4.7 MB/s | 233 kB 00:00 2026-02-17T05:26:58.738 INFO:teuthology.orchestra.run.trial106.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-17T05:26:58.749 INFO:teuthology.orchestra.run.trial106.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 27 MB/s | 303 kB 00:00 2026-02-17T05:26:58.758 INFO:teuthology.orchestra.run.trial106.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.9 MB/s | 64 kB 00:00 2026-02-17T05:26:58.787 INFO:teuthology.orchestra.run.trial106.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.2 MB/s | 122 kB 00:00 2026-02-17T05:26:59.422 INFO:teuthology.orchestra.run.trial106.stdout:(9/10): ceph-test-20.3.0-5271.g32585015.el9.x86 51 MB/s | 78 MB 00:01 2026-02-17T05:27:00.991 INFO:teuthology.orchestra.run.trial106.stdout:(10/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 689 kB/s | 2.1 MB 00:03 2026-02-17T05:27:00.995 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:00.995 INFO:teuthology.orchestra.run.trial106.stdout:Total 23 MB/s | 82 MB 00:03 2026-02-17T05:27:01.057 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:01.068 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:01.069 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:01.351 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:01.351 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:01.658 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:01.667 INFO:teuthology.orchestra.run.trial106.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-17T05:27:01.677 INFO:teuthology.orchestra.run.trial106.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-17T05:27:01.682 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-17T05:27:01.686 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-17T05:27:01.691 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-17T05:27:01.693 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-17T05:27:01.704 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-17T05:27:01.712 INFO:teuthology.orchestra.run.trial106.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-17T05:27:01.713 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T05:27:01.792 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T05:27:01.810 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 1/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-17T05:27:02.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-17T05:27:02.113 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-17T05:27:02.113 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-17T05:27:02.113 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T05:27:02.166 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T05:27:02.167 INFO:teuthology.orchestra.run.trial118.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T05:27:02.167 INFO:teuthology.orchestra.run.trial118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T05:27:02.167 INFO:teuthology.orchestra.run.trial118.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T05:27:02.167 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:02.167 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:02.203 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph 2026-02-17T05:27:02.509 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:19 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:02.593 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:02.595 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repository Size 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: ceph x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 k 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout:Installing dependencies: 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 57 k 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mds x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.4 M 2026-02-17T05:27:02.596 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr x86_64 2:20.3.0-5271.g32585015.el9 ceph 936 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 297 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mon x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.0 M 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd x86_64 2:20.3.0-5271.g32585015.el9 ceph 167 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-classic x86_64 2:20.3.0-5271.g32585015.el9 ceph 16 M 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-crimson x86_64 2:20.3.0-5271.g32585015.el9 ceph 19 M 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 17 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 1.0 M 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T05:27:02.597 INFO:teuthology.orchestra.run.trial118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T05:27:02.598 INFO:teuthology.orchestra.run.trial118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T05:27:02.599 INFO:teuthology.orchestra.run.trial118.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T05:27:02.600 INFO:teuthology.orchestra.run.trial118.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T05:27:02.601 INFO:teuthology.orchestra.run.trial118.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T05:27:02.602 INFO:teuthology.orchestra.run.trial118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout:Installing weak dependencies: 2026-02-17T05:27:02.603 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 184 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 51 M 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 7.4 M 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 22 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-rook noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 50 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: ceph-volume noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 299 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout:======================================================================================= 2026-02-17T05:27:02.604 INFO:teuthology.orchestra.run.trial118.stdout:Install 96 Packages 2026-02-17T05:27:02.605 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:02.605 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 158 M 2026-02-17T05:27:02.606 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 732 M 2026-02-17T05:27:02.606 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:03.310 INFO:teuthology.orchestra.run.trial118.stdout:(1/96): ceph-20.3.0-5271.g32585015.el9.x86_64.r 102 kB/s | 6.5 kB 00:00 2026-02-17T05:27:03.397 INFO:teuthology.orchestra.run.trial118.stdout:(2/96): ceph-mgr-20.3.0-5271.g32585015.el9.x86_ 6.1 MB/s | 936 kB 00:00 2026-02-17T05:27:03.424 INFO:teuthology.orchestra.run.trial118.stdout:(3/96): ceph-mds-20.3.0-5271.g32585015.el9.x86_ 13 MB/s | 2.4 MB 00:00 2026-02-17T05:27:03.427 INFO:teuthology.orchestra.run.trial118.stdout:(4/96): ceph-osd-20.3.0-5271.g32585015.el9.x86_ 5.4 MB/s | 167 kB 00:00 2026-02-17T05:27:03.601 INFO:teuthology.orchestra.run.trial118.stdout:(5/96): ceph-mon-20.3.0-5271.g32585015.el9.x86_ 17 MB/s | 5.0 MB 00:00 2026-02-17T05:27:03.642 INFO:teuthology.orchestra.run.trial118.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5271.g32 1.4 MB/s | 57 kB 00:00 2026-02-17T05:27:03.689 INFO:teuthology.orchestra.run.trial118.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5271.g32585015. 3.8 MB/s | 184 kB 00:00 2026-02-17T05:27:04.068 INFO:teuthology.orchestra.run.trial118.stdout:(8/96): ceph-osd-classic-20.3.0-5271.g32585015. 24 MB/s | 16 MB 00:00 2026-02-17T05:27:04.398 INFO:teuthology.orchestra.run.trial118.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-52 22 MB/s | 7.4 MB 00:00 2026-02-17T05:27:04.429 INFO:teuthology.orchestra.run.trial118.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5271.g325850 733 kB/s | 22 kB 00:00 2026-02-17T05:27:04.481 INFO:teuthology.orchestra.run.trial118.stdout:(11/96): ceph-osd-crimson-20.3.0-5271.g32585015 18 MB/s | 19 MB 00:01 2026-02-17T05:27:04.482 INFO:teuthology.orchestra.run.trial118.stdout:(12/96): ceph-mgr-modules-core-20.3.0-5271.g325 5.4 MB/s | 297 kB 00:00 2026-02-17T05:27:04.493 INFO:teuthology.orchestra.run.trial118.stdout:(13/96): ceph-mgr-rook-20.3.0-5271.g32585015.el 4.2 MB/s | 50 kB 00:00 2026-02-17T05:27:04.500 INFO:teuthology.orchestra.run.trial118.stdout:(14/96): ceph-prometheus-alerts-20.3.0-5271.g32 968 kB/s | 17 kB 00:00 2026-02-17T05:27:04.516 INFO:teuthology.orchestra.run.trial118.stdout:(15/96): ceph-volume-20.3.0-5271.g32585015.el9. 13 MB/s | 299 kB 00:00 2026-02-17T05:27:04.540 INFO:teuthology.orchestra.run.trial118.stdout:(16/96): cephadm-20.3.0-5271.g32585015.el9.noar 25 MB/s | 1.0 MB 00:00 2026-02-17T05:27:05.153 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T05:27:05.173 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T05:27:05.179 INFO:teuthology.orchestra.run.trial118.stdout:(17/96): ceph-mgr-dashboard-20.3.0-5271.g325850 34 MB/s | 51 MB 00:01 2026-02-17T05:27:05.218 INFO:teuthology.orchestra.run.trial118.stdout:(18/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 60 kB/s | 40 kB 00:00 2026-02-17T05:27:05.424 INFO:teuthology.orchestra.run.trial118.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 293 kB/s | 72 kB 00:00 2026-02-17T05:27:05.480 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T05:27:05.480 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 1/10 2026-02-17T05:27:05.480 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2/10 2026-02-17T05:27:05.480 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-17T05:27:05.481 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-17T05:27:05.532 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-17T05:27:05.532 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:05.533 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:05.569 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph 2026-02-17T05:27:05.678 INFO:teuthology.orchestra.run.trial118.stdout:(20/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 301 kB/s | 350 kB 00:01 2026-02-17T05:27:05.752 INFO:teuthology.orchestra.run.trial118.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 563 kB/s | 184 kB 00:00 2026-02-17T05:27:05.874 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:05.960 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:05.962 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-17T05:27:05.962 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 k 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 57 k 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.4 M 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr x86_64 2:20.3.0-5271.g32585015.el9 ceph 936 k 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 297 k 2026-02-17T05:27:05.963 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.0 M 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd x86_64 2:20.3.0-5271.g32585015.el9 ceph 167 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-classic x86_64 2:20.3.0-5271.g32585015.el9 ceph 16 M 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson x86_64 2:20.3.0-5271.g32585015.el9 ceph 19 M 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 17 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 1.0 M 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T05:27:05.964 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T05:27:05.965 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T05:27:05.966 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T05:27:05.967 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T05:27:05.968 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T05:27:05.969 INFO:teuthology.orchestra.run.trial106.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 184 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 51 M 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 7.4 M 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 22 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 50 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 299 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T05:27:05.970 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:05.971 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:05.971 INFO:teuthology.orchestra.run.trial106.stdout:======================================================================================= 2026-02-17T05:27:05.971 INFO:teuthology.orchestra.run.trial106.stdout:Install 96 Packages 2026-02-17T05:27:05.971 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:05.972 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 158 M 2026-02-17T05:27:05.972 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 732 M 2026-02-17T05:27:05.972 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:06.092 INFO:teuthology.orchestra.run.trial118.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 612 kB/s | 253 kB 00:00 2026-02-17T05:27:06.329 INFO:teuthology.orchestra.run.trial106.stdout:(1/96): ceph-20.3.0-5271.g32585015.el9.x86_64.r 130 kB/s | 6.5 kB 00:00 2026-02-17T05:27:06.340 INFO:teuthology.orchestra.run.trial118.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 428 kB/s | 106 kB 00:00 2026-02-17T05:27:06.414 INFO:teuthology.orchestra.run.trial106.stdout:(2/96): ceph-mgr-20.3.0-5271.g32585015.el9.x86_ 6.8 MB/s | 936 kB 00:00 2026-02-17T05:27:06.443 INFO:teuthology.orchestra.run.trial106.stdout:(3/96): ceph-mds-20.3.0-5271.g32585015.el9.x86_ 14 MB/s | 2.4 MB 00:00 2026-02-17T05:27:06.446 INFO:teuthology.orchestra.run.trial106.stdout:(4/96): ceph-osd-20.3.0-5271.g32585015.el9.x86_ 5.2 MB/s | 167 kB 00:00 2026-02-17T05:27:06.588 INFO:teuthology.orchestra.run.trial118.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 546 kB/s | 135 kB 00:00 2026-02-17T05:27:06.615 INFO:teuthology.orchestra.run.trial106.stdout:(5/96): ceph-mon-20.3.0-5271.g32585015.el9.x86_ 17 MB/s | 5.0 MB 00:00 2026-02-17T05:27:06.657 INFO:teuthology.orchestra.run.trial106.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5271.g32 1.3 MB/s | 57 kB 00:00 2026-02-17T05:27:06.704 INFO:teuthology.orchestra.run.trial106.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5271.g32585015. 3.9 MB/s | 184 kB 00:00 2026-02-17T05:27:06.918 INFO:teuthology.orchestra.run.trial118.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 456 kB/s | 150 kB 00:00 2026-02-17T05:27:07.085 INFO:teuthology.orchestra.run.trial106.stdout:(8/96): ceph-osd-classic-20.3.0-5271.g32585015. 24 MB/s | 16 MB 00:00 2026-02-17T05:27:07.166 INFO:teuthology.orchestra.run.trial118.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 510 kB/s | 126 kB 00:00 2026-02-17T05:27:07.387 INFO:teuthology.orchestra.run.trial118.stdout:(27/96): python3-cryptography-36.0.1-5.el9.x86_ 780 kB/s | 1.2 MB 00:01 2026-02-17T05:27:07.413 INFO:teuthology.orchestra.run.trial106.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-52 23 MB/s | 7.4 MB 00:00 2026-02-17T05:27:07.443 INFO:teuthology.orchestra.run.trial106.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5271.g325850 768 kB/s | 22 kB 00:00 2026-02-17T05:27:07.469 INFO:teuthology.orchestra.run.trial106.stdout:(11/96): ceph-osd-crimson-20.3.0-5271.g32585015 19 MB/s | 19 MB 00:01 2026-02-17T05:27:07.470 INFO:teuthology.orchestra.run.trial106.stdout:(12/96): ceph-mgr-modules-core-20.3.0-5271.g325 11 MB/s | 297 kB 00:00 2026-02-17T05:27:07.481 INFO:teuthology.orchestra.run.trial106.stdout:(13/96): ceph-mgr-rook-20.3.0-5271.g32585015.el 4.1 MB/s | 50 kB 00:00 2026-02-17T05:27:07.487 INFO:teuthology.orchestra.run.trial106.stdout:(14/96): ceph-prometheus-alerts-20.3.0-5271.g32 1.0 MB/s | 17 kB 00:00 2026-02-17T05:27:07.505 INFO:teuthology.orchestra.run.trial106.stdout:(15/96): ceph-volume-20.3.0-5271.g32585015.el9. 12 MB/s | 299 kB 00:00 2026-02-17T05:27:07.527 INFO:teuthology.orchestra.run.trial106.stdout:(16/96): cephadm-20.3.0-5271.g32585015.el9.noar 26 MB/s | 1.0 MB 00:00 2026-02-17T05:27:07.579 INFO:teuthology.orchestra.run.trial118.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 528 kB/s | 218 kB 00:00 2026-02-17T05:27:07.591 INFO:teuthology.orchestra.run.trial118.stdout:(29/96): libgfortran-11.5.0-14.el9.x86_64.rpm 335 kB/s | 794 kB 00:02 2026-02-17T05:27:07.681 INFO:teuthology.orchestra.run.trial118.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 329 kB/s | 30 kB 00:00 2026-02-17T05:27:07.715 INFO:teuthology.orchestra.run.trial118.stdout:(31/96): unzip-6.0-59.el9.x86_64.rpm 556 kB/s | 182 kB 00:00 2026-02-17T05:27:07.788 INFO:teuthology.orchestra.run.trial118.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 203 kB/s | 15 kB 00:00 2026-02-17T05:27:07.804 INFO:teuthology.orchestra.run.trial106.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 146 kB/s | 40 kB 00:00 2026-02-17T05:27:07.871 INFO:teuthology.orchestra.run.trial118.stdout:(33/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-17T05:27:07.898 INFO:teuthology.orchestra.run.trial118.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.2 MB/s | 246 kB 00:00 2026-02-17T05:27:07.898 INFO:teuthology.orchestra.run.trial118.stdout:(35/96): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-17T05:27:07.924 INFO:teuthology.orchestra.run.trial118.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-17T05:27:07.994 INFO:teuthology.orchestra.run.trial106.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 379 kB/s | 72 kB 00:00 2026-02-17T05:27:07.995 INFO:teuthology.orchestra.run.trial118.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 83 MB/s | 6.0 MB 00:00 2026-02-17T05:27:07.996 INFO:teuthology.orchestra.run.trial118.stdout:(38/96): zip-3.0-35.el9.x86_64.rpm 636 kB/s | 266 kB 00:00 2026-02-17T05:27:08.024 INFO:teuthology.orchestra.run.trial118.stdout:(39/96): python3-devel-3.9.25-2.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-17T05:27:08.049 INFO:teuthology.orchestra.run.trial106.stdout:(19/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 644 kB/s | 350 kB 00:00 2026-02-17T05:27:08.050 INFO:teuthology.orchestra.run.trial118.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.8 MB/s | 48 kB 00:00 2026-02-17T05:27:08.075 INFO:teuthology.orchestra.run.trial118.stdout:(41/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 30 MB/s | 5.3 MB 00:00 2026-02-17T05:27:08.077 INFO:teuthology.orchestra.run.trial118.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.4 MB/s | 177 kB 00:00 2026-02-17T05:27:08.103 INFO:teuthology.orchestra.run.trial118.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-17T05:27:08.109 INFO:teuthology.orchestra.run.trial118.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-17T05:27:08.138 INFO:teuthology.orchestra.run.trial118.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-17T05:27:08.153 INFO:teuthology.orchestra.run.trial118.stdout:(46/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.6 MB/s | 249 kB 00:00 2026-02-17T05:27:08.169 INFO:teuthology.orchestra.run.trial118.stdout:(47/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 93 MB/s | 6.1 MB 00:00 2026-02-17T05:27:08.170 INFO:teuthology.orchestra.run.trial118.stdout:(48/96): python3-packaging-20.9-5.el9.noarch.rp 2.4 MB/s | 77 kB 00:00 2026-02-17T05:27:08.195 INFO:teuthology.orchestra.run.trial106.stdout:(20/96): ceph-mgr-dashboard-20.3.0-5271.g325850 34 MB/s | 51 MB 00:01 2026-02-17T05:27:08.196 INFO:teuthology.orchestra.run.trial118.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 10 MB/s | 279 kB 00:00 2026-02-17T05:27:08.196 INFO:teuthology.orchestra.run.trial106.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 184 kB 00:00 2026-02-17T05:27:08.197 INFO:teuthology.orchestra.run.trial118.stdout:(50/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.6 MB/s | 159 kB 00:00 2026-02-17T05:27:08.203 INFO:teuthology.orchestra.run.trial118.stdout:(51/96): python3-protobuf-3.14.0-17.el9.noarch. 5.2 MB/s | 267 kB 00:00 2026-02-17T05:27:08.223 INFO:teuthology.orchestra.run.trial118.stdout:(52/96): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-17T05:27:08.228 INFO:teuthology.orchestra.run.trial118.stdout:(53/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-17T05:27:08.249 INFO:teuthology.orchestra.run.trial118.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-17T05:27:08.256 INFO:teuthology.orchestra.run.trial118.stdout:(55/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.3 MB/s | 90 kB 00:00 2026-02-17T05:27:08.274 INFO:teuthology.orchestra.run.trial118.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 887 kB/s | 22 kB 00:00 2026-02-17T05:27:08.312 INFO:teuthology.orchestra.run.trial118.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 14 MB/s | 551 kB 00:00 2026-02-17T05:27:08.313 INFO:teuthology.orchestra.run.trial118.stdout:(58/96): protobuf-compiler-3.14.0-17.el9.x86_64 15 MB/s | 862 kB 00:00 2026-02-17T05:27:08.315 INFO:teuthology.orchestra.run.trial118.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 5.8 MB/s | 19 kB 00:00 2026-02-17T05:27:08.317 INFO:teuthology.orchestra.run.trial118.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 42 MB/s | 151 kB 00:00 2026-02-17T05:27:08.321 INFO:teuthology.orchestra.run.trial118.stdout:(61/96): python3-asyncssh-2.13.2-5.el9.noarch.r 96 MB/s | 548 kB 00:00 2026-02-17T05:27:08.322 INFO:teuthology.orchestra.run.trial118.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 5.3 MB/s | 29 kB 00:00 2026-02-17T05:27:08.327 INFO:teuthology.orchestra.run.trial118.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 9.3 MB/s | 60 kB 00:00 2026-02-17T05:27:08.328 INFO:teuthology.orchestra.run.trial118.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 8.3 MB/s | 43 kB 00:00 2026-02-17T05:27:08.331 INFO:teuthology.orchestra.run.trial118.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 9.1 MB/s | 32 kB 00:00 2026-02-17T05:27:08.331 INFO:teuthology.orchestra.run.trial118.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 3.7 MB/s | 14 kB 00:00 2026-02-17T05:27:08.336 INFO:teuthology.orchestra.run.trial118.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 43 MB/s | 173 kB 00:00 2026-02-17T05:27:08.337 INFO:teuthology.orchestra.run.trial118.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 71 MB/s | 358 kB 00:00 2026-02-17T05:27:08.340 INFO:teuthology.orchestra.run.trial118.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 62 MB/s | 254 kB 00:00 2026-02-17T05:27:08.346 INFO:teuthology.orchestra.run.trial118.stdout:(70/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 214 MB/s | 2.0 MB 00:00 2026-02-17T05:27:08.347 INFO:teuthology.orchestra.run.trial118.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 24 MB/s | 144 kB 00:00 2026-02-17T05:27:08.361 INFO:teuthology.orchestra.run.trial106.stdout:(22/96): libgfortran-11.5.0-14.el9.x86_64.rpm 2.1 MB/s | 794 kB 00:00 2026-02-17T05:27:08.373 INFO:teuthology.orchestra.run.trial118.stdout:(72/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 109 MB/s | 19 MB 00:00 2026-02-17T05:27:08.374 INFO:teuthology.orchestra.run.trial118.stdout:(73/96): python3-influxdb-5.3.1-1.el9.noarch.rp 4.9 MB/s | 139 kB 00:00 2026-02-17T05:27:08.374 INFO:teuthology.orchestra.run.trial118.stdout:(74/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.0 MB/s | 56 kB 00:00 2026-02-17T05:27:08.381 INFO:teuthology.orchestra.run.trial118.stdout:(75/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.5 MB/s | 11 kB 00:00 2026-02-17T05:27:08.381 INFO:teuthology.orchestra.run.trial118.stdout:(76/96): python3-jaraco-classes-3.2.1-5.el9.noa 2.6 MB/s | 18 kB 00:00 2026-02-17T05:27:08.381 INFO:teuthology.orchestra.run.trial118.stdout:(77/96): python3-jaraco-collections-3.0.0-8.el9 3.2 MB/s | 23 kB 00:00 2026-02-17T05:27:08.384 INFO:teuthology.orchestra.run.trial118.stdout:(78/96): python3-jaraco-context-6.0.1-3.el9.noa 5.9 MB/s | 20 kB 00:00 2026-02-17T05:27:08.385 INFO:teuthology.orchestra.run.trial118.stdout:(79/96): python3-jaraco-functools-3.5.0-2.el9.n 5.2 MB/s | 19 kB 00:00 2026-02-17T05:27:08.385 INFO:teuthology.orchestra.run.trial118.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 7.3 MB/s | 26 kB 00:00 2026-02-17T05:27:08.391 INFO:teuthology.orchestra.run.trial118.stdout:(81/96): python3-kubernetes-26.1.0-3.el9.noarch 173 MB/s | 1.0 MB 00:00 2026-02-17T05:27:08.391 INFO:teuthology.orchestra.run.trial118.stdout:(82/96): python3-more-itertools-8.12.0-2.el9.no 14 MB/s | 79 kB 00:00 2026-02-17T05:27:08.392 INFO:teuthology.orchestra.run.trial118.stdout:(83/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 14 MB/s | 86 kB 00:00 2026-02-17T05:27:08.395 INFO:teuthology.orchestra.run.trial118.stdout:(84/96): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-17T05:27:08.395 INFO:teuthology.orchestra.run.trial118.stdout:(85/96): python3-portend-3.1.0-2.el9.noarch.rpm 4.0 MB/s | 16 kB 00:00 2026-02-17T05:27:08.396 INFO:teuthology.orchestra.run.trial118.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 23 MB/s | 90 kB 00:00 2026-02-17T05:27:08.398 INFO:teuthology.orchestra.run.trial118.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 9.1 MB/s | 31 kB 00:00 2026-02-17T05:27:08.399 INFO:teuthology.orchestra.run.trial118.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 48 MB/s | 188 kB 00:00 2026-02-17T05:27:08.400 INFO:teuthology.orchestra.run.trial118.stdout:(89/96): python3-rsa-4.9-2.el9.noarch.rpm 14 MB/s | 59 kB 00:00 2026-02-17T05:27:08.402 INFO:teuthology.orchestra.run.trial118.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 34 MB/s | 125 kB 00:00 2026-02-17T05:27:08.403 INFO:teuthology.orchestra.run.trial118.stdout:(91/96): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-17T05:27:08.404 INFO:teuthology.orchestra.run.trial118.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 22 MB/s | 86 kB 00:00 2026-02-17T05:27:08.405 INFO:teuthology.orchestra.run.trial118.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 25 MB/s | 90 kB 00:00 2026-02-17T05:27:08.406 INFO:teuthology.orchestra.run.trial118.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 14 MB/s | 48 kB 00:00 2026-02-17T05:27:08.407 INFO:teuthology.orchestra.run.trial118.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 6.8 MB/s | 22 kB 00:00 2026-02-17T05:27:08.409 INFO:teuthology.orchestra.run.trial118.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 5.1 MB/s | 20 kB 00:00 2026-02-17T05:27:08.413 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:08.413 INFO:teuthology.orchestra.run.trial118.stdout:Total 27 MB/s | 158 MB 00:05 2026-02-17T05:27:08.442 INFO:teuthology.orchestra.run.trial106.stdout:(23/96): python3-cryptography-36.0.1-5.el9.x86_ 5.1 MB/s | 1.2 MB 00:00 2026-02-17T05:27:08.446 INFO:teuthology.orchestra.run.trial106.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-17T05:27:08.524 INFO:teuthology.orchestra.run.trial106.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 1.6 MB/s | 135 kB 00:00 2026-02-17T05:27:08.533 INFO:teuthology.orchestra.run.trial106.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-17T05:27:08.607 INFO:teuthology.orchestra.run.trial106.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-17T05:27:08.625 INFO:teuthology.orchestra.run.trial106.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-17T05:27:08.691 INFO:teuthology.orchestra.run.trial106.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-17T05:27:08.695 INFO:teuthology.orchestra.run.trial106.stdout:(30/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 507 kB/s | 253 kB 00:00 2026-02-17T05:27:08.720 INFO:teuthology.orchestra.run.trial106.stdout:(31/96): zip-3.0-35.el9.x86_64.rpm 2.7 MB/s | 266 kB 00:00 2026-02-17T05:27:08.829 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:08.868 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:08.868 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:09.152 INFO:teuthology.orchestra.run.trial106.stdout:(32/96): flexiblas-3.0.4-9.el9.x86_64.rpm 64 kB/s | 30 kB 00:00 2026-02-17T05:27:09.170 INFO:teuthology.orchestra.run.trial106.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-9.el9. 33 kB/s | 15 kB 00:00 2026-02-17T05:27:09.464 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:09.465 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:09.499 INFO:teuthology.orchestra.run.trial106.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 710 kB/s | 246 kB 00:00 2026-02-17T05:27:09.514 INFO:teuthology.orchestra.run.trial106.stdout:(35/96): lua-5.4.4-4.el9.x86_64.rpm 548 kB/s | 188 kB 00:00 2026-02-17T05:27:09.602 INFO:teuthology.orchestra.run.trial106.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 411 kB/s | 42 kB 00:00 2026-02-17T05:27:10.084 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:10.086 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T05:27:10.090 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T05:27:10.111 INFO:teuthology.orchestra.run.trial118.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T05:27:10.144 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T05:27:10.151 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T05:27:10.153 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T05:27:10.157 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T05:27:10.181 INFO:teuthology.orchestra.run.trial118.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T05:27:10.193 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T05:27:10.196 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T05:27:10.202 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T05:27:10.204 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T05:27:10.215 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T05:27:10.221 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T05:27:10.246 INFO:teuthology.orchestra.run.trial118.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T05:27:10.249 INFO:teuthology.orchestra.run.trial118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T05:27:10.283 INFO:teuthology.orchestra.run.trial106.stdout:(37/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 1.9 MB/s | 3.0 MB 00:01 2026-02-17T05:27:10.299 INFO:teuthology.orchestra.run.trial118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T05:27:10.312 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T05:27:10.314 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T05:27:10.319 INFO:teuthology.orchestra.run.trial118.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T05:27:10.324 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T05:27:10.329 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T05:27:10.332 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T05:27:10.346 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T05:27:10.351 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T05:27:10.356 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T05:27:10.367 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T05:27:10.376 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T05:27:10.382 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T05:27:10.386 INFO:teuthology.orchestra.run.trial106.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 2.3 MB/s | 244 kB 00:00 2026-02-17T05:27:10.402 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T05:27:10.413 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T05:27:10.428 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T05:27:10.433 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T05:27:10.440 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T05:27:10.481 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T05:27:10.489 INFO:teuthology.orchestra.run.trial106.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.4 MB/s | 249 kB 00:00 2026-02-17T05:27:10.591 INFO:teuthology.orchestra.run.trial106.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 465 kB/s | 48 kB 00:00 2026-02-17T05:27:10.694 INFO:teuthology.orchestra.run.trial106.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-17T05:27:10.805 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T05:27:10.815 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T05:27:10.819 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T05:27:10.825 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T05:27:10.827 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T05:27:10.854 INFO:teuthology.orchestra.run.trial118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T05:27:10.880 INFO:teuthology.orchestra.run.trial106.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.6 MB/s | 1.2 MB 00:00 2026-02-17T05:27:10.897 INFO:teuthology.orchestra.run.trial118.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T05:27:10.906 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T05:27:10.912 INFO:teuthology.orchestra.run.trial118.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T05:27:10.915 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T05:27:10.921 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T05:27:10.925 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T05:27:10.931 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T05:27:10.935 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T05:27:10.963 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T05:27:10.973 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T05:27:10.979 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T05:27:10.982 INFO:teuthology.orchestra.run.trial106.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 341 kB/s | 35 kB 00:00 2026-02-17T05:27:10.985 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T05:27:11.020 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T05:27:11.244 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T05:27:11.267 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T05:27:11.271 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T05:27:11.330 INFO:teuthology.orchestra.run.trial118.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T05:27:11.332 INFO:teuthology.orchestra.run.trial118.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T05:27:11.353 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T05:27:11.501 INFO:teuthology.orchestra.run.trial106.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 12 MB/s | 6.1 MB 00:00 2026-02-17T05:27:11.606 INFO:teuthology.orchestra.run.trial106.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.1 MB/s | 442 kB 00:00 2026-02-17T05:27:11.681 INFO:teuthology.orchestra.run.trial118.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T05:27:11.708 INFO:teuthology.orchestra.run.trial106.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 756 kB/s | 77 kB 00:00 2026-02-17T05:27:11.754 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T05:27:11.811 INFO:teuthology.orchestra.run.trial106.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 2.5 MB/s | 267 kB 00:00 2026-02-17T05:27:11.913 INFO:teuthology.orchestra.run.trial106.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2026-02-17T05:27:12.016 INFO:teuthology.orchestra.run.trial106.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 2.6 MB/s | 279 kB 00:00 2026-02-17T05:27:12.118 INFO:teuthology.orchestra.run.trial106.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 526 kB/s | 54 kB 00:00 2026-02-17T05:27:12.426 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T05:27:12.444 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T05:27:12.454 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T05:27:12.460 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T05:27:12.474 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T05:27:12.490 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T05:27:12.565 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T05:27:12.574 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T05:27:12.597 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T05:27:12.614 INFO:teuthology.orchestra.run.trial106.stdout:(51/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.7 MB/s | 5.3 MB 00:03 2026-02-17T05:27:12.627 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T05:27:12.678 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T05:27:12.684 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T05:27:12.687 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T05:27:12.688 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T05:27:12.706 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:12.707 INFO:teuthology.orchestra.run.trial118.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T05:27:12.707 INFO:teuthology.orchestra.run.trial118.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T05:27:12.707 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:12.715 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:12.716 INFO:teuthology.orchestra.run.trial106.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 407 kB/s | 42 kB 00:00 2026-02-17T05:27:12.742 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:12.742 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T05:27:12.742 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:12.776 INFO:teuthology.orchestra.run.trial106.stdout:(53/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 29 MB/s | 19 MB 00:00 2026-02-17T05:27:12.777 INFO:teuthology.orchestra.run.trial118.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T05:27:12.819 INFO:teuthology.orchestra.run.trial106.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.8 MB/s | 189 kB 00:00 2026-02-17T05:27:12.878 INFO:teuthology.orchestra.run.trial106.stdout:(55/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 888 kB/s | 90 kB 00:00 2026-02-17T05:27:12.898 INFO:teuthology.orchestra.run.trial106.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 283 kB/s | 22 kB 00:00 2026-02-17T05:27:13.015 INFO:teuthology.orchestra.run.trial106.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 6.1 MB/s | 862 kB 00:00 2026-02-17T05:27:13.069 INFO:teuthology.orchestra.run.trial106.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.2 MB/s | 551 kB 00:00 2026-02-17T05:27:13.085 INFO:teuthology.orchestra.run.trial106.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 278 kB/s | 19 kB 00:00 2026-02-17T05:27:13.163 INFO:teuthology.orchestra.run.trial106.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2026-02-17T05:27:13.183 INFO:teuthology.orchestra.run.trial106.stdout:(61/96): python3-asyncssh-2.13.2-5.el9.noarch.r 5.5 MB/s | 548 kB 00:00 2026-02-17T05:27:13.183 INFO:teuthology.orchestra.run.trial106.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-17T05:27:13.202 INFO:teuthology.orchestra.run.trial106.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-17T05:27:13.203 INFO:teuthology.orchestra.run.trial106.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-17T05:27:13.222 INFO:teuthology.orchestra.run.trial106.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-17T05:27:13.223 INFO:teuthology.orchestra.run.trial106.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 719 kB/s | 14 kB 00:00 2026-02-17T05:27:13.243 INFO:teuthology.orchestra.run.trial106.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 8.1 MB/s | 173 kB 00:00 2026-02-17T05:27:13.246 INFO:teuthology.orchestra.run.trial106.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 16 MB/s | 358 kB 00:00 2026-02-17T05:27:13.304 INFO:teuthology.orchestra.run.trial106.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 4.1 MB/s | 254 kB 00:00 2026-02-17T05:27:13.327 INFO:teuthology.orchestra.run.trial106.stdout:(70/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 25 MB/s | 2.0 MB 00:00 2026-02-17T05:27:13.333 INFO:teuthology.orchestra.run.trial106.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 4.9 MB/s | 144 kB 00:00 2026-02-17T05:27:13.348 INFO:teuthology.orchestra.run.trial106.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 6.6 MB/s | 139 kB 00:00 2026-02-17T05:27:13.353 INFO:teuthology.orchestra.run.trial106.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.7 MB/s | 56 kB 00:00 2026-02-17T05:27:13.370 INFO:teuthology.orchestra.run.trial106.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 494 kB/s | 11 kB 00:00 2026-02-17T05:27:13.373 INFO:teuthology.orchestra.run.trial106.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 887 kB/s | 18 kB 00:00 2026-02-17T05:27:13.397 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T05:27:13.437 INFO:teuthology.orchestra.run.trial106.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 347 kB/s | 23 kB 00:00 2026-02-17T05:27:13.437 INFO:teuthology.orchestra.run.trial106.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 310 kB/s | 20 kB 00:00 2026-02-17T05:27:13.518 INFO:teuthology.orchestra.run.trial106.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 238 kB/s | 19 kB 00:00 2026-02-17T05:27:13.519 INFO:teuthology.orchestra.run.trial106.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 323 kB/s | 26 kB 00:00 2026-02-17T05:27:13.566 INFO:teuthology.orchestra.run.trial106.stdout:(80/96): python3-kubernetes-26.1.0-3.el9.noarch 21 MB/s | 1.0 MB 00:00 2026-02-17T05:27:13.566 INFO:teuthology.orchestra.run.trial106.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 1.6 MB/s | 79 kB 00:00 2026-02-17T05:27:13.588 INFO:teuthology.orchestra.run.trial106.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2026-02-17T05:27:13.588 INFO:teuthology.orchestra.run.trial106.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.6 MB/s | 58 kB 00:00 2026-02-17T05:27:13.608 INFO:teuthology.orchestra.run.trial106.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 825 kB/s | 16 kB 00:00 2026-02-17T05:27:13.609 INFO:teuthology.orchestra.run.trial106.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.3 MB/s | 90 kB 00:00 2026-02-17T05:27:13.628 INFO:teuthology.orchestra.run.trial106.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-17T05:27:13.630 INFO:teuthology.orchestra.run.trial106.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 8.9 MB/s | 188 kB 00:00 2026-02-17T05:27:13.649 INFO:teuthology.orchestra.run.trial106.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 2.8 MB/s | 59 kB 00:00 2026-02-17T05:27:13.651 INFO:teuthology.orchestra.run.trial106.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.7 MB/s | 125 kB 00:00 2026-02-17T05:27:13.760 INFO:teuthology.orchestra.run.trial106.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 322 kB/s | 36 kB 00:00 2026-02-17T05:27:13.761 INFO:teuthology.orchestra.run.trial106.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 791 kB/s | 86 kB 00:00 2026-02-17T05:27:13.814 INFO:teuthology.orchestra.run.trial106.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 1.6 MB/s | 90 kB 00:00 2026-02-17T05:27:13.815 INFO:teuthology.orchestra.run.trial106.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 906 kB/s | 48 kB 00:00 2026-02-17T05:27:13.834 INFO:teuthology.orchestra.run.trial106.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-17T05:27:13.836 INFO:teuthology.orchestra.run.trial106.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 949 kB/s | 20 kB 00:00 2026-02-17T05:27:14.159 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 80/96 2026-02-17T05:27:14.222 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 81/96 2026-02-17T05:27:14.225 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T05:27:14.239 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T05:27:14.239 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:14.239 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T05:27:14.239 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:14.251 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T05:27:14.275 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T05:27:14.275 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:14.275 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T05:27:14.275 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:27:14.275 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:27:14.276 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:14.335 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T05:27:14.337 INFO:teuthology.orchestra.run.trial118.stdout: Installing : cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T05:27:14.346 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 85/96 2026-02-17T05:27:14.370 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 86/96 2026-02-17T05:27:14.371 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T05:27:16.733 INFO:teuthology.orchestra.run.trial106.stdout:(96/96): python3-babel-2.9.1-2.el9.noarch.rpm 856 kB/s | 6.0 MB 00:07 2026-02-17T05:27:16.735 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:16.736 INFO:teuthology.orchestra.run.trial106.stdout:Total 15 MB/s | 158 MB 00:10 2026-02-17T05:27:17.145 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:17.184 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:17.184 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:17.264 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T05:27:17.271 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T05:27:17.724 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T05:27:17.726 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T05:27:17.738 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T05:27:17.739 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T05:27:17.785 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:17.786 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:17.801 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T05:27:17.843 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 91/96 2026-02-17T05:27:17.844 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T05:27:17.865 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T05:27:17.866 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:17.866 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T05:27:17.866 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:27:17.866 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:27:17.866 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:17.878 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T05:27:18.102 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T05:27:18.103 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:27:18.125 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:18.220 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T05:27:18.240 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T05:27:18.241 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:18.241 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T05:27:18.241 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:27:18.241 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:27:18.241 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:18.242 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T05:27:18.246 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T05:27:18.269 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T05:27:18.412 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:18.414 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T05:27:18.418 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T05:27:18.441 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T05:27:18.474 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T05:27:18.481 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T05:27:18.483 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T05:27:18.488 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T05:27:18.512 INFO:teuthology.orchestra.run.trial106.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T05:27:18.525 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T05:27:18.528 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T05:27:18.534 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T05:27:18.536 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T05:27:18.547 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T05:27:18.553 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T05:27:18.578 INFO:teuthology.orchestra.run.trial106.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T05:27:18.581 INFO:teuthology.orchestra.run.trial106.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T05:27:18.633 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T05:27:18.646 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T05:27:18.648 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T05:27:18.653 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T05:27:18.658 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T05:27:18.663 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T05:27:18.666 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T05:27:18.680 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T05:27:18.685 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T05:27:18.690 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T05:27:18.701 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T05:27:18.711 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T05:27:18.717 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T05:27:18.737 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T05:27:18.748 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T05:27:18.764 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T05:27:18.768 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T05:27:18.776 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T05:27:18.817 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T05:27:19.109 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-2:20.3.0-5271.g32585015.el9.x86_64 1/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 3/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 4/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 5/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 6/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 7/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 8/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 9/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 10/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 11/96 2026-02-17T05:27:19.110 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 12/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 13/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 14/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 15/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 16/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cephadm-2:20.3.0-5271.g32585015.el9.noarch 17/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T05:27:19.111 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T05:27:19.112 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T05:27:19.116 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T05:27:19.116 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T05:27:19.116 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T05:27:19.116 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T05:27:19.117 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T05:27:19.118 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T05:27:19.119 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T05:27:19.120 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T05:27:19.148 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T05:27:19.158 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T05:27:19.162 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T05:27:19.168 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T05:27:19.170 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: ceph-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.179 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:19.180 INFO:teuthology.orchestra.run.trial118.stdout: ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T05:27:19.181 INFO:teuthology.orchestra.run.trial118.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T05:27:19.182 INFO:teuthology.orchestra.run.trial118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T05:27:19.183 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T05:27:19.184 INFO:teuthology.orchestra.run.trial118.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T05:27:19.185 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T05:27:19.186 INFO:teuthology.orchestra.run.trial118.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: zip-3.0-35.el9.x86_64 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:19.187 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:19.197 INFO:teuthology.orchestra.run.trial106.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T05:27:19.241 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-base 2026-02-17T05:27:19.242 INFO:teuthology.orchestra.run.trial106.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T05:27:19.251 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T05:27:19.256 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T05:27:19.260 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T05:27:19.266 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T05:27:19.270 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T05:27:19.276 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T05:27:19.280 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T05:27:19.308 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T05:27:19.317 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T05:27:19.324 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T05:27:19.331 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T05:27:19.366 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T05:27:19.553 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:19.593 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T05:27:19.617 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T05:27:19.617 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:19.621 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T05:27:19.635 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:19.635 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:19.635 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:19.655 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install cephadm 2026-02-17T05:27:19.680 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T05:27:19.682 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T05:27:19.703 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T05:27:19.961 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:20.026 INFO:teuthology.orchestra.run.trial118.stdout:Package cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:20.035 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T05:27:20.043 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:20.044 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:20.044 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:20.064 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T05:27:20.109 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T05:27:20.369 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:20.451 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repo Size 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5271.g32585015.el9 ceph 147 k 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 147 k 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 419 k 2026-02-17T05:27:20.452 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:20.537 INFO:teuthology.orchestra.run.trial118.stdout:ceph-immutable-object-cache-20.3.0-5271.g325850 1.7 MB/s | 147 kB 00:00 2026-02-17T05:27:20.538 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:20.538 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-17T05:27:20.538 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:20.541 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:20.542 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:20.573 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:20.573 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:20.627 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:20.628 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:20.650 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:20.650 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:20.651 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T05:27:20.651 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:20.792 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T05:27:20.809 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T05:27:20.819 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T05:27:20.826 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T05:27:20.840 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T05:27:20.855 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T05:27:20.931 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:20.931 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:20.931 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:20.931 INFO:teuthology.orchestra.run.trial118.stdout: ceph-immutable-object-cache-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:20.931 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:20.932 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:20.932 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T05:27:20.941 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T05:27:20.958 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-mgr 2026-02-17T05:27:20.965 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T05:27:20.995 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T05:27:21.046 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T05:27:21.052 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T05:27:21.056 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T05:27:21.057 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T05:27:21.075 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:21.075 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T05:27:21.075 INFO:teuthology.orchestra.run.trial106.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T05:27:21.075 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:21.082 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:21.107 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T05:27:21.108 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T05:27:21.108 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:21.142 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T05:27:21.272 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:21.336 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:21.354 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:21.354 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:21.354 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:21.376 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T05:27:21.686 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:21.750 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:21.767 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:21.768 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:21.768 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:21.787 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T05:27:21.790 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T05:27:22.097 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:22.160 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:22.178 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:22.178 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:22.179 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:22.199 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-mgr-rook 2026-02-17T05:27:22.514 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:22.576 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 80/96 2026-02-17T05:27:22.577 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:22.595 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:22.596 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:22.596 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:22.617 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T05:27:22.640 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 81/96 2026-02-17T05:27:22.642 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T05:27:22.656 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T05:27:22.656 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:22.656 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T05:27:22.656 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:22.666 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T05:27:22.690 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T05:27:22.690 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:22.690 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T05:27:22.691 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:27:22.691 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:27:22.691 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:22.750 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T05:27:22.752 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T05:27:22.761 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 85/96 2026-02-17T05:27:22.786 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 86/96 2026-02-17T05:27:22.787 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T05:27:22.926 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:22.990 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:23.007 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:23.008 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:23.008 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:23.028 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-osd 2026-02-17T05:27:23.332 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:23.396 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:23.414 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:23.415 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:23.415 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:23.435 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-osd-classic 2026-02-17T05:27:23.744 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:23.808 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:23.825 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:23.826 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:23.826 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:23.847 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-fuse 2026-02-17T05:27:24.157 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repo Size 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:24.241 INFO:teuthology.orchestra.run.trial118.stdout: ceph-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 987 k 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 987 k 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 2.9 M 2026-02-17T05:27:24.242 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:24.372 INFO:teuthology.orchestra.run.trial118.stdout:ceph-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 7.4 MB/s | 987 kB 00:00 2026-02-17T05:27:24.373 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:24.373 INFO:teuthology.orchestra.run.trial118.stdout:Total 7.3 MB/s | 987 kB 00:00 2026-02-17T05:27:24.373 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:24.377 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:24.377 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:24.413 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:24.414 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:24.508 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:24.525 INFO:teuthology.orchestra.run.trial118.stdout: Installing : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:24.731 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:24.787 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:24.814 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install ceph-volume 2026-02-17T05:27:25.122 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:25.186 INFO:teuthology.orchestra.run.trial118.stdout:Package ceph-volume-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:25.204 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:25.204 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:25.205 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:25.225 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install librados-devel 2026-02-17T05:27:25.533 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repo Size 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout: librados-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 123 k 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:25.615 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 123 k 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 437 k 2026-02-17T05:27:25.616 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:25.701 INFO:teuthology.orchestra.run.trial118.stdout:librados-devel-20.3.0-5271.g32585015.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-17T05:27:25.701 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:25.701 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-17T05:27:25.701 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:25.704 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:25.704 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:25.718 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T05:27:25.725 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T05:27:25.735 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:25.735 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:25.788 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:25.805 INFO:teuthology.orchestra.run.trial118.stdout: Installing : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:25.881 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:25.939 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:25.967 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install libcephfs2 2026-02-17T05:27:26.188 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T05:27:26.189 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T05:27:26.202 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T05:27:26.203 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T05:27:26.265 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T05:27:26.290 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:26.309 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 91/96 2026-02-17T05:27:26.310 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T05:27:26.331 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T05:27:26.331 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:26.331 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T05:27:26.332 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:27:26.332 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:27:26.332 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:26.343 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T05:27:26.354 INFO:teuthology.orchestra.run.trial118.stdout:Package libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:26.371 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:26.372 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:26.372 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:26.393 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install libcephfs-devel 2026-02-17T05:27:26.577 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T05:27:26.579 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T05:27:26.601 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T05:27:26.601 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:26.601 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T05:27:26.601 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:27:26.601 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:27:26.602 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:26.701 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:26.701 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:27:26.722 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:26.723 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T05:27:26.730 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T05:27:26.753 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T05:27:26.783 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:26.783 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:26.783 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repo Size 2026-02-17T05:27:26.783 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 37 k 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 171 k 2026-02-17T05:27:26.784 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:26.847 INFO:teuthology.orchestra.run.trial118.stdout:libcephfs-devel-20.3.0-5271.g32585015.el9.x86_6 593 kB/s | 37 kB 00:00 2026-02-17T05:27:26.848 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:26.848 INFO:teuthology.orchestra.run.trial118.stdout:Total 583 kB/s | 37 kB 00:00 2026-02-17T05:27:26.849 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:26.850 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:26.850 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:26.852 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:26.853 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:26.874 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:26.890 INFO:teuthology.orchestra.run.trial118.stdout: Installing : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:26.944 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:27.001 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:27.027 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install librados2 2026-02-17T05:27:27.336 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:27.401 INFO:teuthology.orchestra.run.trial118.stdout:Package librados2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:27.419 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:27.420 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:27.420 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:27.441 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install librbd1 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-2:20.3.0-5271.g32585015.el9.x86_64 1/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 3/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 4/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 5/96 2026-02-17T05:27:27.570 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 6/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 7/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 8/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 9/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 10/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 11/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 12/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 13/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 14/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 15/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 16/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cephadm-2:20.3.0-5271.g32585015.el9.noarch 17/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T05:27:27.571 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T05:27:27.572 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T05:27:27.573 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: ceph-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.638 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T05:27:27.639 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T05:27:27.640 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: zip-3.0-35.el9.x86_64 2026-02-17T05:27:27.641 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:27.642 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:27.699 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-base 2026-02-17T05:27:27.751 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:27.817 INFO:teuthology.orchestra.run.trial118.stdout:Package librbd1-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:27.834 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:27.835 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:27.835 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:27.856 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install python3-rados 2026-02-17T05:27:28.011 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:28.077 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:28.095 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:28.096 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:28.096 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:28.117 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install cephadm 2026-02-17T05:27:28.169 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:28.233 INFO:teuthology.orchestra.run.trial118.stdout:Package python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:28.250 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:28.251 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:28.251 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:28.272 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install python3-rgw 2026-02-17T05:27:28.434 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:28.500 INFO:teuthology.orchestra.run.trial106.stdout:Package cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:28.517 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:28.518 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:28.518 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:28.539 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T05:27:28.583 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:28.647 INFO:teuthology.orchestra.run.trial118.stdout:Package python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:28.665 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:28.665 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:28.665 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:28.687 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install python3-cephfs 2026-02-17T05:27:28.852 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5271.g32585015.el9 ceph 147 k 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:28.935 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:28.936 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:28.936 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 147 k 2026-02-17T05:27:28.936 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 419 k 2026-02-17T05:27:28.936 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:28.989 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:29.020 INFO:teuthology.orchestra.run.trial106.stdout:ceph-immutable-object-cache-20.3.0-5271.g325850 1.7 MB/s | 147 kB 00:00 2026-02-17T05:27:29.020 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:29.020 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-17T05:27:29.020 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:29.024 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:29.024 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:29.053 INFO:teuthology.orchestra.run.trial118.stdout:Package python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:29.056 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:29.056 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:29.070 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:29.071 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:29.071 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:29.092 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install python3-rbd 2026-02-17T05:27:29.111 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:29.112 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:29.134 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:29.135 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:29.135 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T05:27:29.135 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:29.402 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:29.437 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T05:27:29.437 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:29.437 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:29.437 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:29.437 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:29.438 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:29.464 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr 2026-02-17T05:27:29.466 INFO:teuthology.orchestra.run.trial118.stdout:Package python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:29.483 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:29.484 INFO:teuthology.orchestra.run.trial118.stdout:Nothing to do. 2026-02-17T05:27:29.484 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:29.505 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install rbd-fuse 2026-02-17T05:27:29.781 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:29.815 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:29.846 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:29.863 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:29.864 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:29.864 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:29.886 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T05:27:29.897 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:29.898 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:29.898 INFO:teuthology.orchestra.run.trial118.stdout: Package Architecture Version Repository Size 2026-02-17T05:27:29.898 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:29.898 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:29.898 INFO:teuthology.orchestra.run.trial118.stdout: rbd-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 84 k 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 84 k 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 209 k 2026-02-17T05:27:29.899 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:29.973 INFO:teuthology.orchestra.run.trial118.stdout:rbd-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-17T05:27:29.973 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:29.973 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-17T05:27:29.973 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:29.976 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:29.977 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:30.007 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:30.008 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:30.058 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:30.075 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:30.149 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:30.204 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:30.206 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:30.206 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:30.206 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:30.207 INFO:teuthology.orchestra.run.trial118.stdout: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:30.207 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:30.207 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:30.233 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install rbd-mirror 2026-02-17T05:27:30.268 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:30.285 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:30.286 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:30.286 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:30.308 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T05:27:30.554 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:30.618 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:30.635 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:30.636 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout: Package Arch Version Repo Size 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout: rbd-mirror x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.9 M 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:30.637 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:30.638 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 2.9 M 2026-02-17T05:27:30.638 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 11 M 2026-02-17T05:27:30.638 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:30.683 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:30.701 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:30.701 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:30.701 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:30.722 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-rook 2026-02-17T05:27:30.783 INFO:teuthology.orchestra.run.trial118.stdout:rbd-mirror-20.3.0-5271.g32585015.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-17T05:27:30.783 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:30.783 INFO:teuthology.orchestra.run.trial118.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-17T05:27:30.784 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:30.788 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:30.788 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:30.827 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:30.828 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:31.004 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:31.005 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:31.027 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:31.027 INFO:teuthology.orchestra.run.trial118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:31.027 INFO:teuthology.orchestra.run.trial118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T05:27:31.027 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:27:31.028 INFO:teuthology.orchestra.run.trial118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:27:31.028 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:31.035 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:31.101 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:31.119 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:31.119 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:31.119 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:31.140 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T05:27:31.346 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:31.346 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:31.346 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:31.346 INFO:teuthology.orchestra.run.trial118.stdout: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:31.347 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:31.347 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:31.375 DEBUG:teuthology.orchestra.run.trial118:> sudo yum -y install rbd-nbd 2026-02-17T05:27:31.451 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:31.517 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:31.535 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:31.535 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:31.535 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:31.556 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd 2026-02-17T05:27:31.687 INFO:teuthology.orchestra.run.trial118.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 05:26:43 AM UTC. 2026-02-17T05:27:31.769 INFO:teuthology.orchestra.run.trial118.stdout:Dependencies resolved. 2026-02-17T05:27:31.769 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout: Package Architecture Version Repository Size 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:Installing: 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout: rbd-nbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 172 k 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:Transaction Summary 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:================================================================================ 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:Install 1 Package 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:Total download size: 172 k 2026-02-17T05:27:31.770 INFO:teuthology.orchestra.run.trial118.stdout:Installed size: 462 k 2026-02-17T05:27:31.771 INFO:teuthology.orchestra.run.trial118.stdout:Downloading Packages: 2026-02-17T05:27:31.856 INFO:teuthology.orchestra.run.trial118.stdout:rbd-nbd-20.3.0-5271.g32585015.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-17T05:27:31.856 INFO:teuthology.orchestra.run.trial118.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:31.857 INFO:teuthology.orchestra.run.trial118.stdout:Total 1.9 MB/s | 172 kB 00:00 2026-02-17T05:27:31.857 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction check 2026-02-17T05:27:31.861 INFO:teuthology.orchestra.run.trial118.stdout:Transaction check succeeded. 2026-02-17T05:27:31.861 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction test 2026-02-17T05:27:31.874 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:31.892 INFO:teuthology.orchestra.run.trial118.stdout:Transaction test succeeded. 2026-02-17T05:27:31.893 INFO:teuthology.orchestra.run.trial118.stdout:Running transaction 2026-02-17T05:27:31.941 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:31.950 INFO:teuthology.orchestra.run.trial118.stdout: Preparing : 1/1 2026-02-17T05:27:31.959 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:31.960 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:31.960 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:31.966 INFO:teuthology.orchestra.run.trial118.stdout: Installing : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:31.981 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-osd-classic 2026-02-17T05:27:32.047 INFO:teuthology.orchestra.run.trial118.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:32.105 INFO:teuthology.orchestra.run.trial118.stdout: Verifying : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:32.105 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:32.105 INFO:teuthology.orchestra.run.trial118.stdout:Installed: 2026-02-17T05:27:32.105 INFO:teuthology.orchestra.run.trial118.stdout: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:32.105 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:32.106 INFO:teuthology.orchestra.run.trial118.stdout:Complete! 2026-02-17T05:27:32.136 DEBUG:teuthology.parallel:result is None 2026-02-17T05:27:32.289 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:32.354 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:32.372 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:32.372 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:32.373 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:32.396 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-fuse 2026-02-17T05:27:32.711 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 987 k 2026-02-17T05:27:32.795 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 987 k 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 2.9 M 2026-02-17T05:27:32.796 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:32.915 INFO:teuthology.orchestra.run.trial106.stdout:ceph-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 8.1 MB/s | 987 kB 00:00 2026-02-17T05:27:32.915 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:32.915 INFO:teuthology.orchestra.run.trial106.stdout:Total 8.0 MB/s | 987 kB 00:00 2026-02-17T05:27:32.915 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:32.920 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:32.920 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:32.957 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:32.957 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:33.051 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:33.068 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:33.289 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:33.346 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:33.375 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-volume 2026-02-17T05:27:33.697 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:33.760 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-volume-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T05:27:33.778 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:33.779 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:33.779 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:33.801 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados-devel 2026-02-17T05:27:34.113 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:34.196 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 123 k 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:34.197 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:34.198 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:34.198 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 123 k 2026-02-17T05:27:34.198 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 437 k 2026-02-17T05:27:34.198 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:34.281 INFO:teuthology.orchestra.run.trial106.stdout:librados-devel-20.3.0-5271.g32585015.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-17T05:27:34.282 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:34.282 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-17T05:27:34.282 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:34.284 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:34.285 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:34.316 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:34.316 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:34.370 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:34.386 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:34.466 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:34.525 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:34.553 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs2 2026-02-17T05:27:34.874 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:34.937 INFO:teuthology.orchestra.run.trial106.stdout:Package libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:34.955 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:34.955 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:34.956 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:34.976 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs-devel 2026-02-17T05:27:35.288 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:35.370 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:35.370 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:35.370 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-17T05:27:35.370 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:35.370 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 37 k 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 171 k 2026-02-17T05:27:35.371 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:35.647 INFO:teuthology.orchestra.run.trial106.stdout:libcephfs-devel-20.3.0-5271.g32585015.el9.x86_6 135 kB/s | 37 kB 00:00 2026-02-17T05:27:35.647 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:35.647 INFO:teuthology.orchestra.run.trial106.stdout:Total 135 kB/s | 37 kB 00:00 2026-02-17T05:27:35.648 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:35.650 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:35.650 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:35.652 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:35.652 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:35.674 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:35.690 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:35.746 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:35.803 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:35.803 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:35.804 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:35.804 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:35.804 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:35.804 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:35.829 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados2 2026-02-17T05:27:36.145 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:36.210 INFO:teuthology.orchestra.run.trial106.stdout:Package librados2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:36.227 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:36.228 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:36.228 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:36.249 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librbd1 2026-02-17T05:27:36.555 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:36.620 INFO:teuthology.orchestra.run.trial106.stdout:Package librbd1-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:36.637 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:36.638 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:36.638 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:36.661 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rados 2026-02-17T05:27:36.975 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:37.040 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:37.057 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:37.058 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:37.058 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:37.080 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rgw 2026-02-17T05:27:37.394 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:37.461 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:37.479 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:37.480 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:37.480 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:37.501 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-cephfs 2026-02-17T05:27:37.809 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:37.873 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:37.890 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:37.891 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:37.891 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:37.914 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rbd 2026-02-17T05:27:38.232 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:38.297 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T05:27:38.315 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:38.315 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-17T05:27:38.315 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:38.337 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-fuse 2026-02-17T05:27:38.654 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:38.737 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:38.737 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 84 k 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:38.738 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 84 k 2026-02-17T05:27:38.739 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 209 k 2026-02-17T05:27:38.739 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:38.811 INFO:teuthology.orchestra.run.trial106.stdout:rbd-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-17T05:27:38.811 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:38.812 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-17T05:27:38.812 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:38.815 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:38.816 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:38.846 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:38.847 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:38.897 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:38.914 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:38.988 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:39.045 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:39.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:39.046 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:39.046 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:39.046 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:39.046 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:39.074 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-mirror 2026-02-17T05:27:39.388 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.9 M 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:39.473 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:39.474 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:39.474 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 2.9 M 2026-02-17T05:27:39.474 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 11 M 2026-02-17T05:27:39.474 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:39.621 INFO:teuthology.orchestra.run.trial106.stdout:rbd-mirror-20.3.0-5271.g32585015.el9.x86_64.rpm 19 MB/s | 2.9 MB 00:00 2026-02-17T05:27:39.621 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:39.621 INFO:teuthology.orchestra.run.trial106.stdout:Total 19 MB/s | 2.9 MB 00:00 2026-02-17T05:27:39.621 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:39.626 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:39.626 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:39.666 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:39.666 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:39.842 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:39.843 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:27:39.867 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.191 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:40.221 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-nbd 2026-02-17T05:27:40.539 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 05:26:44 AM UTC. 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-17T05:27:40.624 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 172 k 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 172 k 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 462 k 2026-02-17T05:27:40.625 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-17T05:27:40.711 INFO:teuthology.orchestra.run.trial106.stdout:rbd-nbd-20.3.0-5271.g32585015.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-17T05:27:40.712 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:27:40.712 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.9 MB/s | 172 kB 00:00 2026-02-17T05:27:40.712 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-17T05:27:40.716 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-17T05:27:40.716 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-17T05:27:40.747 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-17T05:27:40.747 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-17T05:27:40.804 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-17T05:27:40.820 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:40.907 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:40.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T05:27:40.966 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.966 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-17T05:27:40.967 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T05:27:40.967 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:40.967 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-17T05:27:40.997 DEBUG:teuthology.parallel:result is None 2026-02-17T05:27:40.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:27:41.172 DEBUG:teuthology.orchestra.run.trial106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T05:27:41.193 INFO:teuthology.orchestra.run.trial106.stdout:20.3.0-5271.g32585015.el9 2026-02-17T05:27:41.194 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5271.g32585015.el9 2026-02-17T05:27:41.194 INFO:teuthology.task.install:The correct ceph version 20.3.0-5271.g32585015 is installed. 2026-02-17T05:27:41.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:27:41.354 DEBUG:teuthology.orchestra.run.trial118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T05:27:41.376 INFO:teuthology.orchestra.run.trial118.stdout:20.3.0-5271.g32585015.el9 2026-02-17T05:27:41.376 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5271.g32585015.el9 2026-02-17T05:27:41.376 INFO:teuthology.task.install:The correct ceph version 20.3.0-5271.g32585015 is installed. 2026-02-17T05:27:41.379 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T05:27:41.379 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:41.379 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T05:27:41.406 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:41.406 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T05:27:41.444 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T05:27:41.444 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:41.444 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T05:27:41.470 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T05:27:41.536 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:41.536 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T05:27:41.560 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T05:27:41.626 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T05:27:41.626 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:41.627 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T05:27:41.652 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T05:27:41.716 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:41.717 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T05:27:41.743 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T05:27:41.806 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T05:27:41.806 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:41.806 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T05:27:41.831 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T05:27:41.894 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:41.895 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T05:27:41.920 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T05:27:41.982 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T05:27:42.088 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T05:27:42.088 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 777 /var/log/ceph 2026-02-17T05:27:42.090 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod 777 /var/log/ceph 2026-02-17T05:27:42.113 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T05:27:42.113 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T05:27:42.154 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T05:27:42.178 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T05:27:42.178 DEBUG:teuthology.orchestra.run.trial106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T05:27:42.215 DEBUG:teuthology.orchestra.run.trial118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T05:27:42.249 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T05:27:42.249 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': '1024K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-17T05:27:42.249 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002', 'branch': 'wip-bharath18-testing-2026-02-13-0856', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{1M} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51002', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath18-testing-2026-02-13-0856'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': '1024K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath18-testing-2026-02-13-0856', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 7109, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath18-testing-2026-02-13-0856', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'targets': {'trial106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGv21XoMGp4ZlmKoBflQnC66fTKcwflu5wwpbLaoPUJecgvYDJK4xa1WaVXF4BLKuqflZZQn8w9XBXeOaAjbPkM=', 'trial118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6MW++Vv+NeLzST5mculpQ1NZ2DABYq9iJAMtMME1o17E72/dMBf0fEmNwEV35wmYicnjfqDrzuJmxKA9rdleg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_03:53:03', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T05:27:42.250 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T05:27:42.280 DEBUG:teuthology.orchestra.run.trial118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T05:27:42.297 DEBUG:teuthology.orchestra.run.trial106:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T05:27:42.336 DEBUG:teuthology.orchestra.run.trial118:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T05:27:42.359 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:42.359 DEBUG:teuthology.orchestra.run.trial106:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T05:27:42.418 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T05:27:42.419 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_1 2026-02-17T05:27:42.474 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-17 05:27:40.012260427 +0000 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-17 05:26:49.913948018 +0000 2026-02-17T05:27:42.475 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-17 05:26:49.913948018 +0000 2026-02-17T05:27:42.476 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-17 05:26:49.913948018 +0000 2026-02-17T05:27:42.476 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T05:27:42.539 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-17T05:27:42.540 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-17T05:27:42.540 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000169364 s, 3.0 MB/s 2026-02-17T05:27:42.541 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T05:27:42.598 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_2 2026-02-17T05:27:42.654 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T05:27:42.654 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:42.654 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T05:27:42.654 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:42.654 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:42.655 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-17 05:27:40.012260427 +0000 2026-02-17T05:27:42.655 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.655 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.655 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.655 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T05:27:42.720 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-17T05:27:42.720 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-17T05:27:42.720 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000143676 s, 3.6 MB/s 2026-02-17T05:27:42.721 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T05:27:42.779 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_3 2026-02-17T05:27:42.835 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T05:27:42.835 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:42.835 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-17 05:27:40.013260389 +0000 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.836 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-17 05:26:49.912948052 +0000 2026-02-17T05:27:42.836 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T05:27:42.899 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-17T05:27:42.899 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-17T05:27:42.899 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000150259 s, 3.4 MB/s 2026-02-17T05:27:42.900 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T05:27:42.956 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_4 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-17 05:27:40.013260389 +0000 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-17 05:26:49.911948085 +0000 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-17 05:26:49.911948085 +0000 2026-02-17T05:27:43.014 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-17 05:26:49.911948085 +0000 2026-02-17T05:27:43.014 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T05:27:43.075 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-17T05:27:43.075 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-17T05:27:43.075 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000143346 s, 3.6 MB/s 2026-02-17T05:27:43.076 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T05:27:43.134 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:43.134 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:43.134 DEBUG:teuthology.orchestra.run.trial118:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T05:27:43.152 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T05:27:43.152 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_1 2026-02-17T05:27:43.207 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1322 Links: 1 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-17 05:27:31.166143838 +0000 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.208 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.208 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T05:27:43.271 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-17T05:27:43.271 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-17T05:27:43.271 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000234096 s, 2.2 MB/s 2026-02-17T05:27:43.272 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T05:27:43.329 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_2 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-17 05:27:31.166143838 +0000 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.385 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.385 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T05:27:43.447 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-17T05:27:43.447 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-17T05:27:43.447 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000224297 s, 2.3 MB/s 2026-02-17T05:27:43.448 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T05:27:43.504 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_3 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-17 05:27:31.166143838 +0000 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.560 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.560 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T05:27:43.623 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-17T05:27:43.623 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-17T05:27:43.623 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000153335 s, 3.3 MB/s 2026-02-17T05:27:43.624 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T05:27:43.682 DEBUG:teuthology.orchestra.run.trial118:> stat /dev/vg_nvme/lv_4 2026-02-17T05:27:43.738 INFO:teuthology.orchestra.run.trial118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T05:27:43.738 INFO:teuthology.orchestra.run.trial118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:27:43.738 INFO:teuthology.orchestra.run.trial118.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout:Access: 2026-02-17 05:27:31.167143821 +0000 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout:Modify: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout:Change: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.739 INFO:teuthology.orchestra.run.trial118.stdout: Birth: 2026-02-17 05:26:48.420870238 +0000 2026-02-17T05:27:43.739 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T05:27:43.801 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records in 2026-02-17T05:27:43.801 INFO:teuthology.orchestra.run.trial118.stderr:1+0 records out 2026-02-17T05:27:43.801 INFO:teuthology.orchestra.run.trial118.stderr:512 bytes copied, 0.000149588 s, 3.4 MB/s 2026-02-17T05:27:43.802 DEBUG:teuthology.orchestra.run.trial118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T05:27:43.858 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:43.858 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial118.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T05:27:43.858 INFO:tasks.ceph:Generating config... 2026-02-17T05:27:43.859 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T05:27:43.859 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T05:27:43.859 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T05:27:43.859 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T05:27:43.859 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-17T05:27:43.859 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T05:27:43.859 INFO:tasks.ceph:[global] ms type = async 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] debug ms = 20 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T05:27:43.859 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bluestore onode segment size = 1024K 2026-02-17T05:27:43.859 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T05:27:43.860 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T05:27:43.860 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T05:27:43.860 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T05:27:43.894 INFO:teuthology.orchestra.run.trial106.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T05:27:43.896 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T05:27:43.969 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T05:27:44.035 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.106:6789]'), ('mon.c', '[v1:10.20.193.106:6790]'), ('mon.b', '[v1:10.20.193.118:6789]')] 2026-02-17T05:27:44.036 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.106:6789],[v1:10.20.193.106:6790],[v1:10.20.193.118:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': '1024K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 20, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-17T05:27:44.038 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:44.038 DEBUG:teuthology.orchestra.run.trial106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T05:27:44.093 DEBUG:teuthology.orchestra.run.trial106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.106:6789]' --addv c '[v1:10.20.193.106:6790]' --addv b '[v1:10.20.193.118:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:44.166 INFO:teuthology.orchestra.run.trial106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:monmaptool: generated fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:setting min_mon_release = tentacle 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:epoch 0 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:min_mon_release 20 (tentacle) 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:election_strategy: 3 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:44.167 INFO:teuthology.orchestra.run.trial106.stdout:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:44.168 INFO:teuthology.orchestra.run.trial106.stdout:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:44.168 INFO:teuthology.orchestra.run.trial106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T05:27:44.169 DEBUG:teuthology.orchestra.run.trial106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T05:27:44.224 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f9284388-9cba-4b6a-8ae7-6bff755d8682... 2026-02-17T05:27:44.224 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T05:27:44.266 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout:[global] 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: chdir = "" 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: auth supported = cephx 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: filestore xattr use omap = true 2026-02-17T05:27:44.307 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: mon clock drift allowed = 1.000 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: osd crush chooseleaf type = 0 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: auth debug = true 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: ms die on old message = true 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: ms die on bug = true 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: mon pg warn max object skew = 0 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.308 INFO:teuthology.orchestra.run.trial118.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: osd pool default size = 2 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: mon osd allow primary affinity = true 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: mon osd allow pg remap = true 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: mon warn on legacy crush tunables = false 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: mon warn on crush straw calc version zero = false 2026-02-17T05:27:44.309 INFO:teuthology.orchestra.run.trial118.stdout: mon warn on no sortbitwise = false 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon warn on osd down out interval zero = false 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon warn on too few osds = false 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon_allow_pool_size_one = true 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: osd default data pool replay window = 5 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: mon allow pool delete = true 2026-02-17T05:27:44.310 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: mon cluster log file level = debug 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: debug asserts on shutdown = true 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: mon health detail to clog = false 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: mon host = "[v1:10.20.193.106:6789],[v1:10.20.193.106:6790],[v1:10.20.193.118:6789]" 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: mon client directed command retry = 5 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: mon election default strategy = 3 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: ms bind msgr2 = False 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: ms inject socket failures = 5000 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: ms type = async 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: fsid = f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:44.311 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout:[osd] 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd journal size = 100 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd scrub load threshold = 5.0 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd scrub max interval = 600 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd mclock profile = high_recovery_ops 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd mclock skip benchmark = True 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd recover clone overlap = true 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd recovery max chunk = 1048576 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd debug shutdown = true 2026-02-17T05:27:44.312 INFO:teuthology.orchestra.run.trial118.stdout: osd debug op order = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd debug verify stray on activate = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd debug trim objects = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd open classes on start = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd debug pg log writeout = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd deep scrub update digest min age = 30 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: osd map max advance = 10 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: journal zero on create = true 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.313 INFO:teuthology.orchestra.run.trial118.stdout: filestore ondisk finisher threads = 3 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: filestore apply finisher threads = 3 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bdev debug aio = true 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: osd debug misdirected ops = true 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bdev async discard = True 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bdev enable discard = True 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore allocator = bitmap 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore block size = 96636764160 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore fsck on mount = True 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore onode segment size = 1024K 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore write v2 random = True 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: bluestore zero block detection = True 2026-02-17T05:27:44.314 INFO:teuthology.orchestra.run.trial118.stdout: debug bluefs = 20 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: debug bluestore = 20 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: debug ms = 1 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: debug osd = 20 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: debug rocksdb = 10 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: mon osd full ratio = 0.9 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: mon osd nearfull ratio = 0.8 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd debug verify cached snaps = True 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd debug verify missing on start = True 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd failsafe full ratio = 0.95 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd mclock override recovery settings = True 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd objectstore = bluestore 2026-02-17T05:27:44.315 INFO:teuthology.orchestra.run.trial118.stdout: osd op queue = debug_random 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: osd op queue cut off = debug_random 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout:[mgr] 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: debug ms = 1 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: debug mgr = 20 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: debug mon = 20 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: debug auth = 20 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: mgr/telemetry/nag = false 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout:[mon] 2026-02-17T05:27:44.316 INFO:teuthology.orchestra.run.trial118.stdout: debug ms = 20 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: debug mon = 30 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: debug paxos = 20 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: debug auth = 20 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon data avail warn = 5 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon mgr mkfs grace = 240 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon osd reporter subtree level = osd 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon osd prime pg temp = true 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T05:27:44.317 INFO:teuthology.orchestra.run.trial118.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: # 1m isn't quite enough 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon_down_mkfs_grace = 2m 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon_warn_on_filestore_osds = false 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon min osdmap epochs = 25 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon osdmap full prune interval = 2 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon osdmap full prune min = 15 2026-02-17T05:27:44.318 INFO:teuthology.orchestra.run.trial118.stdout: mon osdmap full prune txsize = 2 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: mon scrub inject missing keys = 0.05 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: mon scrub interval = 300 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: paxos service trim min = 5 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout:[client] 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: rgw cache enabled = true 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: rgw enable ops log = true 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: rgw enable usage log = true 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T05:27:44.319 INFO:teuthology.orchestra.run.trial118.stdout: debug monc = 20 2026-02-17T05:27:44.320 INFO:teuthology.orchestra.run.trial118.stdout: debug ms = 1 2026-02-17T05:27:44.320 INFO:teuthology.orchestra.run.trial118.stdout:[mon.a] 2026-02-17T05:27:44.320 INFO:teuthology.orchestra.run.trial118.stdout:[mon.c] 2026-02-17T05:27:44.320 INFO:teuthology.orchestra.run.trial118.stdout:[mon.b] 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout:[global] 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: chdir = "" 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: auth supported = cephx 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: filestore xattr use omap = true 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: mon clock drift allowed = 1.000 2026-02-17T05:27:44.322 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: osd crush chooseleaf type = 0 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: auth debug = true 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: ms die on old message = true 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: ms die on bug = true 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: mon pg warn max object skew = 0 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T05:27:44.323 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: osd pool default size = 2 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon osd allow primary affinity = true 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon osd allow pg remap = true 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on legacy crush tunables = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on crush straw calc version zero = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on no sortbitwise = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on osd down out interval zero = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon warn on too few osds = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: mon_allow_pool_size_one = true 2026-02-17T05:27:44.324 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: osd default data pool replay window = 5 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: mon allow pool delete = true 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: mon cluster log file level = debug 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: debug asserts on shutdown = true 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: mon health detail to clog = false 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: mon host = "[v1:10.20.193.106:6789],[v1:10.20.193.106:6790],[v1:10.20.193.118:6789]" 2026-02-17T05:27:44.325 INFO:teuthology.orchestra.run.trial106.stdout: mon client directed command retry = 5 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: mon election default strategy = 3 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: ms bind msgr2 = False 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: ms inject socket failures = 5000 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: ms type = async 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: fsid = f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout:[osd] 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: osd journal size = 100 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: osd scrub load threshold = 5.0 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: osd scrub max interval = 600 2026-02-17T05:27:44.326 INFO:teuthology.orchestra.run.trial106.stdout: osd mclock profile = high_recovery_ops 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd mclock skip benchmark = True 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd recover clone overlap = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd recovery max chunk = 1048576 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd debug shutdown = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd debug op order = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd debug verify stray on activate = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd debug trim objects = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd open classes on start = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: osd debug pg log writeout = true 2026-02-17T05:27:44.327 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: osd deep scrub update digest min age = 30 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: osd map max advance = 10 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: journal zero on create = true 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: filestore ondisk finisher threads = 3 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: filestore apply finisher threads = 3 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: bdev debug aio = true 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: osd debug misdirected ops = true 2026-02-17T05:27:44.328 INFO:teuthology.orchestra.run.trial106.stdout: bdev async discard = True 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bdev enable discard = True 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore allocator = bitmap 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore block size = 96636764160 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore fsck on mount = True 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore onode segment size = 1024K 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore write v2 random = True 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: bluestore zero block detection = True 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: debug bluefs = 20 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: debug bluestore = 20 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 1 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: debug osd = 20 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: debug rocksdb = 10 2026-02-17T05:27:44.329 INFO:teuthology.orchestra.run.trial106.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: mon osd full ratio = 0.9 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: mon osd nearfull ratio = 0.8 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd debug verify cached snaps = True 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd debug verify missing on start = True 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd failsafe full ratio = 0.95 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd mclock override recovery settings = True 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd objectstore = bluestore 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd op queue = debug_random 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: osd op queue cut off = debug_random 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout:[mgr] 2026-02-17T05:27:44.330 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 1 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug mgr = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug mon = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug auth = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: mgr/telemetry/nag = false 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout:[mon] 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug mon = 30 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug paxos = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: debug auth = 20 2026-02-17T05:27:44.331 INFO:teuthology.orchestra.run.trial106.stdout: mon data avail warn = 5 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon mgr mkfs grace = 240 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon osd reporter subtree level = osd 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon osd prime pg temp = true 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T05:27:44.332 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: # 1m isn't quite enough 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon_down_mkfs_grace = 2m 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon_warn_on_filestore_osds = false 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon min osdmap epochs = 25 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune interval = 2 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune min = 15 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon osdmap full prune txsize = 2 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon scrub inject missing keys = 0.05 2026-02-17T05:27:44.333 INFO:teuthology.orchestra.run.trial106.stdout: mon scrub interval = 300 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: paxos service trim min = 5 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout:[client] 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: rgw cache enabled = true 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: rgw enable ops log = true 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: rgw enable usage log = true 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: debug monc = 20 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout: debug ms = 1 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout:[mon.a] 2026-02-17T05:27:44.334 INFO:teuthology.orchestra.run.trial106.stdout:[mon.c] 2026-02-17T05:27:44.335 INFO:teuthology.orchestra.run.trial106.stdout:[mon.b] 2026-02-17T05:27:44.335 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T05:27:44.335 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T05:27:44.403 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T05:27:44.404 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:44.404 DEBUG:teuthology.orchestra.run.trial106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T05:27:44.461 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:44.461 DEBUG:teuthology.orchestra.run.trial106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T05:27:44.517 INFO:tasks.ceph:Sending monmap to node ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:27:44.518 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:44.518 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T05:27:44.518 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T05:27:44.590 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:44.590 DEBUG:teuthology.orchestra.run.trial106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:44.646 INFO:tasks.ceph:Sending monmap to node ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:27:44.646 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:44.646 DEBUG:teuthology.orchestra.run.trial118:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T05:27:44.646 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T05:27:44.680 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:44.680 DEBUG:teuthology.orchestra.run.trial118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:44.736 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T05:27:44.737 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T05:27:44.737 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T05:27:44.818 INFO:teuthology.orchestra.run.trial118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T05:27:44.821 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T05:27:44.821 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T05:27:44.822 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T05:27:44.894 INFO:teuthology.orchestra.run.trial118.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T05:27:44.905 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T05:27:44.905 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial118.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T05:27:44.905 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T05:27:44.932 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:44.932 INFO:tasks.ceph:role: osd.0 2026-02-17T05:27:44.932 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:27:44.932 DEBUG:teuthology.orchestra.run.trial106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:44.997 INFO:teuthology.orchestra.run.trial106.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:44.998 INFO:teuthology.orchestra.run.trial106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:44.998 INFO:teuthology.orchestra.run.trial106.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:44.998 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:44.998 INFO:teuthology.orchestra.run.trial106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:45.565 INFO:teuthology.orchestra.run.trial106.stdout:Discarding blocks...Done. 2026-02-17T05:27:45.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial106.front.sepia.ceph.com -o noatime 2026-02-17T05:27:45.567 DEBUG:teuthology.orchestra.run.trial106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T05:27:45.635 DEBUG:teuthology.orchestra.run.trial106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T05:27:45.701 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T05:27:45.766 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:45.766 INFO:tasks.ceph:role: osd.1 2026-02-17T05:27:45.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:27:45.767 DEBUG:teuthology.orchestra.run.trial106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T05:27:45.833 INFO:teuthology.orchestra.run.trial106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:45.833 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:45.834 INFO:teuthology.orchestra.run.trial106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:46.390 INFO:teuthology.orchestra.run.trial106.stdout:Discarding blocks...Done. 2026-02-17T05:27:46.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial106.front.sepia.ceph.com -o noatime 2026-02-17T05:27:46.392 DEBUG:teuthology.orchestra.run.trial106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T05:27:46.461 DEBUG:teuthology.orchestra.run.trial106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T05:27:46.528 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T05:27:46.592 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:46.592 INFO:tasks.ceph:role: osd.2 2026-02-17T05:27:46.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:27:46.593 DEBUG:teuthology.orchestra.run.trial106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T05:27:46.657 INFO:teuthology.orchestra.run.trial106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:46.657 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:46.657 INFO:teuthology.orchestra.run.trial106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:46.658 INFO:teuthology.orchestra.run.trial106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:47.212 INFO:teuthology.orchestra.run.trial106.stdout:Discarding blocks...Done. 2026-02-17T05:27:47.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial106.front.sepia.ceph.com -o noatime 2026-02-17T05:27:47.215 DEBUG:teuthology.orchestra.run.trial106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T05:27:47.283 DEBUG:teuthology.orchestra.run.trial106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T05:27:47.350 DEBUG:teuthology.orchestra.run.trial106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:47.428 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:47.426+0000 7f2c5da2f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T05:27:47.429 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:47.426+0000 7f2c5da2f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T05:27:47.429 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:47.426+0000 7f2c5da2f780 -1 bdev(0x2661400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:47.429 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:47.426+0000 7f2c5da2f780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T05:27:47.914 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T05:27:47.979 DEBUG:teuthology.orchestra.run.trial106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:48.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.052+0000 7ff9aea69780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T05:27:48.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.053+0000 7ff9aea69780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T05:27:48.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.053+0000 7ff9aea69780 -1 bdev(0x372f400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:48.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.053+0000 7ff9aea69780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T05:27:48.518 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T05:27:48.583 DEBUG:teuthology.orchestra.run.trial106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:48.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.657+0000 7f7cf063f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T05:27:48.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.657+0000 7f7cf063f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T05:27:48.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.657+0000 7f7cf063f780 -1 bdev(0x3009400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:48.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:48.657+0000 7f7cf063f780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T05:27:49.140 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T05:27:49.206 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T05:27:49.231 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:49.231 INFO:tasks.ceph:role: osd.3 2026-02-17T05:27:49.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:27:49.231 DEBUG:teuthology.orchestra.run.trial118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:49.296 INFO:teuthology.orchestra.run.trial118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:49.297 INFO:teuthology.orchestra.run.trial118.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:49.297 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:49.297 INFO:teuthology.orchestra.run.trial118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:49.864 INFO:teuthology.orchestra.run.trial118.stdout:Discarding blocks...Done. 2026-02-17T05:27:49.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial118.front.sepia.ceph.com -o noatime 2026-02-17T05:27:49.866 DEBUG:teuthology.orchestra.run.trial118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T05:27:49.935 DEBUG:teuthology.orchestra.run.trial118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T05:27:50.003 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T05:27:50.066 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:50.066 INFO:tasks.ceph:role: osd.4 2026-02-17T05:27:50.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:27:50.067 DEBUG:teuthology.orchestra.run.trial118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T05:27:50.130 INFO:teuthology.orchestra.run.trial118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:50.131 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:50.132 INFO:teuthology.orchestra.run.trial118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:50.689 INFO:teuthology.orchestra.run.trial118.stdout:Discarding blocks...Done. 2026-02-17T05:27:50.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial118.front.sepia.ceph.com -o noatime 2026-02-17T05:27:50.691 DEBUG:teuthology.orchestra.run.trial118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T05:27:50.759 DEBUG:teuthology.orchestra.run.trial118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T05:27:50.825 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T05:27:50.890 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T05:27:50.890 INFO:tasks.ceph:role: osd.5 2026-02-17T05:27:50.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:27:50.890 DEBUG:teuthology.orchestra.run.trial118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T05:27:50.956 INFO:teuthology.orchestra.run.trial118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:27:50.957 INFO:teuthology.orchestra.run.trial118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:27:51.512 INFO:teuthology.orchestra.run.trial118.stdout:Discarding blocks...Done. 2026-02-17T05:27:51.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial118.front.sepia.ceph.com -o noatime 2026-02-17T05:27:51.514 DEBUG:teuthology.orchestra.run.trial118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-17T05:27:51.583 DEBUG:teuthology.orchestra.run.trial118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T05:27:51.649 DEBUG:teuthology.orchestra.run.trial118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:51.726 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:51.723+0000 7fd2d2069780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T05:27:51.726 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:51.723+0000 7fd2d2069780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T05:27:51.726 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:51.723+0000 7fd2d2069780 -1 bdev(0x243d400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:51.726 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:51.723+0000 7fd2d2069780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T05:27:52.182 DEBUG:teuthology.orchestra.run.trial118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T05:27:52.247 DEBUG:teuthology.orchestra.run.trial118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:52.324 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.321+0000 7efefe62c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T05:27:52.324 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.321+0000 7efefe62c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T05:27:52.324 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.321+0000 7efefe62c780 -1 bdev(0x3f0b400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:52.324 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.321+0000 7efefe62c780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T05:27:52.792 DEBUG:teuthology.orchestra.run.trial118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T05:27:52.857 DEBUG:teuthology.orchestra.run.trial118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:52.932 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.929+0000 7f78dba39780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T05:27:52.933 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.929+0000 7f78dba39780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T05:27:52.933 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.929+0000 7f78dba39780 -1 bdev(0x330b400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T05:27:52.933 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:52.929+0000 7f78dba39780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T05:27:53.397 DEBUG:teuthology.orchestra.run.trial118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T05:27:53.463 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T05:27:53.463 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:53.463 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T05:27:53.489 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:53.489 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T05:27:53.553 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:53.553 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T05:27:53.619 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:53.619 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T05:27:53.644 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:53.644 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T05:27:53.707 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:53.707 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T05:27:53.772 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:53.773 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T05:27:53.835 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:53.835 DEBUG:teuthology.orchestra.run.trial118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T05:27:53.891 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T05:27:53.891 DEBUG:teuthology.orchestra.run.trial106:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T05:27:53.894 DEBUG:teuthology.orchestra.run.trial118:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.0] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBT/JNpFhd+GRAAGDxyAOtAAf86LFMYtj1OKw== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.1] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBU/JNpe/o8AxAA/yxrRjYcH+HgRBV+7UjW3w== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.2] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBU/JNpzkNCJxAAIRiwRZnDskMMy9QHct2haA== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[mgr.x] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBQ/JNpGfO1MBAAhD+dU9zMR26eh0RUH3c+mw== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.3] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBX/JNpXTQzKxAALDn/GEIfdJY26+4CAvxj1g== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.4] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBY/JNp7Fo8ExAAFZRkiIPmfZu40IG5njzrWQ== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[osd.5] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBY/JNpwMV8NxAAC6oRUZ/d1plY+orCpuoFJQ== 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout:[client.0] 2026-02-17T05:27:53.933 INFO:teuthology.orchestra.run.trial106.stdout: key = AQBQ/JNpI9gyNRAAViy+Ep77E9J2HnWjsw4Aeg== 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout:[osd.0] 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBT/JNpFhd+GRAAGDxyAOtAAf86LFMYtj1OKw== 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout:[osd.1] 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBU/JNpe/o8AxAA/yxrRjYcH+HgRBV+7UjW3w== 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout:[osd.2] 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBU/JNpzkNCJxAAIRiwRZnDskMMy9QHct2haA== 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout:[mgr.x] 2026-02-17T05:27:53.952 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBQ/JNpGfO1MBAAhD+dU9zMR26eh0RUH3c+mw== 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout:[osd.3] 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBX/JNpXTQzKxAALDn/GEIfdJY26+4CAvxj1g== 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout:[osd.4] 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBY/JNp7Fo8ExAAFZRkiIPmfZu40IG5njzrWQ== 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout:[osd.5] 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBY/JNpwMV8NxAAC6oRUZ/d1plY+orCpuoFJQ== 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout:[client.0] 2026-02-17T05:27:53.953 INFO:teuthology.orchestra.run.trial118.stdout: key = AQBQ/JNpI9gyNRAAViy+Ep77E9J2HnWjsw4Aeg== 2026-02-17T05:27:53.953 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:53.977 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.032 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.055 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.110 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.133 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.190 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T05:27:54.212 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T05:27:54.267 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.290 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.343 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.369 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.420 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.450 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:27:54.499 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T05:27:54.527 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T05:27:54.578 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T05:27:54.578 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T05:27:54.630 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T05:27:54.712 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T05:27:54.776 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T05:27:54.841 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T05:27:54.924 DEBUG:teuthology.orchestra.run.trial106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T05:27:54.988 DEBUG:teuthology.orchestra.run.trial118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T05:27:55.013 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T05:27:55.098 DEBUG:teuthology.orchestra.run.trial118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T05:27:55.122 DEBUG:teuthology.orchestra.run.trial106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:55.124 DEBUG:teuthology.orchestra.run.trial118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:27:55.178 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T05:27:55.179 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:27:55.179 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:27:55.181 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:27:55.182 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T05:27:55.182 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T05:27:55.184 INFO:tasks.ceph.mon.c:Started 2026-02-17T05:27:55.184 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T05:27:55.184 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T05:27:55.220 INFO:tasks.ceph.mon.b:Started 2026-02-17T05:27:55.221 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T05:27:55.221 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T05:27:55.221 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T05:27:55.224 INFO:tasks.ceph.mgr.x:Started 2026-02-17T05:27:55.225 DEBUG:tasks.ceph:set 0 configs 2026-02-17T05:27:55.225 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph config dump 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.286+0000 7fbb7805b640 10 monclient: get_monmap_and_config 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.286+0000 7fbb7805b640 10 monclient: build_initial_monmap 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.286+0000 7fbb7805b640 10 monclient: monmap: 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:55.288066+0000 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:55.288066+0000 2026-02-17T05:27:55.288 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 1 Processor -- start 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 1 -- start start 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient: init 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:55.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-c con 0x7fbb7008dfe0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-b con 0x7fbb7008e3b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-a con 0x7fbb7008e810 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70057170 con 0x7fbb7008e810 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7005dd60 con 0x7fbb7008dfe0 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7005d130 con 0x7fbb7008e3b0 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb7805b640 10 monclient(hunting): authenticate will time out at 603.916488s 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb755cf640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbb7008e3b0 0x7fbb70183210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35300/0 (socket says 10.20.193.106:35300) 2026-02-17T05:27:55.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.287+0000 7fbb755cf640 1 -- 10.20.193.106:0/3020025876 learned_addr learned my addr 10.20.193.106:0/3020025876 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:55.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586186910 0 0) 0x7fbb70057170 con 0x7fbb7008e810 2026-02-17T05:27:55.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): my global_id is 4098 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb580035e0 con 0x7fbb7008e810 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457256214 0 0) 0x7fbb7005d130 con 0x7fbb7008e3b0 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): my global_id is 4103 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb70057170 con 0x7fbb7008e3b0 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575643693 0 0) 0x7fbb7005dd60 con 0x7fbb7008dfe0 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient(hunting): my global_id is 4102 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb7005d130 con 0x7fbb7008dfe0 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3934277130 0 0) 0x7fbb70057170 con 0x7fbb7008e3b0 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 >> v1:10.20.193.118:6789/0 conn(0x7fbb7008dfe0 legacy=0x7fbb701423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 >> v1:10.20.193.106:6789/0 conn(0x7fbb7008e810 legacy=0x7fbb701a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: _finish_hunting 0 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 monclient: found mon.noname-b 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70056ec0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: _finish_auth 0 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: _check_auth_tickets 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb7805b640 5 monclient: authenticate success, global_id 4103 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb7805b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbb64002dd0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: dump: 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.497 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb7805b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:55.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb64002fd0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb74dce640 1 -- 10.20.193.106:0/3020025876 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbb640033e0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.475+0000 7fbb7805b640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 4 set_mon_vals no callback set 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb74dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb74dce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb74dce640 10 monclient: dump: 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.500 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 10 monclient: shutdown 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 1 -- 10.20.193.106:0/3020025876 >> v1:10.20.193.106:6790/0 conn(0x7fbb7008e3b0 legacy=0x7fbb70183210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 1 -- 10.20.193.106:0/3020025876 shutdown_connections 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 1 -- 10.20.193.106:0/3020025876 >> 10.20.193.106:0/3020025876 conn(0x7fbb70054400 msgr2=0x7fbb70054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 1 -- 10.20.193.106:0/3020025876 shutdown_connections 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 1 -- 10.20.193.106:0/3020025876 wait complete. 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 10 monclient: build_initial_monmap 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.476+0000 7fbb7805b640 10 monclient: monmap: 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:55.502 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 1 Processor -- start 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 1 -- start start 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient: init 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-a con 0x7fbb7008dfe0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-c con 0x7fbb7008e3b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:55.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient(hunting): picked mon.noname-b con 0x7fbb7008e810 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7012fea0 con 0x7fbb7008dfe0 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70140b00 con 0x7fbb7008e810 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70089500 con 0x7fbb7008e3b0 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb7805b640 10 monclient(hunting): authenticate will time out at 604.106546s 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb75dd0640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fbb7008dfe0 0x7fbb701520e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50138/0 (socket says 10.20.193.106:50138) 2026-02-17T05:27:55.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.477+0000 7fbb75dd0640 1 -- 10.20.193.106:0/3780986256 learned_addr learned my addr 10.20.193.106:0/3780986256 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402653086 0 0) 0x7fbb70140b00 con 0x7fbb7008e810 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): my global_id is 4108 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb400035e0 con 0x7fbb7008e810 2026-02-17T05:27:55.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420619837 0 0) 0x7fbb70089500 con 0x7fbb7008e3b0 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): my global_id is 4109 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb70140b00 con 0x7fbb7008e3b0 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2729013754 0 0) 0x7fbb70140b00 con 0x7fbb7008e3b0 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb70089500 con 0x7fbb7008e3b0 2026-02-17T05:27:55.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbb64002ce0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): dump: 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.508 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1897078275 0 0) 0x7fbb400035e0 con 0x7fbb7008e810 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb70140b00 con 0x7fbb7008e810 2026-02-17T05:27:55.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbb6c004170 con 0x7fbb7008e810 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): dump: 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.510 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598619334 0 0) 0x7fbb7012fea0 con 0x7fbb7008dfe0 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient(hunting): my global_id is 4107 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb400035e0 con 0x7fbb7008dfe0 2026-02-17T05:27:55.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 513968357 0 0) 0x7fbb70089500 con 0x7fbb7008e3b0 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 >> v1:10.20.193.118:6789/0 conn(0x7fbb7008e810 legacy=0x7fbb70194450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 >> v1:10.20.193.106:6789/0 conn(0x7fbb7008dfe0 legacy=0x7fbb701520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 monclient: found mon.c 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb701527f0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:27:55.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 5 monclient: authenticate success, global_id 4109 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 10 monclient: _renew_subs 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb70130740 con 0x7fbb7008e3b0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 10 monclient: _renew_subs 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb7013f450 con 0x7fbb7008e3b0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb64004b50 con 0x7fbb7008e3b0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbb64004f30 con 0x7fbb7008e3b0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 10 monclient: dump: 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.513 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5ffff640 4 set_mon_vals no callback set 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fbb64005510 con 0x7fbb7008e3b0 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1532679431 0 0) 0x7fbb64006c10 con 0x7fbb7008e3b0 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.478+0000 7fbb7805b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.479+0000 7fbb7805b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.479+0000 7fbb7805b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.479+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7012e3e0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.480+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fbb64005ad0 con 0x7fbb7008e3b0 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.480+0000 7fbb5e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.480+0000 7fbb5e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb7805b640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb7805b640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb7805b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbb70130310 con 0x7fbb7008e3b0 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb5e7fc640 1 -- 10.20.193.106:0/3780986256 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7fbb64005c70 con 0x7fbb7008e3b0 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb5e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-17T05:27:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.510+0000 7fbb5e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:55.516 INFO:teuthology.orchestra.run.trial106.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-17T05:27:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 10 monclient: shutdown 2026-02-17T05:27:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 >> v1:10.20.193.106:6790/0 conn(0x7fbb7008e3b0 legacy=0x7fbb7013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 shutdown_connections 2026-02-17T05:27:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 >> 10.20.193.106:0/3780986256 conn(0x7fbb70054400 msgr2=0x7fbb70089710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 shutdown_connections 2026-02-17T05:27:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.511+0000 7fbb7805b640 1 -- 10.20.193.106:0/3780986256 wait complete. 2026-02-17T05:27:55.520 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T05:27:55.520 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T05:27:55.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 10 monclient: get_monmap_and_config 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 10 monclient: build_initial_monmap 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 10 monclient: monmap: 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:55.583883+0000 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:55.583883+0000 2026-02-17T05:27:55.594 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 1 Processor -- start 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 1 -- start start 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.582+0000 7f1631acc640 10 monclient: init 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:55.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-a con 0x7f162c1420b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-b con 0x7f162c142b90 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-c con 0x7f162c184b50 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c08b540 con 0x7f162c1420b0 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c05c940 con 0x7f162c184b50 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c08cdd0 con 0x7f162c142b90 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient(hunting): authenticate will time out at 604.212345s 2026-02-17T05:27:55.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162b7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f162c1420b0 0x7f162c142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50154/0 (socket says 10.20.193.106:50154) 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162b7fe640 1 -- 10.20.193.106:0/122759732 learned_addr learned my addr 10.20.193.106:0/122759732 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044944854 0 0) 0x7f16180028e0 con 0x7f162c1420b0 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): my global_id is 4110 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16100035e0 con 0x7f162c1420b0 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237765534 0 0) 0x7f162c08cdd0 con 0x7f162c142b90 2026-02-17T05:27:55.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient(hunting): my global_id is 4112 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16180028e0 con 0x7f162c142b90 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 315878909 0 0) 0x7f16100035e0 con 0x7f162c1420b0 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 >> v1:10.20.193.106:6790/0 conn(0x7f162c142b90 legacy=0x7f162c183430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 >> v1:10.20.193.118:6789/0 conn(0x7f162c184b50 legacy=0x7f162c1a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 monclient: found mon.noname-a 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c05ce20 con 0x7f162c1420b0 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 5 monclient: authenticate success, global_id 4110 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1618002f60 con 0x7f162c1420b0 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: dump: 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.599 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1618003160 con 0x7f162c1420b0 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 1 -- 10.20.193.106:0/122759732 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1618004960 con 0x7f162c1420b0 2026-02-17T05:27:55.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f1631acc640 4 set_mon_vals no callback set 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.583+0000 7f162a7fc640 10 monclient: dump: 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.601 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 10 monclient: shutdown 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- 10.20.193.106:0/122759732 >> v1:10.20.193.106:6789/0 conn(0x7f162c1420b0 legacy=0x7f162c142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- 10.20.193.106:0/122759732 shutdown_connections 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- 10.20.193.106:0/122759732 >> 10.20.193.106:0/122759732 conn(0x7f162c054ef0 msgr2=0x7f162c090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- 10.20.193.106:0/122759732 shutdown_connections 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- 10.20.193.106:0/122759732 wait complete. 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 10 monclient: build_initial_monmap 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 10 monclient: monmap: 2026-02-17T05:27:55.602 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 Processor -- start 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 1 -- start start 2026-02-17T05:27:55.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.584+0000 7f1631acc640 10 monclient: init 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-b con 0x7f162c1420b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-a con 0x7f162c142b90 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient(hunting): picked mon.noname-c con 0x7f162c184b50 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c05e930 con 0x7f162c142b90 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c10b440 con 0x7f162c1420b0 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c109f50 con 0x7f162c184b50 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient(hunting): authenticate will time out at 604.214152s 2026-02-17T05:27:55.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f162affd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f162c142b90 0x7f162c183120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50164/0 (socket says 10.20.193.106:50164) 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f162affd640 1 -- 10.20.193.106:0/907652553 learned_addr learned my addr 10.20.193.106:0/907652553 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541515938 0 0) 0x7f161c0029f0 con 0x7f162c142b90 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): my global_id is 4113 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc0035e0 con 0x7f162c142b90 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159626463 0 0) 0x7f162c109f50 con 0x7f162c184b50 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): my global_id is 4115 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f161c0029f0 con 0x7f162c184b50 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930643783 0 0) 0x7f162c10b440 con 0x7f162c1420b0 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): my global_id is 4114 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f162c109f50 con 0x7f162c1420b0 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3204806212 0 0) 0x7f15fc0035e0 con 0x7f162c142b90 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f162c10b440 con 0x7f162c142b90 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f161c003590 con 0x7f162c142b90 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:55.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): dump: 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:55.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2981896289 0 0) 0x7f161c0029f0 con 0x7f162c184b50 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15fc0035e0 con 0x7f162c184b50 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16200040d0 con 0x7f162c184b50 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient(hunting): dump: 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.608 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2441870931 0 0) 0x7f162c109f50 con 0x7f162c1420b0 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f161c0029f0 con 0x7f162c1420b0 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3567480644 0 0) 0x7f162c10b440 con 0x7f162c142b90 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 >> v1:10.20.193.106:6790/0 conn(0x7f162c184b50 legacy=0x7f162c114850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 >> v1:10.20.193.118:6789/0 conn(0x7f162c1420b0 legacy=0x7f162c13bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: _finish_hunting 0 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 monclient: found mon.a 2026-02-17T05:27:55.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c10c2b0 con 0x7f162c142b90 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: _finish_auth 0 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: _check_auth_tickets 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 5 monclient: authenticate success, global_id 4113 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _renew_subs 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f162c109930 con 0x7f162c142b90 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _renew_subs 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f162c10aab0 con 0x7f162c142b90 2026-02-17T05:27:55.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f161c002c70 con 0x7f162c142b90 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f161c003b80 con 0x7f162c142b90 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 10 monclient: dump: 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:55.611 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1629ffb640 4 set_mon_vals no callback set 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f161c005560 con 0x7f162c142b90 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.585+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1532679431 0 0) 0x7f161c006b50 con 0x7f162c142b90 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.586+0000 7f1631acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.586+0000 7f1631acc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.586+0000 7f1631acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.586+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162c0008d0 con 0x7f162c142b90 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.587+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f162c05e930 con 0x7f162c142b90 2026-02-17T05:27:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.587+0000 7f1607fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:55.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.587+0000 7f1607fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.616+0000 7f1631acc640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T05:27:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.616+0000 7f1631acc640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T05:27:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.616+0000 7f1631acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.616+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f162c10adb0 con 0x7f162c142b90 2026-02-17T05:27:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.617+0000 7f1607fff640 1 -- 10.20.193.106:0/907652553 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f161c0059d0 con 0x7f162c142b90 2026-02-17T05:27:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.617+0000 7f1607fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T05:27:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.617+0000 7f1607fff640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T05:27:55.620 INFO:teuthology.orchestra.run.trial106.stderr:adjusted tunables profile to default 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 10 monclient: shutdown 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 >> v1:10.20.193.106:6789/0 conn(0x7f162c142b90 legacy=0x7f162c183120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 shutdown_connections 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 >> 10.20.193.106:0/907652553 conn(0x7f162c054ef0 msgr2=0x7f162c1409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 shutdown_connections 2026-02-17T05:27:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:55.618+0000 7f1631acc640 1 -- 10.20.193.106:0/907652553 wait complete. 2026-02-17T05:27:55.626 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T05:27:55.626 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T05:27:55.627 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:55.627 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T05:27:55.652 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:55.652 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T05:27:55.717 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-17T05:27:55.717 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T05:27:55.781 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:55.781 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T05:27:55.807 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:55.807 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T05:27:55.871 DEBUG:teuthology.orchestra.run.trial118:> set -ex 2026-02-17T05:27:55.871 DEBUG:teuthology.orchestra.run.trial118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T05:27:55.933 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new be23feaa-a891-4188-82fa-da6a1555577a 0 2026-02-17T05:27:56.047 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 10 monclient: monmap: 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.036776+0000 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.036776+0000 2026-02-17T05:27:56.048 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 1 Processor -- start 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 1 -- start start 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.035+0000 7f6731b0c640 10 monclient: init 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f672c13f070 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.049 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f672c08fe90 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f672c0902f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c091b00 con 0x7f672c0902f0 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c0917e0 con 0x7f672c13f070 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c057620 con 0x7f672c08fe90 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient(hunting): authenticate will time out at 605.710108s 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672b7fe640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f672c13f070 0x7f672c13f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52102/0 (socket says 10.20.193.118:52102) 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672b7fe640 1 -- 10.20.193.118:0/716113724 learned_addr learned my addr 10.20.193.118:0/716113724 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587886896 0 0) 0x7f672c0917e0 con 0x7f672c13f070 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.050 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient(hunting): my global_id is 4117 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67100035e0 con 0x7f672c13f070 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 732579397 0 0) 0x7f67100035e0 con 0x7f672c13f070 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 legacy=0x7f672c183170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 >> v1:10.20.193.106:6789/0 conn(0x7f672c0902f0 legacy=0x7f672c1a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c057900 con 0x7f672c13f070 2026-02-17T05:27:56.051 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6718002dd0 con 0x7f672c13f070 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 5 monclient: authenticate success, global_id 4117 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: dump: 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.052 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6718002fa0 con 0x7f672c13f070 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 1 -- 10.20.193.118:0/716113724 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67180033b0 con 0x7f672c13f070 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.053 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f672a7fc640 10 monclient: dump: 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.054 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.036+0000 7f6731b0c640 4 set_mon_vals no callback set 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 10 monclient: shutdown 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- 10.20.193.118:0/716113724 >> v1:10.20.193.118:6789/0 conn(0x7f672c13f070 legacy=0x7f672c13f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- 10.20.193.118:0/716113724 shutdown_connections 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- 10.20.193.118:0/716113724 >> 10.20.193.118:0/716113724 conn(0x7f672c05e460 msgr2=0x7f672c095490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- 10.20.193.118:0/716113724 shutdown_connections 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- 10.20.193.118:0/716113724 wait complete. 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 10 monclient: monmap: 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.055 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 Processor -- start 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 1 -- start start 2026-02-17T05:27:56.056 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.037+0000 7f6731b0c640 10 monclient: init 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f672c08fe90 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f672c13f070 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f672c13e640 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c08e110 con 0x7f672c13f070 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c132680 con 0x7f672c13e640 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c132960 con 0x7f672c08fe90 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6731b0c640 10 monclient(hunting): authenticate will time out at 605.712229s 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f672bfff640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f672c13e640 0x7f672c194a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52106/0 (socket says 10.20.193.118:52106) 2026-02-17T05:27:56.057 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f672bfff640 1 -- 10.20.193.118:0/3377627983 learned_addr learned my addr 10.20.193.118:0/3377627983 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f672bfff640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.118:6789/0 conn(0x7f672c13e640 legacy=0x7f672c194a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f672bfff640 1 --1- 10.20.193.118:0/3377627983 >> v1:10.20.193.118:6789/0 conn(0x7f672c13e640 0x7f672c194a50 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=3 cs=0 l=1).fault on lossy channel, failing 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.118:6789/0 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198138004 0 0) 0x7f672c132960 con 0x7f672c08fe90 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): my global_id is 4121 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc0035e0 con 0x7f672c08fe90 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139681412 0 0) 0x7f671c0029f0 con 0x7f672c13f070 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.058 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 10 monclient(hunting): my global_id is 4119 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.038+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f672c132960 con 0x7f672c13f070 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3792995298 0 0) 0x7f66fc0035e0 con 0x7f672c08fe90 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f672b7fe640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 legacy=0x7f672c13df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f672b7fe640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 legacy=0x7f672c13df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f672b7fe640 1 --1- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 0x7f672c13df30 :-1 s=OPENED pgs=16 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f672b7fe640 1 --1- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 0x7f672c13df30 :-1 s=OPENED pgs=16 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f671c0029f0 con 0x7f672c08fe90 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.106:6790/0 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3178263293 0 0) 0x7f672c132960 con 0x7f672c13f070 2026-02-17T05:27:56.059 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66fc0035e0 con 0x7f672c13f070 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f671c003200 con 0x7f672c13f070 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient(hunting): dump: 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.060 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3164958793 0 0) 0x7f66fc0035e0 con 0x7f672c13f070 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6790/0 conn(0x7f672c08fe90 legacy=0x7f672c13df30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.118:6789/0 conn(0x7f672c13e640 legacy=0x7f672c194a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 monclient: found mon.a 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c131160 con 0x7f672c13f070 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.061 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 5 monclient: authenticate success, global_id 4119 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _renew_subs 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f672c08c680 con 0x7f672c13f070 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _renew_subs 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f672c1320c0 con 0x7f672c13f070 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f671c0036d0 con 0x7f672c13f070 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f671c0039f0 con 0x7f672c13f070 2026-02-17T05:27:56.062 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6729ffb640 4 set_mon_vals no callback set 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 10 monclient: dump: 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.063 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f671c003f60 con 0x7f672c13f070 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 2935420449 0 0) 0x7f671c005760 con 0x7f672c13f070 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.039+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c0008d0 con 0x7f672c13f070 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.041+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f672c08e110 con 0x7f672c13f070 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.041+0000 7f6707fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.064 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.041+0000 7f6707fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.079 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.075+0000 7f6731b0c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "be23feaa-a891-4188-82fa-da6a1555577a", "id": 0}] 2026-02-17T05:27:56.079 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.075+0000 7f6731b0c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "be23feaa-a891-4188-82fa-da6a1555577a", "id": 0}] 2026-02-17T05:27:56.079 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.075+0000 7f6731b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.079 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.075+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "be23feaa-a891-4188-82fa-da6a1555577a", "id": 0} v 0) -- 0x7f672c094410 con 0x7f672c13f070 2026-02-17T05:27:56.080 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.076+0000 7f6707fff640 1 -- 10.20.193.118:0/3377627983 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be23feaa-a891-4188-82fa-da6a1555577a", "id": 0}]=0 v3) ==== 112+0+2 (unknown 264934775 0 732707515) 0x7f671c005920 con 0x7f672c13f070 2026-02-17T05:27:56.080 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.076+0000 7f6707fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "be23feaa-a891-4188-82fa-da6a1555577a", "id": 0}] 2026-02-17T05:27:56.080 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.076+0000 7f6707fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.081 INFO:teuthology.orchestra.run.trial118.stdout:0 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 10 monclient: shutdown 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 >> v1:10.20.193.106:6789/0 conn(0x7f672c13f070 legacy=0x7f672c193330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 shutdown_connections 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 >> 10.20.193.118:0/3377627983 conn(0x7f672c05e460 msgr2=0x7f672c08d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 shutdown_connections 2026-02-17T05:27:56.082 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.077+0000 7f6731b0c640 1 -- 10.20.193.118:0/3377627983 wait complete. 2026-02-17T05:27:56.089 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new b4eb1865-e288-4485-a460-ff9dc40e9ac4 1 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 10 monclient: monmap: 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.154914+0000 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.154914+0000 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.156 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 1 Processor -- start 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 1 -- start start 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.153+0000 7f59622c3640 10 monclient: init 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-c con 0x7f595c05d300 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-b con 0x7f595c140420 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-a con 0x7f595c140860 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c05dde0 con 0x7f595c140860 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c08c2a0 con 0x7f595c05d300 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c08d5c0 con 0x7f595c140420 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient(hunting): authenticate will time out at 605.828293s 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595bfff640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f595c05d300 0x7f595c05d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52108/0 (socket says 10.20.193.118:52108) 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595bfff640 1 -- 10.20.193.118:0/3592299016 learned_addr learned my addr 10.20.193.118:0/3592299016 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864006930 0 0) 0x7f595c08c2a0 con 0x7f595c05d300 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.158 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient(hunting): my global_id is 4120 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59400035e0 con 0x7f595c05d300 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1685397333 0 0) 0x7f59400035e0 con 0x7f595c05d300 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 >> v1:10.20.193.106:6790/0 conn(0x7f595c140420 legacy=0x7f595c181190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 >> v1:10.20.193.106:6789/0 conn(0x7f595c140860 legacy=0x7f595c1a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c057880 con 0x7f595c05d300 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5948002dd0 con 0x7f595c05d300 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: dump: 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 5 monclient: authenticate success, global_id 4120 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5948003020 con 0x7f595c05d300 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.159 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 1 -- 10.20.193.118:0/3592299016 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5948003430 con 0x7f595c05d300 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f595affd640 10 monclient: dump: 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.154+0000 7f59622c3640 4 set_mon_vals no callback set 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 10 monclient: shutdown 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- 10.20.193.118:0/3592299016 >> v1:10.20.193.118:6789/0 conn(0x7f595c05d300 legacy=0x7f595c05d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- 10.20.193.118:0/3592299016 shutdown_connections 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- 10.20.193.118:0/3592299016 >> 10.20.193.118:0/3592299016 conn(0x7f595c054ef0 msgr2=0x7f595c090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- 10.20.193.118:0/3592299016 shutdown_connections 2026-02-17T05:27:56.160 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- 10.20.193.118:0/3592299016 wait complete. 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 10 monclient: monmap: 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 Processor -- start 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 1 -- start start 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.155+0000 7f59622c3640 10 monclient: init 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-a con 0x7f595c05d300 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-c con 0x7f595c140420 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient(hunting): picked mon.noname-b con 0x7f595c140860 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c152f00 con 0x7f595c05d300 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c05e8c0 con 0x7f595c140860 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c13f8b0 con 0x7f595c140420 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient(hunting): authenticate will time out at 605.830237s 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5960839640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f595c140860 0x7f595c194f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52120/0 (socket says 10.20.193.118:52120) 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5960839640 1 -- 10.20.193.118:0/2445478908 learned_addr learned my addr 10.20.193.118:0/2445478908 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386291069 0 0) 0x7f595c05e8c0 con 0x7f595c140860 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): my global_id is 4123 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592c0035e0 con 0x7f595c140860 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691022900 0 0) 0x7f595c152f00 con 0x7f595c05d300 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.162 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): my global_id is 4122 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f595c05e8c0 con 0x7f595c05d300 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 664499624 0 0) 0x7f592c0035e0 con 0x7f595c140860 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f595c152f00 con 0x7f595c140860 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5950004140 con 0x7f595c140860 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): dump: 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483585416 0 0) 0x7f595c13f8b0 con 0x7f595c140420 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient(hunting): my global_id is 4124 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592c0035e0 con 0x7f595c140420 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3639886962 0 0) 0x7f595c152f00 con 0x7f595c140860 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 >> v1:10.20.193.106:6790/0 conn(0x7f595c140420 legacy=0x7f595c1937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 >> v1:10.20.193.106:6789/0 conn(0x7f595c05d300 legacy=0x7f595c139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 monclient: found mon.b 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c12b400 con 0x7f595c140860 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 5 monclient: authenticate success, global_id 4123 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _renew_subs 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.163 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f595c12d760 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _renew_subs 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f595c12c100 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5950004310 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5950004a20 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f595a7fc640 4 set_mon_vals no callback set 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 10 monclient: dump: 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f5950004f90 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.156+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 4164956318 0 0) 0x7f5950007a50 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.157+0000 7f59622c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.157+0000 7f59622c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.157+0000 7f59622c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.157+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c12d3e0 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.158+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f5950005450 con 0x7f595c140860 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.158+0000 7f5958ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.164 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.158+0000 7f5958ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.196 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.192+0000 7f59622c3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b4eb1865-e288-4485-a460-ff9dc40e9ac4", "id": 1}] 2026-02-17T05:27:56.196 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.192+0000 7f59622c3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b4eb1865-e288-4485-a460-ff9dc40e9ac4", "id": 1}] 2026-02-17T05:27:56.196 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.192+0000 7f59622c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.196 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.192+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b4eb1865-e288-4485-a460-ff9dc40e9ac4", "id": 1} v 0) -- 0x7f595c0554e0 con 0x7f595c140860 2026-02-17T05:27:56.198 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f5958ff9640 1 -- 10.20.193.118:0/2445478908 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4eb1865-e288-4485-a460-ff9dc40e9ac4", "id": 1}]=0 v4) ==== 112+0+2 (unknown 3404901989 0 940483276) 0x7f5950006960 con 0x7f595c140860 2026-02-17T05:27:56.198 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f5958ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b4eb1865-e288-4485-a460-ff9dc40e9ac4", "id": 1}] 2026-02-17T05:27:56.198 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f5958ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.198 INFO:teuthology.orchestra.run.trial118.stdout:1 2026-02-17T05:27:56.199 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 10 monclient: shutdown 2026-02-17T05:27:56.199 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.199 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 >> v1:10.20.193.118:6789/0 conn(0x7f595c140860 legacy=0x7f595c194f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.200 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 shutdown_connections 2026-02-17T05:27:56.200 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 >> 10.20.193.118:0/2445478908 conn(0x7f595c054ef0 msgr2=0x7f595c13e400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.200 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 shutdown_connections 2026-02-17T05:27:56.200 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.195+0000 7f59622c3640 1 -- 10.20.193.118:0/2445478908 wait complete. 2026-02-17T05:27:56.206 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new 9e4e4e8f-99fc-479a-92ae-882940fe62cf 2 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 10 monclient: monmap: 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.268744+0000 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.268744+0000 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.270 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.271 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.271 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.271 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 1 Processor -- start 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 1 -- start start 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 10 monclient: init 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.267+0000 7fce11d4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-c con 0x7fce0c1420b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-a con 0x7fce0c142b90 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-b con 0x7fce0c184b50 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c08b540 con 0x7fce0c142b90 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c05c940 con 0x7fce0c1420b0 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c08cdd0 con 0x7fce0c184b50 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient(hunting): authenticate will time out at 605.942063s 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0b7fe640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7fce0c1420b0 0x7fce0c142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52134/0 (socket says 10.20.193.118:52134) 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0b7fe640 1 -- 10.20.193.118:0/349938586 learned_addr learned my addr 10.20.193.118:0/349938586 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.275 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374629937 0 0) 0x7fce0c05c940 con 0x7fce0c1420b0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient(hunting): my global_id is 4126 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf00035e0 con 0x7fce0c1420b0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1174622677 0 0) 0x7fcdf00035e0 con 0x7fce0c1420b0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 >> v1:10.20.193.106:6790/0 conn(0x7fce0c184b50 legacy=0x7fce0c1a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 >> v1:10.20.193.106:6789/0 conn(0x7fce0c142b90 legacy=0x7fce0c183430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c05ce20 con 0x7fce0c1420b0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcdf8002dd0 con 0x7fce0c1420b0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 5 monclient: authenticate success, global_id 4126 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.276 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: dump: 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdf8003090 con 0x7fce0c1420b0 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce11d4c640 4 set_mon_vals no callback set 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 1 -- 10.20.193.118:0/349938586 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcdf8003460 con 0x7fce0c1420b0 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.268+0000 7fce0a7fc640 10 monclient: dump: 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.277 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 10 monclient: shutdown 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- 10.20.193.118:0/349938586 >> v1:10.20.193.118:6789/0 conn(0x7fce0c1420b0 legacy=0x7fce0c142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- 10.20.193.118:0/349938586 shutdown_connections 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- 10.20.193.118:0/349938586 >> 10.20.193.118:0/349938586 conn(0x7fce0c054ef0 msgr2=0x7fce0c090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- 10.20.193.118:0/349938586 shutdown_connections 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- 10.20.193.118:0/349938586 wait complete. 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 10 monclient: monmap: 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.278 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 Processor -- start 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 1 -- start start 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.269+0000 7fce11d4c640 10 monclient: init 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-b con 0x7fce0c1420b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-a con 0x7fce0c142b90 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient(hunting): picked mon.noname-c con 0x7fce0c184b50 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c05c3d0 con 0x7fce0c142b90 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c05e930 con 0x7fce0c1420b0 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c10ba80 con 0x7fce0c184b50 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient(hunting): authenticate will time out at 605.944106s 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce0b7fe640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7fce0c1420b0 0x7fce0c13bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52150/0 (socket says 10.20.193.118:52150) 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce0b7fe640 1 -- 10.20.193.118:0/429786974 learned_addr learned my addr 10.20.193.118:0/429786974 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486916997 0 0) 0x7fce0c05ce20 con 0x7fce0c1420b0 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.279 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): my global_id is 4129 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcddc0035e0 con 0x7fce0c1420b0 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430618500 0 0) 0x7fce0c05c3d0 con 0x7fce0c142b90 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): my global_id is 4125 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce0c05ce20 con 0x7fce0c142b90 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1014225223 0 0) 0x7fcddc0035e0 con 0x7fce0c1420b0 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce0c05c3d0 con 0x7fce0c1420b0 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcdf80033b0 con 0x7fce0c1420b0 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): dump: 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.280 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360943736 0 0) 0x7fce0c10ba80 con 0x7fce0c184b50 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient(hunting): my global_id is 4127 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcddc0035e0 con 0x7fce0c184b50 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2124722614 0 0) 0x7fce0c05c3d0 con 0x7fce0c1420b0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 >> v1:10.20.193.106:6790/0 conn(0x7fce0c184b50 legacy=0x7fce0c184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 >> v1:10.20.193.106:6789/0 conn(0x7fce0c142b90 legacy=0x7fce0c13c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 monclient: found mon.b 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c10b1d0 con 0x7fce0c1420b0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 5 monclient: authenticate success, global_id 4129 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _renew_subs 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c10c040 con 0x7fce0c1420b0 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _renew_subs 2026-02-17T05:27:56.281 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fce0c184840 con 0x7fce0c1420b0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdf8002880 con 0x7fce0c1420b0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcdf8004e60 con 0x7fce0c1420b0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fce09ffb640 4 set_mon_vals no callback set 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 10 monclient: dump: 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fcdf80053d0 con 0x7fce0c1420b0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.270+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 3796447204 0 0) 0x7fcdf8006c30 con 0x7fce0c1420b0 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.271+0000 7fce11d4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.271+0000 7fce11d4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.282 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.271+0000 7fce11d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.283 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.271+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c10bcc0 con 0x7fce0c1420b0 2026-02-17T05:27:56.283 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.272+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fcdf8006e60 con 0x7fce0c1420b0 2026-02-17T05:27:56.283 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.272+0000 7fcde7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.283 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.272+0000 7fcde7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.308 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.305+0000 7fce11d4c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9e4e4e8f-99fc-479a-92ae-882940fe62cf", "id": 2}] 2026-02-17T05:27:56.308 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.305+0000 7fce11d4c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9e4e4e8f-99fc-479a-92ae-882940fe62cf", "id": 2}] 2026-02-17T05:27:56.308 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.305+0000 7fce11d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.308 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.305+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9e4e4e8f-99fc-479a-92ae-882940fe62cf", "id": 2} v 0) -- 0x7fce0c05d160 con 0x7fce0c1420b0 2026-02-17T05:27:56.310 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.307+0000 7fcde7fff640 1 -- 10.20.193.118:0/429786974 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e4e4e8f-99fc-479a-92ae-882940fe62cf", "id": 2}]=0 v5) ==== 112+0+2 (unknown 818742660 0 216599125) 0x7fce0c05e930 con 0x7fce0c1420b0 2026-02-17T05:27:56.310 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.307+0000 7fcde7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9e4e4e8f-99fc-479a-92ae-882940fe62cf", "id": 2}] 2026-02-17T05:27:56.310 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.307+0000 7fcde7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.310 INFO:teuthology.orchestra.run.trial118.stdout:2 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 10 monclient: shutdown 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 >> v1:10.20.193.118:6789/0 conn(0x7fce0c1420b0 legacy=0x7fce0c13bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 shutdown_connections 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 >> 10.20.193.118:0/429786974 conn(0x7fce0c054ef0 msgr2=0x7fce0c089f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 shutdown_connections 2026-02-17T05:27:56.311 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.308+0000 7fce11d4c640 1 -- 10.20.193.118:0/429786974 wait complete. 2026-02-17T05:27:56.318 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new ef20611a-4a38-4302-abe1-22c33d1f4fed 3 2026-02-17T05:27:56.334 INFO:tasks.ceph.mgr.x.trial118.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T05:27:56.334 INFO:tasks.ceph.mgr.x.trial118.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T05:27:56.334 INFO:tasks.ceph.mgr.x.trial118.stderr: from numpy import show_config as show_numpy_config 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 10 monclient: monmap: 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.380771+0000 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.380771+0000 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.382 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.389 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 1 Processor -- start 2026-02-17T05:27:56.389 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 1 -- start start 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.379+0000 7f7c3550c640 10 monclient: init 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-c con 0x7f7c300585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-a con 0x7f7c3013f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-b con 0x7f7c3008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c30056bb0 con 0x7f7c3013f6c0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c300575d0 con 0x7f7c300585c0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c300578b0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.390 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient(hunting): authenticate will time out at 606.054162s 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2effd640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f7c300585c0 0x7f7c3013efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52156/0 (socket says 10.20.193.118:52156) 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2effd640 1 -- 10.20.193.118:0/352982482 learned_addr learned my addr 10.20.193.118:0/352982482 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546892494 0 0) 0x7f7c300575d0 con 0x7f7c300585c0 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): my global_id is 4132 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2f7fe640 1 -- 10.20.193.118:0/352982482 >> v1:10.20.193.106:6790/0 conn(0x7f7c3008c0d0 legacy=0x7f7c301a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2f7fe640 1 -- 10.20.193.118:0/352982482 >> v1:10.20.193.106:6790/0 conn(0x7f7c3008c0d0 legacy=0x7f7c301a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2f7fe640 1 --1- 10.20.193.118:0/352982482 >> v1:10.20.193.106:6790/0 conn(0x7f7c3008c0d0 0x7f7c301a4930 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=3 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c1c0035e0 con 0x7f7c300585c0 2026-02-17T05:27:56.391 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614453218 0 0) 0x7f7c30056bb0 con 0x7f7c3013f6c0 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient(hunting): my global_id is 4128 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c300575d0 con 0x7f7c3013f6c0 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2575824759 0 0) 0x7f7c1c0035e0 con 0x7f7c300585c0 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 >> v1:10.20.193.106:6790/0 conn(0x7f7c3008c0d0 legacy=0x7f7c301a4930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 >> v1:10.20.193.106:6789/0 conn(0x7f7c3013f6c0 legacy=0x7f7c30183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.392 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30057b90 con 0x7f7c300585c0 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c24002d50 con 0x7f7c300585c0 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: dump: 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.393 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 5 monclient: authenticate success, global_id 4132 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c24003010 con 0x7f7c300585c0 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.394 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 1 -- 10.20.193.118:0/352982482 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c24003420 con 0x7f7c300585c0 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c3550c640 4 set_mon_vals no callback set 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.380+0000 7f7c2dffb640 10 monclient: dump: 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.395 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: shutdown 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- 10.20.193.118:0/352982482 >> v1:10.20.193.118:6789/0 conn(0x7f7c300585c0 legacy=0x7f7c3013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- 10.20.193.118:0/352982482 shutdown_connections 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- 10.20.193.118:0/352982482 >> 10.20.193.118:0/352982482 conn(0x7f7c3005e410 msgr2=0x7f7c30095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- 10.20.193.118:0/352982482 shutdown_connections 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- 10.20.193.118:0/352982482 wait complete. 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.396 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: monmap: 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.397 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 Processor -- start 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- start start 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: init 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-a con 0x7f7c300585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-b con 0x7f7c3008c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient(hunting): picked mon.noname-c con 0x7f7c3013f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c301426e0 con 0x7f7c300585c0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c3008b650 con 0x7f7c3008c0d0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c3012dc70 con 0x7f7c3013f6c0 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.381+0000 7f7c3550c640 10 monclient(hunting): authenticate will time out at 606.055975s 2026-02-17T05:27:56.398 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c2e7fc640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f7c3008c0d0 0x7f7c3012c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52166/0 (socket says 10.20.193.118:52166) 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c2e7fc640 1 -- 10.20.193.118:0/468029735 learned_addr learned my addr 10.20.193.118:0/468029735 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492219929 0 0) 0x7f7c3008b650 con 0x7f7c3008c0d0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): my global_id is 4135 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bfc0035e0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2316584312 0 0) 0x7f7bfc0035e0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c3008b650 con 0x7f7c3008c0d0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c18003150 con 0x7f7c3008c0d0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.399 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): dump: 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.400 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 467764931 0 0) 0x7f7c3008b650 con 0x7f7c3008c0d0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 >> v1:10.20.193.106:6790/0 conn(0x7f7c3013f6c0 legacy=0x7f7c30194500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 >> v1:10.20.193.106:6789/0 conn(0x7f7c300585c0 legacy=0x7f7c3012b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 monclient: found mon.b 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3008c530 con 0x7f7c3008c0d0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 5 monclient: authenticate success, global_id 4135 2026-02-17T05:27:56.401 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 10 monclient: _renew_subs 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3012dfb0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 10 monclient: _renew_subs 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c3012e510 con 0x7f7c3008c0d0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c180034c0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c18003b70 con 0x7f7c3008c0d0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 10 monclient: dump: 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.402 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7c18004150 con 0x7f7c3008c0d0 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c2d7fa640 4 set_mon_vals no callback set 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 2445623816 0 0) 0x7f7c18006c10 con 0x7f7c3008c0d0 2026-02-17T05:27:56.403 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.382+0000 7f7c3550c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.383+0000 7f7c3550c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.383+0000 7f7c3550c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.383+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30093240 con 0x7f7c3008c0d0 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.384+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f7c18006780 con 0x7f7c3008c0d0 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.384+0000 7f7c0f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.404 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.384+0000 7f7c0f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.420 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.417+0000 7f7c3550c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ef20611a-4a38-4302-abe1-22c33d1f4fed", "id": 3}] 2026-02-17T05:27:56.420 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.417+0000 7f7c3550c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ef20611a-4a38-4302-abe1-22c33d1f4fed", "id": 3}] 2026-02-17T05:27:56.420 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.417+0000 7f7c3550c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.420 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.417+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "ef20611a-4a38-4302-abe1-22c33d1f4fed", "id": 3} v 0) -- 0x7f7c30058c70 con 0x7f7c3008c0d0 2026-02-17T05:27:56.422 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c0f7fe640 1 -- 10.20.193.118:0/468029735 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef20611a-4a38-4302-abe1-22c33d1f4fed", "id": 3}]=0 v6) ==== 112+0+2 (unknown 1950050062 0 525046306) 0x7f7c180069e0 con 0x7f7c3008c0d0 2026-02-17T05:27:56.422 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c0f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ef20611a-4a38-4302-abe1-22c33d1f4fed", "id": 3}] 2026-02-17T05:27:56.422 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c0f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.422 INFO:teuthology.orchestra.run.trial118.stdout:3 2026-02-17T05:27:56.423 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 10 monclient: shutdown 2026-02-17T05:27:56.423 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.423 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 >> v1:10.20.193.118:6789/0 conn(0x7f7c3008c0d0 legacy=0x7f7c3012c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.424 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 shutdown_connections 2026-02-17T05:27:56.424 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 >> 10.20.193.118:0/468029735 conn(0x7f7c3005e410 msgr2=0x7f7c301415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.424 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 shutdown_connections 2026-02-17T05:27:56.424 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.419+0000 7f7c3550c640 1 -- 10.20.193.118:0/468029735 wait complete. 2026-02-17T05:27:56.430 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new 616997f6-105f-4a7b-8be3-bd39e505540d 4 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 10 monclient: monmap: 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.531840+0000 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.531840+0000 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.533 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 1 Processor -- start 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 1 -- start start 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.530+0000 7f030a6cc640 10 monclient: init 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f03040585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f030413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f030408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0304056bb0 con 0x7f030408c0d0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040575d0 con 0x7f03040585c0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040578b0 con 0x7f030413f6c0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient(hunting): authenticate will time out at 606.205172s 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0303fff640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f03040585c0 0x7f030413efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52168/0 (socket says 10.20.193.118:52168) 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0303fff640 1 -- 10.20.193.118:0/1617612731 learned_addr learned my addr 10.20.193.118:0/1617612731 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496784640 0 0) 0x7f03040575d0 con 0x7f03040585c0 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): my global_id is 4138 2026-02-17T05:27:56.534 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e80035e0 con 0x7f03040585c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846771224 0 0) 0x7f0304056bb0 con 0x7f030408c0d0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): my global_id is 4131 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03040575d0 con 0x7f030408c0d0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176386299 0 0) 0x7f03040578b0 con 0x7f030413f6c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient(hunting): my global_id is 4133 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0304056bb0 con 0x7f030413f6c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781436715 0 0) 0x7f02e80035e0 con 0x7f03040585c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 >> v1:10.20.193.106:6790/0 conn(0x7f030413f6c0 legacy=0x7f0304183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 >> v1:10.20.193.106:6789/0 conn(0x7f030408c0d0 legacy=0x7f03041a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0304057b90 con 0x7f03040585c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f02f0002dd0 con 0x7f03040585c0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 5 monclient: authenticate success, global_id 4138 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: dump: 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.537 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02f0002fd0 con 0x7f03040585c0 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f030a6cc640 4 set_mon_vals no callback set 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 1 -- 10.20.193.118:0/1617612731 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f02f00033e0 con 0x7f03040585c0 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.531+0000 7f0302ffd640 10 monclient: dump: 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: shutdown 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- 10.20.193.118:0/1617612731 >> v1:10.20.193.118:6789/0 conn(0x7f03040585c0 legacy=0x7f030413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- 10.20.193.118:0/1617612731 shutdown_connections 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- 10.20.193.118:0/1617612731 >> 10.20.193.118:0/1617612731 conn(0x7f030405e410 msgr2=0x7f0304095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- 10.20.193.118:0/1617612731 shutdown_connections 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- 10.20.193.118:0/1617612731 wait complete. 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: monmap: 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.538 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 Processor -- start 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- start start 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: init 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f03040585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f030408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f030413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030408c4f0 con 0x7f030408c0d0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030412c7c0 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030413e4d0 con 0x7f03040585c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.532+0000 7f030a6cc640 10 monclient(hunting): authenticate will time out at 606.206963s 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0308c42640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f030413f6c0 0x7f0304194620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52170/0 (socket says 10.20.193.118:52170) 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0308c42640 1 -- 10.20.193.118:0/1035911907 learned_addr learned my addr 10.20.193.118:0/1035911907 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470540407 0 0) 0x7f030412c7c0 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): my global_id is 4141 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d40035e0 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152919184 0 0) 0x7f030413e4d0 con 0x7f03040585c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): my global_id is 4136 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f030412c7c0 con 0x7f03040585c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108966909 0 0) 0x7f030408c4f0 con 0x7f030408c0d0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): my global_id is 4134 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f030413e4d0 con 0x7f030408c0d0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2995757706 0 0) 0x7f02d40035e0 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f030408c4f0 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f02f8004150 con 0x7f030413f6c0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): dump: 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.539 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1602192594 0 0) 0x7f030408c4f0 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 >> v1:10.20.193.106:6790/0 conn(0x7f03040585c0 legacy=0x7f030412b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 >> v1:10.20.193.106:6789/0 conn(0x7f030408c0d0 legacy=0x7f030412c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 monclient: found mon.b 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030408b930 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 5 monclient: authenticate success, global_id 4141 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 10 monclient: _renew_subs 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f030412deb0 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 10 monclient: _renew_subs 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f030412cf50 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02f80042b0 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f02f80049e0 con 0x7f030413f6c0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f03027fc640 4 set_mon_vals no callback set 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 10 monclient: dump: 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.540 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f02f8004fc0 con 0x7f030413f6c0 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.533+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 3170289929 0 0) 0x7f02f8007c70 con 0x7f030413f6c0 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.534+0000 7f030a6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.534+0000 7f030a6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.534+0000 7f030a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.534+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0304093240 con 0x7f030413f6c0 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.535+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f02f80054d0 con 0x7f030413f6c0 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.535+0000 7f0300ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.541 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.535+0000 7f0300ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.570 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.567+0000 7f030a6cc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "616997f6-105f-4a7b-8be3-bd39e505540d", "id": 4}] 2026-02-17T05:27:56.570 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.567+0000 7f030a6cc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "616997f6-105f-4a7b-8be3-bd39e505540d", "id": 4}] 2026-02-17T05:27:56.570 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.567+0000 7f030a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.570 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.567+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "616997f6-105f-4a7b-8be3-bd39e505540d", "id": 4} v 0) -- 0x7f0304058c70 con 0x7f030413f6c0 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f0300ff9640 1 -- 10.20.193.118:0/1035911907 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "616997f6-105f-4a7b-8be3-bd39e505540d", "id": 4}]=0 v7) ==== 112+0+2 (unknown 948617365 0 1697012583) 0x7f02f8007770 con 0x7f030413f6c0 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f0300ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "616997f6-105f-4a7b-8be3-bd39e505540d", "id": 4}] 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f0300ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stdout:4 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f030a6cc640 10 monclient: shutdown 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f030a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.572 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.569+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 >> v1:10.20.193.118:6789/0 conn(0x7f030413f6c0 legacy=0x7f0304194620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.570+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 shutdown_connections 2026-02-17T05:27:56.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.570+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 >> 10.20.193.118:0/1035911907 conn(0x7f030405e410 msgr2=0x7f0304141710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.570+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 shutdown_connections 2026-02-17T05:27:56.573 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.570+0000 7f030a6cc640 1 -- 10.20.193.118:0/1035911907 wait complete. 2026-02-17T05:27:56.580 DEBUG:teuthology.orchestra.run.trial118:> sudo ceph --cluster ceph osd new d500ce8b-c1a1-41f6-993d-4bd3f1a9f145 5 2026-02-17T05:27:56.642 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.642 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.642 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: monmap: 2026-02-17T05:27:56.642 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.642 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:56.640548+0000 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:56.640548+0000 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.643 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.650 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 1 Processor -- start 2026-02-17T05:27:56.650 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 1 -- start start 2026-02-17T05:27:56.650 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: init 2026-02-17T05:27:56.650 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fd4500585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fd45013f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fd45008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd450056bb0 con 0x7fd45013f6c0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4500575d0 con 0x7fd4500585c0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4500578b0 con 0x7fd45008c0d0 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.639+0000 7fd456ecc640 10 monclient(hunting): authenticate will time out at 606.313998s 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd454c41640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7fd4500585c0 0x7fd45013efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52180/0 (socket says 10.20.193.118:52180) 2026-02-17T05:27:56.651 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd454c41640 1 -- 10.20.193.118:0/4022515367 learned_addr learned my addr 10.20.193.118:0/4022515367 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955438997 0 0) 0x7fd4500575d0 con 0x7fd4500585c0 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient(hunting): my global_id is 4144 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c0035e0 con 0x7fd4500585c0 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 438089064 0 0) 0x7fd43c0035e0 con 0x7fd4500585c0 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 >> v1:10.20.193.106:6790/0 conn(0x7fd45008c0d0 legacy=0x7fd4501a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 >> v1:10.20.193.106:6789/0 conn(0x7fd45013f6c0 legacy=0x7fd450183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 monclient: found mon.noname-c 2026-02-17T05:27:56.652 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd450057b90 con 0x7fd4500585c0 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd440002dd0 con 0x7fd4500585c0 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: dump: 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.653 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 5 monclient: authenticate success, global_id 4144 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd440003010 con 0x7fd4500585c0 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.654 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 1 -- 10.20.193.118:0/4022515367 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd4400033e0 con 0x7fd4500585c0 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd4477fe640 10 monclient: dump: 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.655 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 4 set_mon_vals no callback set 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 10 monclient: shutdown 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 1 -- 10.20.193.118:0/4022515367 >> v1:10.20.193.118:6789/0 conn(0x7fd4500585c0 legacy=0x7fd45013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 1 -- 10.20.193.118:0/4022515367 shutdown_connections 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 1 -- 10.20.193.118:0/4022515367 >> 10.20.193.118:0/4022515367 conn(0x7fd45005e410 msgr2=0x7fd450095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.640+0000 7fd456ecc640 1 -- 10.20.193.118:0/4022515367 shutdown_connections 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 -- 10.20.193.118:0/4022515367 wait complete. 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.656 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient: monmap: 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:epoch 0 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 0.000000 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:created 0.000000 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 1 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 Processor -- start 2026-02-17T05:27:56.657 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 -- start start 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient: init 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fd4500585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fd45008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fd45013f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45012d490 con 0x7fd4500585c0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45008c530 con 0x7fd45013f6c0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45008baf0 con 0x7fd45008c0d0 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd456ecc640 10 monclient(hunting): authenticate will time out at 606.315911s 2026-02-17T05:27:56.658 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd455442640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7fd45013f6c0 0x7fd450194c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.118:52182/0 (socket says 10.20.193.118:52182) 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.641+0000 7fd455442640 1 -- 10.20.193.118:0/1426247823 learned_addr learned my addr 10.20.193.118:0/1426247823 (peer_addr_for_me v1:10.20.193.118:0/0) 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380601445 0 0) 0x7fd45008c530 con 0x7fd45013f6c0 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): my global_id is 4147 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4200035e0 con 0x7fd45013f6c0 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799353507 0 0) 0x7fd4200035e0 con 0x7fd45013f6c0 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd45008c530 con 0x7fd45013f6c0 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd44c0041d0 con 0x7fd45013f6c0 2026-02-17T05:27:56.659 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): dump: 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.660 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927003326 0 0) 0x7fd45008baf0 con 0x7fd45008c0d0 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient(hunting): my global_id is 4142 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4200035e0 con 0x7fd45008c0d0 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3682556001 0 0) 0x7fd45008c530 con 0x7fd45013f6c0 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 >> v1:10.20.193.106:6790/0 conn(0x7fd45008c0d0 legacy=0x7fd450193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 >> v1:10.20.193.106:6789/0 conn(0x7fd4500585c0 legacy=0x7fd45013cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 monclient: found mon.b 2026-02-17T05:27:56.661 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45012e8e0 con 0x7fd45013f6c0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 5 monclient: authenticate success, global_id 4147 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _renew_subs 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd45012e040 con 0x7fd45013f6c0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _renew_subs 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.662 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4501526d0 con 0x7fd45013f6c0 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd44c004420 con 0x7fd45013f6c0 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd44c004c10 con 0x7fd45013f6c0 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 10 monclient: dump: 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:epoch 1 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.663 INFO:teuthology.orchestra.run.trial118.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:election_strategy: 3 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fd44c0051f0 con 0x7fd45013f6c0 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd446ffd640 4 set_mon_vals no callback set 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 3195306041 0 0) 0x7fd44c007dd0 con 0x7fd45013f6c0 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.664 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.642+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd450093240 con 0x7fd45013f6c0 2026-02-17T05:27:56.665 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.643+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fd44c007860 con 0x7fd45013f6c0 2026-02-17T05:27:56.665 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.643+0000 7fd4457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.665 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.643+0000 7fd4457fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.680 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.676+0000 7fd456ecc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d500ce8b-c1a1-41f6-993d-4bd3f1a9f145", "id": 5}] 2026-02-17T05:27:56.680 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.676+0000 7fd456ecc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d500ce8b-c1a1-41f6-993d-4bd3f1a9f145", "id": 5}] 2026-02-17T05:27:56.680 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.676+0000 7fd456ecc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:27:56.680 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.676+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d500ce8b-c1a1-41f6-993d-4bd3f1a9f145", "id": 5} v 0) -- 0x7fd450094410 con 0x7fd45013f6c0 2026-02-17T05:27:56.682 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd4457fa640 1 -- 10.20.193.118:0/1426247823 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d500ce8b-c1a1-41f6-993d-4bd3f1a9f145", "id": 5}]=0 v8) ==== 112+0+2 (unknown 4098592203 0 1988412176) 0x7fd44c007a80 con 0x7fd45013f6c0 2026-02-17T05:27:56.682 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd4457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d500ce8b-c1a1-41f6-993d-4bd3f1a9f145", "id": 5}] 2026-02-17T05:27:56.682 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd4457fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.682 INFO:teuthology.orchestra.run.trial118.stdout:5 2026-02-17T05:27:56.683 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd456ecc640 10 monclient: shutdown 2026-02-17T05:27:56.683 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd456ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.684 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.679+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 >> v1:10.20.193.118:6789/0 conn(0x7fd45013f6c0 legacy=0x7fd450194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.684 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.680+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 shutdown_connections 2026-02-17T05:27:56.684 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.680+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 >> 10.20.193.118:0/1426247823 conn(0x7fd45005e410 msgr2=0x7fd4501417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.684 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.680+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 shutdown_connections 2026-02-17T05:27:56.684 INFO:teuthology.orchestra.run.trial118.stderr:2026-02-17T05:27:56.680+0000 7fd456ecc640 1 -- 10.20.193.118:0/1426247823 wait complete. 2026-02-17T05:27:56.691 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T05:27:56.691 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T05:27:56.694 INFO:tasks.ceph.osd.0:Started 2026-02-17T05:27:56.694 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T05:27:56.694 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T05:27:56.696 INFO:tasks.ceph.osd.1:Started 2026-02-17T05:27:56.697 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T05:27:56.697 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T05:27:56.699 INFO:tasks.ceph.osd.2:Started 2026-02-17T05:27:56.699 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T05:27:56.699 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T05:27:56.702 INFO:tasks.ceph.osd.3:Started 2026-02-17T05:27:56.702 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T05:27:56.702 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-17T05:27:56.705 INFO:tasks.ceph.osd.4:Started 2026-02-17T05:27:56.705 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T05:27:56.705 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-17T05:27:56.707 INFO:tasks.ceph.osd.5:Started 2026-02-17T05:27:56.708 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.774+0000 7fb3e1d0c640 10 monclient: get_monmap_and_config 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.774+0000 7fb3e1d0c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.774+0000 7fb3e1d0c640 10 monclient: monmap: 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:56.776150+0000 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:56.776150+0000 2026-02-17T05:27:56.776 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.777 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.777 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.777 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:56.777 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:56.777 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 1 Processor -- start 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 1 -- start start 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient: init 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb3dc13bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb3dc15fe20 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb3dc181920 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc13c650 con 0x7fb3dc13bb70 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc08a750 con 0x7fb3dc181920 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc08aa30 con 0x7fb3dc15fe20 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3e1d0c640 10 monclient(hunting): authenticate will time out at 605.404603s 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3db7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb3dc13bb70 0x7fb3dc13bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50204/0 (socket says 10.20.193.106:50204) 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3db7fe640 1 -- 10.20.193.106:0/1247554865 learned_addr learned my addr 10.20.193.106:0/1247554865 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370787648 0 0) 0x7fb3dc13c650 con 0x7fb3dc13bb70 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): my global_id is 4161 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3c00035e0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442730215 0 0) 0x7fb3dc08aa30 con 0x7fb3dc15fe20 2026-02-17T05:27:56.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 10 monclient(hunting): my global_id is 4163 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3dc13c650 con 0x7fb3dc15fe20 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2464757685 0 0) 0x7fb3c00035e0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.775+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 >> v1:10.20.193.106:6790/0 conn(0x7fb3dc15fe20 legacy=0x7fb3dc180200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 >> v1:10.20.193.118:6789/0 conn(0x7fb3dc181920 legacy=0x7fb3dc1a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 monclient: found mon.noname-a 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc0885f0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3c8002dd0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 5 monclient: authenticate success, global_id 4161 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: dump: 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3c8002fa0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 1 -- 10.20.193.106:0/1247554865 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3c80033b0 con 0x7fb3dc13bb70 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3da7fc640 10 monclient: dump: 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.779 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 4 set_mon_vals no callback set 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 10 monclient: shutdown 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/1247554865 >> v1:10.20.193.106:6789/0 conn(0x7fb3dc13bb70 legacy=0x7fb3dc13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/1247554865 shutdown_connections 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/1247554865 >> 10.20.193.106:0/1247554865 conn(0x7fb3dc0915f0 msgr2=0x7fb3dc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/1247554865 shutdown_connections 2026-02-17T05:27:56.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/1247554865 wait complete. 2026-02-17T05:27:56.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 10 monclient: build_initial_monmap 2026-02-17T05:27:56.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.776+0000 7fb3e1d0c640 10 monclient: monmap: 2026-02-17T05:27:56.781 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:27:56.781 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:56.781 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 1 Processor -- start 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 1 -- start start 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient: init 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb3dc13bb70 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb3dc15fe20 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb3dc181920 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc08b570 con 0x7fb3dc181920 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc144b30 con 0x7fb3dc13bb70 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc08bf40 con 0x7fb3dc15fe20 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3e1d0c640 10 monclient(hunting): authenticate will time out at 605.406391s 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3dbfff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb3dc181920 0x7fb3dc12f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50218/0 (socket says 10.20.193.106:50218) 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3daffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb3dc15fe20 0x7fb3dc12d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35396/0 (socket says 10.20.193.106:35396) 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3dbfff640 1 -- 10.20.193.106:0/409469843 learned_addr learned my addr 10.20.193.106:0/409469843 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923945970 0 0) 0x7fb3dc08b570 con 0x7fb3dc181920 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): my global_id is 4164 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3ac0035e0 con 0x7fb3dc181920 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149738912 0 0) 0x7fb3dc08bf40 con 0x7fb3dc15fe20 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): my global_id is 4166 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3dc08b570 con 0x7fb3dc15fe20 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309614734 0 0) 0x7fb3dc144b30 con 0x7fb3dc13bb70 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:56.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): my global_id is 4171 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3dc08bf40 con 0x7fb3dc13bb70 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2389627376 0 0) 0x7fb3ac0035e0 con 0x7fb3dc181920 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3dc144b30 con 0x7fb3dc181920 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3131369317 0 0) 0x7fb3dc08b570 con 0x7fb3dc15fe20 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3ac0035e0 con 0x7fb3dc15fe20 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3d00041d0 con 0x7fb3dc181920 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): dump: 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3cc003010 con 0x7fb3dc15fe20 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 10 monclient(hunting): dump: 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.777+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3331445321 0 0) 0x7fb3dc144b30 con 0x7fb3dc181920 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 >> v1:10.20.193.106:6790/0 conn(0x7fb3dc15fe20 legacy=0x7fb3dc12d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 >> v1:10.20.193.118:6789/0 conn(0x7fb3dc13bb70 legacy=0x7fb3dc10c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 monclient: found mon.a 2026-02-17T05:27:56.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc146050 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: _finish_auth 0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 5 monclient: authenticate success, global_id 4164 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _renew_subs 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc146330 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _renew_subs 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3dc145d70 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3d0004330 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3d0004a60 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 10 monclient: dump: 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3d9ffb640 4 set_mon_vals no callback set 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fb3d0005040 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3001305545 0 0) 0x7fb3d0007d60 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.778+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc144880 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.779+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fb3d0005500 con 0x7fb3dc181920 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.779+0000 7fb3b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:56.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.779+0000 7fb3b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.807+0000 7fb3e1d0c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.807+0000 7fb3e1d0c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.807+0000 7fb3e1d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.807+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3dc055570 con 0x7fb3dc181920 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3b7fff640 1 -- 10.20.193.106:0/409469843 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 2876941366) 0x7fb3d0007820 con 0x7fb3dc181920 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:27:56.810 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":8,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:27:56.679957+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:27:56.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 10 monclient: shutdown 2026-02-17T05:27:56.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:56.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 >> v1:10.20.193.106:6789/0 conn(0x7fb3dc181920 legacy=0x7fb3dc12f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:56.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 shutdown_connections 2026-02-17T05:27:56.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 >> 10.20.193.106:0/409469843 conn(0x7fb3dc0915f0 msgr2=0x7fb3dc089210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:56.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 shutdown_connections 2026-02-17T05:27:56.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:27:56.808+0000 7fb3e1d0c640 1 -- 10.20.193.106:0/409469843 wait complete. 2026-02-17T05:27:56.817 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T05:27:56.817 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T05:27:56.924 INFO:tasks.ceph.osd.2.trial106.stderr:2026-02-17T05:27:56.922+0000 7f4fb91d8780 -1 Falling back to public interface 2026-02-17T05:27:56.937 INFO:tasks.ceph.osd.0.trial106.stderr:2026-02-17T05:27:56.935+0000 7f03f8646780 -1 Falling back to public interface 2026-02-17T05:27:56.937 INFO:tasks.ceph.osd.1.trial106.stderr:2026-02-17T05:27:56.935+0000 7f26aa030780 -1 Falling back to public interface 2026-02-17T05:27:56.982 INFO:tasks.ceph.osd.4.trial118.stderr:2026-02-17T05:27:56.978+0000 7f6b5bc41780 -1 Falling back to public interface 2026-02-17T05:27:56.989 INFO:tasks.ceph.osd.5.trial118.stderr:2026-02-17T05:27:56.986+0000 7fa366835780 -1 Falling back to public interface 2026-02-17T05:27:57.007 INFO:tasks.ceph.osd.3.trial118.stderr:2026-02-17T05:27:57.004+0000 7f4fdea23780 -1 Falling back to public interface 2026-02-17T05:27:57.423 DEBUG:teuthology.orchestra.run.trial106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T05:27:57.426 INFO:tasks.ceph.osd.2.trial106.stderr:2026-02-17T05:27:57.422+0000 7f4fb91d8780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:27:57.472 INFO:tasks.ceph.osd.0.trial106.stderr:2026-02-17T05:27:57.470+0000 7f03f8646780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:27:57.479 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.477+0000 7f94fb05b640 10 monclient: get_monmap_and_config 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.477+0000 7f94fb05b640 10 monclient: build_initial_monmap 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.477+0000 7f94fb05b640 10 monclient: monmap: 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:epoch 0 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:57.479164+0000 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:57.479164+0000 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:27:57.480 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.486 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 1 Processor -- start 2026-02-17T05:27:57.486 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 1 -- start start 2026-02-17T05:27:57.486 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient: init 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-b con 0x7f94f4141b30 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-c con 0x7f94f4142610 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-a con 0x7f94f4184780 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f40947b0 con 0x7f94f4184780 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f4094c70 con 0x7f94f4142610 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f4090320 con 0x7f94f4141b30 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94fb05b640 10 monclient(hunting): authenticate will time out at 606.107790s 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94f8dd0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f94f4141b30 0x7f94f4141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35438/0 (socket says 10.20.193.106:35438) 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.478+0000 7f94f8dd0640 1 -- 10.20.193.106:0/3058249829 learned_addr learned my addr 10.20.193.106:0/3058249829 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996426533 0 0) 0x7f94f40947b0 con 0x7f94f4184780 2026-02-17T05:27:57.487 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): my global_id is 4173 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e00035e0 con 0x7f94f4184780 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502748841 0 0) 0x7f94f4090320 con 0x7f94f4141b30 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient(hunting): my global_id is 4175 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f40947b0 con 0x7f94f4141b30 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487687066 0 0) 0x7f94e00035e0 con 0x7f94f4184780 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 >> v1:10.20.193.106:6790/0 conn(0x7f94f4141b30 legacy=0x7f94f4141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 >> v1:10.20.193.118:6789/0 conn(0x7f94f4142610 legacy=0x7f94f4183060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:27:57.488 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 monclient: found mon.noname-a 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f40914a0 con 0x7f94f4184780 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: _finish_auth 0 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f94f0003de0 con 0x7f94f4184780 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 5 monclient: authenticate success, global_id 4173 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: dump: 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.489 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94f00040a0 con 0x7f94f4184780 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 10 monclient: get_monmap_and_config success 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 4 set_mon_vals no callback set 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 1 -- 10.20.193.106:0/3058249829 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f94f00044b0 con 0x7f94f4184780 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:57.490 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94eb7fe640 10 monclient: dump: 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 10 monclient: shutdown 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 1 -- 10.20.193.106:0/3058249829 >> v1:10.20.193.106:6789/0 conn(0x7f94f4184780 legacy=0x7f94f41a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 1 -- 10.20.193.106:0/3058249829 shutdown_connections 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 1 -- 10.20.193.106:0/3058249829 >> 10.20.193.106:0/3058249829 conn(0x7f94f4054400 msgr2=0x7f94f4054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:57.491 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 1 -- 10.20.193.106:0/3058249829 shutdown_connections 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.479+0000 7f94fb05b640 1 -- 10.20.193.106:0/3058249829 wait complete. 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient: build_initial_monmap 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient: monmap: 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:epoch 0 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:last_changed 0.000000 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:created 0.000000 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 1 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 1 Processor -- start 2026-02-17T05:27:57.492 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 1 -- start start 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient: init 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient: _reopen_session rank -1 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-b con 0x7f94f4141b30 addr v1:10.20.193.118:6789/0 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-c con 0x7f94f4142610 addr v1:10.20.193.106:6790/0 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient(hunting): picked mon.noname-a con 0x7f94f4184780 addr v1:10.20.193.106:6789/0 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f412b900 con 0x7f94f4184780 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f419fc40 con 0x7f94f4141b30 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f41a6030 con 0x7f94f4142610 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient(hunting): _renew_subs 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94fb05b640 10 monclient(hunting): authenticate will time out at 606.109730s 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94ebfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f94f4142610 0x7f94f418da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35452/0 (socket says 10.20.193.106:35452) 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94ebfff640 1 -- 10.20.193.106:0/2499693543 learned_addr learned my addr 10.20.193.106:0/2499693543 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226505309 0 0) 0x7f94f412b900 con 0x7f94f4184780 2026-02-17T05:27:57.493 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): my global_id is 4176 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c40035e0 con 0x7f94f4184780 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211817235 0 0) 0x7f94f41a6030 con 0x7f94f4142610 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 10 monclient(hunting): my global_id is 4178 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.480+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f412b900 con 0x7f94f4142610 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1605337562 0 0) 0x7f94f412b900 con 0x7f94f4142610 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94f41a6030 con 0x7f94f4142610 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f94dc0030e0 con 0x7f94f4142610 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:27:57.494 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): dump: 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2886900419 0 0) 0x7f94c40035e0 con 0x7f94f4184780 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94f412b900 con 0x7f94f4184780 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f94f0003da0 con 0x7f94f4184780 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:27:57.495 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient(hunting): dump: 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1342449893 0 0) 0x7f94f41a6030 con 0x7f94f4142610 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 >> v1:10.20.193.118:6789/0 conn(0x7f94f4141b30 legacy=0x7f94f418d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 >> v1:10.20.193.106:6789/0 conn(0x7f94f4184780 legacy=0x7f94f4184070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: _finish_hunting 0 2026-02-17T05:27:57.496 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 monclient: found mon.c 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f418e120 con 0x7f94f4142610 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: _finish_auth 0 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: _check_auth_tickets 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 5 monclient: authenticate success, global_id 4178 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _renew_subs 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f94f41a4290 con 0x7f94f4142610 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _renew_subs 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f94f41a5e00 con 0x7f94f4142610 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94dc003450 con 0x7f94f4142610 2026-02-17T05:27:57.497 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f94dc003b30 con 0x7f94f4142610 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94eaffd640 4 set_mon_vals no callback set 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 10 monclient: dump: 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:27:57.498 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f94dc0040e0 con 0x7f94f4142610 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3001305545 0 0) 0x7f94dc006cc0 con 0x7f94f4142610 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.481+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f4055410 con 0x7f94f4142610 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.482+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f94dc0066d0 con 0x7f94f4142610 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.482+0000 7f94e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:27:57.499 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.482+0000 7f94e97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:27:57.499 INFO:tasks.ceph.osd.1.trial106.stderr:2026-02-17T05:27:57.493+0000 7f26aa030780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.512+0000 7f94fb05b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.512+0000 7f94fb05b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.512+0000 7f94fb05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.512+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94f408fc00 con 0x7f94f4142610 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94e97fa640 1 -- 10.20.193.106:0/2499693543 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 2876941366) 0x7f94dc0068f0 con 0x7f94f4142610 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94e97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:27:57.515 INFO:teuthology.misc.health.trial106.stdout: 2026-02-17T05:27:57.516 INFO:teuthology.misc.health.trial106.stdout:{"epoch":8,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:27:56.679957+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:27:57.516 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94fb05b640 10 monclient: shutdown 2026-02-17T05:27:57.516 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94fb05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:27:57.516 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.513+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 >> v1:10.20.193.106:6790/0 conn(0x7f94f4142610 legacy=0x7f94f418da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:27:57.517 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.514+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 shutdown_connections 2026-02-17T05:27:57.517 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.514+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 >> 10.20.193.106:0/2499693543 conn(0x7f94f4054400 msgr2=0x7f94f408b520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:27:57.517 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.514+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 shutdown_connections 2026-02-17T05:27:57.517 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:27:57.514+0000 7f94fb05b640 1 -- 10.20.193.106:0/2499693543 wait complete. 2026-02-17T05:27:57.522 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-17T05:27:57.608 INFO:tasks.ceph.osd.4.trial118.stderr:2026-02-17T05:27:57.605+0000 7f6b5bc41780 -1 osd.4 0 log_to_monitors true 2026-02-17T05:27:57.639 INFO:tasks.ceph.osd.3.trial118.stderr:2026-02-17T05:27:57.636+0000 7f4fdea23780 -1 osd.3 0 log_to_monitors true 2026-02-17T05:27:57.639 INFO:tasks.ceph.osd.5.trial118.stderr:2026-02-17T05:27:57.636+0000 7fa366835780 -1 osd.5 0 log_to_monitors true 2026-02-17T05:27:58.684 INFO:tasks.ceph.osd.2.trial106.stderr:2026-02-17T05:27:58.682+0000 7f4fb47f7640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T05:27:58.684 INFO:tasks.ceph.osd.0.trial106.stderr:2026-02-17T05:27:58.682+0000 7f03f39f7640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T05:27:58.684 INFO:tasks.ceph.osd.1.trial106.stderr:2026-02-17T05:27:58.682+0000 7f26a4ff7640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T05:27:58.685 INFO:tasks.ceph.osd.4.trial118.stderr:2026-02-17T05:27:58.682+0000 7f6b56ff7640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T05:27:58.685 INFO:tasks.ceph.osd.3.trial118.stderr:2026-02-17T05:27:58.682+0000 7f4fd9df7640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T05:27:58.685 INFO:tasks.ceph.osd.5.trial118.stderr:2026-02-17T05:27:58.682+0000 7fa361ff8640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T05:27:58.686 INFO:tasks.ceph.osd.2.trial106.stderr:2026-02-17T05:27:58.684+0000 7f4fac7e7640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.686 INFO:tasks.ceph.osd.0.trial106.stderr:2026-02-17T05:27:58.684+0000 7f03eb9e7640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.686 INFO:tasks.ceph.osd.1.trial106.stderr:2026-02-17T05:27:58.685+0000 7f269cfe7640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.687 INFO:tasks.ceph.osd.4.trial118.stderr:2026-02-17T05:27:58.684+0000 7f6b4efe7640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.687 INFO:tasks.ceph.osd.3.trial118.stderr:2026-02-17T05:27:58.684+0000 7f4fd1de7640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.687 INFO:tasks.ceph.osd.5.trial118.stderr:2026-02-17T05:27:58.685+0000 7fa35d7ef640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:27:58.717 INFO:tasks.ceph.mgr.x.trial118.stderr:2026-02-17T05:27:58.714+0000 7efcefcb1640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T05:27:58.717 INFO:tasks.ceph.mgr.x.trial118.stderr:2026-02-17T05:27:58.714+0000 7efcefcb1640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T05:28:04.126 DEBUG:teuthology.orchestra.run.trial106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 10 monclient: monmap: 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:epoch 0 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.192 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:28:04.183864+0000 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:28:04.183864+0000 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 1 Processor -- start 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 1 -- start start 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.183+0000 7f3950ccc640 10 monclient: init 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.193 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f394c05d370 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f394c05dfa0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f394c08af90 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c08c910 con 0x7f394c05d370 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c08ace0 con 0x7f394c05dfa0 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c057710 con 0x7f394c08af90 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient(hunting): authenticate will time out at 612.812224s 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f394a575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f394c05d370 0x7f394c05d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:35942/0 (socket says 10.20.193.106:35942) 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f394ad76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f394c08af90 0x7f394c1a2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35904/0 (socket says 10.20.193.106:35904) 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f394a575640 1 -- 10.20.193.106:0/4000529511 learned_addr learned my addr 10.20.193.106:0/4000529511 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.194 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183648358 0 0) 0x7f394c057710 con 0x7f394c08af90 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): my global_id is 4214 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39380035e0 con 0x7f394c08af90 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192483655 0 0) 0x7f3940002810 con 0x7f394c05d370 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient(hunting): my global_id is 4218 2026-02-17T05:28:04.195 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c057710 con 0x7f394c05d370 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762350365 0 0) 0x7f39380035e0 con 0x7f394c08af90 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 >> v1:10.20.193.118:6789/0 conn(0x7f394c05dfa0 legacy=0x7f394c180e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 >> v1:10.20.193.106:6789/0 conn(0x7f394c05d370 legacy=0x7f394c05d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 monclient: found mon.noname-b 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c08a2f0 con 0x7f394c08af90 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.196 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f393c003eb0 con 0x7f394c08af90 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: dump: 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.197 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 5 monclient: authenticate success, global_id 4214 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f393c004170 con 0x7f394c08af90 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 1 -- 10.20.193.106:0/4000529511 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f393c004580 con 0x7f394c08af90 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3949573640 10 monclient: dump: 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.198 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.184+0000 7f3950ccc640 4 set_mon_vals no callback set 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: shutdown 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- 10.20.193.106:0/4000529511 >> v1:10.20.193.106:6790/0 conn(0x7f394c08af90 legacy=0x7f394c1a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.199 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- 10.20.193.106:0/4000529511 shutdown_connections 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- 10.20.193.106:0/4000529511 >> 10.20.193.106:0/4000529511 conn(0x7f394c090df0 msgr2=0x7f394c0911f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- 10.20.193.106:0/4000529511 shutdown_connections 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- 10.20.193.106:0/4000529511 wait complete. 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: monmap: 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:epoch 0 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:created 0.000000 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 1 2026-02-17T05:28:04.200 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 Processor -- start 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- start start 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: init 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f394c05d370 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f394c05dfa0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f394c08af90 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c1311c0 con 0x7f394c05d370 2026-02-17T05:28:04.201 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c05acb0 con 0x7f394c08af90 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c05b200 con 0x7f394c05dfa0 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f3950ccc640 10 monclient(hunting): authenticate will time out at 612.813932s 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f394a575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f394c05d370 0x7f394c11a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:35958/0 (socket says 10.20.193.106:35958) 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.185+0000 7f394a575640 1 -- 10.20.193.106:0/3813531292 learned_addr learned my addr 10.20.193.106:0/3813531292 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642858634 0 0) 0x7f394c1311c0 con 0x7f394c05d370 2026-02-17T05:28:04.202 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): my global_id is 4221 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39180035e0 con 0x7f394c05d370 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350826057 0 0) 0x7f394c05b200 con 0x7f394c05dfa0 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): my global_id is 4217 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c1311c0 con 0x7f394c05dfa0 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 482517320 0 0) 0x7f39180035e0 con 0x7f394c05d370 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f394c05b200 con 0x7f394c05d370 2026-02-17T05:28:04.203 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3940003150 con 0x7f394c05d370 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.204 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3032396791 0 0) 0x7f394c1311c0 con 0x7f394c05dfa0 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f39180035e0 con 0x7f394c05dfa0 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3934003040 con 0x7f394c05dfa0 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.205 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3310168283 0 0) 0x7f394c05b200 con 0x7f394c05d370 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 >> v1:10.20.193.106:6790/0 conn(0x7f394c05dfa0 legacy=0x7f394c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 >> v1:10.20.193.118:6789/0 conn(0x7f394c08af90 legacy=0x7f394c19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 monclient: found mon.a 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.206 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c130c00 con 0x7f394c05d370 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 5 monclient: authenticate success, global_id 4221 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _renew_subs 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f394c130ee0 con 0x7f394c05d370 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _renew_subs 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f394c130920 con 0x7f394c05d370 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3940002860 con 0x7f394c05d370 2026-02-17T05:28:04.207 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3940004a50 con 0x7f394c05d370 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 10 monclient: dump: 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:epoch 1 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.208 INFO:teuthology.misc.health.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr: 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3948d72640 4 set_mon_vals no callback set 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c0008d0 con 0x7f394c05d370 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.186+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3940004bb0 con 0x7f394c05d370 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.187+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 307297866 0 0) 0x7f394004f8c0 con 0x7f394c05d370 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.187+0000 7f3949d74640 10 monclient: get_auth_request con 0x7f3918040be0 auth_method 0 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.189+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f3940017240 con 0x7f394c05d370 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.190+0000 7f3932ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.209 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.190+0000 7f3932ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:04.293 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.291+0000 7f3950ccc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:04.293 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.291+0000 7f3950ccc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:04.293 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.291+0000 7f3950ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.293 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.291+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f394c08c910 con 0x7f394c05d370 2026-02-17T05:28:04.294 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.292+0000 7f3932ffd640 1 -- 10.20.193.106:0/3813531292 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9072 (unknown 92231148 0 3625059064) 0x7f394c08c910 con 0x7f394c05d370 2026-02-17T05:28:04.294 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.292+0000 7f3932ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:04.294 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.292+0000 7f3932ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:04.294 INFO:teuthology.misc.health.trial106.stdout: 2026-02-17T05:28:04.294 INFO:teuthology.misc.health.trial106.stdout:{"epoch":14,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:28:02.719654+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:28:04.295 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 >> v1:10.20.193.118:6812/703720803 conn(0x7f3918040be0 legacy=0x7f3918061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.295 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 10 monclient: shutdown 2026-02-17T05:28:04.295 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:04.296 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 >> v1:10.20.193.106:6789/0 conn(0x7f394c05d370 legacy=0x7f394c11a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.296 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 shutdown_connections 2026-02-17T05:28:04.296 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 >> 10.20.193.106:0/3813531292 conn(0x7f394c090df0 msgr2=0x7f394c05b430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:04.296 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 shutdown_connections 2026-02-17T05:28:04.296 INFO:teuthology.misc.health.trial106.stderr:2026-02-17T05:28:04.293+0000 7f3950ccc640 1 -- 10.20.193.106:0/3813531292 wait complete. 2026-02-17T05:28:04.300 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-17T05:28:04.301 INFO:tasks.ceph:Creating RBD pool 2026-02-17T05:28:04.301 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.365+0000 7f9a7445b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.365+0000 7f9a7445b640 10 monclient: build_initial_monmap 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.365+0000 7f9a7445b640 10 monclient: monmap: 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:04.366282+0000 2026-02-17T05:28:04.367 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:04.366282+0000 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:04.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 1 Processor -- start 2026-02-17T05:28:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 1 -- start start 2026-02-17T05:28:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient: init 2026-02-17T05:28:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-b con 0x7f9a6c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-c con 0x7f9a6c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-a con 0x7f9a6c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c08b060 con 0x7f9a6c182720 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c05dc90 con 0x7f9a6c05dee0 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c08d6a0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.366+0000 7f9a7445b640 10 monclient(hunting): authenticate will time out at 612.994981s 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a721d0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9a6c05d1b0 0x7f9a6c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35922/0 (socket says 10.20.193.106:35922) 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a721d0640 1 -- 10.20.193.106:0/4211433101 learned_addr learned my addr 10.20.193.106:0/4211433101 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671323427 0 0) 0x7f9a6c08d6a0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): my global_id is 4220 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a540035e0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129283855 0 0) 0x7f9a6c08b060 con 0x7f9a6c182720 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient(hunting): my global_id is 4224 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a6c08d6a0 con 0x7f9a6c182720 2026-02-17T05:28:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 462416672 0 0) 0x7f9a540035e0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 >> v1:10.20.193.118:6789/0 conn(0x7f9a6c05dee0 legacy=0x7f9a6c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 >> v1:10.20.193.106:6789/0 conn(0x7f9a6c182720 legacy=0x7f9a6c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 monclient: found mon.noname-b 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c057960 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9a5c002dd0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: dump: 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 5 monclient: authenticate success, global_id 4220 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a5c002fa0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 1 -- 10.20.193.106:0/4211433101 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9a5c0033b0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 4 set_mon_vals no callback set 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a711ce640 10 monclient: dump: 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.381 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.382 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 10 monclient: shutdown 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 1 -- 10.20.193.106:0/4211433101 >> v1:10.20.193.106:6790/0 conn(0x7f9a6c05d1b0 legacy=0x7f9a6c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 1 -- 10.20.193.106:0/4211433101 shutdown_connections 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 1 -- 10.20.193.106:0/4211433101 >> 10.20.193.106:0/4211433101 conn(0x7f9a6c0915f0 msgr2=0x7f9a6c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 1 -- 10.20.193.106:0/4211433101 shutdown_connections 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.367+0000 7f9a7445b640 1 -- 10.20.193.106:0/4211433101 wait complete. 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient: build_initial_monmap 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient: monmap: 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:04.383 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 1 Processor -- start 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 1 -- start start 2026-02-17T05:28:04.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient: init 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-b con 0x7f9a6c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-c con 0x7f9a6c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient(hunting): picked mon.noname-a con 0x7f9a6c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c05e950 con 0x7f9a6c182720 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c10cac0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c12bfe0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a7445b640 10 monclient(hunting): authenticate will time out at 612.996873s 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a729d1640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9a6c182720 0x7f9a6c181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:35964/0 (socket says 10.20.193.106:35964) 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.368+0000 7f9a729d1640 1 -- 10.20.193.106:0/1969493655 learned_addr learned my addr 10.20.193.106:0/1969493655 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075708254 0 0) 0x7f9a68003ad0 con 0x7f9a6c182720 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): my global_id is 4227 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c0035e0 con 0x7f9a6c182720 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495210642 0 0) 0x7f9a6c12bfe0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): my global_id is 4223 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a68003ad0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3342533960 0 0) 0x7f9a3c0035e0 con 0x7f9a6c182720 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a6c12bfe0 con 0x7f9a6c182720 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9a68004670 con 0x7f9a6c182720 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.387 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1493999108 0 0) 0x7f9a68003ad0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a3c0035e0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9a60002fc0 con 0x7f9a6c05dee0 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.388 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523959524 0 0) 0x7f9a6c10cac0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient(hunting): my global_id is 4231 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a68003ad0 con 0x7f9a6c05d1b0 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1392387033 0 0) 0x7f9a6c12bfe0 con 0x7f9a6c182720 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 >> v1:10.20.193.106:6790/0 conn(0x7f9a6c05dee0 legacy=0x7f9a6c12b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 >> v1:10.20.193.118:6789/0 conn(0x7f9a6c05d1b0 legacy=0x7f9a6c12b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 monclient: found mon.a 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c10bc50 con 0x7f9a6c182720 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 5 monclient: authenticate success, global_id 4227 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _renew_subs 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c10a760 con 0x7f9a6c182720 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _renew_subs 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a6c10b2c0 con 0x7f9a6c182720 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a68003cd0 con 0x7f9a6c182720 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9a68004ca0 con 0x7f9a6c182720 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a709cd640 4 set_mon_vals no callback set 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 10 monclient: dump: 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.392 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c10c620 con 0x7f9a6c182720 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.369+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9a68013070 con 0x7f9a6c182720 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.370+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 307297866 0 0) 0x7f9a68050b60 con 0x7f9a6c182720 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.370+0000 7f9a721d0640 10 monclient: get_auth_request con 0x7f9a3c040d70 auth_method 0 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.372+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9a680184e0 con 0x7f9a6c182720 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.372+0000 7f9a52ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:04.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.372+0000 7f9a52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:04.476 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.475+0000 7f9a7445b640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T05:28:04.476 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.475+0000 7f9a7445b640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T05:28:04.476 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.475+0000 7f9a7445b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.476 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.475+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f9a6c05e950 con 0x7f9a6c182720 2026-02-17T05:28:04.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.729+0000 7f9a52ffd640 1 -- 10.20.193.106:0/1969493655 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (unknown 1237045831 0 0) 0x7f9a6c05e950 con 0x7f9a6c182720 2026-02-17T05:28:04.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.729+0000 7f9a52ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T05:28:04.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.729+0000 7f9a52ffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T05:28:04.730 INFO:teuthology.orchestra.run.trial106.stderr:pool 'rbd' created 2026-02-17T05:28:04.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 >> v1:10.20.193.118:6812/703720803 conn(0x7f9a3c040d70 legacy=0x7f9a3c061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 10 monclient: shutdown 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 >> v1:10.20.193.106:6789/0 conn(0x7f9a6c182720 legacy=0x7f9a6c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 shutdown_connections 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.731+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 >> 10.20.193.106:0/1969493655 conn(0x7f9a6c0915f0 msgr2=0x7f9a6c054bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.732+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 shutdown_connections 2026-02-17T05:28:04.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.732+0000 7f9a7445b640 1 -- 10.20.193.106:0/1969493655 wait complete. 2026-02-17T05:28:04.741 DEBUG:teuthology.orchestra.run.trial106:> rbd --cluster ceph pool init rbd 2026-02-17T05:28:04.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: get_monmap_and_config 2026-02-17T05:28:04.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: build_initial_monmap 2026-02-17T05:28:04.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: monmap: 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:04.774474+0000 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:04.774474+0000 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 1 Processor -- start 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 1 -- start start 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: init 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-b con 0x2556df0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-c con 0x25571c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-a con 0x264c950 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x23a6920 con 0x264c950 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x23d0ac0 con 0x25571c0 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x23ba490 con 0x2556df0 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.774+0000 7f0a63f4f240 10 monclient(hunting): authenticate will time out at 613.402960s 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a62a07640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x2556df0 0x2557a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35932/0 (socket says 10.20.193.106:35932) 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a62a07640 1 -- 10.20.193.106:0/999708689 learned_addr learned my addr 10.20.193.106:0/999708689 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000764638 0 0) 0x23a6920 con 0x264c950 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): my global_id is 4230 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a50001e10 con 0x264c950 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991782923 0 0) 0x23ba490 con 0x2556df0 2026-02-17T05:28:04.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient(hunting): my global_id is 4226 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x23a6920 con 0x2556df0 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1939248180 0 0) 0x7f0a50001e10 con 0x264c950 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 >> v1:10.20.193.106:6790/0 conn(0x2556df0 legacy=0x2557a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 >> v1:10.20.193.118:6789/0 conn(0x25571c0 legacy=0x2558170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 monclient: found mon.noname-a 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:04.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x23b4b50 con 0x264c950 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0a54002b60 con 0x264c950 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 5 monclient: authenticate success, global_id 4230 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: dump: 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.788 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a54002e20 con 0x264c950 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 1 -- 10.20.193.106:0/999708689 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0a54003230 con 0x264c950 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a61a05640 10 monclient: dump: 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.790 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 10 monclient: get_monmap_and_config success 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 4 set_mon_vals no callback set 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 10 monclient: shutdown 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 1 -- 10.20.193.106:0/999708689 >> v1:10.20.193.106:6789/0 conn(0x264c950 legacy=0x266cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 1 -- 10.20.193.106:0/999708689 shutdown_connections 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 1 -- 10.20.193.106:0/999708689 >> 10.20.193.106:0/999708689 conn(0x2537890 msgr2=0x255d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 1 -- 10.20.193.106:0/999708689 shutdown_connections 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.775+0000 7f0a63f4f240 1 -- 10.20.193.106:0/999708689 wait complete. 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient: build_initial_monmap 2026-02-17T05:28:04.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient: monmap: 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 1 Processor -- start 2026-02-17T05:28:04.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 1 -- start start 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient: init 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient: _reopen_session rank -1 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-c con 0x2556df0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-a con 0x25571c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient(hunting): picked mon.noname-b con 0x264c950 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x23a6c50 con 0x25571c0 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x23ba6f0 con 0x264c950 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x25d7210 con 0x2556df0 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient(hunting): _renew_subs 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a63f4f240 10 monclient(hunting): authenticate will time out at 613.404833s 2026-02-17T05:28:04.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a62206640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x25571c0 0x263a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:35990/0 (socket says 10.20.193.106:35990) 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.776+0000 7f0a62206640 1 -- 10.20.193.106:0/682952145 learned_addr learned my addr 10.20.193.106:0/682952145 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143979631 0 0) 0x23a6c50 con 0x25571c0 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): my global_id is 4233 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a44001e10 con 0x25571c0 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739591879 0 0) 0x25d7210 con 0x2556df0 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): my global_id is 4229 2026-02-17T05:28:04.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x23a6c50 con 0x2556df0 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2868065102 0 0) 0x23a6c50 con 0x2556df0 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x25d7210 con 0x2556df0 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0a580017f0 con 0x2556df0 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.795 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1171196236 0 0) 0x7f0a44001e10 con 0x25571c0 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x23a6c50 con 0x25571c0 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0a4c0019a0 con 0x25571c0 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient(hunting): dump: 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.796 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 628982205 0 0) 0x25d7210 con 0x2556df0 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 >> v1:10.20.193.118:6789/0 conn(0x264c950 legacy=0x263b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 >> v1:10.20.193.106:6789/0 conn(0x25571c0 legacy=0x263a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 monclient: found mon.c 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:04.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x25541d0 con 0x2556df0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: _finish_auth 0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 5 monclient: authenticate success, global_id 4229 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 10 monclient: _renew_subs 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x25d5350 con 0x2556df0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 10 monclient: _renew_subs 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x25d6f30 con 0x2556df0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a58001d10 con 0x2556df0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0a58003280 con 0x2556df0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:04.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 10 monclient: dump: 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a61204640 4 set_mon_vals no callback set 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.777+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f0a580033e0 con 0x2556df0 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3492+0+0 (unknown 1267803188 0 0) 0x7f0a5804e2f0 con 0x2556df0 2026-02-17T05:28:04.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a63f4f240 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T05:28:04.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a63f4f240 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T05:28:04.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a63f4f240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:04.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x25d49b0 con 0x2556df0 2026-02-17T05:28:04.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:04.778+0000 7f0a62206640 10 monclient: get_auth_request con 0x7f0a4403f420 auth_method 0 2026-02-17T05:28:05.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.733+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (unknown 2855932958 0 0) 0x7f0a58003c20 con 0x2556df0 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.733+0000 7f0a4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.733+0000 7f0a4affd640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.733+0000 7f0a63f4f240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.733+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x23aa320 con 0x2556df0 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (unknown 3847591702 0 0) 0x7f0a580164c0 con 0x2556df0 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a4affd640 10 monclient: handle_get_version_reply finishing 1 version 16 2026-02-17T05:28:05.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a61204640 10 monclient: _renew_subs 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a61204640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a61204640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=16}) -- 0x7f0a3c002ae0 con 0x2556df0 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 11 ==== osd_map(16..16 src has 1..16) ==== 661+0+0 (unknown 2637319944 0 0) 0x7f0a58015da0 con 0x2556df0 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.118:6804/2938654647 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x263f080 con 0x263d570 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.734+0000 7f0a63c90640 10 monclient: get_auth_request con 0x263d570 auth_method 0 2026-02-17T05:28:05.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.736+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 <== osd.5 v1:10.20.193.118:6804/2938654647 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 2685446591 0 0) 0x7f0a54002ad0 con 0x263d570 2026-02-17T05:28:05.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.118:6804/2938654647 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x26daa60 con 0x263d570 2026-02-17T05:28:05.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 <== osd.5 v1:10.20.193.118:6804/2938654647 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2026326479 0 0) 0x7f0a54002ad0 con 0x263d570 2026-02-17T05:28:05.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.118:6804/2938654647 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x26d9b70 con 0x263d570 2026-02-17T05:28:05.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 <== osd.5 v1:10.20.193.118:6804/2938654647 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2039985091 0 0) 0x7f0a54002ad0 con 0x263d570 2026-02-17T05:28:05.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a60a03640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:05.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:05.737+0000 7f0a60a03640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f0a40001f40 con 0x2556df0 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 12 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (unknown 3419445252 0 0) 0x7f0a58015320 con 0x2556df0 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a4affd640 10 monclient: _renew_subs 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a4affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=17}) -- 0x25d7210 con 0x2556df0 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 13 ==== osd_map(17..17 src has 1..17) ==== 629+0+0 (unknown 2472517693 0 0) 0x7f0a5801b6c0 con 0x2556df0 2026-02-17T05:28:06.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.734+0000 7f0a61204640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.118:6804/2938654647 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f0a3c005830 con 0x263d570 2026-02-17T05:28:06.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.736+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 <== osd.5 v1:10.20.193.118:6804/2938654647 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3115756469 0 0) 0x7f0a54002ad0 con 0x263d570 2026-02-17T05:28:06.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.736+0000 7f0a60a03640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:06.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:06.736+0000 7f0a60a03640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f0a40003370 con 0x2556df0 2026-02-17T05:28:07.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 14 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (unknown 3905612253 0 0) 0x7f0a58015500 con 0x2556df0 2026-02-17T05:28:07.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a4affd640 10 monclient: _renew_subs 2026-02-17T05:28:07.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a4affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=18}) -- 0x7f0a44001e10 con 0x2556df0 2026-02-17T05:28:07.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a4affd640 1 -- 10.20.193.106:0/682952145 <== mon.2 v1:10.20.193.106:6790/0 15 ==== osd_map(18..18 src has 1..18) ==== 657+0+0 (unknown 4170457089 0 0) 0x7f0a5801dca0 con 0x2556df0 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.738+0000 7f0a61204640 1 -- 10.20.193.106:0/682952145 --> v1:10.20.193.118:6804/2938654647 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f0a3c005bd0 con 0x263d570 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 <== osd.5 v1:10.20.193.118:6804/2938654647 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 4030416863 0 0) 0x7f0a54002ad0 con 0x263d570 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 >> v1:10.20.193.118:6804/2938654647 conn(0x263d570 legacy=0x263d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 >> v1:10.20.193.118:6812/703720803 conn(0x7f0a4403f420 legacy=0x7f0a4405f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 10 monclient: shutdown 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 >> v1:10.20.193.106:6790/0 conn(0x2556df0 legacy=0x25ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63c90640 1 -- 10.20.193.106:0/682952145 reap_dead start 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 shutdown_connections 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 >> 10.20.193.106:0/682952145 conn(0x2537890 msgr2=0x25ebb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 shutdown_connections 2026-02-17T05:28:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.740+0000 7f0a63f4f240 1 -- 10.20.193.106:0/682952145 wait complete. 2026-02-17T05:28:07.744 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T05:28:07.744 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-17T05:28:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.849+0000 7f42efccc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.849+0000 7f42efccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.849+0000 7f42efccc640 10 monclient: monmap: 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:07.850296+0000 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:07.850296+0000 2026-02-17T05:28:07.851 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:07.852 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.852 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:07.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:07.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 1 Processor -- start 2026-02-17T05:28:07.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 1 -- start start 2026-02-17T05:28:07.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient: init 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-c con 0x7f42e813ec40 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-b con 0x7f42e813f010 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-a con 0x7f42e81811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e808a7d0 con 0x7f42e81811f0 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e808d5c0 con 0x7f42e813ec40 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e808d800 con 0x7f42e813f010 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42efccc640 10 monclient(hunting): authenticate will time out at 616.478876s 2026-02-17T05:28:07.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42ed240640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f42e813f010 0x7f42e813f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35950/0 (socket says 10.20.193.106:35950) 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.850+0000 7f42ed240640 1 -- 10.20.193.106:0/1063519604 learned_addr learned my addr 10.20.193.106:0/1063519604 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022763435 0 0) 0x7f42e808d800 con 0x7f42e813f010 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): my global_id is 4232 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42d00035e0 con 0x7f42e813f010 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237647702 0 0) 0x7f42e808a7d0 con 0x7f42e81811f0 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:07.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient(hunting): my global_id is 4236 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e808d800 con 0x7f42e81811f0 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 497165827 0 0) 0x7f42d00035e0 con 0x7f42e813f010 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 >> v1:10.20.193.118:6789/0 conn(0x7f42e813ec40 legacy=0x7f42e808ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 >> v1:10.20.193.106:6789/0 conn(0x7f42e81811f0 legacy=0x7f42e81a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: _finish_hunting 0 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 monclient: found mon.noname-b 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e808a180 con 0x7f42e813f010 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: _finish_auth 0 2026-02-17T05:28:07.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: _check_auth_tickets 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f42dc002dd0 con 0x7f42e813f010 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 5 monclient: authenticate success, global_id 4232 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: dump: 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.864 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42dc003090 con 0x7f42e813f010 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 1 -- 10.20.193.106:0/1063519604 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f42dc0034a0 con 0x7f42e813f010 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:07.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42eca3f640 10 monclient: dump: 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 4 set_mon_vals no callback set 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 10 monclient: shutdown 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 1 -- 10.20.193.106:0/1063519604 >> v1:10.20.193.106:6790/0 conn(0x7f42e813f010 legacy=0x7f42e813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 1 -- 10.20.193.106:0/1063519604 shutdown_connections 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 1 -- 10.20.193.106:0/1063519604 >> 10.20.193.106:0/1063519604 conn(0x7f42e80915f0 msgr2=0x7f42e80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 1 -- 10.20.193.106:0/1063519604 shutdown_connections 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.851+0000 7f42efccc640 1 -- 10.20.193.106:0/1063519604 wait complete. 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient: monmap: 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:07.867 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 1 Processor -- start 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 1 -- start start 2026-02-17T05:28:07.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient: init 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-a con 0x7f42e813ec40 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-c con 0x7f42e813f010 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient(hunting): picked mon.noname-b con 0x7f42e81811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e81a0b00 con 0x7f42e813ec40 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e8059210 con 0x7f42e81811f0 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e81a27c0 con 0x7f42e813f010 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42efccc640 10 monclient(hunting): authenticate will time out at 616.480924s 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42ed240640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f42e813f010 0x7f42e8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35962/0 (socket says 10.20.193.106:35962) 2026-02-17T05:28:07.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.852+0000 7f42ed240640 1 -- 10.20.193.106:0/3762212887 learned_addr learned my addr 10.20.193.106:0/3762212887 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870266722 0 0) 0x7f42e81a27c0 con 0x7f42e813f010 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): my global_id is 4235 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b80035e0 con 0x7f42e813f010 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803922777 0 0) 0x7f42e81a0b00 con 0x7f42e813ec40 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): my global_id is 4239 2026-02-17T05:28:07.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e81a27c0 con 0x7f42e813ec40 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2912663066 0 0) 0x7f42b80035e0 con 0x7f42e813f010 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42e81a0b00 con 0x7f42e813f010 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f42dc0033b0 con 0x7f42e813f010 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): dump: 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:07.871 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1968145298 0 0) 0x7f42e81a27c0 con 0x7f42e813ec40 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42b80035e0 con 0x7f42e813ec40 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f42d8002ff0 con 0x7f42e813ec40 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): dump: 2026-02-17T05:28:07.872 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925685440 0 0) 0x7f42e8059210 con 0x7f42e81811f0 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:07.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient(hunting): my global_id is 4243 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e81a27c0 con 0x7f42e81811f0 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1359100431 0 0) 0x7f42e81a0b00 con 0x7f42e813f010 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 >> v1:10.20.193.118:6789/0 conn(0x7f42e81811f0 legacy=0x7f42e818e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 >> v1:10.20.193.106:6789/0 conn(0x7f42e813ec40 legacy=0x7f42e80577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 monclient: found mon.c 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e81a0540 con 0x7f42e813f010 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 5 monclient: authenticate success, global_id 4235 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _renew_subs 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42e81a0820 con 0x7f42e813f010 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _renew_subs 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f42e813caf0 con 0x7f42e813f010 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42dc0028c0 con 0x7f42e813f010 2026-02-17T05:28:07.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f42dc004e60 con 0x7f42e813f010 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d67fc640 10 monclient: dump: 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:07.876 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42d7fff640 4 set_mon_vals no callback set 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.853+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e805e8e0 con 0x7f42e813f010 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.854+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f42dc011e00 con 0x7f42e813f010 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.854+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f42dc04fd70 con 0x7f42e813f010 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.854+0000 7f42eda41640 10 monclient: get_auth_request con 0x7f42b8040dd0 auth_method 0 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.856+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f42dc0175b0 con 0x7f42e813f010 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.856+0000 7f42d67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:07.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.856+0000 7f42d67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:07.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.958+0000 7f42efccc640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-17T05:28:07.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.958+0000 7f42efccc640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-17T05:28:07.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.958+0000 7f42efccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:07.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.958+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f42e81a29c0 con 0x7f42e813f010 2026-02-17T05:28:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.959+0000 7f42d67fc640 1 -- 10.20.193.106:0/3762212887 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f42dc016d60 con 0x7f42e813f010 2026-02-17T05:28:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.959+0000 7f42d67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-17T05:28:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.959+0000 7f42d67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:07.961 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 >> v1:10.20.193.118:6812/703720803 conn(0x7f42b8040dd0 legacy=0x7f42b8061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 10 monclient: shutdown 2026-02-17T05:28:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 >> v1:10.20.193.106:6790/0 conn(0x7f42e813f010 legacy=0x7f42e8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 shutdown_connections 2026-02-17T05:28:07.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 >> 10.20.193.106:0/3762212887 conn(0x7f42e80915f0 msgr2=0x7f42e805cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:07.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 shutdown_connections 2026-02-17T05:28:07.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:07.960+0000 7f42efccc640 1 -- 10.20.193.106:0/3762212887 wait complete. 2026-02-17T05:28:07.969 INFO:teuthology.orchestra.run.trial106.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-17T05:28:07.969 INFO:tasks.ceph_manager:config epoch is 1 2026-02-17T05:28:07.969 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T05:28:07.970 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T05:28:07.970 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T05:28:08.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: monmap: 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.035558+0000 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.035558+0000 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 1 Processor -- start 2026-02-17T05:28:08.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 1 -- start start 2026-02-17T05:28:08.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: init 2026-02-17T05:28:08.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-a con 0x7f271005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-b con 0x7f271005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-c con 0x7f2710182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271008b060 con 0x7f271005d1b0 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271005dc90 con 0x7f2710182720 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271008d6a0 con 0x7f271005dee0 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.035+0000 7f2715f4c640 10 monclient(hunting): authenticate will time out at 616.663965s 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270f7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f271005d1b0 0x7f271005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36018/0 (socket says 10.20.193.106:36018) 2026-02-17T05:28:08.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270f7fe640 1 -- 10.20.193.106:0/2821873848 learned_addr learned my addr 10.20.193.106:0/2821873848 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625060088 0 0) 0x7f271008d6a0 con 0x7f271005dee0 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): my global_id is 4238 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f40035e0 con 0x7f271005dee0 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467120224 0 0) 0x7f271008b060 con 0x7f271005d1b0 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient(hunting): my global_id is 4242 2026-02-17T05:28:08.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f271008d6a0 con 0x7f271005d1b0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3194965530 0 0) 0x7f26f40035e0 con 0x7f271005dee0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 >> v1:10.20.193.118:6789/0 conn(0x7f2710182720 legacy=0x7f27101a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 >> v1:10.20.193.106:6789/0 conn(0x7f271005d1b0 legacy=0x7f271005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2710057960 con 0x7f271005dee0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2700002dd0 con 0x7f271005dee0 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: dump: 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 5 monclient: authenticate success, global_id 4238 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2700002fd0 con 0x7f271005dee0 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 1 -- 10.20.193.106:0/2821873848 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27000033e0 con 0x7f271005dee0 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f270e7fc640 10 monclient: dump: 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 10 monclient: shutdown 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 1 -- 10.20.193.106:0/2821873848 >> v1:10.20.193.106:6790/0 conn(0x7f271005dee0 legacy=0x7f2710181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 1 -- 10.20.193.106:0/2821873848 shutdown_connections 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 1 -- 10.20.193.106:0/2821873848 >> 10.20.193.106:0/2821873848 conn(0x7f27100915f0 msgr2=0x7f27100919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 1 -- 10.20.193.106:0/2821873848 shutdown_connections 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.036+0000 7f2715f4c640 1 -- 10.20.193.106:0/2821873848 wait complete. 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient: monmap: 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.052 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 1 Processor -- start 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 1 -- start start 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient: init 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-c con 0x7f271005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-b con 0x7f271005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient(hunting): picked mon.noname-a con 0x7f2710182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271012c1a0 con 0x7f2710182720 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271005e8e0 con 0x7f271005dee0 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271010be10 con 0x7f271005d1b0 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f2715f4c640 10 monclient(hunting): authenticate will time out at 616.665739s 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f270f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f271005d1b0 0x7f271012b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35992/0 (socket says 10.20.193.106:35992) 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f270f7fe640 1 -- 10.20.193.106:0/47444499 learned_addr learned my addr 10.20.193.106:0/47444499 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165203481 0 0) 0x7f271010be10 con 0x7f271005d1b0 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 10 monclient(hunting): my global_id is 4241 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.037+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e00035e0 con 0x7f271005d1b0 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548826356 0 0) 0x7f271012c1a0 con 0x7f2710182720 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): my global_id is 4245 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f271010be10 con 0x7f2710182720 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3925272829 0 0) 0x7f26e00035e0 con 0x7f271005d1b0 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f271012c1a0 con 0x7f271005d1b0 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235198175 0 0) 0x7f271005e8e0 con 0x7f271005dee0 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): my global_id is 4249 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e00035e0 con 0x7f271005dee0 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f26fc0030f0 con 0x7f271005d1b0 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): dump: 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.056 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1146840068 0 0) 0x7f271010be10 con 0x7f2710182720 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f271005e8e0 con 0x7f2710182720 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27040040d0 con 0x7f2710182720 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient(hunting): dump: 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1789784945 0 0) 0x7f271012c1a0 con 0x7f271005d1b0 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 >> v1:10.20.193.118:6789/0 conn(0x7f271005dee0 legacy=0x7f271012ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 >> v1:10.20.193.106:6789/0 conn(0x7f2710182720 legacy=0x7f2710181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 monclient: found mon.c 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271010a920 con 0x7f271005d1b0 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 5 monclient: authenticate success, global_id 4241 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _renew_subs 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27101824f0 con 0x7f271005d1b0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _renew_subs 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f271010b6b0 con 0x7f271005d1b0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26fc003250 con 0x7f271005d1b0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f26fc004b10 con 0x7f271005d1b0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 10 monclient: dump: 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.060 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f270dffb640 4 set_mon_vals no callback set 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271010c900 con 0x7f271005d1b0 2026-02-17T05:28:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.038+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f26fc011ab0 con 0x7f271005d1b0 2026-02-17T05:28:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.039+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f26fc04fb80 con 0x7f271005d1b0 2026-02-17T05:28:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.039+0000 7f270effd640 10 monclient: get_auth_request con 0x7f26e0040d50 auth_method 0 2026-02-17T05:28:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.041+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f26fc0173c0 con 0x7f271005d1b0 2026-02-17T05:28:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.041+0000 7f26ebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.041+0000 7f26ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.174+0000 7f2715f4c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T05:28:08.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.174+0000 7f2715f4c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T05:28:08.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.174+0000 7f2715f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.174+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2710055570 con 0x7f271005d1b0 2026-02-17T05:28:08.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.175+0000 7f26ebfff640 1 -- 10.20.193.106:0/47444499 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+100144 (unknown 481731318 0 1517460907) 0x7f26fc016b70 con 0x7f271005d1b0 2026-02-17T05:28:08.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.175+0000 7f26ebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T05:28:08.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.175+0000 7f26ebfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.178 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:08.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 >> v1:10.20.193.118:6812/703720803 conn(0x7f26e0040d50 legacy=0x7f26e0061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 10 monclient: shutdown 2026-02-17T05:28:08.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 >> v1:10.20.193.106:6790/0 conn(0x7f271005d1b0 legacy=0x7f271012b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 shutdown_connections 2026-02-17T05:28:08.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 >> 10.20.193.106:0/47444499 conn(0x7f27100915f0 msgr2=0x7f271008b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 shutdown_connections 2026-02-17T05:28:08.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.176+0000 7f2715f4c640 1 -- 10.20.193.106:0/47444499 wait complete. 2026-02-17T05:28:08.185 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6812","nonce":703720803}]},"active_addr":"10.20.193.118:6812/703720803","active_change":"2026-02-17T05:27:57.709322+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.118:0","nonce":2017099344}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.118:0","nonce":4271585471}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.118:0","nonce":867959244}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.118:0","nonce":2678493801}]}]} 2026-02-17T05:28:08.189 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T05:28:08.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T05:28:08.189 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 10 monclient: monmap: 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.255665+0000 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.255665+0000 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.256 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 1 Processor -- start 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 1 -- start start 2026-02-17T05:28:08.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 10 monclient: init 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.255+0000 7fb94950c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-b con 0x7fb94405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-a con 0x7fb94405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-c con 0x7fb944182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94408b060 con 0x7fb94405dee0 2026-02-17T05:28:08.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94405dc90 con 0x7fb944182720 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94408d6a0 con 0x7fb94405d1b0 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient(hunting): authenticate will time out at 616.884134s 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb942ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb94405d1b0 0x7fb94405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36000/0 (socket says 10.20.193.106:36000) 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb942ffd640 1 -- 10.20.193.106:0/3843453941 learned_addr learned my addr 10.20.193.106:0/3843453941 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb9427fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb94405dee0 0x7fb944181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36042/0 (socket says 10.20.193.106:36042) 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036080420 0 0) 0x7fb94408b060 con 0x7fb94405dee0 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): my global_id is 4248 2026-02-17T05:28:08.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9300035e0 con 0x7fb94405dee0 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251057937 0 0) 0x7fb94408d6a0 con 0x7fb94405d1b0 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient(hunting): my global_id is 4244 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb94408b060 con 0x7fb94405d1b0 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 628376476 0 0) 0x7fb9300035e0 con 0x7fb94405dee0 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 >> v1:10.20.193.106:6790/0 conn(0x7fb94405d1b0 legacy=0x7fb94405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 >> v1:10.20.193.118:6789/0 conn(0x7fb944182720 legacy=0x7fb9441a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 monclient: found mon.noname-a 2026-02-17T05:28:08.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb944057960 con 0x7fb94405dee0 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb92c002dd0 con 0x7fb94405dee0 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: dump: 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.267 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 5 monclient: authenticate success, global_id 4248 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb92c003050 con 0x7fb94405dee0 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 1 -- 10.20.193.106:0/3843453941 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb92c003430 con 0x7fb94405dee0 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb941ffb640 10 monclient: dump: 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.269 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 10 monclient: shutdown 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- 10.20.193.106:0/3843453941 >> v1:10.20.193.106:6789/0 conn(0x7fb94405dee0 legacy=0x7fb944181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- 10.20.193.106:0/3843453941 shutdown_connections 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- 10.20.193.106:0/3843453941 >> 10.20.193.106:0/3843453941 conn(0x7fb9440915f0 msgr2=0x7fb9440919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- 10.20.193.106:0/3843453941 shutdown_connections 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.256+0000 7fb94950c640 1 -- 10.20.193.106:0/3843453941 wait complete. 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient: monmap: 2026-02-17T05:28:08.270 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 1 Processor -- start 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 1 -- start start 2026-02-17T05:28:08.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient: init 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-a con 0x7fb94405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-b con 0x7fb94405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient(hunting): picked mon.noname-c con 0x7fb944182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94410bd20 con 0x7fb94405d1b0 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94410a830 con 0x7fb94405dee0 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9441824f0 con 0x7fb944182720 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb94950c640 10 monclient(hunting): authenticate will time out at 616.885879s 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb942ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb94405d1b0 0x7fb9441281d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36056/0 (socket says 10.20.193.106:36056) 2026-02-17T05:28:08.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.257+0000 7fb942ffd640 1 -- 10.20.193.106:0/208296026 learned_addr learned my addr 10.20.193.106:0/208296026 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202959029 0 0) 0x7fb94410bd20 con 0x7fb94405d1b0 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): my global_id is 4251 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9100035e0 con 0x7fb94405d1b0 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417722057 0 0) 0x7fb9441824f0 con 0x7fb944182720 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): my global_id is 4247 2026-02-17T05:28:08.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb94410bd20 con 0x7fb944182720 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418385039 0 0) 0x7fb94410bd20 con 0x7fb944182720 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9441824f0 con 0x7fb944182720 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb9340040d0 con 0x7fb944182720 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.274 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3163258206 0 0) 0x7fb9100035e0 con 0x7fb94405d1b0 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb94410bd20 con 0x7fb94405d1b0 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb938003170 con 0x7fb94405d1b0 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.275 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307345840 0 0) 0x7fb94410a830 con 0x7fb94405dee0 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient(hunting): my global_id is 4255 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9100035e0 con 0x7fb94405dee0 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1998045547 0 0) 0x7fb9441824f0 con 0x7fb944182720 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 >> v1:10.20.193.118:6789/0 conn(0x7fb94405dee0 legacy=0x7fb944180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 >> v1:10.20.193.106:6789/0 conn(0x7fb94405d1b0 legacy=0x7fb9441281d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 monclient: found mon.c 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94410c2f0 con 0x7fb944182720 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 5 monclient: authenticate success, global_id 4247 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _renew_subs 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb94410c5d0 con 0x7fb944182720 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _renew_subs 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb94410b5c0 con 0x7fb944182720 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9340047b0 con 0x7fb944182720 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb934004ad0 con 0x7fb944182720 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9417fa640 4 set_mon_vals no callback set 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb9237fe640 10 monclient: dump: 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.258+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9440008d0 con 0x7fb944182720 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.259+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb934011a70 con 0x7fb944182720 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.259+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fb93404f9b0 con 0x7fb944182720 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.259+0000 7fb942ffd640 10 monclient: get_auth_request con 0x7fb910040dd0 auth_method 0 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.261+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb934017190 con 0x7fb944182720 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.261+0000 7fb9237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.261+0000 7fb9237fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.365+0000 7fb94950c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.365+0000 7fb94950c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.365+0000 7fb94950c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.365+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb94408e3d0 con 0x7fb944182720 2026-02-17T05:28:08.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.366+0000 7fb9237fe640 1 -- 10.20.193.106:0/208296026 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+11001 (unknown 3338201251 0 1406356743) 0x7fb934016940 con 0x7fb944182720 2026-02-17T05:28:08.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.366+0000 7fb9237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.366+0000 7fb9237fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.368 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:08.368 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":18,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:28:07.735673+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T05:28:04.479659+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:28:08.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 >> v1:10.20.193.118:6812/703720803 conn(0x7fb910040dd0 legacy=0x7fb910061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 10 monclient: shutdown 2026-02-17T05:28:08.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 >> v1:10.20.193.106:6790/0 conn(0x7fb944182720 legacy=0x7fb944114120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 shutdown_connections 2026-02-17T05:28:08.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 >> 10.20.193.106:0/208296026 conn(0x7fb9440915f0 msgr2=0x7fb94408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 shutdown_connections 2026-02-17T05:28:08.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.367+0000 7fb94950c640 1 -- 10.20.193.106:0/208296026 wait complete. 2026-02-17T05:28:08.377 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T05:28:08.377 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:28:08.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.441+0000 7f77b310c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.441+0000 7f77b310c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.441+0000 7f77b310c640 10 monclient: monmap: 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.442032+0000 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.442032+0000 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.443 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 1 Processor -- start 2026-02-17T05:28:08.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 1 -- start start 2026-02-17T05:28:08.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient: init 2026-02-17T05:28:08.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-a con 0x7f77ac05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-b con 0x7f77ac05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-c con 0x7f77ac182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac08b060 con 0x7f77ac05d1b0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac05dc90 con 0x7f77ac182720 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac08d6a0 con 0x7f77ac05dee0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b310c640 10 monclient(hunting): authenticate will time out at 617.070484s 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b0e81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f77ac05d1b0 0x7f77ac05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36058/0 (socket says 10.20.193.106:36058) 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77b0e81640 1 -- 10.20.193.106:0/3794431151 learned_addr learned my addr 10.20.193.106:0/3794431151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480240096 0 0) 0x7f77ac08b060 con 0x7f77ac05d1b0 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): my global_id is 4254 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77980035e0 con 0x7f77ac05d1b0 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586101673 0 0) 0x7f77ac08d6a0 con 0x7f77ac05dee0 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): my global_id is 4250 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac08b060 con 0x7f77ac05dee0 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938391084 0 0) 0x7f77ac05dc90 con 0x7f77ac182720 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 10 monclient(hunting): my global_id is 4258 2026-02-17T05:28:08.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac08d6a0 con 0x7f77ac182720 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3260855140 0 0) 0x7f77ac08b060 con 0x7f77ac05dee0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 >> v1:10.20.193.118:6789/0 conn(0x7f77ac182720 legacy=0x7f77ac1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.442+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 >> v1:10.20.193.106:6789/0 conn(0x7f77ac05d1b0 legacy=0x7f77ac05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac057960 con 0x7f77ac05dee0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7794002dd0 con 0x7f77ac05dee0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: dump: 2026-02-17T05:28:08.453 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 5 monclient: authenticate success, global_id 4250 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7794003050 con 0x7f77ac05dee0 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 1 -- 10.20.193.106:0/3794431151 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7794003430 con 0x7f77ac05dee0 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77a37fe640 10 monclient: dump: 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 10 monclient: shutdown 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 1 -- 10.20.193.106:0/3794431151 >> v1:10.20.193.106:6790/0 conn(0x7f77ac05dee0 legacy=0x7f77ac181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 1 -- 10.20.193.106:0/3794431151 shutdown_connections 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 1 -- 10.20.193.106:0/3794431151 >> 10.20.193.106:0/3794431151 conn(0x7f77ac0915f0 msgr2=0x7f77ac0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 1 -- 10.20.193.106:0/3794431151 shutdown_connections 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 1 -- 10.20.193.106:0/3794431151 wait complete. 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.443+0000 7f77b310c640 10 monclient: monmap: 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.456 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 Processor -- start 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- start start 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: init 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-a con 0x7f77ac05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-c con 0x7f77ac05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient(hunting): picked mon.noname-b con 0x7f77ac182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac108fa0 con 0x7f77ac05d1b0 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac13f600 con 0x7f77ac182720 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac10a690 con 0x7f77ac05dee0 2026-02-17T05:28:08.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient(hunting): authenticate will time out at 617.072338s 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b0e81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f77ac05d1b0 0x7f77ac132070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36060/0 (socket says 10.20.193.106:36060) 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b0e81640 1 -- 10.20.193.106:0/2333385362 learned_addr learned my addr 10.20.193.106:0/2333385362 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a3fff640 1 --1- 10.20.193.106:0/2333385362 >> v1:10.20.193.106:6790/0 conn(0x7f77ac05dee0 0x7f77ac132780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36032/0 (socket says 10.20.193.106:36032) 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201612206 0 0) 0x7f77ac10a690 con 0x7f77ac05dee0 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): my global_id is 4253 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f777c0035e0 con 0x7f77ac05dee0 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099155988 0 0) 0x7f77ac108fa0 con 0x7f77ac05d1b0 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): my global_id is 4257 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac10a690 con 0x7f77ac05d1b0 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2900565585 0 0) 0x7f777c0035e0 con 0x7f77ac05dee0 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77ac108fa0 con 0x7f77ac05dee0 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7794003370 con 0x7f77ac05dee0 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): dump: 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.459 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839611218 0 0) 0x7f77ac13f600 con 0x7f77ac182720 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): my global_id is 4261 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f777c0035e0 con 0x7f77ac182720 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4139250696 0 0) 0x7f77ac10a690 con 0x7f77ac05d1b0 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77ac13f600 con 0x7f77ac05d1b0 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f779c003170 con 0x7f77ac05d1b0 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient(hunting): dump: 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.460 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3701606934 0 0) 0x7f77ac108fa0 con 0x7f77ac05dee0 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 >> v1:10.20.193.118:6789/0 conn(0x7f77ac182720 legacy=0x7f77ac181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 >> v1:10.20.193.106:6789/0 conn(0x7f77ac05d1b0 legacy=0x7f77ac132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 monclient: found mon.c 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac05c680 con 0x7f77ac05dee0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 5 monclient: authenticate success, global_id 4253 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _renew_subs 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac05e8e0 con 0x7f77ac05dee0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _renew_subs 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f77ac10a970 con 0x7f77ac05dee0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7794002940 con 0x7f77ac05dee0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7794003bd0 con 0x7f77ac05dee0 2026-02-17T05:28:08.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a2ffd640 4 set_mon_vals no callback set 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.444+0000 7f77a17fa640 10 monclient: dump: 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77b310c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77b310c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77b310c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac10ad90 con 0x7f77ac05dee0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7794003d30 con 0x7f77ac05dee0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f779404fc30 con 0x7f77ac05dee0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.445+0000 7f77b0e81640 10 monclient: get_auth_request con 0x7f777c040dd0 auth_method 0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.447+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f7794004010 con 0x7f77ac05dee0 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.447+0000 7f77a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.447+0000 7f77a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77b310c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77b310c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77b310c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77ac055570 con 0x7f77ac05dee0 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77a17fa640 1 -- 10.20.193.106:0/2333385362 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+11001 (unknown 3338201251 0 1406356743) 0x7f7794016ce0 con 0x7f77ac05dee0 2026-02-17T05:28:08.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.553+0000 7f77a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":18,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:28:07.735673+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T05:28:04.479659+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.554+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 >> v1:10.20.193.118:6812/703720803 conn(0x7f777c040dd0 legacy=0x7f777c061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.554+0000 7f77b310c640 10 monclient: shutdown 2026-02-17T05:28:08.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.554+0000 7f77b310c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.554+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 >> v1:10.20.193.106:6790/0 conn(0x7f77ac05dee0 legacy=0x7f77ac132780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.555+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 shutdown_connections 2026-02-17T05:28:08.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.555+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 >> 10.20.193.106:0/2333385362 conn(0x7f77ac0915f0 msgr2=0x7f77ac05bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.555+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 shutdown_connections 2026-02-17T05:28:08.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.555+0000 7f77b310c640 1 -- 10.20.193.106:0/2333385362 wait complete. 2026-02-17T05:28:08.564 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:28:08.564 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:28:08.564 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T05:28:08.565 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T05:28:08.565 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T05:28:08.566 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T05:28:08.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fdcd950c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fdcd950c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fdcd950c640 10 monclient: monmap: 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.632774+0000 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.632774+0000 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.634 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 10 monclient: monmap: 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.635 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.632811+0000 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.632811+0000 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fc8942af640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fc8942af640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fc8942af640 10 monclient: monmap: 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.632827+0000 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.632827+0000 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.637 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f96cc647640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f96cc647640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f96cc647640 10 monclient: monmap: 2026-02-17T05:28:08.638 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.638 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.633043+0000 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.633043+0000 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.639 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 1 Processor -- start 2026-02-17T05:28:08.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 1 -- start start 2026-02-17T05:28:08.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7f48f645b640 10 monclient: init 2026-02-17T05:28:08.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.632+0000 7fdcd950c640 1 Processor -- start 2026-02-17T05:28:08.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 1 Processor -- start 2026-02-17T05:28:08.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 1 -- start start 2026-02-17T05:28:08.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient: init 2026-02-17T05:28:08.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 1 Processor -- start 2026-02-17T05:28:08.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 1 -- start start 2026-02-17T05:28:08.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient: init 2026-02-17T05:28:08.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 1 -- start start 2026-02-17T05:28:08.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient: init 2026-02-17T05:28:08.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:08.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-c con 0x7f48f0058cd0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-b con 0x7f48f013f6f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-a con 0x7f48f0184a70 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f00590a0 con 0x7f48f0184a70 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f008f870 con 0x7f48f0058cd0 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f0058210 con 0x7f48f013f6f0 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 10 monclient(hunting): authenticate will time out at 617.261300s 2026-02-17T05:28:08.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48ef7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f48f013f6f0 0x7f48f0183350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36046/0 (socket says 10.20.193.106:36046) 2026-02-17T05:28:08.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f49d1640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f48f0184a70 0x7f48f01a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36064/0 (socket says 10.20.193.106:36064) 2026-02-17T05:28:08.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48ef7fe640 1 -- 10.20.193.106:0/435275487 learned_addr learned my addr 10.20.193.106:0/435275487 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-a con 0x7fdcd40585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-c con 0x7fdcd413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-a con 0x7fc88c0585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-b con 0x7fc88c13f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-c con 0x7fc88c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-b con 0x7fdcd408c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd4056bb0 con 0x7fdcd40585c0 2026-02-17T05:28:08.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c056bb0 con 0x7fc88c0585c0 2026-02-17T05:28:08.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0575d0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0578b0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc8942af640 10 monclient(hunting): authenticate will time out at 617.261504s 2026-02-17T05:28:08.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-a con 0x7f96c40585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd40575d0 con 0x7fdcd413f6c0 2026-02-17T05:28:08.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-c con 0x7f96c413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd40578b0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-b con 0x7f96c408c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c4056bb0 con 0x7f96c40585c0 2026-02-17T05:28:08.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c40575d0 con 0x7f96c413f6c0 2026-02-17T05:28:08.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd950c640 10 monclient(hunting): authenticate will time out at 617.261554s 2026-02-17T05:28:08.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c40578b0 con 0x7f96c408c0d0 2026-02-17T05:28:08.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cc647640 10 monclient(hunting): authenticate will time out at 617.261564s 2026-02-17T05:28:08.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd2ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fdcd40585c0 0x7fdcd413efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36080/0 (socket says 10.20.193.106:36080) 2026-02-17T05:28:08.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd2ffd640 1 -- 10.20.193.106:0/420790508 learned_addr learned my addr 10.20.193.106:0/420790508 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891823640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc88c13f6c0 0x7fc88c183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36048/0 (socket says 10.20.193.106:36048) 2026-02-17T05:28:08.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc892024640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc88c0585c0 0x7fc88c13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36090/0 (socket says 10.20.193.106:36090) 2026-02-17T05:28:08.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891823640 1 -- 10.20.193.106:0/2329776098 learned_addr learned my addr 10.20.193.106:0/2329776098 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685024908 0 0) 0x7f48f0058210 con 0x7f48f013f6f0 2026-02-17T05:28:08.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): my global_id is 4256 2026-02-17T05:28:08.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d40035e0 con 0x7f48f013f6f0 2026-02-17T05:28:08.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cabbd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f96c408c0d0 0x7f96c41a4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36076/0 (socket says 10.20.193.106:36076) 2026-02-17T05:28:08.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96ca3bc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f96c40585c0 0x7f96c413efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36100/0 (socket says 10.20.193.106:36100) 2026-02-17T05:28:08.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f96cabbd640 1 -- 10.20.193.106:0/4152723552 learned_addr learned my addr 10.20.193.106:0/4152723552 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661678392 0 0) 0x7f48f008f870 con 0x7f48f0058cd0 2026-02-17T05:28:08.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): my global_id is 4264 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f0058210 con 0x7f48f0058cd0 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70303957 0 0) 0x7f48f00590a0 con 0x7f48f0184a70 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient(hunting): my global_id is 4260 2026-02-17T05:28:08.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f008f870 con 0x7f48f0184a70 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564520563 0 0) 0x7fdcd4056bb0 con 0x7fdcd40585c0 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): my global_id is 4263 2026-02-17T05:28:08.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc00035e0 con 0x7fdcd40585c0 2026-02-17T05:28:08.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150254081 0 0) 0x7fc88c0578b0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): my global_id is 4259 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026169130 0 0) 0x7fdcd40578b0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): my global_id is 4262 2026-02-17T05:28:08.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd4056bb0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8740035e0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40438016 0 0) 0x7fc88c056bb0 con 0x7fc88c0585c0 2026-02-17T05:28:08.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215359178 0 0) 0x7fdcd40575d0 con 0x7fdcd413f6c0 2026-02-17T05:28:08.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 10 monclient(hunting): my global_id is 4267 2026-02-17T05:28:08.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 10 monclient(hunting): my global_id is 4266 2026-02-17T05:28:08.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c0578b0 con 0x7fc88c0585c0 2026-02-17T05:28:08.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd40578b0 con 0x7fdcd413f6c0 2026-02-17T05:28:08.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414266603 0 0) 0x7f48d40035e0 con 0x7f48f013f6f0 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 >> v1:10.20.193.118:6789/0 conn(0x7f48f0058cd0 legacy=0x7f48f013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 >> v1:10.20.193.106:6789/0 conn(0x7f48f0184a70 legacy=0x7f48f01a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f00584f0 con 0x7f48f013f6f0 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48e0002dd0 con 0x7f48f013f6f0 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 5 monclient: authenticate success, global_id 4256 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48f645b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.633+0000 7f48eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: dump: 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.670 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969473185 0 0) 0x7fc88c0575d0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient(hunting): my global_id is 4270 2026-02-17T05:28:08.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611098847 0 0) 0x7f96c40578b0 con 0x7f96c408c0d0 2026-02-17T05:28:08.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c056bb0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): my global_id is 4265 2026-02-17T05:28:08.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96ac0035e0 con 0x7f96c408c0d0 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370315237 0 0) 0x7fdcd4056bb0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 >> v1:10.20.193.118:6789/0 conn(0x7fdcd413f6c0 legacy=0x7fdcd4183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 >> v1:10.20.193.106:6789/0 conn(0x7fdcd40585c0 legacy=0x7fdcd413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4057b90 con 0x7fdcd408c0d0 2026-02-17T05:28:08.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327840425 0 0) 0x7f96c40575d0 con 0x7f96c413f6c0 2026-02-17T05:28:08.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdcc4003de0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): my global_id is 4273 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c40578b0 con 0x7f96c413f6c0 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: dump: 2026-02-17T05:28:08.677 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 5 monclient: authenticate success, global_id 4262 2026-02-17T05:28:08.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574540839 0 0) 0x7f96c4056bb0 con 0x7f96c40585c0 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient(hunting): my global_id is 4269 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c40575d0 con 0x7f96c40585c0 2026-02-17T05:28:08.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3101249103 0 0) 0x7fc8740035e0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48e0003050 con 0x7f48f013f6f0 2026-02-17T05:28:08.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 >> v1:10.20.193.118:6789/0 conn(0x7fc88c08c0d0 legacy=0x7fc88c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 >> v1:10.20.193.106:6789/0 conn(0x7fc88c0585c0 legacy=0x7fc88c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 1 -- 10.20.193.106:0/435275487 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48e0003460 con 0x7f48f013f6f0 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48eeffd640 10 monclient: dump: 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.681 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c057b90 con 0x7fc88c13f6c0 2026-02-17T05:28:08.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 4 set_mon_vals no callback set 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc880002dd0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: dump: 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 5 monclient: authenticate success, global_id 4259 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: monmap: 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.684 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.634561+0000 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.634561+0000 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4208506266 0 0) 0x7f96ac0035e0 con 0x7f96c408c0d0 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 >> v1:10.20.193.118:6789/0 conn(0x7f96c413f6c0 legacy=0x7f96c4183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 >> v1:10.20.193.106:6789/0 conn(0x7f96c40585c0 legacy=0x7f96c413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c4057b90 con 0x7f96c408c0d0 2026-02-17T05:28:08.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f96c0003eb0 con 0x7f96c408c0d0 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcc4003fe0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: dump: 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 5 monclient: authenticate success, global_id 4265 2026-02-17T05:28:08.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 1 -- 10.20.193.106:0/420790508 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdcc40043f0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd1ffb640 10 monclient: dump: 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.688 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc880002fd0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 1 -- 10.20.193.106:0/2329776098 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8800033e0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc891022640 10 monclient: dump: 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 4 set_mon_vals no callback set 2026-02-17T05:28:08.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 10 monclient: shutdown 2026-02-17T05:28:08.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 1 -- 10.20.193.106:0/435275487 >> v1:10.20.193.106:6790/0 conn(0x7f48f013f6f0 legacy=0x7f48f0183350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 1 -- 10.20.193.106:0/435275487 shutdown_connections 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 1 -- 10.20.193.106:0/435275487 >> 10.20.193.106:0/435275487 conn(0x7f48f0056b70 msgr2=0x7f48f00932b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96c0004130 con 0x7f96c408c0d0 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 1 -- 10.20.193.106:0/4152723552 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f96c0004540 con 0x7f96c408c0d0 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96c93ba640 10 monclient: dump: 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 4 set_mon_vals no callback set 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 1 -- 10.20.193.106:0/435275487 shutdown_connections 2026-02-17T05:28:08.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f48f645b640 1 -- 10.20.193.106:0/435275487 wait complete. 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 10 monclient: shutdown 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 1 -- 10.20.193.106:0/420790508 >> v1:10.20.193.106:6790/0 conn(0x7fdcd408c0d0 legacy=0x7fdcd41a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 1 -- 10.20.193.106:0/420790508 shutdown_connections 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 1 -- 10.20.193.106:0/420790508 >> 10.20.193.106:0/420790508 conn(0x7fdcd405e410 msgr2=0x7fdcd4095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 1 -- 10.20.193.106:0/420790508 shutdown_connections 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 1 Processor -- start 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fdcd950c640 1 -- 10.20.193.106:0/420790508 wait complete. 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 1 -- start start 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: init 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 10 monclient: shutdown 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 1 -- 10.20.193.106:0/4152723552 >> v1:10.20.193.106:6790/0 conn(0x7f96c408c0d0 legacy=0x7f96c41a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 10 monclient: shutdown 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 1 -- 10.20.193.106:0/2329776098 >> v1:10.20.193.106:6790/0 conn(0x7fc88c13f6c0 legacy=0x7fc88c183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 1 -- 10.20.193.106:0/4152723552 shutdown_connections 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 1 -- 10.20.193.106:0/4152723552 >> 10.20.193.106:0/4152723552 conn(0x7f96c405e410 msgr2=0x7f96c4095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 1 -- 10.20.193.106:0/4152723552 shutdown_connections 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 1 -- 10.20.193.106:0/2329776098 shutdown_connections 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 1 -- 10.20.193.106:0/2329776098 >> 10.20.193.106:0/2329776098 conn(0x7fc88c05e410 msgr2=0x7fc88c095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7f96cc647640 1 -- 10.20.193.106:0/4152723552 wait complete. 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 1 -- 10.20.193.106:0/2329776098 shutdown_connections 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fc8942af640 1 -- 10.20.193.106:0/2329776098 wait complete. 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient(hunting): picked mon.noname-a con 0x7fa17c0585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.634+0000 7fa183812640 10 monclient(hunting): picked mon.noname-b con 0x7fa17c13f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 10 monclient(hunting): picked mon.noname-c con 0x7fa17c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c056bb0 con 0x7fa17c0585c0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c0575d0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c0578b0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 10 monclient(hunting): authenticate will time out at 617.263026s 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient: monmap: 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient: monmap: 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.698 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa180d86640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa17c13f6c0 0x7fa17c183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36092/0 (socket says 10.20.193.106:36092) 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa181587640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa17c0585c0 0x7fa17c13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36102/0 (socket says 10.20.193.106:36102) 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa180d86640 1 -- 10.20.193.106:0/4261177641 learned_addr learned my addr 10.20.193.106:0/4261177641 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 1 Processor -- start 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686152263 0 0) 0x7fa17c0578b0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): my global_id is 4268 2026-02-17T05:28:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 1 -- start start 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1640035e0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990905984 0 0) 0x7fa17c056bb0 con 0x7fa17c0585c0 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient: init 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient(hunting): my global_id is 4272 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa17c0578b0 con 0x7fa17c0585c0 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 1 Processor -- start 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 1 -- start start 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient: init 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f96cc647640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f96cc647640 10 monclient: monmap: 2026-02-17T05:28:08.700 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 10 monclient: monmap: 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.635711+0000 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.635711+0000 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1690593592 0 0) 0x7fa1640035e0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 >> v1:10.20.193.118:6789/0 conn(0x7fa17c08c0d0 legacy=0x7fa17c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 >> v1:10.20.193.106:6789/0 conn(0x7fa17c0585c0 legacy=0x7fa17c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fc8942af640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fc8942af640 10 monclient: monmap: 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c057b90 con 0x7fa17c13f6c0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa170002dd0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: dump: 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 5 monclient: authenticate success, global_id 4268 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa170003010 con 0x7fa17c13f6c0 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 4 set_mon_vals no callback set 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 1 -- 10.20.193.106:0/4261177641 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa170003420 con 0x7fa17c13f6c0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa16bfff640 10 monclient: dump: 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-a con 0x7fdcd40585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-c con 0x7fdcd408c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient(hunting): picked mon.noname-b con 0x7fdcd413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd408b910 con 0x7fdcd40585c0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd413d730 con 0x7fdcd413f6c0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd412e190 con 0x7fdcd408c0d0 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd950c640 10 monclient(hunting): authenticate will time out at 617.263566s 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-a con 0x7f48f0058cd0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-b con 0x7f48f013f6f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f96cc647640 1 Processor -- start 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient(hunting): picked mon.noname-c con 0x7f48f0184a70 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f0089aa0 con 0x7f48f0058cd0 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f008a510 con 0x7f48f013f6f0 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f012c3a0 con 0x7f48f0184a70 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48f645b640 10 monclient(hunting): authenticate will time out at 617.263628s 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd27fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdcd408c0d0 0x7fdcd412c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36098/0 (socket says 10.20.193.106:36098) 2026-02-17T05:28:08.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcd27fc640 1 -- 10.20.193.106:0/3903907274 learned_addr learned my addr 10.20.193.106:0/3903907274 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48effff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f48f0058cd0 0x7f48f012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36122/0 (socket says 10.20.193.106:36122) 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48effff640 1 -- 10.20.193.106:0/186883388 learned_addr learned my addr 10.20.193.106:0/186883388 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fc8942af640 1 Processor -- start 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 1 Processor -- start 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fc8942af640 1 -- start start 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fc8942af640 10 monclient: init 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f96cc647640 1 -- start start 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f96cc647640 10 monclient: init 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 1 -- start start 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f561bcc3640 10 monclient: init 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 10 monclient: shutdown 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- 10.20.193.106:0/4261177641 >> v1:10.20.193.106:6790/0 conn(0x7fa17c13f6c0 legacy=0x7fa17c183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505144710 0 0) 0x7fdcd408b910 con 0x7fdcd40585c0 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): my global_id is 4275 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316894020 0 0) 0x7f48f0089aa0 con 0x7f48f0058cd0 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 10 monclient(hunting): my global_id is 4278 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca00035e0 con 0x7fdcd40585c0 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136178762 0 0) 0x7fdcd412e190 con 0x7fdcd408c0d0 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c00035e0 con 0x7f48f0058cd0 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): my global_id is 4271 2026-02-17T05:28:08.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd408b910 con 0x7fdcd408c0d0 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- 10.20.193.106:0/4261177641 shutdown_connections 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- 10.20.193.106:0/4261177641 >> 10.20.193.106:0/4261177641 conn(0x7fa17c05e410 msgr2=0x7fa17c095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- 10.20.193.106:0/4261177641 shutdown_connections 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fa183812640 1 -- 10.20.193.106:0/4261177641 wait complete. 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516802197 0 0) 0x7fdcd413d730 con 0x7fdcd413f6c0 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 10 monclient(hunting): my global_id is 4279 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.635+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd412e190 con 0x7fdcd413f6c0 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 378319305 0 0) 0x7fdcd412e190 con 0x7fdcd413f6c0 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-a con 0x7f96c40585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-b con 0x7f96c408c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcd413d730 con 0x7fdcd413f6c0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdcc4004300 con 0x7fdcd413f6c0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient(hunting): picked mon.noname-c con 0x7f96c413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-b con 0x7fc88c0585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-a con 0x7fc88c08c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient(hunting): picked mon.noname-c con 0x7fc88c13f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1096981548 0 0) 0x7fdcd408b910 con 0x7fdcd408c0d0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcd412e190 con 0x7fdcd408c0d0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdcbc0030a0 con 0x7fdcd408c0d0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058484795 0 0) 0x7f48f012c3a0 con 0x7f48f0184a70 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): my global_id is 4274 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f0089aa0 con 0x7f48f0184a70 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c08c530 con 0x7fc88c08c0d0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c12e860 con 0x7fc88c0585c0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c12eb40 con 0x7fc88c13f6c0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc8942af640 10 monclient(hunting): authenticate will time out at 617.264181s 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c413e510 con 0x7f96c40585c0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c41428a0 con 0x7f96c408c0d0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c412e7c0 con 0x7f96c413f6c0 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient(hunting): authenticate will time out at 617.264141s 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-a con 0x7f56140585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-b con 0x7f561413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-c con 0x7f561408c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cabbd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f96c413f6c0 0x7f96c4194be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36112/0 (socket says 10.20.193.106:36112) 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cabbd640 1 -- 10.20.193.106:0/3067892901 learned_addr learned my addr 10.20.193.106:0/3067892901 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5614056bb0 con 0x7f56140585c0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140575d0 con 0x7f561408c0d0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140578b0 con 0x7f561413f6c0 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f561bcc3640 10 monclient(hunting): authenticate will time out at 617.264230s 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 684713177 0 0) 0x7f48c00035e0 con 0x7f48f0058cd0 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 378107768 0 0) 0x7fdcd413d730 con 0x7fdcd413f6c0 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48f012c3a0 con 0x7f48f0058cd0 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48dc0030c0 con 0x7f48f0058cd0 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 >> v1:10.20.193.106:6790/0 conn(0x7fdcd408c0d0 legacy=0x7fdcd412c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): dump: 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 >> v1:10.20.193.106:6789/0 conn(0x7fdcd40585c0 legacy=0x7fdcd412b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 monclient: found mon.b 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd412e470 con 0x7fdcd413f6c0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 5 monclient: authenticate success, global_id 4279 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 10 monclient: _renew_subs 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd412c820 con 0x7fdcd413f6c0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5619237640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f561413f6c0 0x7f5614183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36126/0 (socket says 10.20.193.106:36126) 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5619237640 1 -- 10.20.193.106:0/2111266639 learned_addr learned my addr 10.20.193.106:0/2111266639 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 10 monclient: _renew_subs 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdcd408c530 con 0x7fdcd413f6c0 2026-02-17T05:28:08.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc892024640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7fc88c0585c0 0x7fc88c13d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.106:46000/0 (socket says 10.20.193.106:46000) 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591358988 0 0) 0x7f48f008a510 con 0x7f48f013f6f0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient(hunting): my global_id is 4282 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c00035e0 con 0x7f48f013f6f0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc892024640 1 -- 10.20.193.106:0/1798512136 learned_addr learned my addr 10.20.193.106:0/1798512136 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218157515 0 0) 0x7f96c413e510 con 0x7f96c40585c0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): my global_id is 4281 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96940035e0 con 0x7f96c40585c0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcc4004460 con 0x7fdcd413f6c0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdcc4004b00 con 0x7fdcd413f6c0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd17fa640 4 set_mon_vals no callback set 2026-02-17T05:28:08.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcb37fe640 10 monclient: dump: 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 195988603 0 0) 0x7f48f012c3a0 con 0x7f48f0058cd0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 >> v1:10.20.193.106:6790/0 conn(0x7f48f0184a70 legacy=0x7f48f0181300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 >> v1:10.20.193.118:6789/0 conn(0x7f48f013f6f0 legacy=0x7f48f017fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 monclient: found mon.a 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0194740 con 0x7f48f0058cd0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 5 monclient: authenticate success, global_id 4278 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 10 monclient: _renew_subs 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48f012cf00 con 0x7f48f0058cd0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265684619 0 0) 0x7f5614056bb0 con 0x7f56140585c0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): my global_id is 4284 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55fc0035e0 con 0x7f56140585c0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient: monmap: 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 10 monclient: _renew_subs 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 1 Processor -- start 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f48f012bbd0 con 0x7f48f0058cd0 2026-02-17T05:28:08.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 1 -- start start 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4271657326 0 0) 0x7f96940035e0 con 0x7f96c40585c0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient: init 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96c413e510 con 0x7f96c40585c0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f96b4003040 con 0x7f96c40585c0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112490945 0 0) 0x7fc88c08c530 con 0x7fc88c08c0d0 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): my global_id is 4287 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc85c0035e0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090298293 0 0) 0x7fc88c12eb40 con 0x7fc88c13f6c0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.118:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdcd4093240 con 0x7fdcd413f6c0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): my global_id is 4280 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48dc003310 con 0x7f48f0058cd0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ecff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c08c530 con 0x7fc88c13f6c0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794518199 0 0) 0x7f56140578b0 con 0x7f561413f6c0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f48ee7fc640 4 set_mon_vals no callback set 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652613989 0 0) 0x7fc88c12e860 con 0x7fc88c0585c0 2026-02-17T05:28:08.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 10 monclient(hunting): my global_id is 4283 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5614056bb0 con 0x7f561413f6c0 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 10 monclient(hunting): my global_id is 4285 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c12eb40 con 0x7fc88c0585c0 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583803143 0 0) 0x7f96c412e7c0 con 0x7f96c413f6c0 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient(hunting): my global_id is 4277 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96940035e0 con 0x7f96c413f6c0 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4246470157 0 0) 0x7f96c413e510 con 0x7f96c40585c0 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 >> v1:10.20.193.106:6790/0 conn(0x7f96c413f6c0 legacy=0x7f96c4194be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient(hunting): picked mon.noname-c con 0x7fa17c0585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 >> v1:10.20.193.118:6789/0 conn(0x7f96c408c0d0 legacy=0x7f96c41934c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 monclient: found mon.a 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7fa183812640 10 monclient(hunting): picked mon.noname-b con 0x7fa17c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c408c530 con 0x7f96c40585c0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 5 monclient: authenticate success, global_id 4281 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient: _renew_subs 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.636+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96c408b950 con 0x7f96c40585c0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96cc647640 10 monclient: _renew_subs 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96cc647640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96c412c5c0 con 0x7f96c40585c0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient(hunting): picked mon.noname-a con 0x7fa17c13f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c1428a0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c13e500 con 0x7fa17c08c0d0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1155376587 0 0) 0x7fc88c08c530 con 0x7fc88c13f6c0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc88c12e860 con 0x7fc88c13f6c0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc888004150 con 0x7fc88c13f6c0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c08c530 con 0x7fa17c0585c0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1496680833 0 0) 0x7fc85c0035e0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc88c08c530 con 0x7fc88c08c0d0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc880002ce0 con 0x7fc88c08c0d0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient(hunting): authenticate will time out at 617.265091s 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa181d88640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa17c13f6c0 0x7fa17c133890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36160/0 (socket says 10.20.193.106:36160) 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa181d88640 1 -- 10.20.193.106:0/720814356 learned_addr learned my addr 10.20.193.106:0/720814356 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fdcc4011aa0 con 0x7fdcd413f6c0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1984020440 0 0) 0x7fc88c12eb40 con 0x7fc88c0585c0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc85c0035e0 con 0x7fc88c0585c0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc87c0030a0 con 0x7fc88c0585c0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3175638433 0 0) 0x7f55fc0035e0 con 0x7f56140585c0 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 >> v1:10.20.193.106:6790/0 conn(0x7f561413f6c0 legacy=0x7f5614183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 >> v1:10.20.193.118:6789/0 conn(0x7f561408c0d0 legacy=0x7f56141a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 monclient: found mon.noname-a 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614057b90 con 0x7f56140585c0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5604002dd0 con 0x7f56140585c0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: dump: 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 5 monclient: authenticate success, global_id 4284 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48dc003b30 con 0x7f48f0058cd0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48f645b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f48f012de60 con 0x7f48f0058cd0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 10 monclient: dump: 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.723 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4291323404 0 0) 0x7fc88c12e860 con 0x7fc88c13f6c0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 >> v1:10.20.193.118:6789/0 conn(0x7fc88c0585c0 legacy=0x7fc88c13d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 >> v1:10.20.193.106:6789/0 conn(0x7fc88c08c0d0 legacy=0x7fc88c193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 monclient: found mon.c 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c12d340 con 0x7fc88c13f6c0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f48dc003d00 con 0x7f48f0058cd0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 5 monclient: authenticate success, global_id 4280 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 10 monclient: _renew_subs 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c12d6f0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fdcc404fa20 con 0x7fdcd413f6c0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702870053 0 0) 0x7fa17c08c530 con 0x7fa17c0585c0 2026-02-17T05:28:08.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 10 monclient: _renew_subs 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): my global_id is 4286 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc88c1526b0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa14c0035e0 con 0x7fa17c0585c0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.106:6804/3242040173 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdca00875f0 con 0x7fdca0065970 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fdcc404fdc0 con 0x7fdcd413f6c0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcb37fe640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395001443 0 0) 0x7fa17c1428a0 con 0x7fa17c13f6c0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): my global_id is 4290 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa17c08c530 con 0x7fa17c13f6c0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877701458 0 0) 0x7fa17c13e500 con 0x7fa17c08c0d0 2026-02-17T05:28:08.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96b40048e0 con 0x7f96c40585c0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): my global_id is 4294 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa17c1428a0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f96b4004c80 con 0x7f96c40585c0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96c8bb9640 4 set_mon_vals no callback set 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96aaffd640 10 monclient: dump: 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96cc647640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f96c412e640 con 0x7f96c40585c0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5604003010 con 0x7f56140585c0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 1 -- 10.20.193.106:0/2111266639 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5604003420 con 0x7f56140585c0 2026-02-17T05:28:08.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f5618a36640 10 monclient: dump: 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 4 set_mon_vals no callback set 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 10 monclient: shutdown 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 1 -- 10.20.193.106:0/2111266639 >> v1:10.20.193.106:6789/0 conn(0x7f56140585c0 legacy=0x7f561413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcd2ffd640 10 monclient: get_auth_request con 0x7fdca0040d70 auth_method 0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f48dc04fc20 con 0x7f48f0058cd0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 1 -- 10.20.193.106:0/2111266639 shutdown_connections 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 1 -- 10.20.193.106:0/2111266639 >> 10.20.193.106:0/2111266639 conn(0x7f561405e410 msgr2=0x7f5614095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3219206699 0 0) 0x7fa17c1428a0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa17c13e500 con 0x7fa17c08c0d0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa170002ce0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 1 -- 10.20.193.106:0/2111266639 shutdown_connections 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): dump: 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6807/319256485 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48c0087240 con 0x7f48c00655a0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f48dc050030 con 0x7f48f0058cd0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ecff9640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1341993610 0 0) 0x7fa14c0035e0 con 0x7fa17c0585c0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa17c1428a0 con 0x7fa17c0585c0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa16c003090 con 0x7fa17c0585c0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient(hunting): dump: 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 761370052 0 0) 0x7fa17c13e500 con 0x7fa17c08c0d0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 >> v1:10.20.193.106:6790/0 conn(0x7fa17c0585c0 legacy=0x7fa17c05cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 >> v1:10.20.193.106:6789/0 conn(0x7fa17c13f6c0 legacy=0x7fa17c133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 monclient: found mon.b 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c05b460 con 0x7fa17c08c0d0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 5 monclient: authenticate success, global_id 4294 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient: _renew_subs 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c05b740 con 0x7fa17c08c0d0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48f49d1640 10 monclient: get_auth_request con 0x7f48c00655a0 auth_method 0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f48ef7fe640 10 monclient: get_auth_request con 0x7f48c00409c0 auth_method 0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient: _renew_subs 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa17c059f40 con 0x7fa17c08c0d0 2026-02-17T05:28:08.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fdcd27fc640 10 monclient: get_auth_request con 0x7fdca0065970 auth_method 0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8880047b0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc888004ad0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc890821640 4 set_mon_vals no callback set 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc872ffd640 10 monclient: dump: 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc88c093240 con 0x7fc88c13f6c0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa170002870 con 0x7fa17c08c0d0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa170002eb0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7fa169ffb640 10 monclient: dump: 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.730 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.637+0000 7f561bcc3640 1 -- 10.20.193.106:0/2111266639 wait complete. 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa16affd640 4 set_mon_vals no callback set 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f96b4004de0 con 0x7f96c40585c0 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient: monmap: 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f96b404fc70 con 0x7f96c40585c0 2026-02-17T05:28:08.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 1 Processor -- start 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.118:6808/334549894 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9694087070 con 0x7f96940653d0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f96b404fff0 con 0x7f96c40585c0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96aaffd640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 1 -- start start 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient: init 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa183812640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa17c093240 con 0x7fa17c08c0d0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc888011a70 con 0x7fc88c13f6c0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96c9bbb640 10 monclient: get_auth_request con 0x7f9694040840 auth_method 0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== osd.1 v1:10.20.193.106:6807/319256485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f48c0087240 con 0x7f48c00655a0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== osd.0 v1:10.20.193.106:6804/3242040173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fdca00875f0 con 0x7fdca0065970 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa170011b40 con 0x7fa17c08c0d0 2026-02-17T05:28:08.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f96cabbd640 10 monclient: get_auth_request con 0x7f96940653d0 auth_method 0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-c con 0x7f56140585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-a con 0x7f561408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fc88804fa60 con 0x7fc88c13f6c0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6800/3659912429 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc85c0878c0 con 0x7fc85c065c40 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fc88804fda0 con 0x7fc88c13f6c0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc872ffd640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fa17004fb50 con 0x7fa17c08c0d0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6804/2938654647 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa14c087580 con 0x7fa14c0658e0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fa17004fea0 con 0x7fa17c08c0d0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa169ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc891823640 10 monclient: get_auth_request con 0x7fc85c065c40 auth_method 0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient(hunting): picked mon.noname-b con 0x7f561413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fa181587640 10 monclient: get_auth_request con 0x7fa14c040cb0 auth_method 0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7fc892024640 10 monclient: get_auth_request con 0x7fc85c041040 auth_method 0 2026-02-17T05:28:08.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7fa181d88640 10 monclient: get_auth_request con 0x7fa14c0658e0 auth_method 0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561408a6e0 con 0x7f561408c0d0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5614088c90 con 0x7f561413f6c0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561408c530 con 0x7f56140585c0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f561bcc3640 10 monclient(hunting): authenticate will time out at 617.266636s 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f5619237640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f561408c0d0 0x7f5614088580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36164/0 (socket says 10.20.193.106:36164) 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f5619237640 1 -- 10.20.193.106:0/1432672399 learned_addr learned my addr 10.20.193.106:0/1432672399 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952110221 0 0) 0x7f561408a6e0 con 0x7f561408c0d0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 10 monclient(hunting): my global_id is 4293 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.638+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55e40035e0 con 0x7f561408c0d0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345926298 0 0) 0x7f5614088c90 con 0x7f561413f6c0 2026-02-17T05:28:08.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== osd.2 v1:10.20.193.106:6800/3659912429 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fc85c0878c0 con 0x7fc85c065c40 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): my global_id is 4297 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f561408a6e0 con 0x7f561413f6c0 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3534290300 0 0) 0x7f55e40035e0 con 0x7f561408c0d0 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5614088c90 con 0x7f561408c0d0 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f56080030d0 con 0x7f561408c0d0 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): dump: 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.735 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3716923238 0 0) 0x7f5614088c90 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 >> v1:10.20.193.106:6790/0 conn(0x7f56140585c0 legacy=0x7f5614087e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 >> v1:10.20.193.118:6789/0 conn(0x7f561413f6c0 legacy=0x7f56141909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 monclient: found mon.a 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614089d60 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 5 monclient: authenticate success, global_id 4293 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 10 monclient: _renew_subs 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f561405d810 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 10 monclient: _renew_subs 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f561408b980 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56080048a0 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== osd.5 v1:10.20.193.118:6804/2938654647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fa14c087580 con 0x7fa14c0658e0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5608004c80 con 0x7f561408c0d0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f56027fc640 10 monclient: dump: 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f5603fff640 4 set_mon_vals no callback set 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== osd.3 v1:10.20.193.118:6808/334549894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f9694087070 con 0x7f96940653d0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.639+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f561408a4c0 con 0x7f561408c0d0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f5608004de0 con 0x7f561408c0d0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f560804fd10 con 0x7f561408c0d0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.118:6800/25351596 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55e4087110 con 0x7f55e4065470 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f56080500e0 con 0x7f561408c0d0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f56027fc640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.640+0000 7f561a239640 10 monclient: get_auth_request con 0x7f55e4065470 auth_method 0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.641+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== osd.4 v1:10.20.193.118:6800/25351596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f55e4087110 con 0x7f55e4065470 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.642+0000 7f5619a38640 10 monclient: get_auth_request con 0x7f55e4040840 auth_method 0 2026-02-17T05:28:08.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.647+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 --> v1:10.20.193.106:6800/3659912429 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc88c12e4a0 con 0x7fc85c065c40 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.647+0000 7fc872ffd640 1 -- 10.20.193.106:0/1798512136 <== osd.2 v1:10.20.193.106:6800/3659912429 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fc88c12e4a0 con 0x7fc85c065c40 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 >> v1:10.20.193.106:6800/3659912429 conn(0x7fc85c065c40 legacy=0x7fc85c086050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 >> v1:10.20.193.118:6812/703720803 conn(0x7fc85c041040 legacy=0x7fc85c0614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 10 monclient: shutdown 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 >> v1:10.20.193.106:6790/0 conn(0x7fc88c13f6c0 legacy=0x7fc88c194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 --> v1:10.20.193.118:6804/2938654647 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa17c05b280 con 0x7fa14c0658e0 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 --> v1:10.20.193.118:6808/334549894 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96c4093240 con 0x7f96940653d0 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc892825640 1 -- 10.20.193.106:0/1798512136 reap_dead start 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 shutdown_connections 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 >> 10.20.193.106:0/1798512136 conn(0x7fc88c05e410 msgr2=0x7fc88c141740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 shutdown_connections 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fc8942af640 1 -- 10.20.193.106:0/1798512136 wait complete. 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa169ffb640 1 -- 10.20.193.106:0/720814356 <== osd.5 v1:10.20.193.118:6804/2938654647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fa17c05b280 con 0x7fa14c0658e0 2026-02-17T05:28:08.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 --> v1:10.20.193.106:6804/3242040173 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcd4058c70 con 0x7fdca0065970 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96aaffd640 1 -- 10.20.193.106:0/3067892901 <== osd.3 v1:10.20.193.118:6808/334549894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f96c4093240 con 0x7f96940653d0 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcb37fe640 1 -- 10.20.193.106:0/3903907274 <== osd.0 v1:10.20.193.106:6804/3242040173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fdcd4058c70 con 0x7fdca0065970 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 >> v1:10.20.193.118:6804/2938654647 conn(0x7fa14c0658e0 legacy=0x7fa14c085d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 >> v1:10.20.193.118:6812/703720803 conn(0x7fa14c040cb0 legacy=0x7fa14c061160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 >> v1:10.20.193.118:6808/334549894 conn(0x7f96940653d0 legacy=0x7f9694085800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 10 monclient: shutdown 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 >> v1:10.20.193.118:6812/703720803 conn(0x7f9694040840 legacy=0x7f9694060cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 10 monclient: shutdown 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 >> v1:10.20.193.106:6789/0 conn(0x7f96c40585c0 legacy=0x7f96c412beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cabbd640 1 -- 10.20.193.106:0/3067892901 reap_dead start 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 >> v1:10.20.193.118:6789/0 conn(0x7fa17c08c0d0 legacy=0x7fa17c13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa181d88640 1 -- 10.20.193.106:0/720814356 reap_dead start 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 >> v1:10.20.193.106:6804/3242040173 conn(0x7fdca0065970 legacy=0x7fdca0085d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 --> v1:10.20.193.106:6807/319256485 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48f012e380 con 0x7f48c00655a0 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 shutdown_connections 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 shutdown_connections 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 >> 10.20.193.106:0/720814356 conn(0x7fa17c05e410 msgr2=0x7fa17c1417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 >> 10.20.193.106:0/3067892901 conn(0x7f96c405e410 msgr2=0x7f96c41417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 shutdown_connections 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 shutdown_connections 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f96cc647640 1 -- 10.20.193.106:0/3067892901 wait complete. 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 >> v1:10.20.193.118:6812/703720803 conn(0x7fdca0040d70 legacy=0x7fdca0061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 10 monclient: shutdown 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 >> v1:10.20.193.118:6789/0 conn(0x7fdcd413f6c0 legacy=0x7fdcd4194570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fa183812640 1 -- 10.20.193.106:0/720814356 wait complete. 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd37fe640 1 -- 10.20.193.106:0/3903907274 reap_dead start 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 shutdown_connections 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 >> 10.20.193.106:0/3903907274 conn(0x7fdcd405e410 msgr2=0x7fdcd4141540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7f48ecff9640 1 -- 10.20.193.106:0/186883388 <== osd.1 v1:10.20.193.106:6807/319256485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f48e40089d0 con 0x7f48c00655a0 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 shutdown_connections 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.648+0000 7fdcd950c640 1 -- 10.20.193.106:0/3903907274 wait complete. 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 >> v1:10.20.193.106:6807/319256485 conn(0x7f48c00655a0 legacy=0x7f48c00859d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 >> v1:10.20.193.118:6812/703720803 conn(0x7f48c00409c0 legacy=0x7f48c0060e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 10 monclient: shutdown 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 >> v1:10.20.193.106:6789/0 conn(0x7f48f0058cd0 legacy=0x7f48f012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f49d1640 1 -- 10.20.193.106:0/186883388 reap_dead start 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 shutdown_connections 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 >> 10.20.193.106:0/186883388 conn(0x7f48f0056b70 msgr2=0x7f48f008cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 shutdown_connections 2026-02-17T05:28:08.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f48f645b640 1 -- 10.20.193.106:0/186883388 wait complete. 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 --> v1:10.20.193.118:6800/25351596 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5614093240 con 0x7f55e4065470 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.649+0000 7f56027fc640 1 -- 10.20.193.106:0/1432672399 <== osd.4 v1:10.20.193.118:6800/25351596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f5614093240 con 0x7f55e4065470 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 >> v1:10.20.193.118:6800/25351596 conn(0x7f55e4065470 legacy=0x7f55e40858a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 >> v1:10.20.193.118:6812/703720803 conn(0x7f55e4040840 legacy=0x7f55e4060cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 10 monclient: shutdown 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 >> v1:10.20.193.106:6789/0 conn(0x7f561408c0d0 legacy=0x7f5614088580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561a239640 1 -- 10.20.193.106:0/1432672399 reap_dead start 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 shutdown_connections 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 >> 10.20.193.106:0/1432672399 conn(0x7f561405e410 msgr2=0x7f5614141670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 shutdown_connections 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.650+0000 7f561bcc3640 1 -- 10.20.193.106:0/1432672399 wait complete. 2026-02-17T05:28:08.742 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.743 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:28:08.743 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.743 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T05:28:08.743 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.743 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T05:28:08.744 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.744 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:28:08.744 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.744 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T05:28:08.745 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:08.745 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T05:28:08.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 10 monclient: monmap: 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.849845+0000 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.849845+0000 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.851 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7f1d9650c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7f1d9650c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7f1d9650c640 10 monclient: monmap: 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.849937+0000 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.849937+0000 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 1 Processor -- start 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 1 -- start start 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7ff2c505b640 10 monclient: init 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.849+0000 7f1d9650c640 1 Processor -- start 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 1 -- start start 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient: init 2026-02-17T05:28:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 10 monclient: monmap: 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.850634+0000 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.850634+0000 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-a con 0x7ff2c013bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2c008d4f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 10 monclient: monmap: 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.850685+0000 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.850685+0000 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.855 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2c01849f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c005cca0 con 0x7ff2c013bb70 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c013c650 con 0x7ff2c01849f0 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c005e010 con 0x7ff2c008d4f0 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2c505b640 10 monclient(hunting): authenticate will time out at 617.478406s 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-b con 0x7f1d900585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-a con 0x7f1d9013f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-c con 0x7f1d9008c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d90056bb0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d900575d0 con 0x7f1d9008c0d0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d900578b0 con 0x7f1d900585c0 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d9650c640 10 monclient(hunting): authenticate will time out at 617.478452s 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bed76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff2c013bb70 0x7ff2c013bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36180/0 (socket says 10.20.193.106:36180) 2026-02-17T05:28:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bed76640 1 -- 10.20.193.106:0/2858426703 learned_addr learned my addr 10.20.193.106:0/2858426703 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8f7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1d9013f6c0 0x7f1d90183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36184/0 (socket says 10.20.193.106:36184) 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8f7fe640 1 -- 10.20.193.106:0/2021081902 learned_addr learned my addr 10.20.193.106:0/2021081902 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8ffff640 1 --1- 10.20.193.106:0/2021081902 >> v1:10.20.193.106:6790/0 conn(0x7f1d900585c0 0x7f1d9013efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36156/0 (socket says 10.20.193.106:36156) 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2be575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff2c008d4f0 0x7ff2c01832d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36154/0 (socket says 10.20.193.106:36154) 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f0b9be5b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f0b9be5b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f0b9be5b640 10 monclient: monmap: 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.851064+0000 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.851064+0000 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 1 Processor -- start 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 1 Processor -- start 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 1 -- start start 2026-02-17T05:28:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f6652fc2640 10 monclient: init 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 1 -- start start 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f8ad5e1b640 10 monclient: init 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941133379 0 0) 0x7f1d900578b0 con 0x7f1d900585c0 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): my global_id is 4289 2026-02-17T05:28:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d740035e0 con 0x7f1d900585c0 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90955120 0 0) 0x7ff2c005cca0 con 0x7ff2c013bb70 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): my global_id is 4296 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2ac0035e0 con 0x7ff2c013bb70 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767594187 0 0) 0x7f1d90056bb0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831310705 0 0) 0x7ff2c005e010 con 0x7ff2c008d4f0 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 10 monclient(hunting): my global_id is 4299 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d900578b0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 10 monclient(hunting): my global_id is 4292 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.850+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c005cca0 con 0x7ff2c008d4f0 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2713754769 0 0) 0x7ff2ac0035e0 con 0x7ff2c013bb70 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 >> v1:10.20.193.106:6790/0 conn(0x7ff2c008d4f0 legacy=0x7ff2c01832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 >> v1:10.20.193.118:6789/0 conn(0x7ff2c01849f0 legacy=0x7ff2c01a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410601394 0 0) 0x7f1d900575d0 con 0x7f1d9008c0d0 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient(hunting): my global_id is 4300 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 monclient: found mon.noname-a 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d90056bb0 con 0x7f1d9008c0d0 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c008d950 con 0x7ff2c013bb70 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff2b4002dd0 con 0x7ff2c013bb70 2026-02-17T05:28:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 5 monclient: authenticate success, global_id 4296 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: dump: 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3673405179 0 0) 0x7f1d900578b0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 >> v1:10.20.193.106:6790/0 conn(0x7f1d900585c0 legacy=0x7f1d9013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 >> v1:10.20.193.118:6789/0 conn(0x7f1d9008c0d0 legacy=0x7f1d901a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 monclient: found mon.noname-a 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 1 Processor -- start 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d90057b90 con 0x7f1d9013f6c0 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1d80002dd0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 5 monclient: authenticate success, global_id 4299 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: dump: 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.866 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f8ad005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f8ad005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-a con 0x7f664c0585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f8ad0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-c con 0x7f664c13f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 1 -- start start 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient: init 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad008b060 con 0x7f8ad0182720 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad005dc90 con 0x7f8ad005d1b0 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad008d6a0 con 0x7f8ad005dee0 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-b con 0x7f664c08c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c056bb0 con 0x7f664c0585c0 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient(hunting): authenticate will time out at 617.479189s 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c0575d0 con 0x7f664c13f6c0 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c0578b0 con 0x7f664c08c0d0 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient(hunting): authenticate will time out at 617.479206s 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2b4003020 con 0x7ff2c013bb70 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 1 -- 10.20.193.106:0/2858426703 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff2b4003430 con 0x7ff2c013bb70 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2bdd74640 10 monclient: dump: 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 4 set_mon_vals no callback set 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8aceffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8ad005dee0 0x7f8ad0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36170/0 (socket says 10.20.193.106:36170) 2026-02-17T05:28:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8aceffd640 1 -- 10.20.193.106:0/1437004537 learned_addr learned my addr 10.20.193.106:0/1437004537 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 10 monclient: monmap: 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:08.851608+0000 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:08.851608+0000 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6650d37640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f664c0585c0 0x7f664c13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36194/0 (socket says 10.20.193.106:36194) 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6650d37640 1 -- 10.20.193.106:0/745738014 learned_addr learned my addr 10.20.193.106:0/745738014 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.871 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6651538640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f664c08c0d0 0x7f664c1a4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36174/0 (socket says 10.20.193.106:36174) 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d80002fa0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 1 -- 10.20.193.106:0/2021081902 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1d800033b0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d8effd640 10 monclient: dump: 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.872 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464757410 0 0) 0x7f8ad008d6a0 con 0x7f8ad005dee0 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-a con 0x7f0b940585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-c con 0x7f0b9413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): my global_id is 4295 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232940302 0 0) 0x7f664c0578b0 con 0x7f664c08c0d0 2026-02-17T05:28:08.873 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): my global_id is 4298 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab40035e0 con 0x7f8ad005dee0 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784538373 0 0) 0x7f8ad008b060 con 0x7f8ad0182720 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66380035e0 con 0x7f664c08c0d0 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444243341 0 0) 0x7f664c056bb0 con 0x7f664c0585c0 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-b con 0x7f0b9408c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.874 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient(hunting): my global_id is 4302 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient(hunting): my global_id is 4305 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664c0578b0 con 0x7f664c0585c0 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b94056bb0 con 0x7f0b940585c0 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b940575d0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad008d6a0 con 0x7f8ad0182720 2026-02-17T05:28:08.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b940578b0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 10 monclient(hunting): authenticate will time out at 617.479514s 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b99bd0640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f0b940585c0 0x7f0b9413efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36214/0 (socket says 10.20.193.106:36214) 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b99bd0640 1 -- 10.20.193.106:0/2179122411 learned_addr learned my addr 10.20.193.106:0/2179122411 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3030436017 0 0) 0x7f66380035e0 con 0x7f664c08c0d0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 >> v1:10.20.193.118:6789/0 conn(0x7f664c13f6c0 legacy=0x7f664c183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 >> v1:10.20.193.106:6789/0 conn(0x7f664c0585c0 legacy=0x7f664c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c057b90 con 0x7f664c08c0d0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6648003eb0 con 0x7f664c08c0d0 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: dump: 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 5 monclient: authenticate success, global_id 4298 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 10 monclient: shutdown 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 1 -- 10.20.193.106:0/2858426703 >> v1:10.20.193.106:6789/0 conn(0x7ff2c013bb70 legacy=0x7ff2c013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577295174 0 0) 0x7f8ab40035e0 con 0x7f8ad005dee0 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 >> v1:10.20.193.118:6789/0 conn(0x7f8ad005d1b0 legacy=0x7f8ad005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 >> v1:10.20.193.106:6789/0 conn(0x7f8ad0182720 legacy=0x7f8ad01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 10 monclient: shutdown 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 1 -- 10.20.193.106:0/2858426703 shutdown_connections 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 1 -- 10.20.193.106:0/2021081902 >> v1:10.20.193.106:6789/0 conn(0x7f1d9013f6c0 legacy=0x7f1d90183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582590954 0 0) 0x7f0b940578b0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): my global_id is 4301 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad0057960 con 0x7f8ad005dee0 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 1 -- 10.20.193.106:0/2858426703 >> 10.20.193.106:0/2858426703 conn(0x7ff2c00915f0 msgr2=0x7ff2c00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7c0035e0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626493513 0 0) 0x7f0b94056bb0 con 0x7f0b940585c0 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.879 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8ac0002dd0 con 0x7f8ad005dee0 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 1 Processor -- start 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 1 -- 10.20.193.106:0/2858426703 shutdown_connections 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 1 -- 10.20.193.106:0/2021081902 shutdown_connections 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 1 -- 10.20.193.106:0/2021081902 >> 10.20.193.106:0/2021081902 conn(0x7f1d9005e410 msgr2=0x7f1d90095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient(hunting): my global_id is 4308 2026-02-17T05:28:08.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b940578b0 con 0x7f0b940585c0 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 5 monclient: authenticate success, global_id 4295 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7ff2c505b640 1 -- 10.20.193.106:0/2858426703 wait complete. 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 1 -- 10.20.193.106:0/2021081902 shutdown_connections 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f1d9650c640 1 -- 10.20.193.106:0/2021081902 wait complete. 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: dump: 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.881 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6648004130 con 0x7f664c08c0d0 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 1 -- 10.20.193.106:0/745738014 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6648004540 con 0x7f664c08c0d0 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 1 -- start start 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f280cd4c640 10 monclient: init 2026-02-17T05:28:08.882 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f66437fe640 10 monclient: dump: 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f6652fc2640 4 set_mon_vals no callback set 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1215800900 0 0) 0x7f0b7c0035e0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 >> v1:10.20.193.118:6789/0 conn(0x7f0b9413f6c0 legacy=0x7f0b94183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 >> v1:10.20.193.106:6789/0 conn(0x7f0b940585c0 legacy=0x7f0b9413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 monclient: found mon.noname-b 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b94057b90 con 0x7f0b9408c0d0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0b90003eb0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 5 monclient: authenticate success, global_id 4301 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b98bce640 10 monclient: dump: 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f0b9be5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ac0002fd0 con 0x7f8ad005dee0 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 1 -- 10.20.193.106:0/1437004537 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8ac00033e0 con 0x7f8ad005dee0 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ad5e1b640 4 set_mon_vals no callback set 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.851+0000 7f8ace7fc640 10 monclient: dump: 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.885 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b90004170 con 0x7f0b9408c0d0 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 1 -- 10.20.193.106:0/2179122411 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0b90004580 con 0x7f0b9408c0d0 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b98bce640 10 monclient: dump: 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 4 set_mon_vals no callback set 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 10 monclient: shutdown 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- 10.20.193.106:0/745738014 >> v1:10.20.193.106:6790/0 conn(0x7f664c08c0d0 legacy=0x7f664c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- 10.20.193.106:0/745738014 shutdown_connections 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- 10.20.193.106:0/745738014 >> 10.20.193.106:0/745738014 conn(0x7f664c05e410 msgr2=0x7f664c095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- 10.20.193.106:0/745738014 shutdown_connections 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- 10.20.193.106:0/745738014 wait complete. 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient: monmap: 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.887 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient: monmap: 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.888 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-a con 0x7f2808088550 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-c con 0x7f2808088920 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-b con 0x7f280805dc70 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2808087e70 con 0x7f2808088550 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2808056fd0 con 0x7f2808088920 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28080891c0 con 0x7f280805dc70 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient(hunting): authenticate will time out at 617.480273s 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 10 monclient: shutdown 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2179122411 >> v1:10.20.193.106:6790/0 conn(0x7f0b9408c0d0 legacy=0x7f0b941a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2806575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2808088550 0x7f28080561b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36228/0 (socket says 10.20.193.106:36228) 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2806575640 1 -- 10.20.193.106:0/4046264267 learned_addr learned my addr 10.20.193.106:0/4046264267 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2179122411 shutdown_connections 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2179122411 >> 10.20.193.106:0/2179122411 conn(0x7f0b9405e410 msgr2=0x7f0b94095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2179122411 shutdown_connections 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 10 monclient: shutdown 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/1437004537 >> v1:10.20.193.106:6790/0 conn(0x7f8ad005dee0 legacy=0x7f8ad0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2179122411 wait complete. 2026-02-17T05:28:08.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/1437004537 shutdown_connections 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/1437004537 >> 10.20.193.106:0/1437004537 conn(0x7f8ad00915f0 msgr2=0x7f8ad00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/1437004537 shutdown_connections 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/1437004537 wait complete. 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 1 Processor -- start 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 10 monclient: monmap: 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.891 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033188326 0 0) 0x7f2808087e70 con 0x7f2808088550 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): my global_id is 4311 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27f40035e0 con 0x7f2808088550 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 1 -- start start 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient: init 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 1 Processor -- start 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220645142 0 0) 0x7f28080891c0 con 0x7f280805dc70 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient(hunting): my global_id is 4304 2026-02-17T05:28:08.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2808087e70 con 0x7f280805dc70 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 1 -- start start 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient: init 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 31947949 0 0) 0x7f27f40035e0 con 0x7f2808088550 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 >> v1:10.20.193.106:6790/0 conn(0x7f280805dc70 legacy=0x7f28081a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 Processor -- start 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 >> v1:10.20.193.118:6789/0 conn(0x7f2808088920 legacy=0x7f28080568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 monclient: found mon.noname-a 2026-02-17T05:28:08.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280808ca90 con 0x7f2808088550 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27fc002dd0 con 0x7f2808088550 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: dump: 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 5 monclient: authenticate success, global_id 4311 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 1 -- start start 2026-02-17T05:28:08.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f6652fc2640 10 monclient: init 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f0b9be5b640 10 monclient: monmap: 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27fc003010 con 0x7f2808088550 2026-02-17T05:28:08.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 1 -- 10.20.193.106:0/4046264267 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27fc003420 con 0x7f2808088550 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f280cd4c640 4 set_mon_vals no callback set 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f8ad5e1b640 10 monclient: monmap: 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.897 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f2805573640 10 monclient: dump: 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.898 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2c008d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2c013bb70 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient(hunting): picked mon.noname-a con 0x7ff2c01849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c008a280 con 0x7ff2c01849f0 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c005e8e0 con 0x7ff2c008d4f0 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c01a5f20 con 0x7ff2c013bb70 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7ff2c505b640 10 monclient(hunting): authenticate will time out at 617.480969s 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.852+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-a con 0x7f1d900585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-b con 0x7f1d9008c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 1 Processor -- start 2026-02-17T05:28:08.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-c con 0x7f664c0585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2be575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff2c013bb70 0x7ff2c017fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36188/0 (socket says 10.20.193.106:36188) 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2be575640 1 -- 10.20.193.106:0/1292708490 learned_addr learned my addr 10.20.193.106:0/1292708490 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2bf577640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff2c01849f0 0x7ff2c0181260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36236/0 (socket says 10.20.193.106:36236) 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient(hunting): picked mon.noname-c con 0x7f1d9013f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d9012cee0 con 0x7f1d900585c0 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-b con 0x7f664c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient(hunting): picked mon.noname-a con 0x7f664c13f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d9008c530 con 0x7f1d9008c0d0 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d9012e6e0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient(hunting): authenticate will time out at 617.481079s 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c13e560 con 0x7f664c13f6c0 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c08c530 con 0x7f664c08c0d0 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c12e390 con 0x7f664c0585c0 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient(hunting): authenticate will time out at 617.481081s 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 1 -- start start 2026-02-17T05:28:08.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient: init 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8ffff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1d900585c0 0x7f1d90152440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36248/0 (socket says 10.20.193.106:36248) 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8ffff640 1 -- 10.20.193.106:0/2825377883 learned_addr learned my addr 10.20.193.106:0/2825377883 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 10 monclient: shutdown 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- 10.20.193.106:0/4046264267 >> v1:10.20.193.106:6789/0 conn(0x7f2808088550 legacy=0x7f28080561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6650d37640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f664c0585c0 0x7f664c12b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36192/0 (socket says 10.20.193.106:36192) 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6650d37640 1 -- 10.20.193.106:0/2163534729 learned_addr learned my addr 10.20.193.106:0/2163534729 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 1 Processor -- start 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- 10.20.193.106:0/4046264267 shutdown_connections 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- 10.20.193.106:0/4046264267 >> 10.20.193.106:0/4046264267 conn(0x7f2808055050 msgr2=0x7f2808092090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 1 -- start start 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient: init 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- 10.20.193.106:0/4046264267 shutdown_connections 2026-02-17T05:28:08.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- 10.20.193.106:0/4046264267 wait complete. 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111815855 0 0) 0x7ff2c01a5f20 con 0x7ff2c013bb70 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): my global_id is 4307 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff28c0035e0 con 0x7ff2c013bb70 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800911428 0 0) 0x7ff2c008a280 con 0x7ff2c01849f0 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197341285 0 0) 0x7f664c12e390 con 0x7f664c0585c0 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): my global_id is 4314 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c01a5f20 con 0x7ff2c01849f0 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): my global_id is 4310 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f661c0035e0 con 0x7f664c0585c0 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927392043 0 0) 0x7f1d9012cee0 con 0x7f1d900585c0 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): my global_id is 4317 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d600035e0 con 0x7f1d900585c0 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176269707 0 0) 0x7f1d9012e6e0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): my global_id is 4313 2026-02-17T05:28:08.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d9012cee0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-b con 0x7f0b940585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-a con 0x7f0b9408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient(hunting): picked mon.noname-c con 0x7f0b9413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b94142750 con 0x7f0b9408c0d0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9413e5c0 con 0x7f0b940585c0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9412c7c0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b9be5b640 10 monclient(hunting): authenticate will time out at 617.481424s 2026-02-17T05:28:08.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255604614 0 0) 0x7f664c13e560 con 0x7f664c13f6c0 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): my global_id is 4320 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664c12e390 con 0x7f664c13f6c0 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f8ad005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f8ad005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b993cf640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f0b9408c0d0 0x7f0b9412c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36276/0 (socket says 10.20.193.106:36276) 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b993cf640 1 -- 10.20.193.106:0/2527234704 learned_addr learned my addr 10.20.193.106:0/2527234704 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f8ad0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad005ceb0 con 0x7f8ad005dee0 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad012cb30 con 0x7f8ad005d1b0 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad012be70 con 0x7f8ad0182720 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8ad5e1b640 10 monclient(hunting): authenticate will time out at 617.481494s 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2652523337 0 0) 0x7ff28c0035e0 con 0x7ff2c013bb70 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2c008a280 con 0x7ff2c013bb70 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff2a8003090 con 0x7ff2c013bb70 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1462374752 0 0) 0x7f661c0035e0 con 0x7f664c0585c0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3334633233 0 0) 0x7ff2c01a5f20 con 0x7ff2c01849f0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f664c13e560 con 0x7f664c0585c0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff28c0035e0 con 0x7ff2c01849f0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff2b0004110 con 0x7ff2c01849f0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f663c003170 con 0x7f664c0585c0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): dump: 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968160755 0 0) 0x7ff2c005e8e0 con 0x7ff2c008d4f0 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8acffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8ad0182720 0x7f8ad0195310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36216/0 (socket says 10.20.193.106:36216) 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8acffff640 1 -- 10.20.193.106:0/559867968 learned_addr learned my addr 10.20.193.106:0/559867968 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): dump: 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient(hunting): my global_id is 4312 2026-02-17T05:28:08.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c01a5f20 con 0x7ff2c008d4f0 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1575936020 0 0) 0x7f1d9012cee0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d9012e6e0 con 0x7f1d9013f6c0 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1d84004150 con 0x7f1d9013f6c0 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 10 monclient: build_initial_monmap 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 10 monclient: monmap: 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:08.915 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): dump: 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3852075423 0 0) 0x7ff2c008a280 con 0x7ff2c013bb70 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4064651605 0 0) 0x7f1d600035e0 con 0x7f1d900585c0 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 >> v1:10.20.193.118:6789/0 conn(0x7ff2c008d4f0 legacy=0x7ff2c01a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 >> v1:10.20.193.106:6789/0 conn(0x7ff2c01849f0 legacy=0x7ff2c0181260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d9012cee0 con 0x7f1d900585c0 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1d7c003170 con 0x7f1d900585c0 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 monclient: found mon.c 2026-02-17T05:28:08.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): dump: 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c012a490 con 0x7ff2c013bb70 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142497252 0 0) 0x7f0b9412c7c0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): my global_id is 4316 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 5 monclient: authenticate success, global_id 4307 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 10 monclient: _renew_subs 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b640035e0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c0129bf0 con 0x7ff2c013bb70 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 10 monclient: _renew_subs 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a56f0 con 0x7ff2c013bb70 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468688350 0 0) 0x7f664c08c530 con 0x7f664c08c0d0 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient(hunting): my global_id is 4315 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f661c0035e0 con 0x7f664c08c0d0 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2836926748 0 0) 0x7f664c13e560 con 0x7f664c0585c0 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 >> v1:10.20.193.118:6789/0 conn(0x7f664c08c0d0 legacy=0x7f664c12c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 >> v1:10.20.193.106:6789/0 conn(0x7f664c13f6c0 legacy=0x7f664c1945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 monclient: found mon.c 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435591273 0 0) 0x7f1d9008c530 con 0x7f1d9008c0d0 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c12e670 con 0x7f664c0585c0 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient(hunting): my global_id is 4318 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d600035e0 con 0x7f1d9008c0d0 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81017944 0 0) 0x7f0b88003980 con 0x7f0b9408c0d0 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): my global_id is 4323 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9412c7c0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f66417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 5 monclient: authenticate success, global_id 4310 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _renew_subs 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 Processor -- start 2026-02-17T05:28:08.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f664c08b7c0 con 0x7f664c0585c0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2208310246 0 0) 0x7f1d9012cee0 con 0x7f1d900585c0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 >> v1:10.20.193.106:6790/0 conn(0x7f1d9013f6c0 legacy=0x7f1d90194a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 >> v1:10.20.193.118:6789/0 conn(0x7f1d9008c0d0 legacy=0x7f1d90193350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 monclient: found mon.a 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9013e460 con 0x7f1d900585c0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _renew_subs 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f664c08afe0 con 0x7f664c0585c0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d8cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 5 monclient: authenticate success, global_id 4317 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient: _renew_subs 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9008b880 con 0x7f1d900585c0 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 1 -- start start 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f280cd4c640 10 monclient: init 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627881629 0 0) 0x7f8ad012be70 con 0x7f8ad0182720 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2a8003260 con 0x7ff2c013bb70 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2953710673 0 0) 0x7f0b640035e0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): my global_id is 4319 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff2a8004b10 con 0x7ff2c013bb70 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff2bd573640 4 set_mon_vals no callback set 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b88003980 con 0x7f0b9413f6c0 2026-02-17T05:28:08.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aa00035e0 con 0x7f8ad0182720 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7ff29f7fe640 10 monclient: dump: 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0b90004490 con 0x7f0b9413f6c0 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): dump: 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f0b827fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187644086 0 0) 0x7f8ad0057960 con 0x7f8ad005dee0 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 10 monclient(hunting): my global_id is 4326 2026-02-17T05:28:08.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient: _renew_subs 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d9008bcc0 con 0x7f1d900585c0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.853+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad012be70 con 0x7f8ad005dee0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1648541562 0 0) 0x7f0b9412c7c0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b640035e0 con 0x7f0b9408c0d0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0b88004240 con 0x7f0b9408c0d0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient(hunting): dump: 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.928 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858263138 0 0) 0x7f8ad012cb30 con 0x7f8ad005d1b0 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): my global_id is 4321 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad0057960 con 0x7f8ad005d1b0 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f663c0048a0 con 0x7f664c0585c0 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f663c004bc0 con 0x7f664c0585c0 2026-02-17T05:28:08.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d7c0048a0 con 0x7f1d900585c0 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f6642ffd640 4 set_mon_vals no callback set 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 10 monclient: dump: 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1d7c004bc0 con 0x7f1d900585c0 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8e7fc640 4 set_mon_vals no callback set 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 439232295 0 0) 0x7f0b88003980 con 0x7f0b9413f6c0 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 >> v1:10.20.193.118:6789/0 conn(0x7f0b940585c0 legacy=0x7f0b9412b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 >> v1:10.20.193.106:6789/0 conn(0x7f0b9408c0d0 legacy=0x7f0b9412c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 10 monclient: dump: 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.931 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 monclient: found mon.c 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9408c530 con 0x7f0b9413f6c0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 5 monclient: authenticate success, global_id 4316 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 10 monclient: _renew_subs 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9412f020 con 0x7f0b9413f6c0 2026-02-17T05:28:08.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 10 monclient: _renew_subs 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b9408af80 con 0x7f0b9413f6c0 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4168284366 0 0) 0x7f8aa00035e0 con 0x7f8ad0182720 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ad012cb30 con 0x7f8ad0182720 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8ac4004250 con 0x7f8ad0182720 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): dump: 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.933 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 159524225 0 0) 0x7f8ad0057960 con 0x7f8ad005d1b0 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8aa00035e0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8abc003070 con 0x7f8ad005d1b0 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): dump: 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.934 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b90004630 con 0x7f0b9413f6c0 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff2c505b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 441449188 0 0) 0x7f8ad012be70 con 0x7f8ad005dee0 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff2c505b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff2c505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ad0057960 con 0x7f8ad005dee0 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8ac0002b30 con 0x7f8ad005dee0 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c00008d0 con 0x7ff2c013bb70 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient(hunting): dump: 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.936 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2812454496 0 0) 0x7f8aa00035e0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 >> v1:10.20.193.106:6790/0 conn(0x7f8ad0182720 legacy=0x7f8ad0195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 >> v1:10.20.193.106:6789/0 conn(0x7f8ad005dee0 legacy=0x7f8ad0180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 monclient: found mon.b 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad012c150 con 0x7f8ad005d1b0 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 5 monclient: authenticate success, global_id 4321 2026-02-17T05:28:08.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 10 monclient: _renew_subs 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad005e940 con 0x7f8ad005d1b0 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 10 monclient: _renew_subs 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ad01824f0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff2a8011ab0 con 0x7ff2c013bb70 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f6652fc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f6652fc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f6652fc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664c093240 con 0x7f664c0585c0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d9650c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d9650c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d9650c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d9012e010 con 0x7f1d900585c0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f663c011b60 con 0x7f664c0585c0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b83fff640 4 set_mon_vals no callback set 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8abc0031d0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8abc0034f0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8acdffb640 4 set_mon_vals no callback set 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0b90003a90 con 0x7f0b9413f6c0 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f8aabfff640 10 monclient: dump: 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 10 monclient: dump: 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7ff2a804fbe0 con 0x7ff2c013bb70 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f0b90011af0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1d7c011b60 con 0x7f1d900585c0 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f0b9004fb20 con 0x7f0b9413f6c0 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-c con 0x7f280805dc70 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-b con 0x7f2808088550 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient(hunting): picked mon.noname-a con 0x7f2808088920 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f280805e900 con 0x7f2808088920 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2808197440 con 0x7f2808088550 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2808197970 con 0x7f280805dc70 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b9be5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient(hunting): authenticate will time out at 617.482309s 2026-02-17T05:28:08.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f2806d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2808088920 0x7f2808239830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36292/0 (socket says 10.20.193.106:36292) 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f2806d76640 1 -- 10.20.193.106:0/2379288137 learned_addr learned my addr 10.20.193.106:0/2379288137 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237005988 0 0) 0x7f2808197970 con 0x7f280805dc70 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): my global_id is 4322 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d40035e0 con 0x7f280805dc70 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f663c04fb50 con 0x7f664c0585c0 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b9be5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b9be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b94093240 con 0x7f0b9413f6c0 2026-02-17T05:28:08.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8ad5e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747509018 0 0) 0x7f280805e900 con 0x7f2808088920 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): my global_id is 4329 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2808197970 con 0x7f2808088920 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151263527 0 0) 0x7f2808197440 con 0x7f2808088550 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): my global_id is 4327 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f280805e900 con 0x7f2808088550 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3828682696 0 0) 0x7f2808197970 con 0x7f2808088920 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f1d7c04fb80 con 0x7f1d900585c0 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2808197440 con 0x7f2808088920 2026-02-17T05:28:08.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27f8004190 con 0x7f2808088920 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2529440299 0 0) 0x7f280805e900 con 0x7f2808088550 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2808197970 con 0x7f2808088550 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27f0002ca0 con 0x7f2808088550 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:08.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7ff2bed76640 10 monclient: get_auth_request con 0x7ff28c040dd0 auth_method 0 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient(hunting): dump: 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3522207324 0 0) 0x7f2808197440 con 0x7f2808088920 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 >> v1:10.20.193.106:6790/0 conn(0x7f280805dc70 legacy=0x7f28081d73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 >> v1:10.20.193.118:6789/0 conn(0x7f2808088550 legacy=0x7f28081d7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 monclient: found mon.a 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:08.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2808197c50 con 0x7f2808088920 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f6643fff640 10 monclient: get_auth_request con 0x7f661c040a40 auth_method 0 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f27eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 5 monclient: authenticate success, global_id 4329 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient: _renew_subs 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.854+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28081d8240 con 0x7f2808088920 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 10 monclient: _renew_subs 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2808197080 con 0x7f2808088920 2026-02-17T05:28:08.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f0b99bd0640 10 monclient: get_auth_request con 0x7f0b64040b40 auth_method 0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f1d8f7fe640 10 monclient: get_auth_request con 0x7f1d60040d20 auth_method 0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8ad5e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8ad5e1b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad012a9b0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8abc003650 con 0x7f8ad005d1b0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28080008d0 con 0x7f2808088920 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.855+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f8abc04e8c0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.856+0000 7f8aceffd640 10 monclient: get_auth_request con 0x7f8aa0041150 auth_method 0 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.856+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7ff2a8013270 con 0x7ff2c013bb70 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7ff29f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7ff29f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27f80042f0 con 0x7f2808088920 2026-02-17T05:28:08.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f27f80049e0 con 0x7f2808088920 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f2804d72640 4 set_mon_vals no callback set 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f27eeffd640 10 monclient: dump: 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f1d7c0173c0 con 0x7f1d900585c0 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f1d8cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.857+0000 7f1d8cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f27f8004b40 con 0x7f2808088920 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f27f8050cc0 con 0x7f2808088920 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f2806575640 10 monclient: get_auth_request con 0x7f27d4040dc0 auth_method 0 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f8abc003930 con 0x7f8ad005d1b0 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f8aabfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.858+0000 7f8aabfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.859+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f663c0173b0 con 0x7f664c0585c0 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.859+0000 7f66417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.859+0000 7f66417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.860+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f27f8005230 con 0x7f2808088920 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.860+0000 7f27eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.860+0000 7f27eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.860+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f0b900139d0 con 0x7f0b9413f6c0 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.861+0000 7f0b827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:08.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.861+0000 7f0b827fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8ad5e1b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8ad5e1b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8ad5e1b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8ad0055570 con 0x7f8ad005d1b0 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8aabfff640 1 -- 10.20.193.106:0/559867968 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f8abc04b7e0 con 0x7f8ad005d1b0 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8aabfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.968+0000 7f8aabfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.969 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 >> v1:10.20.193.118:6812/703720803 conn(0x7f8aa0041150 legacy=0x7f8aa0061600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 10 monclient: shutdown 2026-02-17T05:28:08.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 >> v1:10.20.193.118:6789/0 conn(0x7f8ad005d1b0 legacy=0x7f8ad0194300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 shutdown_connections 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 >> 10.20.193.106:0/559867968 conn(0x7f8ad00915f0 msgr2=0x7f8ad013f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.970+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 shutdown_connections 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7f8ad5e1b640 1 -- 10.20.193.106:0/559867968 wait complete. 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7ff2c505b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7ff2c505b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7ff2c505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff2c008e3d0 con 0x7ff2c013bb70 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7f280cd4c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7f280cd4c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7f280cd4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.971+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f28081975f0 con 0x7f2808088920 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7ff29f7fe640 1 -- 10.20.193.106:0/1292708490 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7ff2a8016bd0 con 0x7ff2c013bb70 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7ff29f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7ff29f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f27eeffd640 1 -- 10.20.193.106:0/2379288137 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f28081975f0 con 0x7f2808088920 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f27eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f27eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d9650c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d9650c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d9650c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1d90058c70 con 0x7f1d900585c0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d8cff9640 1 -- 10.20.193.106:0/2825377883 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f1d7c016b70 con 0x7f1d900585c0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d8cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.972+0000 7f1d8cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.973 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b9be5b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b9be5b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b9be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0b9412df90 con 0x7f0b9413f6c0 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b827fc640 1 -- 10.20.193.106:0/2527234704 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f0b90016b80 con 0x7f0b9413f6c0 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b827fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.973+0000 7f0b827fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f6652fc2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f6652fc2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:08.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f6652fc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f664c058c70 con 0x7f664c0585c0 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f66417fa640 1 -- 10.20.193.106:0/2163534729 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f663c016b60 con 0x7f664c0585c0 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f66417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.974+0000 7f66417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stdout:47244640258 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 >> v1:10.20.193.118:6812/703720803 conn(0x7f27d4040dc0 legacy=0x7f27d4061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 10 monclient: shutdown 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 >> v1:10.20.193.106:6789/0 conn(0x7f2808088920 legacy=0x7f2808239830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 >> v1:10.20.193.118:6812/703720803 conn(0x7ff28c040dd0 legacy=0x7ff28c061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 10 monclient: shutdown 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 >> v1:10.20.193.106:6790/0 conn(0x7ff2c013bb70 legacy=0x7ff2c017fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 shutdown_connections 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 >> 10.20.193.106:0/2379288137 conn(0x7f2808055050 msgr2=0x7f2808059410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 shutdown_connections 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 shutdown_connections 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f280cd4c640 1 -- 10.20.193.106:0/2379288137 wait complete. 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 >> 10.20.193.106:0/1292708490 conn(0x7ff2c00915f0 msgr2=0x7ff2c0054cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 >> v1:10.20.193.118:6812/703720803 conn(0x7f1d60040d20 legacy=0x7f1d600611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 10 monclient: shutdown 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 shutdown_connections 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 >> v1:10.20.193.106:6789/0 conn(0x7f1d900585c0 legacy=0x7f1d90152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 shutdown_connections 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 >> 10.20.193.106:0/2825377883 conn(0x7f1d9005e410 msgr2=0x7f1d901416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 shutdown_connections 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7f1d9650c640 1 -- 10.20.193.106:0/2825377883 wait complete. 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.975+0000 7ff2c505b640 1 -- 10.20.193.106:0/1292708490 wait complete. 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 >> v1:10.20.193.118:6812/703720803 conn(0x7f0b64040b40 legacy=0x7f0b64060ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 10 monclient: shutdown 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 >> v1:10.20.193.106:6790/0 conn(0x7f0b9413f6c0 legacy=0x7f0b94194620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 shutdown_connections 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 >> 10.20.193.106:0/2527234704 conn(0x7f0b9405e410 msgr2=0x7f0b941415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 shutdown_connections 2026-02-17T05:28:08.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.976+0000 7f0b9be5b640 1 -- 10.20.193.106:0/2527234704 wait complete. 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 >> v1:10.20.193.118:6812/703720803 conn(0x7f661c040a40 legacy=0x7f661c060ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 10 monclient: shutdown 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 >> v1:10.20.193.106:6790/0 conn(0x7f664c0585c0 legacy=0x7f664c12b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 shutdown_connections 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 >> 10.20.193.106:0/2163534729 conn(0x7f664c05e410 msgr2=0x7f664c141690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 shutdown_connections 2026-02-17T05:28:08.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:08.977+0000 7f6652fc2640 1 -- 10.20.193.106:0/2163534729 wait complete. 2026-02-17T05:28:08.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-17T05:28:08.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-17T05:28:08.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-17T05:28:08.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-17T05:28:08.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-17T05:28:08.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-17T05:28:09.984 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:28:09.985 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T05:28:09.986 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T05:28:09.987 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:28:09.988 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T05:28:09.988 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T05:28:10.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: monmap: 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.054571+0000 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.054571+0000 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.059 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 1 Processor -- start 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 1 -- start start 2026-02-17T05:28:10.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: init 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd408eb80 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd40881e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd40885d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd408b330 con 0x7f6fd40885d0 2026-02-17T05:28:10.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd408d700 con 0x7f6fd40881e0 2026-02-17T05:28:10.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd408d9e0 con 0x7f6fd408eb80 2026-02-17T05:28:10.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.054+0000 7f6fda6cc640 10 monclient(hunting): authenticate will time out at 618.682930s 2026-02-17T05:28:10.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd8c42640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f6fd40885d0 0x7f6fd41a2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36294/0 (socket says 10.20.193.106:36294) 2026-02-17T05:28:10.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd8c42640 1 -- 10.20.193.106:0/2937912500 learned_addr learned my addr 10.20.193.106:0/2937912500 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd3fff640 1 --1- 10.20.193.106:0/2937912500 >> v1:10.20.193.106:6790/0 conn(0x7f6fd408eb80 0x7f6fd4087ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36234/0 (socket says 10.20.193.106:36234) 2026-02-17T05:28:10.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: monmap: 2026-02-17T05:28:10.064 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.064 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.055465+0000 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.055465+0000 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.065 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.066 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520127150 0 0) 0x7f6fd408b330 con 0x7f6fd40885d0 2026-02-17T05:28:10.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): my global_id is 4332 2026-02-17T05:28:10.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb80035e0 con 0x7f6fd40885d0 2026-02-17T05:28:10.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 1 Processor -- start 2026-02-17T05:28:10.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277279861 0 0) 0x7f6fd408d9e0 con 0x7f6fd408eb80 2026-02-17T05:28:10.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient(hunting): my global_id is 4325 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd408b330 con 0x7f6fd408eb80 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 37557627 0 0) 0x7f6fb80035e0 con 0x7f6fd40885d0 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 >> v1:10.20.193.106:6790/0 conn(0x7f6fd408eb80 legacy=0x7f6fd4087ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 >> v1:10.20.193.118:6789/0 conn(0x7f6fd40881e0 legacy=0x7f6fd4181120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd408dcc0 con 0x7f6fd40885d0 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc8003eb0 con 0x7f6fd40885d0 2026-02-17T05:28:10.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 1 -- start start 2026-02-17T05:28:10.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: init 2026-02-17T05:28:10.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: dump: 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.076 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fda6cc640 5 monclient: authenticate success, global_id 4332 2026-02-17T05:28:10.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fda6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fc80040b0 con 0x7f6fd40885d0 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fda6cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fda6cc640 4 set_mon_vals no callback set 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 1 -- 10.20.193.106:0/2937912500 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc80044c0 con 0x7f6fd40885d0 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f6fd2ffd640 10 monclient: dump: 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.079 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.080 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.080 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.055+0000 7f017508c640 10 monclient(hunting): picked mon.noname-a con 0x7f01700585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 10 monclient: shutdown 2026-02-17T05:28:10.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- 10.20.193.106:0/2937912500 >> v1:10.20.193.106:6789/0 conn(0x7f6fd40885d0 legacy=0x7f6fd41a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient(hunting): picked mon.noname-c con 0x7f017013f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient(hunting): picked mon.noname-b con 0x7f017008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0170056bb0 con 0x7f01700585c0 2026-02-17T05:28:10.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- 10.20.193.106:0/2937912500 shutdown_connections 2026-02-17T05:28:10.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700575d0 con 0x7f017013f6c0 2026-02-17T05:28:10.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016ed76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f01700585c0 0x7f017013efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36300/0 (socket says 10.20.193.106:36300) 2026-02-17T05:28:10.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016ed76640 1 -- 10.20.193.106:0/1149672802 learned_addr learned my addr 10.20.193.106:0/1149672802 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700578b0 con 0x7f017008c0d0 2026-02-17T05:28:10.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.085 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient(hunting): authenticate will time out at 618.684120s 2026-02-17T05:28:10.085 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- 10.20.193.106:0/2937912500 >> 10.20.193.106:0/2937912500 conn(0x7f6fd4091f30 msgr2=0x7f6fd408e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.085 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- 10.20.193.106:0/2937912500 shutdown_connections 2026-02-17T05:28:10.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- 10.20.193.106:0/2937912500 wait complete. 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202414032 0 0) 0x7f0170056bb0 con 0x7f01700585c0 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): my global_id is 4335 2026-02-17T05:28:10.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f015c0035e0 con 0x7f01700585c0 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503281873 0 0) 0x7f01700578b0 con 0x7f017008c0d0 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient(hunting): my global_id is 4328 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0170056bb0 con 0x7f017008c0d0 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3829834455 0 0) 0x7f015c0035e0 con 0x7f01700585c0 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 >> v1:10.20.193.106:6790/0 conn(0x7f017008c0d0 legacy=0x7f01701a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 >> v1:10.20.193.118:6789/0 conn(0x7f017013f6c0 legacy=0x7f0170183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0170057b90 con 0x7f01700585c0 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0164002dd0 con 0x7f01700585c0 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 5 monclient: authenticate success, global_id 4335 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: dump: 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.090 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0164002fd0 con 0x7f01700585c0 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 4 set_mon_vals no callback set 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 1 -- 10.20.193.106:0/1149672802 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f01640033e0 con 0x7f01700585c0 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 10 monclient: monmap: 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.092 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f016dd74640 10 monclient: dump: 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.093 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.094 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 Processor -- start 2026-02-17T05:28:10.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 1 -- start start 2026-02-17T05:28:10.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f6fda6cc640 10 monclient: init 2026-02-17T05:28:10.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 10 monclient: shutdown 2026-02-17T05:28:10.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 >> v1:10.20.193.106:6789/0 conn(0x7f01700585c0 legacy=0x7f017013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 shutdown_connections 2026-02-17T05:28:10.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.056+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 >> 10.20.193.106:0/1149672802 conn(0x7f017005e410 msgr2=0x7f0170095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 shutdown_connections 2026-02-17T05:28:10.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- 10.20.193.106:0/1149672802 wait complete. 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd40881e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd40885d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd408eb80 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40826d0 con 0x7f6fd408eb80 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4080370 con 0x7f6fd40881e0 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40811a0 con 0x7f6fd40885d0 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient(hunting): authenticate will time out at 618.685233s 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd37fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f6fd40885d0 0x7f6fd414f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36258/0 (socket says 10.20.193.106:36258) 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd8c42640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f6fd408eb80 0x7f6fd4194440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36312/0 (socket says 10.20.193.106:36312) 2026-02-17T05:28:10.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd37fe640 1 -- 10.20.193.106:0/1212986910 learned_addr learned my addr 10.20.193.106:0/1212986910 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient: monmap: 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.098 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870734879 0 0) 0x7f6fd40811a0 con 0x7f6fd40885d0 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): my global_id is 4331 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fa40035e0 con 0x7f6fd40885d0 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627368009 0 0) 0x7f6fd40826d0 con 0x7f6fd408eb80 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): my global_id is 4338 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd40811a0 con 0x7f6fd408eb80 2026-02-17T05:28:10.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453648136 0 0) 0x7f6fd4080370 con 0x7f6fd40881e0 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 Processor -- start 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): my global_id is 4336 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd40826d0 con 0x7f6fd40881e0 2026-02-17T05:28:10.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- start start 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient: init 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1775298028 0 0) 0x7f6fa40035e0 con 0x7f6fd40885d0 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd4080370 con 0x7f6fd40885d0 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc4003120 con 0x7f6fd40885d0 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.101 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 211024490 0 0) 0x7f6fd40811a0 con 0x7f6fd408eb80 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fa40035e0 con 0x7f6fd408eb80 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3885286161 0 0) 0x7f6fd40826d0 con 0x7f6fd40881e0 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd40811a0 con 0x7f6fd40881e0 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc8004220 con 0x7f6fd408eb80 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.102 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc0003010 con 0x7f6fd40881e0 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.104 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient(hunting): picked mon.noname-a con 0x7f01700585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient(hunting): picked mon.noname-c con 0x7f017008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient(hunting): picked mon.noname-b con 0x7f017013f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0170142790 con 0x7f01700585c0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017008b8f0 con 0x7f017013f6c0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017013e4b0 con 0x7f017008c0d0 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f017508c640 10 monclient(hunting): authenticate will time out at 618.685902s 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3171759645 0 0) 0x7f6fa40035e0 con 0x7f6fd408eb80 2026-02-17T05:28:10.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 >> v1:10.20.193.106:6790/0 conn(0x7f6fd40885d0 legacy=0x7f6fd414f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f016ed76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f01700585c0 0x7f017013cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36324/0 (socket says 10.20.193.106:36324) 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f016ed76640 1 -- 10.20.193.106:0/3701131667 learned_addr learned my addr 10.20.193.106:0/3701131667 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 >> v1:10.20.193.118:6789/0 conn(0x7f6fd40881e0 legacy=0x7f6fd414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 monclient: found mon.a 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4082110 con 0x7f6fd408eb80 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fd0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 5 monclient: authenticate success, global_id 4338 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient: _renew_subs 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.057+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd414f9b0 con 0x7f6fd408eb80 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 10 monclient: _renew_subs 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fd4058e50 con 0x7f6fd408eb80 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589890083 0 0) 0x7f017013e4b0 con 0x7f017008c0d0 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): my global_id is 4334 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013c0035e0 con 0x7f017008c0d0 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480456123 0 0) 0x7f0170057b90 con 0x7f01700585c0 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): my global_id is 4341 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017013e4b0 con 0x7f01700585c0 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fc8004450 con 0x7f6fd408eb80 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6fc8005de0 con 0x7f6fd408eb80 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 10 monclient: dump: 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.108 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd27fc640 4 set_mon_vals no callback set 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3884672215 0 0) 0x7f013c0035e0 con 0x7f017008c0d0 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0170057b90 con 0x7f017008c0d0 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0158002ff0 con 0x7f017008c0d0 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): dump: 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.110 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244254670 0 0) 0x7f017008b8f0 con 0x7f017013f6c0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): my global_id is 4339 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013c0035e0 con 0x7f017013f6c0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2694536323 0 0) 0x7f017013e4b0 con 0x7f01700585c0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f017008b8f0 con 0x7f01700585c0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f01640032f0 con 0x7f01700585c0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient(hunting): dump: 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.111 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3237108050 0 0) 0x7f0170057b90 con 0x7f017008c0d0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 >> v1:10.20.193.118:6789/0 conn(0x7f017013f6c0 legacy=0x7f0170194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 >> v1:10.20.193.106:6789/0 conn(0x7f01700585c0 legacy=0x7f017013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 monclient: found mon.c 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017008c530 con 0x7f017008c0d0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 5 monclient: authenticate success, global_id 4334 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _renew_subs 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f017012deb0 con 0x7f017008c0d0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _renew_subs 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f017008b100 con 0x7f017008c0d0 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd40889a0 con 0x7f6fd408eb80 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0158003230 con 0x7f017008c0d0 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0158003550 con 0x7f017008c0d0 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f014f7fe640 10 monclient: dump: 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.113 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f016d573640 4 set_mon_vals no callback set 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6fc8012d80 con 0x7f6fd408eb80 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f6fc8050a00 con 0x7f6fd408eb80 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.058+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0170093240 con 0x7f017008c0d0 2026-02-17T05:28:10.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.059+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f01580036b0 con 0x7f017008c0d0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.059+0000 7f6fd3fff640 10 monclient: get_auth_request con 0x7f6fa40410e0 auth_method 0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.059+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f015804e930 con 0x7f017008c0d0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.059+0000 7f016ed76640 10 monclient: get_auth_request con 0x7f013c040dd0 auth_method 0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f6fc8017cb0 con 0x7f6fd408eb80 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f6fd0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f6fd0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f0158016110 con 0x7f017008c0d0 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f014f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.061+0000 7f014f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.098+0000 7fb0dac47640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.098+0000 7fb0dac47640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.098+0000 7fb0dac47640 10 monclient: monmap: 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.099200+0000 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.099200+0000 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 1 Processor -- start 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 1 -- start start 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient: init 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 10 monclient: monmap: 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.116 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.099746+0000 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.099746+0000 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-a con 0x7fb0d40585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-b con 0x7fb0d413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-c con 0x7fb0d408c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d4056bb0 con 0x7fb0d40585c0 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fc29981b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fc29981b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fc29981b640 10 monclient: monmap: 2026-02-17T05:28:10.117 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.099960+0000 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.099960+0000 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d40575d0 con 0x7fb0d408c0d0 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d40578b0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0dac47640 10 monclient(hunting): authenticate will time out at 618.727627s 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0d89bc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb0d40585c0 0x7fb0d413efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36340/0 (socket says 10.20.193.106:36340) 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0d89bc640 1 -- 10.20.193.106:0/4155185812 learned_addr learned my addr 10.20.193.106:0/4155185812 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 1 Processor -- start 2026-02-17T05:28:10.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449926462 0 0) 0x7fb0d40578b0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): my global_id is 4337 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 1 -- start start 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fa664f0c640 10 monclient: init 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c00035e0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410826023 0 0) 0x7fb0d4056bb0 con 0x7fb0d40585c0 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 10 monclient(hunting): my global_id is 4344 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.099+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d40578b0 con 0x7fb0d40585c0 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 703901568 0 0) 0x7fb0c00035e0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 >> v1:10.20.193.118:6789/0 conn(0x7fb0d408c0d0 legacy=0x7fb0d41a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 1 Processor -- start 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 >> v1:10.20.193.106:6789/0 conn(0x7fb0d40585c0 legacy=0x7fb0d413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 monclient: found mon.noname-b 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4057b90 con 0x7fb0d413f6c0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0bc002dd0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: dump: 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.120 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 5 monclient: authenticate success, global_id 4337 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 1 -- start start 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient: init 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: monmap: 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.100568+0000 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.100568+0000 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.121 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0bc002fd0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 1 -- 10.20.193.106:0/4155185812 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0bc0033e0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 4 set_mon_vals no callback set 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0cb7fe640 10 monclient: dump: 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fa66013ec40 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fa66013f010 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fa6601811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66008a7d0 con 0x7fa6601811f0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66008d5c0 con 0x7fa66013ec40 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66008d800 con 0x7fa66013f010 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient(hunting): authenticate will time out at 618.728362s 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65ed76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa6601811f0 0x7fa6601a15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36348/0 (socket says 10.20.193.106:36348) 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65ed76640 1 -- 10.20.193.106:0/4103449138 learned_addr learned my addr 10.20.193.106:0/4103449138 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65dd74640 1 --1- 10.20.193.106:0/4103449138 >> v1:10.20.193.106:6790/0 conn(0x7fa66013f010 0x7fa66013f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36278/0 (socket says 10.20.193.106:36278) 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-c con 0x7fc2940585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-a con 0x7fc29413f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958671165 0 0) 0x7fa66008a7d0 con 0x7fa6601811f0 2026-02-17T05:28:10.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): my global_id is 4347 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-b con 0x7fc29408c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa64c0035e0 con 0x7fa6601811f0 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc294056bb0 con 0x7fc29413f6c0 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940575d0 con 0x7fc2940585c0 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940578b0 con 0x7fc29408c0d0 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368753510 0 0) 0x7fa66008d800 con 0x7fa66013f010 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc29981b640 10 monclient(hunting): authenticate will time out at 618.728627s 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 1 Processor -- start 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): my global_id is 4340 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66008a7d0 con 0x7fa66013f010 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc2927fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc29413f6c0 0x7fc294183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36356/0 (socket says 10.20.193.106:36356) 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc2927fc640 1 -- 10.20.193.106:0/675974325 learned_addr learned my addr 10.20.193.106:0/675974325 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 1 -- start start 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: init 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 10 monclient: shutdown 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 1 -- 10.20.193.106:0/4155185812 >> v1:10.20.193.106:6790/0 conn(0x7fb0d413f6c0 legacy=0x7fb0d4183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089212545 0 0) 0x7fa66008d5c0 con 0x7fa66013ec40 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient(hunting): my global_id is 4345 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66008d800 con 0x7fa66013ec40 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 96304698 0 0) 0x7fa64c0035e0 con 0x7fa6601811f0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 >> v1:10.20.193.106:6790/0 conn(0x7fa66013f010 legacy=0x7fa66013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 >> v1:10.20.193.118:6789/0 conn(0x7fa66013ec40 legacy=0x7fa66008ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66008a180 con 0x7fa6601811f0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa650003eb0 con 0x7fa6601811f0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: dump: 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.126 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 5 monclient: authenticate success, global_id 4347 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 1 -- 10.20.193.106:0/4155185812 shutdown_connections 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 1 -- 10.20.193.106:0/4155185812 >> 10.20.193.106:0/4155185812 conn(0x7fb0d405e410 msgr2=0x7fb0d4095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 1 -- 10.20.193.106:0/4155185812 shutdown_connections 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851704369 0 0) 0x7fc294056bb0 con 0x7fc29413f6c0 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fb0dac47640 1 -- 10.20.193.106:0/4155185812 wait complete. 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): my global_id is 4350 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2800035e0 con 0x7fc29413f6c0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494343959 0 0) 0x7fc2940578b0 con 0x7fc29408c0d0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 10 monclient(hunting): my global_id is 4343 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc294056bb0 con 0x7fc29408c0d0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6500040b0 con 0x7fa6601811f0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 1 -- 10.20.193.106:0/4103449138 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa6500044c0 con 0x7fa6601811f0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa664f0c640 4 set_mon_vals no callback set 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7fa65d573640 10 monclient: dump: 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.128 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.100+0000 7f230190c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 830321878 0 0) 0x7fc2800035e0 con 0x7fc29413f6c0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 >> v1:10.20.193.106:6790/0 conn(0x7fc29408c0d0 legacy=0x7fc2941a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 >> v1:10.20.193.118:6789/0 conn(0x7fc2940585c0 legacy=0x7fc29413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc294057b90 con 0x7fc29413f6c0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc27c002dd0 con 0x7fc29413f6c0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient(hunting): picked mon.noname-c con 0x7f22fc0585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient(hunting): picked mon.noname-a con 0x7f22fc13f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient(hunting): picked mon.noname-b con 0x7f22fc08c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc056bb0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 5 monclient: authenticate success, global_id 4350 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc0575d0 con 0x7f22fc0585c0 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc0578b0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient(hunting): authenticate will time out at 618.729052s 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: dump: 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc27c003010 con 0x7fc29413f6c0 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 1 -- 10.20.193.106:0/675974325 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc27c003420 con 0x7fc29413f6c0 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc291ffb640 10 monclient: dump: 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 4 set_mon_vals no callback set 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 10 monclient: shutdown 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 -- 10.20.193.106:0/4103449138 >> v1:10.20.193.106:6789/0 conn(0x7fa6601811f0 legacy=0x7fa6601a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 -- 10.20.193.106:0/4103449138 shutdown_connections 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22faffd640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f22fc0585c0 0x7f22fc13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.106:46224/0 (socket says 10.20.193.106:46224) 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22faffd640 1 -- 10.20.193.106:0/2774933994 learned_addr learned my addr 10.20.193.106:0/2774933994 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 -- 10.20.193.106:0/4103449138 >> 10.20.193.106:0/4103449138 conn(0x7fa6600915f0 msgr2=0x7fa6600919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 -- 10.20.193.106:0/4103449138 shutdown_connections 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 -- 10.20.193.106:0/4103449138 wait complete. 2026-02-17T05:28:10.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fb0dac47640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fb0dac47640 10 monclient: monmap: 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 10 monclient: shutdown 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 1 -- 10.20.193.106:0/675974325 >> v1:10.20.193.106:6789/0 conn(0x7fc29413f6c0 legacy=0x7fc294183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047111439 0 0) 0x7f22fc056bb0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): my global_id is 4353 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 1 -- 10.20.193.106:0/675974325 shutdown_connections 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e80035e0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651583939 0 0) 0x7f22fc0578b0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 1 -- 10.20.193.106:0/675974325 >> 10.20.193.106:0/675974325 conn(0x7fc29405e410 msgr2=0x7fc294095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient(hunting): my global_id is 4346 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22fc056bb0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 10 monclient: monmap: 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.135 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fa664f0c640 1 Processor -- start 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fc29981b640 1 -- 10.20.193.106:0/675974325 shutdown_connections 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1378826668 0 0) 0x7f22e80035e0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 >> v1:10.20.193.106:6790/0 conn(0x7f22fc08c0d0 legacy=0x7f22fc1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 >> v1:10.20.193.118:6789/0 conn(0x7f22fc0585c0 legacy=0x7f22fc13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc057b90 con 0x7f22fc13f6c0 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22e4002dd0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: dump: 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 5 monclient: authenticate success, global_id 4353 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22e4003010 con 0x7f22fc13f6c0 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 1 -- 10.20.193.106:0/2774933994 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22e4003420 con 0x7f22fc13f6c0 2026-02-17T05:28:10.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f230190c640 4 set_mon_vals no callback set 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7f22f9ffb640 10 monclient: dump: 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fb0dac47640 1 Processor -- start 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fb0dac47640 1 -- start start 2026-02-17T05:28:10.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.101+0000 7fb0dac47640 10 monclient: init 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: shutdown 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- 10.20.193.106:0/2774933994 >> v1:10.20.193.106:6789/0 conn(0x7f22fc13f6c0 legacy=0x7f22fc183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 1 -- 10.20.193.106:0/675974325 wait complete. 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- 10.20.193.106:0/2774933994 shutdown_connections 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- 10.20.193.106:0/2774933994 >> 10.20.193.106:0/2774933994 conn(0x7f22fc05e410 msgr2=0x7f22fc095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- 10.20.193.106:0/2774933994 shutdown_connections 2026-02-17T05:28:10.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:10.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- 10.20.193.106:0/2774933994 wait complete. 2026-02-17T05:28:10.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-c con 0x7fb0d40585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 1 -- start start 2026-02-17T05:28:10.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient: init 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-a con 0x7fb0d408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient(hunting): picked mon.noname-b con 0x7fb0d413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d413e560 con 0x7fb0d408c0d0 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d408ba80 con 0x7fb0d413f6c0 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d408c530 con 0x7fb0d40585c0 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient(hunting): authenticate will time out at 618.730152s 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0cbfff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb0d408c0d0 0x7fb0d41935e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36376/0 (socket says 10.20.193.106:36376) 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0d89bc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb0d40585c0 0x7fb0d413cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36318/0 (socket says 10.20.193.106:36318) 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0cbfff640 1 -- 10.20.193.106:0/4272794102 learned_addr learned my addr 10.20.193.106:0/4272794102 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fa66013ec40 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fa66013f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394149619 0 0) 0x7fb0d413e560 con 0x7fb0d408c0d0 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fa6601811f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): my global_id is 4356 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66005a740 con 0x7fa66013ec40 2026-02-17T05:28:10.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66013cf00 con 0x7fa66013f010 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66005c110 con 0x7fa6601811f0 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa664f0c640 10 monclient(hunting): authenticate will time out at 618.730366s 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a40035e0 con 0x7fb0d408c0d0 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939849770 0 0) 0x7fb0d408c530 con 0x7fb0d40585c0 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): my global_id is 4349 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d413e560 con 0x7fb0d40585c0 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa65ed76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa6601811f0 0x7fa66018eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36332/0 (socket says 10.20.193.106:36332) 2026-02-17T05:28:10.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa65ed76640 1 -- 10.20.193.106:0/4213701151 learned_addr learned my addr 10.20.193.106:0/4213701151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 10 monclient: monmap: 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: monmap: 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.144 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741070781 0 0) 0x7fb0d408ba80 con 0x7fb0d413f6c0 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): my global_id is 4354 2026-02-17T05:28:10.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d408c530 con 0x7fb0d413f6c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 661982030 0 0) 0x7fb0a40035e0 con 0x7fb0d408c0d0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0d408ba80 con 0x7fb0d408c0d0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0bc002d20 con 0x7fb0d408c0d0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): dump: 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 582632446 0 0) 0x7fb0d413e560 con 0x7fb0d40585c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0a40035e0 con 0x7fb0d40585c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0c4003020 con 0x7fb0d40585c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): dump: 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1382528035 0 0) 0x7fb0d408c530 con 0x7fb0d413f6c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0d413e560 con 0x7fb0d413f6c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0d00040d0 con 0x7fb0d413f6c0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 Processor -- start 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient(hunting): dump: 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3957716445 0 0) 0x7fb0d408ba80 con 0x7fb0d408c0d0 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 >> v1:10.20.193.106:6790/0 conn(0x7fb0d40585c0 legacy=0x7fb0d413cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 >> v1:10.20.193.118:6789/0 conn(0x7fb0d413f6c0 legacy=0x7fb0d4194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 monclient: found mon.a 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- start start 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: init 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d412e8e0 con 0x7fb0d408c0d0 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 1 Processor -- start 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713697926 0 0) 0x7fa66005a740 con 0x7fa66013ec40 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 5 monclient: authenticate success, global_id 4356 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _renew_subs 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): my global_id is 4359 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d412e040 con 0x7fb0d408c0d0 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa62c0035e0 con 0x7fa66013ec40 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111355693 0 0) 0x7fa66005c110 con 0x7fa6601811f0 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): my global_id is 4352 2026-02-17T05:28:10.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66005a740 con 0x7fa6601811f0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _renew_subs 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0d4152760 con 0x7fb0d408c0d0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 1 -- start start 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fc29981b640 10 monclient: init 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0bc003900 con 0x7fb0d408c0d0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0bc003cd0 con 0x7fb0d408c0d0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0c97fa640 10 monclient: dump: 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fb0caffd640 4 set_mon_vals no callback set 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:10.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient(hunting): picked mon.noname-b con 0x7f22fc0585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237550721 0 0) 0x7fa66013cf00 con 0x7fa66013f010 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient(hunting): picked mon.noname-a con 0x7f22fc08c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): my global_id is 4357 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient(hunting): picked mon.noname-c con 0x7f22fc13f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66005c110 con 0x7fa66013f010 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3862915387 0 0) 0x7fa66005a740 con 0x7fa6601811f0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc13e500 con 0x7f22fc08c0d0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc08c530 con 0x7f22fc0585c0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc08bb10 con 0x7f22fc13f6c0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7f230190c640 10 monclient(hunting): authenticate will time out at 618.730955s 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa66013cf00 con 0x7fa6601811f0 2026-02-17T05:28:10.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa650003dc0 con 0x7fa6601811f0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.102+0000 7fa646ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-c con 0x7fc2940585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-a con 0x7fc29408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient(hunting): picked mon.noname-b con 0x7fc29413f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29413e500 con 0x7fc29408c0d0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22fb7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f22fc13f6c0 0x7f22fc194d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36340/0 (socket says 10.20.193.106:36340) 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22fb7fe640 1 -- 10.20.193.106:0/1157615093 learned_addr learned my addr 10.20.193.106:0/1157615093 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29408c530 con 0x7fc29413f6c0 2026-02-17T05:28:10.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29408bb10 con 0x7fc2940585c0 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient(hunting): authenticate will time out at 618.731078s 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4240947626 0 0) 0x7fa62c0035e0 con 0x7fa66013ec40 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa66005a740 con 0x7fa66013ec40 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa654003040 con 0x7fa66013ec40 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1763284698 0 0) 0x7fa66005c110 con 0x7fa66013f010 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa62c0035e0 con 0x7fa66013f010 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa648003050 con 0x7fa66013f010 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.152 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc2927fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc29408c0d0 0x7fc2941935e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36402/0 (socket says 10.20.193.106:36402) 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc2927fc640 1 -- 10.20.193.106:0/2321734518 learned_addr learned my addr 10.20.193.106:0/2321734518 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc292ffd640 1 --1- 10.20.193.106:0/2321734518 >> v1:10.20.193.106:6790/0 conn(0x7fc2940585c0 0x7fc29413cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36342/0 (socket says 10.20.193.106:36342) 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1204447822 0 0) 0x7fa62c0035e0 con 0x7fa66013f010 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 >> v1:10.20.193.106:6790/0 conn(0x7fa6601811f0 legacy=0x7fa66018eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 >> v1:10.20.193.106:6789/0 conn(0x7fa66013ec40 legacy=0x7fa660058380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 monclient: found mon.b 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600591a0 con 0x7fa66013f010 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0dac47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 5 monclient: authenticate success, global_id 4357 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _renew_subs 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:10.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa66005e8e0 con 0x7fa66013f010 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0dac47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0dac47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d4093240 con 0x7fb0d408c0d0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _renew_subs 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa66013c9c0 con 0x7fa66013f010 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283686573 0 0) 0x7f22fc13e500 con 0x7f22fc08c0d0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): my global_id is 4362 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075131950 0 0) 0x7fc29413e500 con 0x7fc29408c0d0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22cc0035e0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): my global_id is 4365 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192029691 0 0) 0x7f22fc08bb10 con 0x7f22fc13f6c0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): my global_id is 4355 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22fc13e500 con 0x7f22fc13f6c0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2640035e0 con 0x7fc29408c0d0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb0bc003e30 con 0x7fb0d408c0d0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290122326 0 0) 0x7fc29408bb10 con 0x7fc2940585c0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): my global_id is 4358 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc29413e500 con 0x7fc2940585c0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6480048a0 con 0x7fa66013f010 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa648004bc0 con 0x7fa66013f010 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa65cd72640 4 set_mon_vals no callback set 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa646ffd640 10 monclient: dump: 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.155 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096478671 0 0) 0x7fc29408c530 con 0x7fc29413f6c0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): my global_id is 4360 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc29408bb10 con 0x7fc29413f6c0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4071910523 0 0) 0x7f22cc0035e0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22fc08bb10 con 0x7f22fc08c0d0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22e4002ce0 con 0x7f22fc08c0d0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): dump: 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fb0bc04fc70 con 0x7fb0d408c0d0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1048936415 0 0) 0x7f22fc13e500 con 0x7f22fc13f6c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22cc0035e0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22ec004160 con 0x7f22fc13f6c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): dump: 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851091388 0 0) 0x7f22fc08c530 con 0x7f22fc0585c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): my global_id is 4363 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22fc13e500 con 0x7f22fc0585c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 644529728 0 0) 0x7fc29413e500 con 0x7fc2940585c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc29408c530 con 0x7fc2940585c0 2026-02-17T05:28:10.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc2880030b0 con 0x7fc2940585c0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fb0d89bc640 10 monclient: get_auth_request con 0x7fb0a40410e0 auth_method 0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2785038353 0 0) 0x7fc29408bb10 con 0x7fc29413f6c0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc29413e500 con 0x7fc29413f6c0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc284004170 con 0x7fc29413f6c0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 327802488 0 0) 0x7f22fc13e500 con 0x7f22fc0585c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22fc08c530 con 0x7f22fc0585c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22f0002fc0 con 0x7f22fc0585c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient(hunting): dump: 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2401688559 0 0) 0x7f22cc0035e0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 >> v1:10.20.193.118:6789/0 conn(0x7f22fc0585c0 legacy=0x7f22fc13cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 >> v1:10.20.193.106:6789/0 conn(0x7f22fc08c0d0 legacy=0x7f22fc1935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 monclient: found mon.c 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc12e900 con 0x7f22fc13f6c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 379349890 0 0) 0x7fc29408c530 con 0x7fc2940585c0 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f22d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 5 monclient: authenticate success, global_id 4355 2026-02-17T05:28:10.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 10 monclient: _renew_subs 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 >> v1:10.20.193.118:6789/0 conn(0x7fc29413f6c0 legacy=0x7fc294194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc12d100 con 0x7f22fc13f6c0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 >> v1:10.20.193.106:6789/0 conn(0x7fc29408c0d0 legacy=0x7fc2941935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 monclient: found mon.c 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29412e900 con 0x7fc2940585c0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc26bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 10 monclient: _renew_subs 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f22fc08b2e0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6600008d0 con 0x7fa66013f010 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 5 monclient: authenticate success, global_id 4358 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient: _renew_subs 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.103+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc29412d100 con 0x7fc2940585c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 10 monclient: _renew_subs 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc29408b2e0 con 0x7fc2940585c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22ec0046b0 con 0x7f22fc13f6c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f22ec004a10 con 0x7f22fc13f6c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22f97fa640 4 set_mon_vals no callback set 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 10 monclient: dump: 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2880036d0 con 0x7fc2940585c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc288003aa0 con 0x7fc2940585c0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa648011b60 con 0x7fa66013f010 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc2917fa640 4 set_mon_vals no callback set 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 10 monclient: dump: 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fa64804fbf0 con 0x7fa66013f010 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f230190c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f230190c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f230190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22fc093240 con 0x7f22fc13f6c0 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fa65e575640 10 monclient: get_auth_request con 0x7fa62c041010 auth_method 0 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294093240 con 0x7fc2940585c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f22ec004b70 con 0x7f22fc13f6c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc288003c00 con 0x7fc2940585c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7f22ec050b90 con 0x7f22fc13f6c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.105+0000 7f22faffd640 10 monclient: get_auth_request con 0x7f22cc041100 auth_method 0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.104+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 1674829446 0 0) 0x7fc28804fbb0 con 0x7fc2940585c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.105+0000 7fc2927fc640 10 monclient: get_auth_request con 0x7fc264040da0 auth_method 0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb0bc016f00 con 0x7fb0d408c0d0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fb0c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fb0c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fa648017370 con 0x7fa66013f010 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fa646ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.106+0000 7fa646ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.107+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f22ec005230 con 0x7f22fc13f6c0 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.107+0000 7f22d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.107+0000 7f22d3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.108+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fc288017390 con 0x7fc2940585c0 2026-02-17T05:28:10.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.109+0000 7fc26bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.109+0000 7fc26bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f017508c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:10.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f017508c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:10.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f017508c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0170140910 con 0x7f017008c0d0 2026-02-17T05:28:10.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f014f7fe640 1 -- 10.20.193.106:0/3701131667 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7f01580158c0 con 0x7f017008c0d0 2026-02-17T05:28:10.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f014f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T05:28:10.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.173+0000 7f014f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.174 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.174+0000 7f6fda6cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.174+0000 7f6fda6cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.174+0000 7f6fda6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.174+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6fd405fef0 con 0x7f6fd408eb80 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.175+0000 7f6fd0ff9640 1 -- 10.20.193.106:0/1212986910 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 847495621) 0x7f6fc8017ad0 con 0x7f6fd408eb80 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.175+0000 7f6fd0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.175+0000 7f6fd0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.175 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 >> v1:10.20.193.118:6812/703720803 conn(0x7f013c040dd0 legacy=0x7f013c061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 10 monclient: shutdown 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 >> v1:10.20.193.106:6790/0 conn(0x7f017008c0d0 legacy=0x7f0170193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 shutdown_connections 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 >> 10.20.193.106:0/3701131667 conn(0x7f017005e410 msgr2=0x7f0170141620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 shutdown_connections 2026-02-17T05:28:10.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.176+0000 7f017508c640 1 -- 10.20.193.106:0/3701131667 wait complete. 2026-02-17T05:28:10.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 >> v1:10.20.193.118:6812/703720803 conn(0x7f6fa40410e0 legacy=0x7f6fa4061590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 10 monclient: shutdown 2026-02-17T05:28:10.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 >> v1:10.20.193.106:6789/0 conn(0x7f6fd408eb80 legacy=0x7f6fd4194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 shutdown_connections 2026-02-17T05:28:10.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 >> 10.20.193.106:0/1212986910 conn(0x7f6fd4091f30 msgr2=0x7f6fd4087540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 shutdown_connections 2026-02-17T05:28:10.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.178+0000 7f6fda6cc640 1 -- 10.20.193.106:0/1212986910 wait complete. 2026-02-17T05:28:10.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2026-02-17T05:28:10.186 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-17T05:28:10.187 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.214+0000 7fb0dac47640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.214+0000 7fb0dac47640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.214+0000 7fb0dac47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.214+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb0d4058c70 con 0x7fb0d408c0d0 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.215+0000 7fb0c97fa640 1 -- 10.20.193.106:0/4272794102 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7fb0bc016d20 con 0x7fb0d408c0d0 2026-02-17T05:28:10.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.215+0000 7fb0c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T05:28:10.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.215+0000 7fb0c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.217 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f230190c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f230190c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f230190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f22fc058c70 con 0x7f22fc13f6c0 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f22d3fff640 1 -- 10.20.193.106:0/1157615093 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 847495621) 0x7f22ec017b80 con 0x7f22fc13f6c0 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f22d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T05:28:10.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.216+0000 7f22d3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 >> v1:10.20.193.118:6812/703720803 conn(0x7fb0a40410e0 legacy=0x7fb0a4061590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 10 monclient: shutdown 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 >> v1:10.20.193.106:6789/0 conn(0x7fb0d408c0d0 legacy=0x7fb0d41935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 shutdown_connections 2026-02-17T05:28:10.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 >> 10.20.193.106:0/4272794102 conn(0x7fb0d405e410 msgr2=0x7fb0d4141690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc29981b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:10.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc29981b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:10.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 shutdown_connections 2026-02-17T05:28:10.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc29981b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fb0dac47640 1 -- 10.20.193.106:0/4272794102 wait complete. 2026-02-17T05:28:10.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc294058c70 con 0x7fc2940585c0 2026-02-17T05:28:10.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc26bfff640 1 -- 10.20.193.106:0/2321734518 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7fc288016b40 con 0x7fc2940585c0 2026-02-17T05:28:10.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc26bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T05:28:10.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.217+0000 7fc26bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.222 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 >> v1:10.20.193.118:6812/703720803 conn(0x7f22cc041100 legacy=0x7f22cc0615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 10 monclient: shutdown 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 >> v1:10.20.193.106:6790/0 conn(0x7f22fc13f6c0 legacy=0x7f22fc194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 shutdown_connections 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 >> 10.20.193.106:0/1157615093 conn(0x7f22fc05e410 msgr2=0x7f22fc141780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 shutdown_connections 2026-02-17T05:28:10.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7f230190c640 1 -- 10.20.193.106:0/1157615093 wait complete. 2026-02-17T05:28:10.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa664f0c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:10.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa664f0c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:10.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa664f0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:28:10.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa660090010 con 0x7fa66013f010 2026-02-17T05:28:10.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa646ffd640 1 -- 10.20.193.106:0/4213701151 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7fa648016b20 con 0x7fa66013f010 2026-02-17T05:28:10.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa646ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T05:28:10.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.219+0000 7fa646ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.225 INFO:teuthology.orchestra.run.trial106.stdout:47244640259 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 >> v1:10.20.193.118:6812/703720803 conn(0x7fc264040da0 legacy=0x7fc264061250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 10 monclient: shutdown 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 >> v1:10.20.193.106:6790/0 conn(0x7fc2940585c0 legacy=0x7fc29413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 shutdown_connections 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 >> 10.20.193.106:0/2321734518 conn(0x7fc29405e410 msgr2=0x7fc294141780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 shutdown_connections 2026-02-17T05:28:10.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.220+0000 7fc29981b640 1 -- 10.20.193.106:0/2321734518 wait complete. 2026-02-17T05:28:10.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 >> v1:10.20.193.118:6812/703720803 conn(0x7fa62c041010 legacy=0x7fa62c0614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 10 monclient: shutdown 2026-02-17T05:28:10.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 >> v1:10.20.193.118:6789/0 conn(0x7fa66013f010 legacy=0x7fa660058a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 shutdown_connections 2026-02-17T05:28:10.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 >> 10.20.193.106:0/4213701151 conn(0x7fa6600915f0 msgr2=0x7fa660054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 shutdown_connections 2026-02-17T05:28:10.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.222+0000 7fa664f0c640 1 -- 10.20.193.106:0/4213701151 wait complete. 2026-02-17T05:28:10.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2026-02-17T05:28:10.229 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2026-02-17T05:28:10.230 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-17T05:28:10.231 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2026-02-17T05:28:10.231 DEBUG:teuthology.parallel:result is None 2026-02-17T05:28:10.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T05:28:10.232 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:28:10.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: monmap: 2026-02-17T05:28:10.353 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.353 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.337552+0000 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.337552+0000 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.354 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 1 Processor -- start 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 1 -- start start 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: init 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-a con 0x7f7c9805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-c con 0x7f7c9805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-b con 0x7f7c98182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9808b060 con 0x7f7c9805d1b0 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9805dc90 con 0x7f7c9805dee0 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9808d6a0 con 0x7f7c98182720 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.337+0000 7f7c9e65b640 10 monclient(hunting): authenticate will time out at 618.965993s 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c97fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f7c9805d1b0 0x7f7c9805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36410/0 (socket says 10.20.193.106:36410) 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9cbd1640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7c98182720 0x7f7c981a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36352/0 (socket says 10.20.193.106:36352) 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c97fff640 1 -- 10.20.193.106:0/626348295 learned_addr learned my addr 10.20.193.106:0/626348295 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286197666 0 0) 0x7f7c9808d6a0 con 0x7f7c98182720 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4361 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c7c0035e0 con 0x7f7c98182720 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120934329 0 0) 0x7f7c9808b060 con 0x7f7c9805d1b0 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4368 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c9808d6a0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879178151 0 0) 0x7f7c9805dc90 con 0x7f7c9805dee0 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4366 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c9808b060 con 0x7f7c9805dee0 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2212474260 0 0) 0x7f7c9808d6a0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 >> v1:10.20.193.106:6790/0 conn(0x7f7c98182720 legacy=0x7f7c981a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 >> v1:10.20.193.118:6789/0 conn(0x7f7c9805dee0 legacy=0x7f7c98181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c98057960 con 0x7f7c9805d1b0 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c84002d00 con 0x7f7c9805d1b0 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: dump: 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.361 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 5 monclient: authenticate success, global_id 4368 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c84002ed0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 1 -- 10.20.193.106:0/626348295 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c840032a0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 4 set_mon_vals no callback set 2026-02-17T05:28:10.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c96ffd640 10 monclient: dump: 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.363 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 10 monclient: shutdown 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 1 -- 10.20.193.106:0/626348295 >> v1:10.20.193.106:6789/0 conn(0x7f7c9805d1b0 legacy=0x7f7c9805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 1 -- 10.20.193.106:0/626348295 shutdown_connections 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 1 -- 10.20.193.106:0/626348295 >> 10.20.193.106:0/626348295 conn(0x7f7c980915f0 msgr2=0x7f7c980919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 1 -- 10.20.193.106:0/626348295 shutdown_connections 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.338+0000 7f7c9e65b640 1 -- 10.20.193.106:0/626348295 wait complete. 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient: monmap: 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 1 Processor -- start 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 1 -- start start 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient: init 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-a con 0x7f7c9805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-b con 0x7f7c9805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient(hunting): picked mon.noname-c con 0x7f7c98182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9810dab0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c98089a90 con 0x7f7c9805dee0 2026-02-17T05:28:10.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9810ef00 con 0x7f7c98182720 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c9e65b640 10 monclient(hunting): authenticate will time out at 618.967854s 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c97fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f7c9805d1b0 0x7f7c9812a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36426/0 (socket says 10.20.193.106:36426) 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.339+0000 7f7c97fff640 1 -- 10.20.193.106:0/1441627697 learned_addr learned my addr 10.20.193.106:0/1441627697 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123726615 0 0) 0x7f7c9810ef00 con 0x7f7c98182720 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): my global_id is 4364 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c680035e0 con 0x7f7c98182720 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909328504 0 0) 0x7f7c9810dab0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): my global_id is 4371 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c9810ef00 con 0x7f7c9805d1b0 2026-02-17T05:28:10.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2928950603 0 0) 0x7f7c9810ef00 con 0x7f7c9805d1b0 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c9810dab0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c840031f0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2260327826 0 0) 0x7f7c680035e0 con 0x7f7c98182720 2026-02-17T05:28:10.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c9810ef00 con 0x7f7c98182720 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c8c0039d0 con 0x7f7c98182720 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2222704853 0 0) 0x7f7c9810dab0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 >> v1:10.20.193.106:6790/0 conn(0x7f7c98182720 legacy=0x7f7c98181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 >> v1:10.20.193.118:6789/0 conn(0x7f7c9805dee0 legacy=0x7f7c9812a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 monclient: found mon.a 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9812ae30 con 0x7f7c9805d1b0 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 5 monclient: authenticate success, global_id 4371 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _renew_subs 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9813f630 con 0x7f7c9805d1b0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _renew_subs 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c981824f0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c84002860 con 0x7f7c9805d1b0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7c84004d00 con 0x7f7c9805d1b0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c94ff9640 10 monclient: dump: 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.370 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c967fc640 4 set_mon_vals no callback set 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.340+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c980008d0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.341+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7c84011ca0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.341+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f7c8404fca0 con 0x7f7c9805d1b0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.341+0000 7f7c977fe640 10 monclient: get_auth_request con 0x7f7c68040bf0 auth_method 0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.343+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f7c84017560 con 0x7f7c9805d1b0 2026-02-17T05:28:10.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.343+0000 7f7c94ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.343+0000 7f7c94ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.445+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c98057ca0 con 0x7f7c68040bf0 2026-02-17T05:28:10.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.446+0000 7f7c94ff9640 1 -- 10.20.193.106:0/1441627697 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 3768875460) 0x7f7c88007880 con 0x7f7c68040bf0 2026-02-17T05:28:10.447 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:10.448 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:28:10.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 >> v1:10.20.193.118:6812/703720803 conn(0x7f7c68040bf0 legacy=0x7f7c680610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 10 monclient: shutdown 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 >> v1:10.20.193.106:6789/0 conn(0x7f7c9805d1b0 legacy=0x7f7c9812a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 shutdown_connections 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 >> 10.20.193.106:0/1441627697 conn(0x7f7c980915f0 msgr2=0x7f7c9808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 shutdown_connections 2026-02-17T05:28:10.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.447+0000 7f7c9e65b640 1 -- 10.20.193.106:0/1441627697 wait complete. 2026-02-17T05:28:10.455 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-17T05:28:10.239782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1475662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50696,"internal_metadata":165493240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527047"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738260+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:28:07.738260+0000","last_peered":"2026-02-17T05:28:07.738260+0000","last_clean":"2026-02-17T05:28:07.738260+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:28:07.738260+0000","last_undegraded":"2026-02-17T05:28:07.738260+0000","last_fullsized":"2026-02-17T05:28:07.738260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738997+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:28:07.738997+0000","last_peered":"2026-02-17T05:28:07.738997+0000","last_clean":"2026-02-17T05:28:07.738997+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:28:07.738997+0000","last_undegraded":"2026-02-17T05:28:07.738997+0000","last_fullsized":"2026-02-17T05:28:07.738997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738148+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:28:07.738148+0000","last_peered":"2026-02-17T05:28:07.738148+0000","last_clean":"2026-02-17T05:28:07.738148+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:28:07.738148+0000","last_undegraded":"2026-02-17T05:28:07.738148+0000","last_fullsized":"2026-02-17T05:28:07.738148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739035+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:28:07.739035+0000","last_peered":"2026-02-17T05:28:07.739035+0000","last_clean":"2026-02-17T05:28:07.739035+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:28:07.739035+0000","last_undegraded":"2026-02-17T05:28:07.739035+0000","last_fullsized":"2026-02-17T05:28:07.739035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739585+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:28:07.739585+0000","last_peered":"2026-02-17T05:28:07.739585+0000","last_clean":"2026-02-17T05:28:07.739585+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:28:07.739585+0000","last_undegraded":"2026-02-17T05:28:07.739585+0000","last_fullsized":"2026-02-17T05:28:07.739585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739136+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:28:07.739136+0000","last_peered":"2026-02-17T05:28:07.739136+0000","last_clean":"2026-02-17T05:28:07.739136+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:28:07.739136+0000","last_undegraded":"2026-02-17T05:28:07.739136+0000","last_fullsized":"2026-02-17T05:28:07.739136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738152+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:28:07.738152+0000","last_peered":"2026-02-17T05:28:07.738152+0000","last_clean":"2026-02-17T05:28:07.738152+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:28:07.738152+0000","last_undegraded":"2026-02-17T05:28:07.738152+0000","last_fullsized":"2026-02-17T05:28:07.738152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739072+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:28:07.739072+0000","last_peered":"2026-02-17T05:28:07.739072+0000","last_clean":"2026-02-17T05:28:07.739072+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:28:07.739072+0000","last_undegraded":"2026-02-17T05:28:07.739072+0000","last_fullsized":"2026-02-17T05:28:07.739072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.737842+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:28:07.737842+0000","last_peered":"2026-02-17T05:28:07.737842+0000","last_clean":"2026-02-17T05:28:07.737842+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:28:07.737842+0000","last_undegraded":"2026-02-17T05:28:07.737842+0000","last_fullsized":"2026-02-17T05:28:07.737842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:28:10.457 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:28:10.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.520+0000 7eff397b9640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.520+0000 7eff397b9640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.520+0000 7eff397b9640 10 monclient: monmap: 2026-02-17T05:28:10.536 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.520956+0000 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.520956+0000 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.537 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.520+0000 7eff397b9640 1 Processor -- start 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 1 -- start start 2026-02-17T05:28:10.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient: init 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-a con 0x7eff3405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-c con 0x7eff3405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-b con 0x7eff34182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3408b060 con 0x7eff3405d1b0 2026-02-17T05:28:10.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3405dc90 con 0x7eff3405dee0 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3408d6a0 con 0x7eff34182720 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient(hunting): authenticate will time out at 619.149349s 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff32ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7eff3405d1b0 0x7eff3405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36440/0 (socket says 10.20.193.106:36440) 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff32ffd640 1 -- 10.20.193.106:0/1765680097 learned_addr learned my addr 10.20.193.106:0/1765680097 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834105285 0 0) 0x7eff3408b060 con 0x7eff3405d1b0 2026-02-17T05:28:10.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): my global_id is 4374 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff200035e0 con 0x7eff3405d1b0 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124936052 0 0) 0x7eff3408d6a0 con 0x7eff34182720 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient(hunting): my global_id is 4367 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff3408b060 con 0x7eff34182720 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 924730166 0 0) 0x7eff200035e0 con 0x7eff3405d1b0 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 >> v1:10.20.193.106:6790/0 conn(0x7eff34182720 legacy=0x7eff341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 >> v1:10.20.193.118:6789/0 conn(0x7eff3405dee0 legacy=0x7eff34181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 monclient: found mon.noname-a 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34057960 con 0x7eff3405d1b0 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff28002dd0 con 0x7eff3405d1b0 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: dump: 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 5 monclient: authenticate success, global_id 4374 2026-02-17T05:28:10.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff28003050 con 0x7eff3405d1b0 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 1 -- 10.20.193.106:0/1765680097 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff28003460 con 0x7eff3405d1b0 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff31ffb640 10 monclient: dump: 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.545 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.521+0000 7eff397b9640 4 set_mon_vals no callback set 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 10 monclient: shutdown 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- 10.20.193.106:0/1765680097 >> v1:10.20.193.106:6789/0 conn(0x7eff3405d1b0 legacy=0x7eff3405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- 10.20.193.106:0/1765680097 shutdown_connections 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- 10.20.193.106:0/1765680097 >> 10.20.193.106:0/1765680097 conn(0x7eff340915f0 msgr2=0x7eff340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- 10.20.193.106:0/1765680097 shutdown_connections 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- 10.20.193.106:0/1765680097 wait complete. 2026-02-17T05:28:10.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 10 monclient: monmap: 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 Processor -- start 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 1 -- start start 2026-02-17T05:28:10.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.522+0000 7eff397b9640 10 monclient: init 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-a con 0x7eff3405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-b con 0x7eff3405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient(hunting): picked mon.noname-c con 0x7eff34182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3412c150 con 0x7eff3405d1b0 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3405e8e0 con 0x7eff3405dee0 2026-02-17T05:28:10.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3410bdc0 con 0x7eff34182720 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient(hunting): authenticate will time out at 619.151215s 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff32ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7eff3405d1b0 0x7eff3412b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36448/0 (socket says 10.20.193.106:36448) 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff32ffd640 1 -- 10.20.193.106:0/639531942 learned_addr learned my addr 10.20.193.106:0/639531942 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975054870 0 0) 0x7eff3412c150 con 0x7eff3405d1b0 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): my global_id is 4377 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff000035e0 con 0x7eff3405d1b0 2026-02-17T05:28:10.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331066287 0 0) 0x7eff3410bdc0 con 0x7eff34182720 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): my global_id is 4370 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff3412c150 con 0x7eff34182720 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2113649167 0 0) 0x7eff000035e0 con 0x7eff3405d1b0 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff3410bdc0 con 0x7eff3405d1b0 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff28003370 con 0x7eff3405d1b0 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): dump: 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.550 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 601503977 0 0) 0x7eff3412c150 con 0x7eff34182720 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff000035e0 con 0x7eff34182720 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff24004170 con 0x7eff34182720 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient(hunting): dump: 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1325736301 0 0) 0x7eff3410bdc0 con 0x7eff3405d1b0 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 >> v1:10.20.193.106:6790/0 conn(0x7eff34182720 legacy=0x7eff34181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 >> v1:10.20.193.118:6789/0 conn(0x7eff3405dee0 legacy=0x7eff3412ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 monclient: found mon.a 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3410a8d0 con 0x7eff3405d1b0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 5 monclient: authenticate success, global_id 4377 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _renew_subs 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff341824f0 con 0x7eff3405d1b0 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _renew_subs 2026-02-17T05:28:10.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7eff3410b660 con 0x7eff3405d1b0 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff280028c0 con 0x7eff3405d1b0 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff28004e60 con 0x7eff3405d1b0 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff137fe640 10 monclient: dump: 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.554 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.523+0000 7eff317fa640 4 set_mon_vals no callback set 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff397b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff397b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff397b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff340008d0 con 0x7eff3405d1b0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7eff28011e00 con 0x7eff3405d1b0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7eff2804fda0 con 0x7eff3405d1b0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.524+0000 7eff327fc640 10 monclient: get_auth_request con 0x7eff00040b60 auth_method 0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.526+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7eff28017660 con 0x7eff3405d1b0 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.526+0000 7eff137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.526+0000 7eff137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.627+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff34057ca0 con 0x7eff00040b60 2026-02-17T05:28:10.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.628+0000 7eff137fe640 1 -- 10.20.193.106:0/639531942 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 3768875460) 0x7eff1c007880 con 0x7eff00040b60 2026-02-17T05:28:10.630 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 >> v1:10.20.193.118:6812/703720803 conn(0x7eff00040b60 legacy=0x7eff00061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 10 monclient: shutdown 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 >> v1:10.20.193.106:6789/0 conn(0x7eff3405d1b0 legacy=0x7eff3412b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 shutdown_connections 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 >> 10.20.193.106:0/639531942 conn(0x7eff340915f0 msgr2=0x7eff3408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 shutdown_connections 2026-02-17T05:28:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.629+0000 7eff397b9640 1 -- 10.20.193.106:0/639531942 wait complete. 2026-02-17T05:28:10.637 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-17T05:28:10.239782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1475662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50696,"internal_metadata":165493240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527047"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738260+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:28:07.738260+0000","last_peered":"2026-02-17T05:28:07.738260+0000","last_clean":"2026-02-17T05:28:07.738260+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:28:07.738260+0000","last_undegraded":"2026-02-17T05:28:07.738260+0000","last_fullsized":"2026-02-17T05:28:07.738260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738997+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:28:07.738997+0000","last_peered":"2026-02-17T05:28:07.738997+0000","last_clean":"2026-02-17T05:28:07.738997+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:28:07.738997+0000","last_undegraded":"2026-02-17T05:28:07.738997+0000","last_fullsized":"2026-02-17T05:28:07.738997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738148+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:28:07.738148+0000","last_peered":"2026-02-17T05:28:07.738148+0000","last_clean":"2026-02-17T05:28:07.738148+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:28:07.738148+0000","last_undegraded":"2026-02-17T05:28:07.738148+0000","last_fullsized":"2026-02-17T05:28:07.738148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739035+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:28:07.739035+0000","last_peered":"2026-02-17T05:28:07.739035+0000","last_clean":"2026-02-17T05:28:07.739035+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:28:07.739035+0000","last_undegraded":"2026-02-17T05:28:07.739035+0000","last_fullsized":"2026-02-17T05:28:07.739035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739585+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:28:07.739585+0000","last_peered":"2026-02-17T05:28:07.739585+0000","last_clean":"2026-02-17T05:28:07.739585+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:28:07.739585+0000","last_undegraded":"2026-02-17T05:28:07.739585+0000","last_fullsized":"2026-02-17T05:28:07.739585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739136+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:28:07.739136+0000","last_peered":"2026-02-17T05:28:07.739136+0000","last_clean":"2026-02-17T05:28:07.739136+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:28:07.739136+0000","last_undegraded":"2026-02-17T05:28:07.739136+0000","last_fullsized":"2026-02-17T05:28:07.739136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738152+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:28:07.738152+0000","last_peered":"2026-02-17T05:28:07.738152+0000","last_clean":"2026-02-17T05:28:07.738152+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:28:07.738152+0000","last_undegraded":"2026-02-17T05:28:07.738152+0000","last_fullsized":"2026-02-17T05:28:07.738152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739072+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:28:07.739072+0000","last_peered":"2026-02-17T05:28:07.739072+0000","last_clean":"2026-02-17T05:28:07.739072+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:28:07.739072+0000","last_undegraded":"2026-02-17T05:28:07.739072+0000","last_fullsized":"2026-02-17T05:28:07.739072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.737842+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:28:07.737842+0000","last_peered":"2026-02-17T05:28:07.737842+0000","last_clean":"2026-02-17T05:28:07.737842+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:28:07.737842+0000","last_undegraded":"2026-02-17T05:28:07.737842+0000","last_fullsized":"2026-02-17T05:28:07.737842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:28:10.639 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T05:28:10.639 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T05:28:10.639 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T05:28:10.640 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T05:28:10.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: monmap: 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.703545+0000 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.703545+0000 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.712 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 1 Processor -- start 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 1 -- start start 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: init 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-c con 0x7f5c2005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-b con 0x7f5c2005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-a con 0x7f5c20182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2008b060 con 0x7f5c20182720 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2005dc90 con 0x7f5c2005d1b0 2026-02-17T05:28:10.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2008d6a0 con 0x7f5c2005dee0 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c24c8c640 10 monclient(hunting): authenticate will time out at 619.331914s 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.703+0000 7f5c1dd74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f5c2005dee0 0x7f5c20181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36384/0 (socket says 10.20.193.106:36384) 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1dd74640 1 -- 10.20.193.106:0/3835932352 learned_addr learned my addr 10.20.193.106:0/3835932352 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502797674 0 0) 0x7f5c2008d6a0 con 0x7f5c2005dee0 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): my global_id is 4373 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c0c0035e0 con 0x7f5c2005dee0 2026-02-17T05:28:10.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782638837 0 0) 0x7f5c2008b060 con 0x7f5c20182720 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): my global_id is 4380 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c2008d6a0 con 0x7f5c20182720 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887031013 0 0) 0x7f5c2005dc90 con 0x7f5c2005d1b0 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient(hunting): my global_id is 4378 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c2008b060 con 0x7f5c2005d1b0 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1952642281 0 0) 0x7f5c0c0035e0 con 0x7f5c2005dee0 2026-02-17T05:28:10.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 >> v1:10.20.193.118:6789/0 conn(0x7f5c2005d1b0 legacy=0x7f5c2005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 >> v1:10.20.193.106:6789/0 conn(0x7f5c20182720 legacy=0x7f5c201a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 monclient: found mon.noname-b 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c20057960 con 0x7f5c2005dee0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5c08002dd0 con 0x7f5c2005dee0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:10.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: dump: 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 5 monclient: authenticate success, global_id 4373 2026-02-17T05:28:10.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c08002fa0 con 0x7f5c2005dee0 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 1 -- 10.20.193.106:0/3835932352 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5c080033b0 con 0x7f5c2005dee0 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 4 set_mon_vals no callback set 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c1d573640 10 monclient: dump: 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.718 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 10 monclient: shutdown 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3835932352 >> v1:10.20.193.106:6790/0 conn(0x7f5c2005dee0 legacy=0x7f5c20181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3835932352 shutdown_connections 2026-02-17T05:28:10.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3835932352 >> 10.20.193.106:0/3835932352 conn(0x7f5c200915f0 msgr2=0x7f5c200919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3835932352 shutdown_connections 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.704+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3835932352 wait complete. 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient: monmap: 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.720 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 1 Processor -- start 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 1 -- start start 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient: init 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-a con 0x7f5c2005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-c con 0x7f5c2005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient(hunting): picked mon.noname-b con 0x7f5c20182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c20089b20 con 0x7f5c2005d1b0 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2010e8d0 con 0x7f5c20182720 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2010ee90 con 0x7f5c2005dee0 2026-02-17T05:28:10.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c24c8c640 10 monclient(hunting): authenticate will time out at 619.333750s 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c1dd74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f5c2005dee0 0x7f5c2012a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36394/0 (socket says 10.20.193.106:36394) 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c1dd74640 1 -- 10.20.193.106:0/3664614353 learned_addr learned my addr 10.20.193.106:0/3664614353 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219915907 0 0) 0x7f5c2010ee90 con 0x7f5c2005dee0 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): my global_id is 4376 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bec0035e0 con 0x7f5c2005dee0 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878247047 0 0) 0x7f5c2008b060 con 0x7f5c2005d1b0 2026-02-17T05:28:10.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 10 monclient(hunting): my global_id is 4383 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.705+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c2010ee90 con 0x7f5c2005d1b0 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3587281973 0 0) 0x7f5bec0035e0 con 0x7f5c2005dee0 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c2008b060 con 0x7f5c2005dee0 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5c08002ce0 con 0x7f5c2005dee0 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.723 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1581808747 0 0) 0x7f5c2010ee90 con 0x7f5c2005d1b0 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bec0035e0 con 0x7f5c2005d1b0 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5c14003070 con 0x7f5c2005d1b0 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2226831667 0 0) 0x7f5c2008b060 con 0x7f5c2005dee0 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 >> v1:10.20.193.118:6789/0 conn(0x7f5c20182720 legacy=0x7f5c20181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 >> v1:10.20.193.106:6789/0 conn(0x7f5c2005d1b0 legacy=0x7f5c2012a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 monclient: found mon.c 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2012ae50 con 0x7f5c2005dee0 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 5 monclient: authenticate success, global_id 4376 2026-02-17T05:28:10.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _renew_subs 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2008a140 con 0x7f5c2005dee0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _renew_subs 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c2010dad0 con 0x7f5c2005dee0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c08004b50 con 0x7f5c2005dee0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5c08004e70 con 0x7f5c2005dee0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c1cd72640 4 set_mon_vals no callback set 2026-02-17T05:28:10.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 10 monclient: dump: 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2010e260 con 0x7f5c2005dee0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f5c08011e10 con 0x7f5c2005dee0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.706+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f5c0804fd40 con 0x7f5c2005dee0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.707+0000 7f5c1e575640 10 monclient: get_auth_request con 0x7f5bec040ae0 auth_method 0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.709+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f5c0808b5e0 con 0x7f5c2005dee0 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.709+0000 7f5c06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.709+0000 7f5c06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.846+0000 7f5c24c8c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T05:28:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.846+0000 7f5c24c8c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T05:28:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.846+0000 7f5c24c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.846+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c2012e010 con 0x7f5c2005dee0 2026-02-17T05:28:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.847+0000 7f5c06ffd640 1 -- 10.20.193.106:0/3664614353 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f5c08017600 con 0x7f5c2005dee0 2026-02-17T05:28:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.847+0000 7f5c06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T05:28:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.847+0000 7f5c06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:10.849 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:10.849 INFO:teuthology.orchestra.run.trial106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T05:28:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 >> v1:10.20.193.118:6812/703720803 conn(0x7f5bec040ae0 legacy=0x7f5bec060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 10 monclient: shutdown 2026-02-17T05:28:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 >> v1:10.20.193.106:6790/0 conn(0x7f5c2005dee0 legacy=0x7f5c2012a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 shutdown_connections 2026-02-17T05:28:10.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 >> 10.20.193.106:0/3664614353 conn(0x7f5c200915f0 msgr2=0x7f5c201a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 shutdown_connections 2026-02-17T05:28:10.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.848+0000 7f5c24c8c640 1 -- 10.20.193.106:0/3664614353 wait complete. 2026-02-17T05:28:10.857 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T05:28:10.858 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-17T05:28:10.882 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-17T05:28:10.883 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:28:10.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.946+0000 7eff8245b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.946+0000 7eff8245b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.946+0000 7eff8245b640 10 monclient: monmap: 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:10.947128+0000 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:10.947128+0000 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.956 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 1 Processor -- start 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 1 -- start start 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient: init 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-a con 0x7eff7c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-b con 0x7eff7c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-c con 0x7eff7c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c08b060 con 0x7eff7c05d1b0 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c05dc90 con 0x7eff7c182720 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c08d6a0 con 0x7eff7c05dee0 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 10 monclient(hunting): authenticate will time out at 619.575482s 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7eff7c05dee0 0x7eff7c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36410/0 (socket says 10.20.193.106:36410) 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7b7fe640 1 -- 10.20.193.106:0/158354694 learned_addr learned my addr 10.20.193.106:0/158354694 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676980584 0 0) 0x7eff7c08d6a0 con 0x7eff7c05dee0 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): my global_id is 4379 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff600035e0 con 0x7eff7c05dee0 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333515662 0 0) 0x7eff7c08b060 con 0x7eff7c05d1b0 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient(hunting): my global_id is 4386 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c08d6a0 con 0x7eff7c05d1b0 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135978029 0 0) 0x7eff600035e0 con 0x7eff7c05dee0 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 >> v1:10.20.193.118:6789/0 conn(0x7eff7c182720 legacy=0x7eff7c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 >> v1:10.20.193.106:6789/0 conn(0x7eff7c05d1b0 legacy=0x7eff7c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 monclient: found mon.noname-b 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c057960 con 0x7eff7c05dee0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff6c002dd0 con 0x7eff7c05dee0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 5 monclient: authenticate success, global_id 4379 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff7affd640 10 monclient: dump: 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.947+0000 7eff8245b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff6c003050 con 0x7eff7c05dee0 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 1 -- 10.20.193.106:0/158354694 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff6c003460 con 0x7eff7c05dee0 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff7affd640 10 monclient: dump: 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.962 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 4 set_mon_vals no callback set 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 10 monclient: shutdown 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 1 -- 10.20.193.106:0/158354694 >> v1:10.20.193.106:6790/0 conn(0x7eff7c05dee0 legacy=0x7eff7c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 1 -- 10.20.193.106:0/158354694 shutdown_connections 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 1 -- 10.20.193.106:0/158354694 >> 10.20.193.106:0/158354694 conn(0x7eff7c0915f0 msgr2=0x7eff7c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:10.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 1 -- 10.20.193.106:0/158354694 shutdown_connections 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 1 -- 10.20.193.106:0/158354694 wait complete. 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 10 monclient: build_initial_monmap 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.948+0000 7eff8245b640 10 monclient: monmap: 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:10.964 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 1 Processor -- start 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 1 -- start start 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient: init 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-a con 0x7eff7c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-c con 0x7eff7c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient(hunting): picked mon.noname-b con 0x7eff7c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c05e950 con 0x7eff7c05d1b0 2026-02-17T05:28:10.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c10e890 con 0x7eff7c182720 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c10ee50 con 0x7eff7c05dee0 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff8245b640 10 monclient(hunting): authenticate will time out at 619.577402s 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff7b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7eff7c05dee0 0x7eff7c12dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36422/0 (socket says 10.20.193.106:36422) 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff7b7fe640 1 -- 10.20.193.106:0/2966943749 learned_addr learned my addr 10.20.193.106:0/2966943749 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff7bfff640 1 --1- 10.20.193.106:0/2966943749 >> v1:10.20.193.106:6789/0 conn(0x7eff7c05d1b0 0x7eff7c12d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36486/0 (socket says 10.20.193.106:36486) 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224590134 0 0) 0x7eff7c10ee50 con 0x7eff7c05dee0 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): my global_id is 4382 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff4c0035e0 con 0x7eff7c05dee0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696285798 0 0) 0x7eff68002920 con 0x7eff7c05d1b0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): my global_id is 4389 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c10ee50 con 0x7eff7c05d1b0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 524656311 0 0) 0x7eff4c0035e0 con 0x7eff7c05dee0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff68002920 con 0x7eff7c05dee0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff6c002890 con 0x7eff7c05dee0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:10.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:10.968 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2806113438 0 0) 0x7eff7c10ee50 con 0x7eff7c05d1b0 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff4c0035e0 con 0x7eff7c05d1b0 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff68003530 con 0x7eff7c05d1b0 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.969 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3751188668 0 0) 0x7eff68002920 con 0x7eff7c05dee0 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 >> v1:10.20.193.118:6789/0 conn(0x7eff7c182720 legacy=0x7eff7c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 >> v1:10.20.193.106:6789/0 conn(0x7eff7c05d1b0 legacy=0x7eff7c12d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 monclient: found mon.c 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.949+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c12e370 con 0x7eff7c05dee0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 5 monclient: authenticate success, global_id 4382 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _renew_subs 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c10caf0 con 0x7eff7c05dee0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _renew_subs 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7eff7c10e5b0 con 0x7eff7c05dee0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff6c003560 con 0x7eff7c05dee0 2026-02-17T05:28:10.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7eff6c004cb0 con 0x7eff7c05dee0 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff7a7fc640 4 set_mon_vals no callback set 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 10 monclient: dump: 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:10.972 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c0008d0 con 0x7eff7c05dee0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7eff6c011c50 con 0x7eff7c05dee0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.950+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7eff6c04fc90 con 0x7eff7c05dee0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.951+0000 7eff7bfff640 10 monclient: get_auth_request con 0x7eff4c040b60 auth_method 0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.952+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7eff6c0175b0 con 0x7eff7c05dee0 2026-02-17T05:28:10.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.952+0000 7eff78ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:10.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:10.952+0000 7eff78ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:11.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff8245b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff8245b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff8245b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff7c08e3d0 con 0x7eff7c05dee0 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff78ff9640 1 -- 10.20.193.106:0/2966943749 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10958 (unknown 941590788 0 748724775) 0x7eff6c016d60 con 0x7eff7c05dee0 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff78ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:28:11.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.063+0000 7eff78ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:11.066 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:11.066 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":19,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:28:10.239323+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T05:28:04.479659+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:28:11.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 >> v1:10.20.193.118:6812/703720803 conn(0x7eff4c040b60 legacy=0x7eff4c061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 10 monclient: shutdown 2026-02-17T05:28:11.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 >> v1:10.20.193.106:6790/0 conn(0x7eff7c05dee0 legacy=0x7eff7c12dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 shutdown_connections 2026-02-17T05:28:11.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 >> 10.20.193.106:0/2966943749 conn(0x7eff7c0915f0 msgr2=0x7eff7c088a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 shutdown_connections 2026-02-17T05:28:11.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.065+0000 7eff8245b640 1 -- 10.20.193.106:0/2966943749 wait complete. 2026-02-17T05:28:11.075 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T05:27:59.724849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-17T05:28:04.479659+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 18, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T05:28:11.076 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-17T05:28:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: monmap: 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:11.142557+0000 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:11.142557+0000 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:11.144 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 1 Processor -- start 2026-02-17T05:28:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 1 -- start start 2026-02-17T05:28:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: init 2026-02-17T05:28:11.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:11.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-b con 0x7f18d405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-a con 0x7f18d405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-c con 0x7f18d4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d408b060 con 0x7f18d405dee0 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d405dc90 con 0x7f18d4182720 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d408d6a0 con 0x7f18d405d1b0 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.142+0000 7f18db45b640 10 monclient(hunting): authenticate will time out at 619.770925s 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18d89cf640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f18d405dee0 0x7f18d4181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36502/0 (socket says 10.20.193.106:36502) 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18d89cf640 1 -- 10.20.193.106:0/1791530679 learned_addr learned my addr 10.20.193.106:0/1791530679 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18d91d0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f18d405d1b0 0x7f18d405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36424/0 (socket says 10.20.193.106:36424) 2026-02-17T05:28:11.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913167267 0 0) 0x7f18d408d6a0 con 0x7f18d405d1b0 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): my global_id is 4385 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18bc0035e0 con 0x7f18d405d1b0 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662134240 0 0) 0x7f18d408b060 con 0x7f18d405dee0 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): my global_id is 4392 2026-02-17T05:28:11.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d408d6a0 con 0x7f18d405dee0 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302701362 0 0) 0x7f18d405dc90 con 0x7f18d4182720 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient(hunting): my global_id is 4390 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d408b060 con 0x7f18d4182720 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738016176 0 0) 0x7f18bc0035e0 con 0x7f18d405d1b0 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 >> v1:10.20.193.118:6789/0 conn(0x7f18d4182720 legacy=0x7f18d41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 >> v1:10.20.193.106:6789/0 conn(0x7f18d405dee0 legacy=0x7f18d4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 monclient: found mon.noname-b 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d4057960 con 0x7f18d405d1b0 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 5 monclient: authenticate success, global_id 4385 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18c4002dd0 con 0x7f18d405d1b0 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: dump: 2026-02-17T05:28:11.157 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18c4003050 con 0x7f18d405d1b0 2026-02-17T05:28:11.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 1 -- 10.20.193.106:0/1791530679 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18c4003460 con 0x7f18d405d1b0 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 4 set_mon_vals no callback set 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18c3fff640 10 monclient: dump: 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.159 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 10 monclient: shutdown 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 1 -- 10.20.193.106:0/1791530679 >> v1:10.20.193.106:6790/0 conn(0x7f18d405d1b0 legacy=0x7f18d405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 1 -- 10.20.193.106:0/1791530679 shutdown_connections 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 1 -- 10.20.193.106:0/1791530679 >> 10.20.193.106:0/1791530679 conn(0x7f18d40915f0 msgr2=0x7f18d40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 1 -- 10.20.193.106:0/1791530679 shutdown_connections 2026-02-17T05:28:11.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.143+0000 7f18db45b640 1 -- 10.20.193.106:0/1791530679 wait complete. 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient: monmap: 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:11.161 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 1 Processor -- start 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 1 -- start start 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient: init 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-c con 0x7f18d405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-b con 0x7f18d405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient(hunting): picked mon.noname-a con 0x7f18d4182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d410eac0 con 0x7f18d4182720 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d410f080 con 0x7f18d405dee0 2026-02-17T05:28:11.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d408a0e0 con 0x7f18d405d1b0 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18db45b640 10 monclient(hunting): authenticate will time out at 619.772918s 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18d91d0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f18d405d1b0 0x7f18d413cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36436/0 (socket says 10.20.193.106:36436) 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.144+0000 7f18d91d0640 1 -- 10.20.193.106:0/4277091674 learned_addr learned my addr 10.20.193.106:0/4277091674 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483138458 0 0) 0x7f18d410eac0 con 0x7f18d4182720 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): my global_id is 4395 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a40035e0 con 0x7f18d4182720 2026-02-17T05:28:11.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483778992 0 0) 0x7f18d408a0e0 con 0x7f18d405d1b0 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): my global_id is 4388 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d410eac0 con 0x7f18d405d1b0 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103516394 0 0) 0x7f18d410f080 con 0x7f18d405dee0 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): my global_id is 4393 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d408a0e0 con 0x7f18d405dee0 2026-02-17T05:28:11.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 360966631 0 0) 0x7f18a40035e0 con 0x7f18d4182720 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18d410f080 con 0x7f18d4182720 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18d00040d0 con 0x7f18d4182720 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): dump: 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.165 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1566746334 0 0) 0x7f18d410eac0 con 0x7f18d405d1b0 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18a40035e0 con 0x7f18d405d1b0 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18c4003370 con 0x7f18d405d1b0 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): dump: 2026-02-17T05:28:11.166 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.167 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3197306114 0 0) 0x7f18d408a0e0 con 0x7f18d405dee0 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18d410eac0 con 0x7f18d405dee0 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18c8003060 con 0x7f18d405dee0 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient(hunting): dump: 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.168 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3730297083 0 0) 0x7f18d410f080 con 0x7f18d4182720 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 >> v1:10.20.193.106:6790/0 conn(0x7f18d405d1b0 legacy=0x7f18d413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 >> v1:10.20.193.118:6789/0 conn(0x7f18d405dee0 legacy=0x7f18d413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 monclient: found mon.a 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d412e220 con 0x7f18d4182720 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 5 monclient: authenticate success, global_id 4395 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 10 monclient: _renew_subs 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f18d41824f0 con 0x7f18d4182720 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 10 monclient: _renew_subs 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f18d410e7e0 con 0x7f18d4182720 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18d0004610 con 0x7f18d4182720 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f18d0004960 con 0x7f18d4182720 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c37fe640 4 set_mon_vals no callback set 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.145+0000 7f18c1ffb640 10 monclient: dump: 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.171 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18db45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18db45b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18db45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d410ec70 con 0x7f18d4182720 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f18d0011900 con 0x7f18d4182720 2026-02-17T05:28:11.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f18d004f980 con 0x7f18d4182720 2026-02-17T05:28:11.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.146+0000 7f18d91d0640 10 monclient: get_auth_request con 0x7f18a4041090 auth_method 0 2026-02-17T05:28:11.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.148+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f18d410ec70 con 0x7f18d4182720 2026-02-17T05:28:11.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.148+0000 7f18c1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.148+0000 7f18c1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18db45b640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18db45b640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18db45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f18d410ec70 con 0x7f18d4182720 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18c1ffb640 1 -- 10.20.193.106:0/4277091674 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (unknown 4170632370 0 2170607528) 0x7f18d410ec70 con 0x7f18d4182720 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18c1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T05:28:11.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.257+0000 7f18c1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:11.259 INFO:teuthology.orchestra.run.trial106.stdout:pg_num: 1 2026-02-17T05:28:11.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 >> v1:10.20.193.118:6812/703720803 conn(0x7f18a4041090 legacy=0x7f18a4061540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 10 monclient: shutdown 2026-02-17T05:28:11.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 >> v1:10.20.193.106:6789/0 conn(0x7f18d4182720 legacy=0x7f18d4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 shutdown_connections 2026-02-17T05:28:11.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 >> 10.20.193.106:0/4277091674 conn(0x7f18d40915f0 msgr2=0x7f18d408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 shutdown_connections 2026-02-17T05:28:11.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.259+0000 7f18db45b640 1 -- 10.20.193.106:0/4277091674 wait complete. 2026-02-17T05:28:11.267 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-17T05:28:11.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 10 monclient: get_monmap_and_config 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 10 monclient: monmap: 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:11.331859+0000 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:11.331859+0000 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.347 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 1 Processor -- start 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 1 -- start start 2026-02-17T05:28:11.348 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.331+0000 7f4d18394640 10 monclient: init 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-b con 0x7f4d1005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-c con 0x7f4d1005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-a con 0x7f4d10182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1008b060 con 0x7f4d10182720 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1005dc90 con 0x7f4d1005dee0 2026-02-17T05:28:11.349 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1008d6a0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient(hunting): authenticate will time out at 619.960262s 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d16109640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4d1005d1b0 0x7f4d1005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36444/0 (socket says 10.20.193.106:36444) 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d16109640 1 -- 10.20.193.106:0/137201214 learned_addr learned my addr 10.20.193.106:0/137201214 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d1690a640 1 --1- 10.20.193.106:0/137201214 >> v1:10.20.193.106:6789/0 conn(0x7f4d10182720 0x7f4d101a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36530/0 (socket says 10.20.193.106:36530) 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281059698 0 0) 0x7f4d1008b060 con 0x7f4d10182720 2026-02-17T05:28:11.350 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): my global_id is 4398 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf80035e0 con 0x7f4d10182720 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756546032 0 0) 0x7f4d1008d6a0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.351 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): my global_id is 4391 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1008b060 con 0x7f4d1005d1b0 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341960897 0 0) 0x7f4d1005dc90 con 0x7f4d1005dee0 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient(hunting): my global_id is 4396 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1008d6a0 con 0x7f4d1005dee0 2026-02-17T05:28:11.352 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 997191596 0 0) 0x7f4cf80035e0 con 0x7f4d10182720 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 >> v1:10.20.193.106:6790/0 conn(0x7f4d1005d1b0 legacy=0x7f4d1005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 >> v1:10.20.193.118:6789/0 conn(0x7f4d1005dee0 legacy=0x7f4d10181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 monclient: found mon.noname-a 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d10057960 con 0x7f4d10182720 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4d0c003eb0 con 0x7f4d10182720 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: dump: 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.354 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 5 monclient: authenticate success, global_id 4398 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:11.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d0c004130 con 0x7f4d10182720 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 1 -- 10.20.193.106:0/137201214 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4d0c004510 con 0x7f4d10182720 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d18394640 4 set_mon_vals no callback set 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.332+0000 7f4d15107640 10 monclient: dump: 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.356 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 10 monclient: shutdown 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- 10.20.193.106:0/137201214 >> v1:10.20.193.106:6789/0 conn(0x7f4d10182720 legacy=0x7f4d101a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- 10.20.193.106:0/137201214 shutdown_connections 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- 10.20.193.106:0/137201214 >> 10.20.193.106:0/137201214 conn(0x7f4d100915f0 msgr2=0x7f4d100919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- 10.20.193.106:0/137201214 shutdown_connections 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- 10.20.193.106:0/137201214 wait complete. 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 10 monclient: monmap: 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.358 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 Processor -- start 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 1 -- start start 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.333+0000 7f4d18394640 10 monclient: init 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-c con 0x7f4d1005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-a con 0x7f4d1005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient(hunting): picked mon.noname-b con 0x7f4d10182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1005e8e0 con 0x7f4d1005dee0 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1010be40 con 0x7f4d10182720 2026-02-17T05:28:11.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1010a950 con 0x7f4d1005d1b0 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient(hunting): authenticate will time out at 619.962107s 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d16109640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4d1005d1b0 0x7f4d101286b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36448/0 (socket says 10.20.193.106:36448) 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d16109640 1 -- 10.20.193.106:0/2144926124 learned_addr learned my addr 10.20.193.106:0/2144926124 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626781760 0 0) 0x7f4d1005e8e0 con 0x7f4d1005dee0 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): my global_id is 4401 2026-02-17T05:28:11.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce00035e0 con 0x7f4d1005dee0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048476696 0 0) 0x7f4d1010a950 con 0x7f4d1005d1b0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): my global_id is 4394 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1005e8e0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 325891965 0 0) 0x7f4ce00035e0 con 0x7f4d1005dee0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d1010a950 con 0x7f4d1005dee0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4d04003040 con 0x7f4d1005dee0 2026-02-17T05:28:11.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.363 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3139907797 0 0) 0x7f4d1005e8e0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ce00035e0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4d000030a0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924238118 0 0) 0x7f4d1010be40 con 0x7f4d10182720 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient(hunting): my global_id is 4399 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1005e8e0 con 0x7f4d10182720 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2389359293 0 0) 0x7f4ce00035e0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 >> v1:10.20.193.118:6789/0 conn(0x7f4d10182720 legacy=0x7f4d10114240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 >> v1:10.20.193.106:6789/0 conn(0x7f4d1005dee0 legacy=0x7f4d10180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 monclient: found mon.c 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d101824f0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 5 monclient: authenticate success, global_id 4394 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _renew_subs 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1010ccb0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _renew_subs 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d1010b4b0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d00003530 con 0x7f4d1005d1b0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4d00004a50 con 0x7f4d1005d1b0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4cf6ffd640 10 monclient: dump: 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.367 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.334+0000 7f4d14906640 4 set_mon_vals no callback set 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4d18394640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4d18394640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4d18394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d100008d0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4d000119f0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f4d0004fae0 con 0x7f4d1005d1b0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.335+0000 7f4d15908640 10 monclient: get_auth_request con 0x7f4ce0040cd0 auth_method 0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.337+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f4d00013530 con 0x7f4d1005d1b0 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.337+0000 7f4cf6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.337+0000 7f4cf6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:11.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4d18394640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T05:28:11.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4d18394640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4d18394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f4d1010b760 con 0x7f4d1005d1b0 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4cf6ffd640 1 -- 10.20.193.106:0/2144926124 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (unknown 1398289234 0 265718887) 0x7f4d00016a90 con 0x7f4d1005d1b0 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4cf6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.442+0000 7f4cf6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stdout:pg_num: 8 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.443+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 >> v1:10.20.193.118:6812/703720803 conn(0x7f4ce0040cd0 legacy=0x7f4ce0061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.443+0000 7f4d18394640 10 monclient: shutdown 2026-02-17T05:28:11.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.443+0000 7f4d18394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.445 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.443+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 >> v1:10.20.193.106:6790/0 conn(0x7f4d1005d1b0 legacy=0x7f4d101286b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.445 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.444+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 shutdown_connections 2026-02-17T05:28:11.445 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.444+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 >> 10.20.193.106:0/2144926124 conn(0x7f4d100915f0 msgr2=0x7f4d101a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.445 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.444+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 shutdown_connections 2026-02-17T05:28:11.445 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.444+0000 7f4d18394640 1 -- 10.20.193.106:0/2144926124 wait complete. 2026-02-17T05:28:11.452 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-17T05:28:11.452 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.525+0000 7ff9170cc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.525+0000 7ff9170cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.525+0000 7ff9170cc640 10 monclient: monmap: 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:11.526308+0000 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:11.526308+0000 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:11.527 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 1 Processor -- start 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 1 -- start start 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient: init 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff91013ec40 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff91013f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff9101811f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008a7d0 con 0x7ff91013ec40 2026-02-17T05:28:11.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008d5c0 con 0x7ff91013f010 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008d800 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff9170cc640 10 monclient(hunting): authenticate will time out at 620.154883s 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff915642640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff9101811f0 0x7ff9101a15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36464/0 (socket says 10.20.193.106:36464) 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff915642640 1 -- 10.20.193.106:0/3409352175 learned_addr learned my addr 10.20.193.106:0/3409352175 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.526+0000 7ff914e41640 1 --1- 10.20.193.106:0/3409352175 >> v1:10.20.193.106:6789/0 conn(0x7ff91013ec40 0x7ff91008ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36542/0 (socket says 10.20.193.106:36542) 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673065337 0 0) 0x7ff91008d800 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): my global_id is 4397 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8fc0035e0 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800295709 0 0) 0x7ff91008a7d0 con 0x7ff91013ec40 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient(hunting): my global_id is 4404 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008d800 con 0x7ff91013ec40 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 147967311 0 0) 0x7ff8fc0035e0 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 >> v1:10.20.193.118:6789/0 conn(0x7ff91013f010 legacy=0x7ff91013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 >> v1:10.20.193.106:6789/0 conn(0x7ff91013ec40 legacy=0x7ff91008ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 monclient: found mon.noname-b 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91008a180 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff90c003eb0 con 0x7ff9101811f0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: dump: 2026-02-17T05:28:11.529 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 5 monclient: authenticate success, global_id 4397 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff90c0040b0 con 0x7ff9101811f0 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 1 -- 10.20.193.106:0/3409352175 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff90c0044c0 con 0x7ff9101811f0 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9077fe640 10 monclient: dump: 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.530 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 4 set_mon_vals no callback set 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 10 monclient: shutdown 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 1 -- 10.20.193.106:0/3409352175 >> v1:10.20.193.106:6790/0 conn(0x7ff9101811f0 legacy=0x7ff9101a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 1 -- 10.20.193.106:0/3409352175 shutdown_connections 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 1 -- 10.20.193.106:0/3409352175 >> 10.20.193.106:0/3409352175 conn(0x7ff9100915f0 msgr2=0x7ff9100919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 1 -- 10.20.193.106:0/3409352175 shutdown_connections 2026-02-17T05:28:11.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.527+0000 7ff9170cc640 1 -- 10.20.193.106:0/3409352175 wait complete. 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient: monmap: 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:11.532 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 1 Processor -- start 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 1 -- start start 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient: init 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff91013ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff91013f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff9101811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91013e820 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91005e8e0 con 0x7ff91013f010 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91012d5c0 con 0x7ff91013ec40 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff9170cc640 10 monclient(hunting): authenticate will time out at 620.156837s 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff914e41640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff91013ec40 0x7ff9101801e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36472/0 (socket says 10.20.193.106:36472) 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff915642640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff9101811f0 0x7ff910116a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36552/0 (socket says 10.20.193.106:36552) 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.528+0000 7ff914e41640 1 -- 10.20.193.106:0/2434345324 learned_addr learned my addr 10.20.193.106:0/2434345324 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968525463 0 0) 0x7ff91008a180 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): my global_id is 4407 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e00035e0 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436248714 0 0) 0x7ff91012d5c0 con 0x7ff91013ec40 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): my global_id is 4400 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008a180 con 0x7ff91013ec40 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230739157 0 0) 0x7ff91005e8e0 con 0x7ff91013f010 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): my global_id is 4405 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91012d5c0 con 0x7ff91013f010 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1367768257 0 0) 0x7ff8e00035e0 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91005e8e0 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff90c003dc0 con 0x7ff9101811f0 2026-02-17T05:28:11.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): dump: 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4197970191 0 0) 0x7ff91008a180 con 0x7ff91013ec40 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8e00035e0 con 0x7ff91013ec40 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff9000030f0 con 0x7ff91013ec40 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): dump: 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422239509 0 0) 0x7ff91012d5c0 con 0x7ff91013f010 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91008a180 con 0x7ff91013f010 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff8f8003070 con 0x7ff91013f010 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient(hunting): dump: 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.534 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 530003702 0 0) 0x7ff91005e8e0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 >> v1:10.20.193.106:6790/0 conn(0x7ff91013ec40 legacy=0x7ff9101801e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 >> v1:10.20.193.118:6789/0 conn(0x7ff91013f010 legacy=0x7ff9101808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 monclient: found mon.a 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91012d8a0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 5 monclient: authenticate success, global_id 4407 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 10 monclient: _renew_subs 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff910181000 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 10 monclient: _renew_subs 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff91012c2d0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff90c003f20 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff90c005de0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff906ffd640 4 set_mon_vals no callback set 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.529+0000 7ff9057fa640 10 monclient: dump: 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9170cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9170cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9170cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9100008d0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff90c012d80 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7ff90c050ab0 con 0x7ff9101811f0 2026-02-17T05:28:11.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.530+0000 7ff914e41640 10 monclient: get_auth_request con 0x7ff8e0040f90 auth_method 0 2026-02-17T05:28:11.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.532+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7ff90c018370 con 0x7ff9101811f0 2026-02-17T05:28:11.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.532+0000 7ff9057fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.532+0000 7ff9057fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:11.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.633+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff91013e820 con 0x7ff8e0040f90 2026-02-17T05:28:11.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.634+0000 7ff9057fa640 1 -- 10.20.193.106:0/2434345324 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 3768875460) 0x7ff91013e820 con 0x7ff8e0040f90 2026-02-17T05:28:11.636 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:11.637 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:28:11.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 >> v1:10.20.193.118:6812/703720803 conn(0x7ff8e0040f90 legacy=0x7ff8e0061440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 10 monclient: shutdown 2026-02-17T05:28:11.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 >> v1:10.20.193.106:6789/0 conn(0x7ff9101811f0 legacy=0x7ff910116a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 shutdown_connections 2026-02-17T05:28:11.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 >> 10.20.193.106:0/2434345324 conn(0x7ff9100915f0 msgr2=0x7ff910054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 shutdown_connections 2026-02-17T05:28:11.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.635+0000 7ff9170cc640 1 -- 10.20.193.106:0/2434345324 wait complete. 2026-02-17T05:28:11.644 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-17T05:28:10.239782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1475662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50696,"internal_metadata":165493240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527047"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738260+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:28:07.738260+0000","last_peered":"2026-02-17T05:28:07.738260+0000","last_clean":"2026-02-17T05:28:07.738260+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:28:07.738260+0000","last_undegraded":"2026-02-17T05:28:07.738260+0000","last_fullsized":"2026-02-17T05:28:07.738260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738997+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:28:07.738997+0000","last_peered":"2026-02-17T05:28:07.738997+0000","last_clean":"2026-02-17T05:28:07.738997+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:28:07.738997+0000","last_undegraded":"2026-02-17T05:28:07.738997+0000","last_fullsized":"2026-02-17T05:28:07.738997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738148+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:28:07.738148+0000","last_peered":"2026-02-17T05:28:07.738148+0000","last_clean":"2026-02-17T05:28:07.738148+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:28:07.738148+0000","last_undegraded":"2026-02-17T05:28:07.738148+0000","last_fullsized":"2026-02-17T05:28:07.738148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739035+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:28:07.739035+0000","last_peered":"2026-02-17T05:28:07.739035+0000","last_clean":"2026-02-17T05:28:07.739035+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:28:07.739035+0000","last_undegraded":"2026-02-17T05:28:07.739035+0000","last_fullsized":"2026-02-17T05:28:07.739035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739585+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:28:07.739585+0000","last_peered":"2026-02-17T05:28:07.739585+0000","last_clean":"2026-02-17T05:28:07.739585+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:28:07.739585+0000","last_undegraded":"2026-02-17T05:28:07.739585+0000","last_fullsized":"2026-02-17T05:28:07.739585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739136+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:28:07.739136+0000","last_peered":"2026-02-17T05:28:07.739136+0000","last_clean":"2026-02-17T05:28:07.739136+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:28:07.739136+0000","last_undegraded":"2026-02-17T05:28:07.739136+0000","last_fullsized":"2026-02-17T05:28:07.739136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738152+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:28:07.738152+0000","last_peered":"2026-02-17T05:28:07.738152+0000","last_clean":"2026-02-17T05:28:07.738152+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:28:07.738152+0000","last_undegraded":"2026-02-17T05:28:07.738152+0000","last_fullsized":"2026-02-17T05:28:07.738152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739072+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:28:07.739072+0000","last_peered":"2026-02-17T05:28:07.739072+0000","last_clean":"2026-02-17T05:28:07.739072+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:28:07.739072+0000","last_undegraded":"2026-02-17T05:28:07.739072+0000","last_fullsized":"2026-02-17T05:28:07.739072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.737842+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:28:07.737842+0000","last_peered":"2026-02-17T05:28:07.737842+0000","last_clean":"2026-02-17T05:28:07.737842+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:28:07.737842+0000","last_undegraded":"2026-02-17T05:28:07.737842+0000","last_fullsized":"2026-02-17T05:28:07.737842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:28:11.646 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: get_monmap_and_config 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: monmap: 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:11.711461+0000 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:11.711461+0000 2026-02-17T05:28:11.721 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 1 Processor -- start 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 1 -- start start 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: init 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:11.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-a con 0x7fe75005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-b con 0x7fe75005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-c con 0x7fe750182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75008b060 con 0x7fe75005d1b0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75005dc90 con 0x7fe750182720 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75008d6a0 con 0x7fe75005dee0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe7561a5640 10 monclient(hunting): authenticate will time out at 620.339822s 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe74f7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe75005d1b0 0x7fe75005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36568/0 (socket says 10.20.193.106:36568) 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.711+0000 7fe74f7fe640 1 -- 10.20.193.106:0/3450732345 learned_addr learned my addr 10.20.193.106:0/3450732345 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768783110 0 0) 0x7fe75008d6a0 con 0x7fe75005dee0 2026-02-17T05:28:11.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): my global_id is 4403 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7340035e0 con 0x7fe75005dee0 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927894398 0 0) 0x7fe75008b060 con 0x7fe75005d1b0 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): my global_id is 4410 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe75008d6a0 con 0x7fe75005d1b0 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417183269 0 0) 0x7fe75005dc90 con 0x7fe750182720 2026-02-17T05:28:11.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient(hunting): my global_id is 4408 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe75008b060 con 0x7fe750182720 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244979747 0 0) 0x7fe7340035e0 con 0x7fe75005dee0 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 >> v1:10.20.193.118:6789/0 conn(0x7fe750182720 legacy=0x7fe7501a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 >> v1:10.20.193.106:6789/0 conn(0x7fe75005d1b0 legacy=0x7fe75005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 monclient: found mon.noname-b 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe750057960 con 0x7fe75005dee0 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe740002dd0 con 0x7fe75005dee0 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: dump: 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.726 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 5 monclient: authenticate success, global_id 4403 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe740002fd0 con 0x7fe75005dee0 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 1 -- 10.20.193.106:0/3450732345 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe7400033e0 con 0x7fe75005dee0 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe74e7fc640 10 monclient: dump: 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:11.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 4 set_mon_vals no callback set 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 10 monclient: shutdown 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 1 -- 10.20.193.106:0/3450732345 >> v1:10.20.193.106:6790/0 conn(0x7fe75005dee0 legacy=0x7fe750181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 1 -- 10.20.193.106:0/3450732345 shutdown_connections 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 1 -- 10.20.193.106:0/3450732345 >> 10.20.193.106:0/3450732345 conn(0x7fe7500915f0 msgr2=0x7fe7500919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 1 -- 10.20.193.106:0/3450732345 shutdown_connections 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.712+0000 7fe7561a5640 1 -- 10.20.193.106:0/3450732345 wait complete. 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient: monmap: 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.730 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 1 Processor -- start 2026-02-17T05:28:11.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 1 -- start start 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient: init 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-c con 0x7fe75005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-a con 0x7fe75005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient(hunting): picked mon.noname-b con 0x7fe750182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75005e950 con 0x7fe75005dee0 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75010f0c0 con 0x7fe750182720 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75010e250 con 0x7fe75005d1b0 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe7561a5640 10 monclient(hunting): authenticate will time out at 620.341893s 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe74f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe75005d1b0 0x7fe75013cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36488/0 (socket says 10.20.193.106:36488) 2026-02-17T05:28:11.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.713+0000 7fe74f7fe640 1 -- 10.20.193.106:0/184107195 learned_addr learned my addr 10.20.193.106:0/184107195 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671301091 0 0) 0x7fe75010e250 con 0x7fe75005d1b0 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): my global_id is 4406 2026-02-17T05:28:11.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7200035e0 con 0x7fe75005d1b0 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997772634 0 0) 0x7fe750057960 con 0x7fe75005dee0 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): my global_id is 4413 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe75010e250 con 0x7fe75005dee0 2026-02-17T05:28:11.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 93796536 0 0) 0x7fe7200035e0 con 0x7fe75005d1b0 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe750057960 con 0x7fe75005d1b0 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe73c003090 con 0x7fe75005d1b0 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:11.736 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.737 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.738 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.738 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:11.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835555413 0 0) 0x7fe75010f0c0 con 0x7fe750182720 2026-02-17T05:28:11.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): my global_id is 4411 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7200035e0 con 0x7fe750182720 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2378340241 0 0) 0x7fe75010e250 con 0x7fe75005dee0 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe75010f0c0 con 0x7fe75005dee0 2026-02-17T05:28:11.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe740002ce0 con 0x7fe75005dee0 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.740 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 882240591 0 0) 0x7fe750057960 con 0x7fe75005d1b0 2026-02-17T05:28:11.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 >> v1:10.20.193.118:6789/0 conn(0x7fe750182720 legacy=0x7fe750181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 >> v1:10.20.193.106:6789/0 conn(0x7fe75005dee0 legacy=0x7fe75013d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 monclient: found mon.c 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75010cd60 con 0x7fe75005d1b0 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 5 monclient: authenticate success, global_id 4406 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 10 monclient: _renew_subs 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501824f0 con 0x7fe75005d1b0 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 10 monclient: _renew_subs 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe75010d8c0 con 0x7fe75005d1b0 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe73c003420 con 0x7fe75005d1b0 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe73c004d00 con 0x7fe75005d1b0 2026-02-17T05:28:11.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe72bfff640 10 monclient: dump: 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.745 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe74dffb640 4 set_mon_vals no callback set 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.714+0000 7fe7561a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe7561a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe7561a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75010e930 con 0x7fe75005d1b0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe73c011ca0 con 0x7fe75005d1b0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fe73c04fc10 con 0x7fe75005d1b0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.715+0000 7fe74effd640 10 monclient: get_auth_request con 0x7fe720040dd0 auth_method 0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.717+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fe73c017410 con 0x7fe75005d1b0 2026-02-17T05:28:11.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.717+0000 7fe72bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.717+0000 7fe72bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:11.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.818+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe750057ca0 con 0x7fe720040dd0 2026-02-17T05:28:11.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.819+0000 7fe72bfff640 1 -- 10.20.193.106:0/184107195 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 2965156977) 0x7fe740007800 con 0x7fe720040dd0 2026-02-17T05:28:11.821 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 >> v1:10.20.193.118:6812/703720803 conn(0x7fe720040dd0 legacy=0x7fe720061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 10 monclient: shutdown 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 >> v1:10.20.193.106:6790/0 conn(0x7fe75005d1b0 legacy=0x7fe75013cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 shutdown_connections 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 >> 10.20.193.106:0/184107195 conn(0x7fe7500915f0 msgr2=0x7fe750089a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 shutdown_connections 2026-02-17T05:28:11.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.820+0000 7fe7561a5640 1 -- 10.20.193.106:0/184107195 wait complete. 2026-02-17T05:28:11.830 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-17T05:28:11.713316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1475662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50696,"internal_metadata":165493240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.981115"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738260+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:28:07.738260+0000","last_peered":"2026-02-17T05:28:07.738260+0000","last_clean":"2026-02-17T05:28:07.738260+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:28:07.738260+0000","last_undegraded":"2026-02-17T05:28:07.738260+0000","last_fullsized":"2026-02-17T05:28:07.738260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738997+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:28:07.738997+0000","last_peered":"2026-02-17T05:28:07.738997+0000","last_clean":"2026-02-17T05:28:07.738997+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:28:07.738997+0000","last_undegraded":"2026-02-17T05:28:07.738997+0000","last_fullsized":"2026-02-17T05:28:07.738997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738148+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:28:07.738148+0000","last_peered":"2026-02-17T05:28:07.738148+0000","last_clean":"2026-02-17T05:28:07.738148+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:28:07.738148+0000","last_undegraded":"2026-02-17T05:28:07.738148+0000","last_fullsized":"2026-02-17T05:28:07.738148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739035+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:28:07.739035+0000","last_peered":"2026-02-17T05:28:07.739035+0000","last_clean":"2026-02-17T05:28:07.739035+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:28:07.739035+0000","last_undegraded":"2026-02-17T05:28:07.739035+0000","last_fullsized":"2026-02-17T05:28:07.739035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739585+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:28:07.739585+0000","last_peered":"2026-02-17T05:28:07.739585+0000","last_clean":"2026-02-17T05:28:07.739585+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:28:07.739585+0000","last_undegraded":"2026-02-17T05:28:07.739585+0000","last_fullsized":"2026-02-17T05:28:07.739585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739136+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:28:07.739136+0000","last_peered":"2026-02-17T05:28:07.739136+0000","last_clean":"2026-02-17T05:28:07.739136+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:28:07.739136+0000","last_undegraded":"2026-02-17T05:28:07.739136+0000","last_fullsized":"2026-02-17T05:28:07.739136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.738152+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:28:07.738152+0000","last_peered":"2026-02-17T05:28:07.738152+0000","last_clean":"2026-02-17T05:28:07.738152+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:28:07.738152+0000","last_undegraded":"2026-02-17T05:28:07.738152+0000","last_fullsized":"2026-02-17T05:28:07.738152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.739072+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:28:07.739072+0000","last_peered":"2026-02-17T05:28:07.739072+0000","last_clean":"2026-02-17T05:28:07.739072+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:28:07.739072+0000","last_undegraded":"2026-02-17T05:28:07.739072+0000","last_fullsized":"2026-02-17T05:28:07.739072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T05:28:07.737842+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:28:07.737842+0000","last_peered":"2026-02-17T05:28:07.737842+0000","last_clean":"2026-02-17T05:28:07.737842+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:28:07.737842+0000","last_undegraded":"2026-02-17T05:28:07.737842+0000","last_fullsized":"2026-02-17T05:28:07.737842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":639516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:28:11.831 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-17T05:28:11.831 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 10 monclient: monmap: 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:11.898554+0000 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:11.898554+0000 2026-02-17T05:28:11.914 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 1 Processor -- start 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 1 -- start start 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.898+0000 7fb7ed41b640 10 monclient: init 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-b con 0x7fb7e813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-c con 0x7fb7e813f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-a con 0x7fb7e81811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e808a7d0 con 0x7fb7e81811f0 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e808d5c0 con 0x7fb7e813f010 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e808d800 con 0x7fb7e813ec40 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient(hunting): authenticate will time out at 620.527125s 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e6ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb7e813ec40 0x7fb7e808ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36502/0 (socket says 10.20.193.106:36502) 2026-02-17T05:28:11.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e6ffd640 1 -- 10.20.193.106:0/95800419 learned_addr learned my addr 10.20.193.106:0/95800419 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106742052 0 0) 0x7fb7e808d800 con 0x7fb7e813ec40 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): my global_id is 4409 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7d40035e0 con 0x7fb7e813ec40 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562892759 0 0) 0x7fb7e808a7d0 con 0x7fb7e81811f0 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): my global_id is 4416 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e808d800 con 0x7fb7e81811f0 2026-02-17T05:28:11.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980069973 0 0) 0x7fb7e808d5c0 con 0x7fb7e813f010 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient(hunting): my global_id is 4414 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e808a7d0 con 0x7fb7e813f010 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3096767003 0 0) 0x7fb7e808d800 con 0x7fb7e81811f0 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 >> v1:10.20.193.106:6790/0 conn(0x7fb7e813ec40 legacy=0x7fb7e808ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 >> v1:10.20.193.118:6789/0 conn(0x7fb7e813f010 legacy=0x7fb7e813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 monclient: found mon.noname-a 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e808a180 con 0x7fb7e81811f0 2026-02-17T05:28:11.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7d8003eb0 con 0x7fb7e81811f0 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: dump: 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.919 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 5 monclient: authenticate success, global_id 4416 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7d8004080 con 0x7fb7e81811f0 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 1 -- 10.20.193.106:0/95800419 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7d8004490 con 0x7fb7e81811f0 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7e5ffb640 10 monclient: dump: 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.920 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.899+0000 7fb7ed41b640 4 set_mon_vals no callback set 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: shutdown 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- 10.20.193.106:0/95800419 >> v1:10.20.193.106:6789/0 conn(0x7fb7e81811f0 legacy=0x7fb7e81a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- 10.20.193.106:0/95800419 shutdown_connections 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- 10.20.193.106:0/95800419 >> 10.20.193.106:0/95800419 conn(0x7fb7e80915f0 msgr2=0x7fb7e80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:11.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- 10.20.193.106:0/95800419 shutdown_connections 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- 10.20.193.106:0/95800419 wait complete. 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: build_initial_monmap 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: monmap: 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 Processor -- start 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- start start 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: init 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-c con 0x7fb7e813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-a con 0x7fb7e813f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient(hunting): picked mon.noname-b con 0x7fb7e81811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e811c640 con 0x7fb7e813f010 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e811c9b0 con 0x7fb7e81811f0 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e810ca20 con 0x7fb7e813ec40 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.900+0000 7fb7ed41b640 10 monclient(hunting): authenticate will time out at 620.528995s 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7e6ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb7e813ec40 0x7fb7e81801e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36518/0 (socket says 10.20.193.106:36518) 2026-02-17T05:28:11.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7e6ffd640 1 -- 10.20.193.106:0/2956988062 learned_addr learned my addr 10.20.193.106:0/2956988062 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224537550 0 0) 0x7fb7e811c640 con 0x7fb7e813f010 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): my global_id is 4419 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7b40035e0 con 0x7fb7e813f010 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910422467 0 0) 0x7fb7e810ca20 con 0x7fb7e813ec40 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): my global_id is 4412 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e811c640 con 0x7fb7e813ec40 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366089501 0 0) 0x7fb7e811c9b0 con 0x7fb7e81811f0 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:11.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): my global_id is 4417 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e810ca20 con 0x7fb7e81811f0 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3145652518 0 0) 0x7fb7b40035e0 con 0x7fb7e813f010 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7e811c9b0 con 0x7fb7e813f010 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7d0003040 con 0x7fb7e813f010 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): dump: 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.925 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2495660525 0 0) 0x7fb7e811c640 con 0x7fb7e813ec40 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7b40035e0 con 0x7fb7e813ec40 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7dc003170 con 0x7fb7e813ec40 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient(hunting): dump: 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.926 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 448534360 0 0) 0x7fb7e811c9b0 con 0x7fb7e813f010 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 >> v1:10.20.193.106:6790/0 conn(0x7fb7e813ec40 legacy=0x7fb7e81801e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 >> v1:10.20.193.118:6789/0 conn(0x7fb7e81811f0 legacy=0x7fb7e8130030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 monclient: found mon.a 2026-02-17T05:28:11.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8181000 con 0x7fb7e813f010 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 5 monclient: authenticate success, global_id 4419 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 10 monclient: _renew_subs 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e810cd60 con 0x7fb7e813f010 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 10 monclient: _renew_subs 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7e805c590 con 0x7fb7e813f010 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7d00036d0 con 0x7fb7e813f010 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:11.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7d00039f0 con 0x7fb7e813f010 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7c77fe640 10 monclient: dump: 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:11.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.901+0000 7fb7e57fa640 4 set_mon_vals no callback set 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7ed41b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7ed41b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7ed41b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb7d0010990 con 0x7fb7e813f010 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e810c7a0 con 0x7fb7e813f010 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fb7d004ea60 con 0x7fb7e813f010 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.902+0000 7fb7e6ffd640 10 monclient: get_auth_request con 0x7fb7b4040c60 auth_method 0 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.904+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb7d0016260 con 0x7fb7e813f010 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.904+0000 7fb7c77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:11.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:11.904+0000 7fb7c77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.009+0000 7fb7ed41b640 10 start_mon_command cmd=[{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-17T05:28:12.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.009+0000 7fb7ed41b640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-17T05:28:12.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.009+0000 7fb7ed41b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.009+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 --> v1:10.20.193.106:6789/0 -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7fb7e805bd10 con 0x7fb7e813f010 2026-02-17T05:28:12.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.011+0000 7fb7c77fe640 1 -- 10.20.193.106:0/2956988062 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v2)=0 v2) ==== 124+0+0 (unknown 948039188 0 0) 0x7fb7d0015a10 con 0x7fb7e813f010 2026-02-17T05:28:12.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.011+0000 7fb7c77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-17T05:28:12.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.011+0000 7fb7c77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 >> v1:10.20.193.118:6812/703720803 conn(0x7fb7b4040c60 legacy=0x7fb7b4061110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 10 monclient: shutdown 2026-02-17T05:28:12.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 >> v1:10.20.193.106:6789/0 conn(0x7fb7e813f010 legacy=0x7fb7e81808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 shutdown_connections 2026-02-17T05:28:12.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 >> 10.20.193.106:0/2956988062 conn(0x7fb7e80915f0 msgr2=0x7fb7e811f280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 shutdown_connections 2026-02-17T05:28:12.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.013+0000 7fb7ed41b640 1 -- 10.20.193.106:0/2956988062 wait complete. 2026-02-17T05:28:12.022 DEBUG:tasks.mon_thrash:Yielding 2026-02-17T05:28:12.022 INFO:teuthology.run_tasks:Running task rados... 2026-02-17T05:28:12.037 INFO:tasks.rados:Beginning rados... 2026-02-17T05:28:12.037 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-17T05:28:12.037 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-bharath18-testing-2026-02-13-0856'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': '1024K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath18-testing-2026-02-13-0856', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}} 2026-02-17T05:28:12.037 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-17T05:28:12.037 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-17T05:28:12.049 INFO:tasks.rados:joining rados 2026-02-17T05:28:12.049 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-17T05:28:12.049 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771306091, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-17T05:28:12.049 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:28:12.049 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:28:12.049 INFO:tasks.rados:clients are ['client.0'] 2026-02-17T05:28:12.049 INFO:tasks.rados:starting run 0 out of 1 2026-02-17T05:28:12.049 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T05:28:12.050 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-17T05:28:12.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 10 monclient: monmap: 2026-02-17T05:28:12.114 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.113606+0000 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.113606+0000 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.115 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 1 Processor -- start 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 1 -- start start 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.113+0000 7fde5de5b640 10 monclient: init 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-b con 0x7fde580585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-c con 0x7fde5813f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-a con 0x7fde5808c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde58056bb0 con 0x7fde5808c0d0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde580575d0 con 0x7fde5813f6c0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde580578b0 con 0x7fde580585c0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient(hunting): authenticate will time out at 620.742176s 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde577fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fde580585c0 0x7fde5813efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36522/0 (socket says 10.20.193.106:36522) 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde577fe640 1 -- 10.20.193.106:0/2751314720 learned_addr learned my addr 10.20.193.106:0/2751314720 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189545826 0 0) 0x7fde58056bb0 con 0x7fde5808c0d0 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): my global_id is 4422 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde3c0035e0 con 0x7fde5808c0d0 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085646555 0 0) 0x7fde580578b0 con 0x7fde580585c0 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient(hunting): my global_id is 4415 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde58056bb0 con 0x7fde580585c0 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789727316 0 0) 0x7fde3c0035e0 con 0x7fde5808c0d0 2026-02-17T05:28:12.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 >> v1:10.20.193.106:6790/0 conn(0x7fde580585c0 legacy=0x7fde5813efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 >> v1:10.20.193.118:6789/0 conn(0x7fde5813f6c0 legacy=0x7fde58183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 monclient: found mon.noname-a 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde58057b90 con 0x7fde5808c0d0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fde4c003eb0 con 0x7fde5808c0d0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: dump: 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.124 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 5 monclient: authenticate success, global_id 4422 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde4c004170 con 0x7fde5808c0d0 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 1 -- 10.20.193.106:0/2751314720 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fde4c004580 con 0x7fde5808c0d0 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde5de5b640 4 set_mon_vals no callback set 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.114+0000 7fde567fc640 10 monclient: dump: 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.125 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: shutdown 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- 10.20.193.106:0/2751314720 >> v1:10.20.193.106:6789/0 conn(0x7fde5808c0d0 legacy=0x7fde581a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- 10.20.193.106:0/2751314720 shutdown_connections 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- 10.20.193.106:0/2751314720 >> 10.20.193.106:0/2751314720 conn(0x7fde5805e410 msgr2=0x7fde58095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- 10.20.193.106:0/2751314720 shutdown_connections 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- 10.20.193.106:0/2751314720 wait complete. 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: monmap: 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.127 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 Processor -- start 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 1 -- start start 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: init 2026-02-17T05:28:12.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7f15a090c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7f15a090c640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7f15a090c640 10 monclient: monmap: 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.116156+0000 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.116156+0000 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.129 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.130 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.130 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-c con 0x7fde580585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-b con 0x7fde5808c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.115+0000 7fde5de5b640 10 monclient(hunting): picked mon.noname-a con 0x7fde5813f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5808c530 con 0x7fde5813f6c0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5808bb60 con 0x7fde5808c0d0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5810e940 con 0x7fde580585c0 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient(hunting): authenticate will time out at 620.744018s 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde57fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fde5813f6c0 0x7fde581a46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36612/0 (socket says 10.20.193.106:36612) 2026-02-17T05:28:12.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde57fff640 1 -- 10.20.193.106:0/4072628062 learned_addr learned my addr 10.20.193.106:0/4072628062 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde577fe640 1 --1- 10.20.193.106:0/4072628062 >> v1:10.20.193.106:6790/0 conn(0x7fde580585c0 0x7fde5812d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36530/0 (socket says 10.20.193.106:36530) 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111898781 0 0) 0x7fde5808c530 con 0x7fde5813f6c0 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): my global_id is 4425 2026-02-17T05:28:12.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 1 Processor -- start 2026-02-17T05:28:12.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde280035e0 con 0x7fde5813f6c0 2026-02-17T05:28:12.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 1 -- start start 2026-02-17T05:28:12.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient: init 2026-02-17T05:28:12.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625249426 0 0) 0x7fde5810e940 con 0x7fde580585c0 2026-02-17T05:28:12.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): my global_id is 4418 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde5808c530 con 0x7fde580585c0 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1266422394 0 0) 0x7fde280035e0 con 0x7fde5813f6c0 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde5810e940 con 0x7fde5813f6c0 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fde4c004490 con 0x7fde5813f6c0 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): dump: 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.137 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2265033957 0 0) 0x7fde5810e940 con 0x7fde5813f6c0 2026-02-17T05:28:12.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 >> v1:10.20.193.106:6790/0 conn(0x7fde580585c0 legacy=0x7fde5812d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 >> v1:10.20.193.118:6789/0 conn(0x7fde5808c0d0 legacy=0x7fde581a2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 monclient: found mon.a 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5810d820 con 0x7fde5813f6c0 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 5 monclient: authenticate success, global_id 4425 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient: _renew_subs 2026-02-17T05:28:12.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde581a5e00 con 0x7fde5813f6c0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient: _renew_subs 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fde5808b480 con 0x7fde5813f6c0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde4c0039d0 con 0x7fde5813f6c0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fde4c004cb0 con 0x7fde5813f6c0 2026-02-17T05:28:12.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde33fff640 10 monclient: dump: 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.141 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:12.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7fde55ffb640 4 set_mon_vals no callback set 2026-02-17T05:28:12.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-b con 0x7f15980585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-c con 0x7f159813f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-a con 0x7f159808c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1598056bb0 con 0x7f159808c0d0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15980575d0 con 0x7f159813f6c0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15980578b0 con 0x7f15980585c0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f15a090c640 10 monclient(hunting): authenticate will time out at 620.744743s 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f159e681640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f15980585c0 0x7f159813efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36536/0 (socket says 10.20.193.106:36536) 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.116+0000 7f159e681640 1 -- 10.20.193.106:0/3704189271 learned_addr learned my addr 10.20.193.106:0/3704189271 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609183600 0 0) 0x7f15980578b0 con 0x7f15980585c0 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde5de5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): my global_id is 4421 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15880035e0 con 0x7f15980585c0 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608259192 0 0) 0x7f1598056bb0 con 0x7f159808c0d0 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient(hunting): my global_id is 4428 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15980578b0 con 0x7f159808c0d0 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 797752735 0 0) 0x7f15980578b0 con 0x7f159808c0d0 2026-02-17T05:28:12.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde5de5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 >> v1:10.20.193.106:6790/0 conn(0x7f15980585c0 legacy=0x7f159813efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 >> v1:10.20.193.118:6789/0 conn(0x7f159813f6c0 legacy=0x7f1598183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde5de5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 monclient: found mon.noname-a 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598057b90 con 0x7f159808c0d0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f158c003eb0 con 0x7f159808c0d0 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 5 monclient: authenticate success, global_id 4428 2026-02-17T05:28:12.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5813eaa0 con 0x7fde5813f6c0 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: dump: 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.149 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fde4c004e90 con 0x7fde5813f6c0 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f158c0040f0 con 0x7f159808c0d0 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 1 -- 10.20.193.106:0/3704189271 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f158c004500 con 0x7f159808c0d0 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 4 set_mon_vals no callback set 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f159d67f640 10 monclient: dump: 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.151 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.152 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.152 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.152 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fde4c050dc0 con 0x7fde5813f6c0 2026-02-17T05:28:12.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 10 monclient: shutdown 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 1 -- 10.20.193.106:0/3704189271 >> v1:10.20.193.106:6789/0 conn(0x7f159808c0d0 legacy=0x7f15981a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 1 -- 10.20.193.106:0/3704189271 shutdown_connections 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 1 -- 10.20.193.106:0/3704189271 >> 10.20.193.106:0/3704189271 conn(0x7f159805e410 msgr2=0x7f1598095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 1 -- 10.20.193.106:0/3704189271 shutdown_connections 2026-02-17T05:28:12.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7fde577fe640 10 monclient: get_auth_request con 0x7fde28040800 auth_method 0 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.117+0000 7f15a090c640 1 -- 10.20.193.106:0/3704189271 wait complete. 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient: monmap: 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 1 Processor -- start 2026-02-17T05:28:12.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 1 -- start start 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient: init 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-a con 0x7f15980585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-b con 0x7f159808c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient(hunting): picked mon.noname-c con 0x7f159813f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159808b930 con 0x7f15980585c0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15981427d0 con 0x7f159808c0d0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159808c530 con 0x7f159813f6c0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f15a090c640 10 monclient(hunting): authenticate will time out at 620.746717s 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f159e681640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f15980585c0 0x7f159813cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36624/0 (socket says 10.20.193.106:36624) 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f159e681640 1 -- 10.20.193.106:0/2687061289 learned_addr learned my addr 10.20.193.106:0/2687061289 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550263999 0 0) 0x7f159808c530 con 0x7f159813f6c0 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 10 monclient(hunting): my global_id is 4424 2026-02-17T05:28:12.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.118+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15680035e0 con 0x7f159813f6c0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 337805374 0 0) 0x7f15680035e0 con 0x7f159813f6c0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f159808c530 con 0x7f159813f6c0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f158c003dc0 con 0x7f159813f6c0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391987230 0 0) 0x7f15981427d0 con 0x7f159808c0d0 2026-02-17T05:28:12.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient(hunting): my global_id is 4429 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15680035e0 con 0x7f159808c0d0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2595305910 0 0) 0x7f159808c530 con 0x7f159813f6c0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 >> v1:10.20.193.118:6789/0 conn(0x7f159808c0d0 legacy=0x7f15981935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 >> v1:10.20.193.106:6789/0 conn(0x7f15980585c0 legacy=0x7f159813cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 monclient: found mon.c 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159812e7c0 con 0x7f159813f6c0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 5 monclient: authenticate success, global_id 4424 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _renew_subs 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f159812df20 con 0x7f159813f6c0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _renew_subs 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f159808b150 con 0x7f159813f6c0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f158c003880 con 0x7f159813f6c0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f158c004bd0 con 0x7f159813f6c0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f1582ffd640 10 monclient: dump: 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.160 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f159ce7e640 4 set_mon_vals no callback set 2026-02-17T05:28:12.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fde5813eaa0 con 0x7fde5813f6c0 2026-02-17T05:28:12.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7fde33fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7fde33fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.119+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1598093240 con 0x7f159813f6c0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.120+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f158c011b70 con 0x7f159813f6c0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.120+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f158c04fae0 con 0x7f159813f6c0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.120+0000 7f159e681640 10 monclient: get_auth_request con 0x7f1568040890 auth_method 0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.122+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f158c0173a0 con 0x7f159813f6c0 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.122+0000 7f1582ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.122+0000 7f1582ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.226+0000 7f15a090c640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T05:28:12.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.226+0000 7f15a090c640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T05:28:12.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.226+0000 7f15a090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.226+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7f159812e290 con 0x7f159813f6c0 2026-02-17T05:28:12.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.271+0000 7fde5de5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:28:12.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.271+0000 7fde5de5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:12.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.271+0000 7fde5de5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.271+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fde5813eaa0 con 0x7fde5813f6c0 2026-02-17T05:28:12.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.272+0000 7fde33fff640 1 -- 10.20.193.106:0/4072628062 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3148098313) 0x7fde5813eaa0 con 0x7fde5813f6c0 2026-02-17T05:28:12.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.272+0000 7fde33fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:12.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.272+0000 7fde33fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.273 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 >> v1:10.20.193.118:6812/703720803 conn(0x7fde28040800 legacy=0x7fde28060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 10 monclient: shutdown 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 >> v1:10.20.193.106:6789/0 conn(0x7fde5813f6c0 legacy=0x7fde581a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 shutdown_connections 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 >> 10.20.193.106:0/4072628062 conn(0x7fde5805e410 msgr2=0x7fde581416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 shutdown_connections 2026-02-17T05:28:12.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.273+0000 7fde5de5b640 1 -- 10.20.193.106:0/4072628062 wait complete. 2026-02-17T05:28:12.282 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:28:12.282 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:28:12.282 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:28:12.282 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:28:12.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 10 monclient: monmap: 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.386693+0000 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.386693+0000 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 1 Processor -- start 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 1 -- start start 2026-02-17T05:28:12.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.386+0000 7fc02cb9d640 10 monclient: init 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-b con 0x7fc02805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-c con 0x7fc02805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-a con 0x7fc028182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02808b060 con 0x7fc028182720 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02805dc90 con 0x7fc02805dee0 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02808d6a0 con 0x7fc02805d1b0 2026-02-17T05:28:12.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient(hunting): authenticate will time out at 621.015082s 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc026575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc02805d1b0 0x7fc02805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36548/0 (socket says 10.20.193.106:36548) 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc026575640 1 -- 10.20.193.106:0/56249272 learned_addr learned my addr 10.20.193.106:0/56249272 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5581369 0 0) 0x7fc02808d6a0 con 0x7fc02805d1b0 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): my global_id is 4427 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0140035e0 con 0x7fc02805d1b0 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604184367 0 0) 0x7fc02808b060 con 0x7fc028182720 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient(hunting): my global_id is 4431 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02808d6a0 con 0x7fc028182720 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2062633863 0 0) 0x7fc0140035e0 con 0x7fc02805d1b0 2026-02-17T05:28:12.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 >> v1:10.20.193.118:6789/0 conn(0x7fc02805dee0 legacy=0x7fc028181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 >> v1:10.20.193.106:6789/0 conn(0x7fc028182720 legacy=0x7fc0281a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 monclient: found mon.noname-b 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc028057960 con 0x7fc02805d1b0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc01c002dd0 con 0x7fc02805d1b0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 5 monclient: authenticate success, global_id 4427 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: dump: 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.398 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc01c003010 con 0x7fc02805d1b0 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 1 -- 10.20.193.106:0/56249272 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc01c003420 con 0x7fc02805d1b0 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 4 set_mon_vals no callback set 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc025573640 10 monclient: dump: 2026-02-17T05:28:12.399 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 10 monclient: shutdown 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 1 -- 10.20.193.106:0/56249272 >> v1:10.20.193.106:6790/0 conn(0x7fc02805d1b0 legacy=0x7fc02805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.387+0000 7fc02cb9d640 1 -- 10.20.193.106:0/56249272 shutdown_connections 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 1 -- 10.20.193.106:0/56249272 >> 10.20.193.106:0/56249272 conn(0x7fc0280915f0 msgr2=0x7fc0280919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 1 -- 10.20.193.106:0/56249272 shutdown_connections 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 1 -- 10.20.193.106:0/56249272 wait complete. 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 10 monclient: monmap: 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 1 Processor -- start 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 1 -- start start 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.388+0000 7fc02cb9d640 10 monclient: init 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-a con 0x7fc02805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-b con 0x7fc02805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient(hunting): picked mon.noname-c con 0x7fc028182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02812c330 con 0x7fc02805d1b0 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02805e8e0 con 0x7fc02805dee0 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02810bfa0 con 0x7fc028182720 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient(hunting): authenticate will time out at 621.017105s 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc026575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc02805d1b0 0x7fc02812b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36640/0 (socket says 10.20.193.106:36640) 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc026575640 1 -- 10.20.193.106:0/1533993849 learned_addr learned my addr 10.20.193.106:0/1533993849 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593098773 0 0) 0x7fc02810bfa0 con 0x7fc028182720 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): my global_id is 4430 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbff40035e0 con 0x7fc028182720 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123839087 0 0) 0x7fc02812c330 con 0x7fc02805d1b0 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): my global_id is 4434 2026-02-17T05:28:12.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02810bfa0 con 0x7fc02805d1b0 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1417379444 0 0) 0x7fbff40035e0 con 0x7fc028182720 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc02812c330 con 0x7fc028182720 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc018004170 con 0x7fc028182720 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 307901583 0 0) 0x7fc02810bfa0 con 0x7fc02805d1b0 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbff40035e0 con 0x7fc02805d1b0 2026-02-17T05:28:12.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc01c002ce0 con 0x7fc02805d1b0 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168149306 0 0) 0x7fc02805e8e0 con 0x7fc02805dee0 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient(hunting): my global_id is 4435 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02810bfa0 con 0x7fc02805dee0 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4195586123 0 0) 0x7fc02812c330 con 0x7fc028182720 2026-02-17T05:28:12.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.118:6789/0 conn(0x7fc02805dee0 legacy=0x7fc02812bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6789/0 conn(0x7fc02805d1b0 legacy=0x7fc02812b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 monclient: found mon.c 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02810aab0 con 0x7fc028182720 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 5 monclient: authenticate success, global_id 4430 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _renew_subs 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0281824f0 con 0x7fc028182720 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _renew_subs 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc02810a420 con 0x7fc028182720 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0180047b0 con 0x7fc028182720 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc018004ad0 con 0x7fc028182720 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc024d72640 4 set_mon_vals no callback set 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.389+0000 7fc00effd640 10 monclient: dump: 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc02cb9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc02810b9e0 con 0x7fc02810b610 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc018011a70 con 0x7fc028182720 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fc01804fa40 con 0x7fc028182720 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030555274 0 0) 0x7fc02810b9e0 con 0x7fc02810b610 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient(hunting): my global_id is 4437 2026-02-17T05:28:12.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02812c330 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc025d74640 10 monclient: get_auth_request con 0x7fbff4040d30 auth_method 0 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 194299895 0 0) 0x7fc02812c330 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc02810b9e0 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc01c004a90 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.390+0000 7fc00effd640 10 monclient: dump: 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2092483020 0 0) 0x7fc02810b9e0 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc028057cd0 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc01c004ed0 con 0x7fc02810b610 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6789/0 conn(0x7fc02810b610 legacy=0x7fc02805a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.391+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6789/0 conn(0x7fc02810b610 legacy=0x7fc02805a0c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc02cb9d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc028128850 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219777978 0 0) 0x7fc028128850 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient(hunting): my global_id is 4440 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02810b9e0 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1718470604 0 0) 0x7fc02810b9e0 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc028128850 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc01c0054d0 con 0x7fc028128450 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.394+0000 7fc00effd640 10 monclient: dump: 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.408 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 937518445 0 0) 0x7fc028128850 con 0x7fc028128450 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc02810c8b0 con 0x7fc028128450 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4515 (unknown 0 0 1447370804) 0x7fc01c006940 con 0x7fc028128450 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6789/0 conn(0x7fc028128450 legacy=0x7fc02804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc00effd640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6789/0 conn(0x7fc028128450 legacy=0x7fc02804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 4, 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 17159, 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:28:12.409 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 16, 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.410 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:28:12.411 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.412 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:28:12.413 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:28:12.414 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:28:12.415 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.118:6812/703720803 conn(0x7fbff4040d30 legacy=0x7fbff40611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 10 monclient: shutdown 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 >> v1:10.20.193.106:6790/0 conn(0x7fc028182720 legacy=0x7fc028181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc026d76640 1 -- 10.20.193.106:0/1533993849 reap_dead start 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc026d76640 1 -- 10.20.193.106:0/1533993849 reap_dead start 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 shutdown_connections 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 >> 10.20.193.106:0/1533993849 conn(0x7fc0280915f0 msgr2=0x7fc02808c270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 shutdown_connections 2026-02-17T05:28:12.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.395+0000 7fc02cb9d640 1 -- 10.20.193.106:0/1533993849 wait complete. 2026-02-17T05:28:12.418 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:28:12.418 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:28:12.418 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.482+0000 7fa5702cc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.482+0000 7fa5702cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.482+0000 7fa5702cc640 10 monclient: monmap: 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.484 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.483223+0000 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.483223+0000 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 1 Processor -- start 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 1 -- start start 2026-02-17T05:28:12.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient: init 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa56805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa56805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa568182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808b060 con 0x7fa568182720 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56805dc90 con 0x7fa56805dee0 2026-02-17T05:28:12.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808d6a0 con 0x7fa56805d1b0 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa5702cc640 10 monclient(hunting): authenticate will time out at 621.111631s 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56e041640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa56805d1b0 0x7fa56805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36572/0 (socket says 10.20.193.106:36572) 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56e041640 1 -- 10.20.193.106:0/3152245487 learned_addr learned my addr 10.20.193.106:0/3152245487 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453497585 0 0) 0x7fa56808d6a0 con 0x7fa56805d1b0 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): my global_id is 4433 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5500035e0 con 0x7fa56805d1b0 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624377452 0 0) 0x7fa56808b060 con 0x7fa568182720 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.483+0000 7fa56d03f640 10 monclient(hunting): my global_id is 4443 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa56808d6a0 con 0x7fa568182720 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525638887 0 0) 0x7fa5500035e0 con 0x7fa56805d1b0 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 >> v1:10.20.193.118:6789/0 conn(0x7fa56805dee0 legacy=0x7fa568181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 >> v1:10.20.193.106:6789/0 conn(0x7fa568182720 legacy=0x7fa5681a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 monclient: found mon.noname-b 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa568057960 con 0x7fa56805d1b0 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa558002dd0 con 0x7fa56805d1b0 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 5 monclient: authenticate success, global_id 4433 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: dump: 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.496 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa558002fa0 con 0x7fa56805d1b0 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 1 -- 10.20.193.106:0/3152245487 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa5580033b0 con 0x7fa56805d1b0 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 4 set_mon_vals no callback set 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa56d03f640 10 monclient: dump: 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.497 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 10 monclient: shutdown 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 1 -- 10.20.193.106:0/3152245487 >> v1:10.20.193.106:6790/0 conn(0x7fa56805d1b0 legacy=0x7fa56805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 1 -- 10.20.193.106:0/3152245487 shutdown_connections 2026-02-17T05:28:12.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 1 -- 10.20.193.106:0/3152245487 >> 10.20.193.106:0/3152245487 conn(0x7fa5680915f0 msgr2=0x7fa5680919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 1 -- 10.20.193.106:0/3152245487 shutdown_connections 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.484+0000 7fa5702cc640 1 -- 10.20.193.106:0/3152245487 wait complete. 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient: monmap: 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.499 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 1 Processor -- start 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 1 -- start start 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient: init 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa56805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa56805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa568182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56810c920 con 0x7fa568182720 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56810e3f0 con 0x7fa56805d1b0 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808c590 con 0x7fa56805dee0 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa5702cc640 10 monclient(hunting): authenticate will time out at 621.113494s 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa56d840640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa56805dee0 0x7fa568180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36574/0 (socket says 10.20.193.106:36574) 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa56d840640 1 -- 10.20.193.106:0/3335551428 learned_addr learned my addr 10.20.193.106:0/3335551428 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288857449 0 0) 0x7fa56808c590 con 0x7fa56805dee0 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): my global_id is 4436 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5380035e0 con 0x7fa56805dee0 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141316301 0 0) 0x7fa564003a00 con 0x7fa568182720 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): my global_id is 4446 2026-02-17T05:28:12.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa56808c590 con 0x7fa568182720 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2690750831 0 0) 0x7fa5380035e0 con 0x7fa56805dee0 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa564003a00 con 0x7fa56805dee0 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa55c003040 con 0x7fa56805dee0 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.502 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4063178235 0 0) 0x7fa56808c590 con 0x7fa568182720 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5380035e0 con 0x7fa568182720 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa564004330 con 0x7fa568182720 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.503 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3303199231 0 0) 0x7fa564003a00 con 0x7fa56805dee0 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.485+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.118:6789/0 conn(0x7fa56805d1b0 legacy=0x7fa56813cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6789/0 conn(0x7fa568182720 legacy=0x7fa5681197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 monclient: found mon.c 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56810ce90 con 0x7fa56805dee0 2026-02-17T05:28:12.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 5 monclient: authenticate success, global_id 4436 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 10 monclient: _renew_subs 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5681824f0 con 0x7fa56805dee0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 10 monclient: _renew_subs 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa56810d9f0 con 0x7fa56805dee0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa55c0036d0 con 0x7fa56805dee0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa55c003ab0 con 0x7fa56805dee0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient: dump: 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa56c83e640 4 set_mon_vals no callback set 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa56813f4f0 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa55c003c10 con 0x7fa56805dee0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fa55c04fc00 con 0x7fa56805dee0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033595014 0 0) 0x7fa56813f4f0 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 10 monclient(hunting): my global_id is 4439 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa564003a00 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.486+0000 7fa56e842640 10 monclient: get_auth_request con 0x7fa538040bb0 auth_method 0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2662748185 0 0) 0x7fa564003a00 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa56813f4f0 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa5580033f0 con 0x7fa56812a7c0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 10 monclient: dump: 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2285341696 0 0) 0x7fa56813f4f0 con 0x7fa56812a7c0 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa56810eab0 con 0x7fa56812a7c0 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa558002ca0 con 0x7fa56812a7c0 2026-02-17T05:28:12.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6790/0 conn(0x7fa56812a7c0 legacy=0x7fa568089770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.487+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6790/0 conn(0x7fa56812a7c0 legacy=0x7fa568089770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa56805d580 con 0x7fa56813d420 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240405961 0 0) 0x7fa56805d580 con 0x7fa56813d420 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient(hunting): my global_id is 4442 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa56813f4f0 con 0x7fa56813d420 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3168639294 0 0) 0x7fa56813f4f0 con 0x7fa56813d420 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa56805d580 con 0x7fa56813d420 2026-02-17T05:28:12.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa558004c40 con 0x7fa56813d420 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient: dump: 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2798577801 0 0) 0x7fa56805d580 con 0x7fa56813d420 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa568057ca0 con 0x7fa56813d420 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4513 (unknown 0 0 4288655481) 0x7fa558005070 con 0x7fa56813d420 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6790/0 conn(0x7fa56813d420 legacy=0x7fa568088db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa54effd640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6790/0 conn(0x7fa56813d420 legacy=0x7fa568088db0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:12.511 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 4, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 17252, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 17, 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.512 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:28:12.513 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:28:12.514 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.515 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:28:12.516 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:28:12.517 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.518 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.519 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.520 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:28:12.521 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.118:6812/703720803 conn(0x7fa538040bb0 legacy=0x7fa538061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 10 monclient: shutdown 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 >> v1:10.20.193.106:6790/0 conn(0x7fa56805dee0 legacy=0x7fa568180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa56e842640 1 -- 10.20.193.106:0/3335551428 reap_dead start 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 shutdown_connections 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 >> 10.20.193.106:0/3335551428 conn(0x7fa5680915f0 msgr2=0x7fa5681a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 shutdown_connections 2026-02-17T05:28:12.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.491+0000 7fa5702cc640 1 -- 10.20.193.106:0/3335551428 wait complete. 2026-02-17T05:28:12.523 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:28:12.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:28:12.523 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:28:12.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: monmap: 2026-02-17T05:28:12.595 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.587510+0000 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.587510+0000 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 1 Processor -- start 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 1 -- start start 2026-02-17T05:28:12.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: init 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-c con 0x7efcc805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-b con 0x7efcc805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-a con 0x7efcc8182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc808b060 con 0x7efcc8182720 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc805dc90 con 0x7efcc805d1b0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc808d6a0 con 0x7efcc805dee0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcccc07640 10 monclient(hunting): authenticate will time out at 621.215888s 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcc5d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7efcc805dee0 0x7efcc8181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36600/0 (socket says 10.20.193.106:36600) 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.587+0000 7efcc5d74640 1 -- 10.20.193.106:0/2287022217 learned_addr learned my addr 10.20.193.106:0/2287022217 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509349372 0 0) 0x7efcc808d6a0 con 0x7efcc805dee0 2026-02-17T05:28:12.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): my global_id is 4445 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb40035e0 con 0x7efcc805dee0 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576154474 0 0) 0x7efcc808b060 con 0x7efcc8182720 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): my global_id is 4449 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc808d6a0 con 0x7efcc8182720 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130342875 0 0) 0x7efcc805dc90 con 0x7efcc805d1b0 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient(hunting): my global_id is 4444 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc808b060 con 0x7efcc805d1b0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1589515978 0 0) 0x7efcb40035e0 con 0x7efcc805dee0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 >> v1:10.20.193.118:6789/0 conn(0x7efcc805d1b0 legacy=0x7efcc805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 >> v1:10.20.193.106:6789/0 conn(0x7efcc8182720 legacy=0x7efcc81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 monclient: found mon.noname-b 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc8057960 con 0x7efcc805dee0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcb0002d50 con 0x7efcc805dee0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: dump: 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 5 monclient: authenticate success, global_id 4445 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0002f50 con 0x7efcc805dee0 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 1 -- 10.20.193.106:0/2287022217 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcb0003320 con 0x7efcc805dee0 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcc5573640 10 monclient: dump: 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 4 set_mon_vals no callback set 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 10 monclient: shutdown 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 1 -- 10.20.193.106:0/2287022217 >> v1:10.20.193.106:6790/0 conn(0x7efcc805dee0 legacy=0x7efcc8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 1 -- 10.20.193.106:0/2287022217 shutdown_connections 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 1 -- 10.20.193.106:0/2287022217 >> 10.20.193.106:0/2287022217 conn(0x7efcc80915f0 msgr2=0x7efcc80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 1 -- 10.20.193.106:0/2287022217 shutdown_connections 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.588+0000 7efcccc07640 1 -- 10.20.193.106:0/2287022217 wait complete. 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient: monmap: 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.602 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 1 Processor -- start 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 1 -- start start 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient: init 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-b con 0x7efcc805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-c con 0x7efcc805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient(hunting): picked mon.noname-a con 0x7efcc8182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc813f630 con 0x7efcc8182720 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc810eee0 con 0x7efcc805d1b0 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc812ae10 con 0x7efcc805dee0 2026-02-17T05:28:12.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcccc07640 10 monclient(hunting): authenticate will time out at 621.217773s 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcc5d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7efcc805dee0 0x7efcc812a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36608/0 (socket says 10.20.193.106:36608) 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcc5d74640 1 -- 10.20.193.106:0/3885666296 learned_addr learned my addr 10.20.193.106:0/3885666296 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083694039 0 0) 0x7efcc812ae10 con 0x7efcc805dee0 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcaeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.589+0000 7efcaeffd640 10 monclient(hunting): my global_id is 4448 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc940035e0 con 0x7efcc805dee0 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354062263 0 0) 0x7efcc813f630 con 0x7efcc8182720 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): my global_id is 4452 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc812ae10 con 0x7efcc8182720 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780248154 0 0) 0x7efcc810eee0 con 0x7efcc805d1b0 2026-02-17T05:28:12.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): my global_id is 4447 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc813f630 con 0x7efcc805d1b0 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2788714142 0 0) 0x7efc940035e0 con 0x7efcc805dee0 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc810eee0 con 0x7efcc805dee0 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcb0003270 con 0x7efcc805dee0 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.605 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3869019565 0 0) 0x7efcc812ae10 con 0x7efcc8182720 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc940035e0 con 0x7efcc8182720 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcb8004420 con 0x7efcc8182720 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.606 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3794381483 0 0) 0x7efcc813f630 con 0x7efcc805d1b0 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc812ae10 con 0x7efcc805d1b0 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcbc003070 con 0x7efcc805d1b0 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.607 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2838587929 0 0) 0x7efcc810eee0 con 0x7efcc805dee0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6789/0 conn(0x7efcc805d1b0 legacy=0x7efcc8129ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.106:6789/0 conn(0x7efcc8182720 legacy=0x7efcc8181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 monclient: found mon.c 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc810d860 con 0x7efcc805dee0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 5 monclient: authenticate success, global_id 4448 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 10 monclient: _renew_subs 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcc805e8e0 con 0x7efcc805dee0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 10 monclient: _renew_subs 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efcc81824f0 con 0x7efcc805dee0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0004b50 con 0x7efcc805dee0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcb0004e70 con 0x7efcc805dee0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcc4d72640 4 set_mon_vals no callback set 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 10 monclient: dump: 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.609 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcc810ecc0 con 0x7efcc8089860 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.590+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7efcb0011e10 con 0x7efcc805dee0 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7efcb004fbf0 con 0x7efcc805dee0 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcc6d76640 10 monclient: get_auth_request con 0x7efc94041090 auth_method 0 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580893254 0 0) 0x7efcc810ecc0 con 0x7efcc8089860 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 10 monclient(hunting): my global_id is 4450 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.591+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc810eee0 con 0x7efcc8089860 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4109802801 0 0) 0x7efcc810eee0 con 0x7efcc8089860 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc810ecc0 con 0x7efcc8089860 2026-02-17T05:28:12.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcbc0035b0 con 0x7efcc8089860 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 10 monclient: dump: 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3181387433 0 0) 0x7efcc810ecc0 con 0x7efcc8089860 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcc8057ca0 con 0x7efcc8089860 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efcbc0058e0 con 0x7efcc8089860 2026-02-17T05:28:12.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6789/0 conn(0x7efcc8089860 legacy=0x7efcc8059e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.592+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6789/0 conn(0x7efcc8089860 legacy=0x7efcc8059e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcccc07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcc812d960 con 0x7efcc812d590 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372659990 0 0) 0x7efcc812d960 con 0x7efcc812d590 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient(hunting): my global_id is 4453 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc810ecc0 con 0x7efcc812d590 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1811378468 0 0) 0x7efcc810ecc0 con 0x7efcc812d590 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc812d960 con 0x7efcc812d590 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7efcbc004f60 con 0x7efcc812d590 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 10 monclient: dump: 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.614 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3471403333 0 0) 0x7efcc812d960 con 0x7efcc812d590 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.596+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efcc810da90 con 0x7efcc812d590 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4680 (unknown 0 0 1130395637) 0x7efcbc005af0 con 0x7efcc812d590 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcaeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcaeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6789/0 conn(0x7efcc812d590 legacy=0x7efcc804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcaeffd640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6789/0 conn(0x7efcc812d590 legacy=0x7efcc804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:12.615 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 4, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 17322, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 17, 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.616 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.617 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:12.618 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:12.619 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.620 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:28:12.621 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:12.622 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.623 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:28:12.624 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.118:6812/703720803 conn(0x7efc94041090 legacy=0x7efc94061540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 10 monclient: shutdown 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 >> v1:10.20.193.106:6790/0 conn(0x7efcc805dee0 legacy=0x7efcc812a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcc6d76640 1 -- 10.20.193.106:0/3885666296 reap_dead start 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcc6d76640 1 -- 10.20.193.106:0/3885666296 reap_dead start 2026-02-17T05:28:12.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 shutdown_connections 2026-02-17T05:28:12.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 >> 10.20.193.106:0/3885666296 conn(0x7efcc80915f0 msgr2=0x7efcc805bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 shutdown_connections 2026-02-17T05:28:12.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.597+0000 7efcccc07640 1 -- 10.20.193.106:0/3885666296 wait complete. 2026-02-17T05:28:12.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:28:12.626 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:28:12.626 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:28:12.626 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:28:12.626 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2026-02-17T05:28:12.626 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.692+0000 7f9988ccc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.692+0000 7f9988ccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.692+0000 7f9988ccc640 10 monclient: monmap: 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.692965+0000 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.692965+0000 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.693 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.694 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.694 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.694 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.692+0000 7f9988ccc640 1 Processor -- start 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 1 -- start start 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient: init 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f998405d300 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f9984140420 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f9984140860 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998405dde0 con 0x7f998405d300 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998408c2a0 con 0x7f9984140420 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998408d5c0 con 0x7f9984140860 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 10 monclient(hunting): authenticate will time out at 621.321350s 2026-02-17T05:28:12.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9982575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f998405d300 0x7f998405d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36698/0 (socket says 10.20.193.106:36698) 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9982d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9984140860 0x7f99841a28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36616/0 (socket says 10.20.193.106:36616) 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9982575640 1 -- 10.20.193.106:0/775782351 learned_addr learned my addr 10.20.193.106:0/775782351 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182244639 0 0) 0x7f998408d5c0 con 0x7f9984140860 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): my global_id is 4451 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99700035e0 con 0x7f9984140860 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565266526 0 0) 0x7f998405dde0 con 0x7f998405d300 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient(hunting): my global_id is 4455 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998408d5c0 con 0x7f998405d300 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2541439281 0 0) 0x7f99700035e0 con 0x7f9984140860 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 >> v1:10.20.193.118:6789/0 conn(0x7f9984140420 legacy=0x7f9984181190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 >> v1:10.20.193.106:6789/0 conn(0x7f998405d300 legacy=0x7f998405d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 monclient: found mon.noname-b 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984057880 con 0x7f9984140860 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 5 monclient: authenticate success, global_id 4451 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9974003eb0 con 0x7f9984140860 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9981573640 10 monclient: dump: 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.693+0000 7f9988ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9974004100 con 0x7f9984140860 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 1 -- 10.20.193.106:0/775782351 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9974004510 con 0x7f9984140860 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 4 set_mon_vals no callback set 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9981573640 10 monclient: dump: 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 10 monclient: shutdown 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- 10.20.193.106:0/775782351 >> v1:10.20.193.106:6790/0 conn(0x7f9984140860 legacy=0x7f99841a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- 10.20.193.106:0/775782351 shutdown_connections 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- 10.20.193.106:0/775782351 >> 10.20.193.106:0/775782351 conn(0x7f9984054ef0 msgr2=0x7f9984090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- 10.20.193.106:0/775782351 shutdown_connections 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- 10.20.193.106:0/775782351 wait complete. 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 10 monclient: monmap: 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 Processor -- start 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 1 -- start start 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.694+0000 7f9988ccc640 10 monclient: init 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f998405d300 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f9984140420 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f9984140860 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998412c150 con 0x7f9984140420 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998412d650 con 0x7f9984140860 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998413d570 con 0x7f998405d300 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient(hunting): authenticate will time out at 621.323113s 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9981d74640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9984140420 0x7f9984088580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36712/0 (socket says 10.20.193.106:36712) 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9981d74640 1 -- 10.20.193.106:0/1127364571 learned_addr learned my addr 10.20.193.106:0/1127364571 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9982575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f998405d300 0x7f9984087e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36624/0 (socket says 10.20.193.106:36624) 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705820183 0 0) 0x7f998412c150 con 0x7f9984140420 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): my global_id is 4458 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99500035e0 con 0x7f9984140420 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832483804 0 0) 0x7f998413d570 con 0x7f998405d300 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): my global_id is 4454 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998412c150 con 0x7f998405d300 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3717698301 0 0) 0x7f99500035e0 con 0x7f9984140420 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998413d570 con 0x7f9984140420 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c003170 con 0x7f9984140420 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.701 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2617387392 0 0) 0x7f998412c150 con 0x7f998405d300 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99500035e0 con 0x7f998405d300 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9978003090 con 0x7f998405d300 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1657233275 0 0) 0x7f998413d570 con 0x7f9984140420 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6790/0 conn(0x7f998405d300 legacy=0x7f9984087e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.118:6789/0 conn(0x7f9984140860 legacy=0x7f9984088c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 monclient: found mon.a 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998413f4b0 con 0x7f9984140420 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 5 monclient: authenticate success, global_id 4458 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _renew_subs 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f998405e8c0 con 0x7f9984140420 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _renew_subs 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f998412c5e0 con 0x7f9984140420 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f996c0033c0 con 0x7f9984140420 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c003b30 con 0x7f9984140420 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f996affd640 10 monclient: dump: 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9980d72640 4 set_mon_vals no callback set 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.695+0000 7f9988ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f998408be90 con 0x7f99840591c0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127936730 0 0) 0x7f998408be90 con 0x7f99840591c0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient(hunting): my global_id is 4461 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998413d570 con 0x7f99840591c0 2026-02-17T05:28:12.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f996c003c90 con 0x7f9984140420 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f996c04fc70 con 0x7f9984140420 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1728600857 0 0) 0x7f998413d570 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998408be90 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f99780048a0 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 10 monclient: dump: 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f9982d76640 10 monclient: get_auth_request con 0x7f9950040c60 auth_method 0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1412336477 0 0) 0x7f998408be90 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.696+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99840008d0 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.697+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9978005990 con 0x7f99840591c0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.697+0000 7f996affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.697+0000 7f996affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.697+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6789/0 conn(0x7f99840591c0 legacy=0x7f998404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.697+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6789/0 conn(0x7f99840591c0 legacy=0x7f998404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.700+0000 7f9988ccc640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.700+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f998404d910 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537854253 0 0) 0x7f998404d910 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient(hunting): my global_id is 4464 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998408be90 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1733774945 0 0) 0x7f998408be90 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998404d910 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9978005080 con 0x7f9984059590 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient: dump: 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.705 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1908729748 0 0) 0x7f998404d910 con 0x7f9984059590 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f9984090010 con 0x7f9984059590 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f99780054a0 con 0x7f9984059590 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6789/0 conn(0x7f9984059590 legacy=0x7f9984196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.701+0000 7f996affd640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6789/0 conn(0x7f9984059590 legacy=0x7f9984196f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stdout: "ret": 0, 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-17T05:28:12.706 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.118:6812/703720803 conn(0x7f9950040c60 legacy=0x7f9950061110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 10 monclient: shutdown 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 >> v1:10.20.193.106:6789/0 conn(0x7f9984140420 legacy=0x7f9984088580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9982d76640 1 -- 10.20.193.106:0/1127364571 reap_dead start 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9982d76640 1 -- 10.20.193.106:0/1127364571 reap_dead start 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 shutdown_connections 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 >> 10.20.193.106:0/1127364571 conn(0x7f9984054ef0 msgr2=0x7f998413c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 shutdown_connections 2026-02-17T05:28:12.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.702+0000 7f9988ccc640 1 -- 10.20.193.106:0/1127364571 wait complete. 2026-02-17T05:28:12.708 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:28:12.708 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:28:12.708 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:28:12.716 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:28:12.717 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:28:12.717 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.819+0000 7fa1607e5640 10 monclient: get_monmap_and_config 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.819+0000 7fa1607e5640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.819+0000 7fa1607e5640 10 monclient: monmap: 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:12.820352+0000 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:12.820352+0000 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.821 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.822 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.822 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:12.822 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:12.822 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 1 Processor -- start 2026-02-17T05:28:12.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 1 -- start start 2026-02-17T05:28:12.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient: init 2026-02-17T05:28:12.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-c con 0x7fa15805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-b con 0x7fa15805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-a con 0x7fa158182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15808b060 con 0x7fa158182720 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15805dc90 con 0x7fa15805d1b0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15808d6a0 con 0x7fa15805dee0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa1607e5640 10 monclient(hunting): authenticate will time out at 621.448736s 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa15ed5b640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fa158182720 legacy=0x7fa1581a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa15dd59640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa15805dee0 0x7fa158181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36658/0 (socket says 10.20.193.106:36658) 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.820+0000 7fa15dd59640 1 -- 10.20.193.106:0/1373126713 learned_addr learned my addr 10.20.193.106:0/1373126713 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598693643 0 0) 0x7fa15808d6a0 con 0x7fa15805dee0 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient(hunting): my global_id is 4457 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1400035e0 con 0x7fa15805dee0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 160758660 0 0) 0x7fa1400035e0 con 0x7fa15805dee0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 >> v1:10.20.193.118:6789/0 conn(0x7fa15805d1b0 legacy=0x7fa15805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 >> v1:10.20.193.106:6789/0 conn(0x7fa158182720 legacy=0x7fa1581a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 monclient: found mon.noname-b 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa158057960 con 0x7fa15805dee0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa14c002dd0 con 0x7fa15805dee0 2026-02-17T05:28:12.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 5 monclient: authenticate success, global_id 4457 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: dump: 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:12.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa14c003010 con 0x7fa15805dee0 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 1 -- 10.20.193.106:0/1373126713 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa14c003420 con 0x7fa15805dee0 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa15d558640 10 monclient: dump: 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:12.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 4 set_mon_vals no callback set 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 10 monclient: shutdown 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 1 -- 10.20.193.106:0/1373126713 >> v1:10.20.193.106:6790/0 conn(0x7fa15805dee0 legacy=0x7fa158181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 1 -- 10.20.193.106:0/1373126713 shutdown_connections 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 1 -- 10.20.193.106:0/1373126713 >> 10.20.193.106:0/1373126713 conn(0x7fa1580915f0 msgr2=0x7fa1580919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 1 -- 10.20.193.106:0/1373126713 shutdown_connections 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.821+0000 7fa1607e5640 1 -- 10.20.193.106:0/1373126713 wait complete. 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient: build_initial_monmap 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient: monmap: 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:12.833 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 1 Processor -- start 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 1 -- start start 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient: init 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-a con 0x7fa15805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-b con 0x7fa15805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient(hunting): picked mon.noname-c con 0x7fa158182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15810db60 con 0x7fa15805d1b0 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15810efb0 con 0x7fa15805dee0 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15812aee0 con 0x7fa158182720 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa1607e5640 10 monclient(hunting): authenticate will time out at 621.450734s 2026-02-17T05:28:12.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa15e55a640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fa15805d1b0 legacy=0x7fa15812a0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa15ed5b640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa158182720 0x7fa158181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36664/0 (socket says 10.20.193.106:36664) 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa15ed5b640 1 -- 10.20.193.106:0/218473535 learned_addr learned my addr 10.20.193.106:0/218473535 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580114803 0 0) 0x7fa15812aee0 con 0x7fa158182720 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 10 monclient(hunting): my global_id is 4460 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.822+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1280035e0 con 0x7fa158182720 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475574330 0 0) 0x7fa15810efb0 con 0x7fa15805dee0 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): my global_id is 4459 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa15812aee0 con 0x7fa15805dee0 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 251204152 0 0) 0x7fa1280035e0 con 0x7fa158182720 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa15810efb0 con 0x7fa158182720 2026-02-17T05:28:12.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa1540051c0 con 0x7fa158182720 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): dump: 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1548408157 0 0) 0x7fa15810efb0 con 0x7fa158182720 2026-02-17T05:28:12.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 >> v1:10.20.193.118:6789/0 conn(0x7fa15805dee0 legacy=0x7fa15812a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 >> v1:10.20.193.106:6789/0 conn(0x7fa15805d1b0 legacy=0x7fa15812a0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 monclient: found mon.c 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15805ce00 con 0x7fa158182720 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: _finish_auth 0 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 5 monclient: authenticate success, global_id 4460 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _renew_subs 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa15805e8e0 con 0x7fa158182720 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _renew_subs 2026-02-17T05:28:12.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1581824f0 con 0x7fa158182720 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa154005400 con 0x7fa158182720 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa1540057e0 con 0x7fa158182720 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 10 monclient: dump: 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:12.838 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa15cd57640 4 set_mon_vals no callback set 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1580008d0 con 0x7fa158182720 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.823+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa154005940 con 0x7fa158182720 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.824+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7fa154050b50 con 0x7fa158182720 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.824+0000 7fa15e55a640 10 monclient: get_auth_request con 0x7fa128040820 auth_method 0 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.826+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fa1540183b0 con 0x7fa158182720 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.826+0000 7fa13effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:12.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.826+0000 7fa13effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:12.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa1607e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa1607e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa1607e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa15808e3d0 con 0x7fa158182720 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa13effd640 1 -- 10.20.193.106:0/218473535 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2886095721) 0x7fa154016340 con 0x7fa158182720 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa13effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.972+0000 7fa13effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:12.974 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:28:12.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 >> v1:10.20.193.118:6812/703720803 conn(0x7fa128040820 legacy=0x7fa128060cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 10 monclient: shutdown 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 >> v1:10.20.193.106:6790/0 conn(0x7fa158182720 legacy=0x7fa158181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 shutdown_connections 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 >> 10.20.193.106:0/218473535 conn(0x7fa1580915f0 msgr2=0x7fa15813f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 shutdown_connections 2026-02-17T05:28:12.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:12.973+0000 7fa1607e5640 1 -- 10.20.193.106:0/218473535 wait complete. 2026-02-17T05:28:15.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:15.117+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:15.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:15.117+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:15.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:15.117+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:15.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:15.117+0000 7f1581ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:15.983 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:28:16.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 10 monclient: get_monmap_and_config 2026-02-17T05:28:16.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 10 monclient: build_initial_monmap 2026-02-17T05:28:16.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 10 monclient: monmap: 2026-02-17T05:28:16.052 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:16.052 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:16.051881+0000 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:16.051881+0000 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:16.053 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 1 Processor -- start 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 1 -- start start 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.050+0000 7f3025da5640 10 monclient: init 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-a con 0x7f302005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-b con 0x7f302005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-c con 0x7f3020182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:16.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302008b060 con 0x7f302005d1b0 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302005dc90 con 0x7f3020182720 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302008d6a0 con 0x7f302005dee0 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient(hunting): authenticate will time out at 624.680350s 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301f7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f302005d1b0 legacy=0x7f302005d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301effd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f302005dee0 0x7f3020181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:45598/0 (socket says 10.20.193.106:45598) 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301effd640 1 -- 10.20.193.106:0/1262337932 learned_addr learned my addr 10.20.193.106:0/1262337932 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985492741 0 0) 0x7f302008d6a0 con 0x7f302005dee0 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient(hunting): my global_id is 4463 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30040035e0 con 0x7f302005dee0 2026-02-17T05:28:16.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2029165563 0 0) 0x7f30040035e0 con 0x7f302005dee0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 >> v1:10.20.193.118:6789/0 conn(0x7f3020182720 legacy=0x7f30201a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 >> v1:10.20.193.106:6789/0 conn(0x7f302005d1b0 legacy=0x7f302005d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 monclient: found mon.noname-b 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3020057960 con 0x7f302005dee0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3010002dd0 con 0x7f302005dee0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: dump: 2026-02-17T05:28:16.059 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 5 monclient: authenticate success, global_id 4463 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3010003090 con 0x7f302005dee0 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:16.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 1 -- 10.20.193.106:0/1262337932 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f30100034a0 con 0x7f302005dee0 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f3025da5640 4 set_mon_vals no callback set 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.051+0000 7f301e7fc640 10 monclient: dump: 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:16.061 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: shutdown 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- 10.20.193.106:0/1262337932 >> v1:10.20.193.106:6790/0 conn(0x7f302005dee0 legacy=0x7f3020181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- 10.20.193.106:0/1262337932 shutdown_connections 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- 10.20.193.106:0/1262337932 >> 10.20.193.106:0/1262337932 conn(0x7f30200915f0 msgr2=0x7f30200919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- 10.20.193.106:0/1262337932 shutdown_connections 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- 10.20.193.106:0/1262337932 wait complete. 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: build_initial_monmap 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: monmap: 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:16.062 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 Processor -- start 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- start start 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: init 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:16.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-a con 0x7f302005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-c con 0x7f302005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient(hunting): picked mon.noname-b con 0x7f3020182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302010c640 con 0x7f302005d1b0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302012e430 con 0x7f3020182720 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302005e8e0 con 0x7f302005dee0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f3025da5640 10 monclient(hunting): authenticate will time out at 624.681978s 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.052+0000 7f301f7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f302005d1b0 legacy=0x7f302012d610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f301effd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f302005dee0 0x7f302012dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:45612/0 (socket says 10.20.193.106:45612) 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f301effd640 1 -- 10.20.193.106:0/2206376342 learned_addr learned my addr 10.20.193.106:0/2206376342 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030429407 0 0) 0x7f302005e8e0 con 0x7f302005dee0 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:16.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): my global_id is 4466 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff00035e0 con 0x7f302005dee0 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1996253019 0 0) 0x7f2ff00035e0 con 0x7f302005dee0 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f302005e8e0 con 0x7f302005dee0 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f30100033b0 con 0x7f302005dee0 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): dump: 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:16.065 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 134620773 0 0) 0x7f302005e8e0 con 0x7f302005dee0 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 >> v1:10.20.193.118:6789/0 conn(0x7f3020182720 legacy=0x7f3020181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 >> v1:10.20.193.106:6789/0 conn(0x7f302005d1b0 legacy=0x7f302012d610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 monclient: found mon.c 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302010e0a0 con 0x7f302005dee0 2026-02-17T05:28:16.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 5 monclient: authenticate success, global_id 4466 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _renew_subs 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f302010cbb0 con 0x7f302005dee0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _renew_subs 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f302010ef10 con 0x7f302005dee0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3010002870 con 0x7f302005dee0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3010004ea0 con 0x7f302005dee0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:16.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 10 monclient: dump: 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f301dffb640 4 set_mon_vals no callback set 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:16.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302010eb90 con 0x7f302005dee0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.053+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3010011e40 con 0x7f302005dee0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.054+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f301004fd40 con 0x7f302005dee0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.054+0000 7f301f7fe640 10 monclient: get_auth_request con 0x7f2ff00405a0 auth_method 0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.056+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f301008b5e0 con 0x7f302005dee0 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.056+0000 7f2ffbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:16.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.056+0000 7f2ffbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:16.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.117+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:16.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.117+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:16.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.117+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f3025da5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f3025da5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f3025da5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3020055570 con 0x7f302005dee0 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f2ffbfff640 1 -- 10.20.193.106:0/2206376342 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1746561383) 0x7f3010017600 con 0x7f302005dee0 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f2ffbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.202+0000 7f2ffbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:16.204 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 >> v1:10.20.193.118:6812/703720803 conn(0x7f2ff00405a0 legacy=0x7f2ff0060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 10 monclient: shutdown 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 >> v1:10.20.193.106:6790/0 conn(0x7f302005dee0 legacy=0x7f302012dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 shutdown_connections 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 >> 10.20.193.106:0/2206376342 conn(0x7f30200915f0 msgr2=0x7f3020088a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 shutdown_connections 2026-02-17T05:28:16.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:16.203+0000 7f3025da5640 1 -- 10.20.193.106:0/2206376342 wait complete. 2026-02-17T05:28:17.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:17.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:17.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:17.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:17.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:17.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:18.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:18.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:18.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:18.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:18.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:18.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:19.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:19.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:19.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:19.213 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 10 monclient: monmap: 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:19.281729+0000 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:19.281729+0000 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:19.282 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:19.283 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:19.283 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:19.283 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:19.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 1 Processor -- start 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 1 -- start start 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.280+0000 7f3ec12cc640 10 monclient: init 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-c con 0x7f3ebc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc08b060 con 0x7f3ebc182720 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc05dc90 con 0x7f3ebc05dee0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc08d6a0 con 0x7f3ebc05d1b0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ec12cc640 10 monclient(hunting): authenticate will time out at 627.910139s 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ebb7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ebaffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 0x7f3ebc05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:45620/0 (socket says 10.20.193.106:45620) 2026-02-17T05:28:19.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.281+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 learned_addr learned my addr 10.20.193.106:0/3050623920 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:19.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.483+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:19.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:19.884+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:20.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:20.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:20.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:20.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:20.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:20.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:20.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:20.686+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:21.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:21.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:21.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:21.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:21.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:21.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:22.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:22.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:22.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:22.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.120+0000 7f15837fe640 10 monclient: _renew_subs 2026-02-17T05:28:22.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.120+0000 7f15837fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:22.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.120+0000 7f15837fe640 1 -- 10.20.193.106:0/2687061289 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=20}) -- 0x7f1574003560 con 0x7f159813f6c0 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): tick 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ebc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:22.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.118:6789/0 conn(0x7f3ebc05dee0 legacy=0x7f3ebc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f3ebc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc057960 con 0x7f3ebc182720 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc08b060 con 0x7f3ebc05dee0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea0069f80 con 0x7f3ebc05d1b0 2026-02-17T05:28:22.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.281+0000 7f3eb8ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:22.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.482+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:22.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:22.883+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:23.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:23.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:23.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:23.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:23.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:23.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:23.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:23.684+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:24.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:24.118+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:24.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:24.118+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:24.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:24.118+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:25.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:25.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:25.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:25.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.119+0000 7f1581ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): tick 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ea0066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.118:6789/0 conn(0x7f3ebc05dee0 legacy=0x7f3ea0044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f3ebc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea006b1e0 con 0x7f3ebc182720 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc057960 con 0x7f3ebc05dee0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea0069070 con 0x7f3ebc05d1b0 2026-02-17T05:28:25.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.282+0000 7f3eb8ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:25.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.483+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:25.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:25.884+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:26.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:26.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:26.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:26.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:26.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:26.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:26.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:26.685+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:27.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:27.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:27.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:27.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:27.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:27.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:28.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:28.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:28.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:28.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): tick 2026-02-17T05:28:28.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:28:28.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ea0066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.118:6789/0 conn(0x7f3ebc05dee0 legacy=0x7f3ea0044ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f3ea00694f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea00692c0 con 0x7f3ebc182720 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea006b1e0 con 0x7f3ea00694f0 2026-02-17T05:28:28.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea0069af0 con 0x7f3ebc05d1b0 2026-02-17T05:28:28.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3eb8ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:28.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.282+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:28.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.483+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:28.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:28.885+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:29.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:29.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:29.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:29.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:29.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:29.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:29.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:29.686+0000 7f3ebb7fe640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:30.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:30.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:30.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:30.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:30.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:30.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:31.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.119+0000 7f1581ffb640 10 monclient: tick 2026-02-17T05:28:31.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.119+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:31.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.119+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): tick 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ea0066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.118:6789/0 conn(0x7f3ea00694f0 legacy=0x7f3ea0066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f3ea00694f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea00692c0 con 0x7f3ebc182720 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea0068ce0 con 0x7f3ea00694f0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea0067ea0 con 0x7f3ebc05d1b0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:31.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.282+0000 7f3eb8ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:31.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.484+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:31.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:31.885+0000 7f3ebaffd640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801495531 0 0) 0x7f3ea0067ea0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient(hunting): my global_id is 4469 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ea80035e0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132084971 0 0) 0x7f3ea80035e0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.118:6789/0 conn(0x7f3ea00694f0 legacy=0x7f3ea00685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ea0023750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 monclient: found mon.noname-b 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea00680d0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3ea4002d30 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: dump: 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.026 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 5 monclient: authenticate success, global_id 4469 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:32.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ea4002f00 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 1 -- 10.20.193.106:0/3050623920 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3ea40032a0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 4 set_mon_vals no callback set 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3eb9ffb640 10 monclient: dump: 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.028 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 10 monclient: shutdown 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.016+0000 7f3ec12cc640 1 -- 10.20.193.106:0/3050623920 >> v1:10.20.193.106:6790/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ea0066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 -- 10.20.193.106:0/3050623920 shutdown_connections 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 -- 10.20.193.106:0/3050623920 >> 10.20.193.106:0/3050623920 conn(0x7f3ebc0915f0 msgr2=0x7f3ebc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 -- 10.20.193.106:0/3050623920 shutdown_connections 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 -- 10.20.193.106:0/3050623920 wait complete. 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 10 monclient: monmap: 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:32.030 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 Processor -- start 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 1 -- start start 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.017+0000 7f3ec12cc640 10 monclient: init 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:28:32.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-c con 0x7f3ea00694f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3ebc05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient(hunting): picked mon.noname-b con 0x7f3ebc182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc12eee0 con 0x7f3ebc05d1b0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc05e8e0 con 0x7f3ebc182720 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc130400 con 0x7f3ea00694f0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3eba7fc640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ebc088d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient(hunting): authenticate will time out at 640.646307s 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ebaffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3ea00694f0 0x7f3ebc0885f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35928/0 (socket says 10.20.193.106:35928) 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ebaffd640 1 -- 10.20.193.106:0/1504654402 learned_addr learned my addr 10.20.193.106:0/1504654402 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492312398 0 0) 0x7f3ebc130400 con 0x7f3ea00694f0 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): my global_id is 4472 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e880035e0 con 0x7f3ea00694f0 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1499519623 0 0) 0x7f3e880035e0 con 0x7f3ea00694f0 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ebc130400 con 0x7f3ea00694f0 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3eb0003030 con 0x7f3ea00694f0 2026-02-17T05:28:32.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): dump: 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.034 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2530394569 0 0) 0x7f3ebc130400 con 0x7f3ea00694f0 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 >> v1:10.20.193.118:6789/0 conn(0x7f3ebc182720 legacy=0x7f3ebc1743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 >> v1:10.20.193.106:6789/0 conn(0x7f3ebc05d1b0 legacy=0x7f3ebc088d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 monclient: found mon.c 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc089410 con 0x7f3ea00694f0 2026-02-17T05:28:32.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3e9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 5 monclient: authenticate success, global_id 4472 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _renew_subs 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ebc1306e0 con 0x7f3ea00694f0 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _renew_subs 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.018+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ebc130120 con 0x7f3ea00694f0 2026-02-17T05:28:32.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eb0003440 con 0x7f3ea00694f0 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3eb0004d40 con 0x7f3ea00694f0 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3eb97fa640 4 set_mon_vals no callback set 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 10 monclient: dump: 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.037 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3eb0004ea0 con 0x7f3ea00694f0 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.019+0000 7f3ec12cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.020+0000 7f3ec12cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.020+0000 7f3ec12cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.020+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ebc0008d0 con 0x7f3ea00694f0 2026-02-17T05:28:32.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.020+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 3655416137 0 0) 0x7f3eb004fce0 con 0x7f3ea00694f0 2026-02-17T05:28:32.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.020+0000 7f3eba7fc640 10 monclient: get_auth_request con 0x7f3e880406f0 auth_method 0 2026-02-17T05:28:32.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.022+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f3eb0005180 con 0x7f3ea00694f0 2026-02-17T05:28:32.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.022+0000 7f3e9b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.022+0000 7f3e9b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:32.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.075+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 10 ==== osd_map(20..20 src has 1..20) ==== 643+0+0 (unknown 3307894883 0 0) 0x7f158c017cf0 con 0x7f159813f6c0 2026-02-17T05:28:32.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.075+0000 7f1582ffd640 1 -- 10.20.193.106:0/2687061289 <== mon.2 v1:10.20.193.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]=0 pool 'unique_pool_0' created v20) ==== 130+0+0 (unknown 3098031066 0 0) 0x7f158c016b50 con 0x7f159813f6c0 2026-02-17T05:28:32.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.075+0000 7f1582ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-17T05:28:32.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.075+0000 7f1582ffd640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' created 2026-02-17T05:28:32.077 INFO:teuthology.orchestra.run.trial106.stderr:pool 'unique_pool_0' created 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 >> v1:10.20.193.118:6812/703720803 conn(0x7f1568040890 legacy=0x7f1568060d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 10 monclient: shutdown 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 >> v1:10.20.193.106:6790/0 conn(0x7f159813f6c0 legacy=0x7f1598194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 shutdown_connections 2026-02-17T05:28:32.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 >> 10.20.193.106:0/2687061289 conn(0x7f159805e410 msgr2=0x7f159813ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 shutdown_connections 2026-02-17T05:28:32.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.078+0000 7f15a090c640 1 -- 10.20.193.106:0/2687061289 wait complete. 2026-02-17T05:28:32.090 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T05:28:32.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.157+0000 7ff9e68cc640 10 monclient: get_monmap_and_config 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.157+0000 7ff9e68cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.157+0000 7ff9e68cc640 10 monclient: monmap: 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:32.158291+0000 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:32.158291+0000 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.167 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 1 Processor -- start 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 1 -- start start 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient: init 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff9e008e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff9e008c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff9e008cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e008e4a0 con 0x7ff9e008cd80 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e008bf90 con 0x7ff9e008c940 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e008d8d0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e68cc640 10 monclient(hunting): authenticate will time out at 640.786671s 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9e4e42640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7ff9e008cd80 legacy=0x7ff9e01a2600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9dffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff9e008e0d0 0x7ff9e008c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35938/0 (socket says 10.20.193.106:35938) 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.158+0000 7ff9dffff640 1 -- 10.20.193.106:0/31611092 learned_addr learned my addr 10.20.193.106:0/31611092 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188647569 0 0) 0x7ff9e008d8d0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient(hunting): my global_id is 4475 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c40035e0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 266658880 0 0) 0x7ff9c40035e0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 >> v1:10.20.193.118:6789/0 conn(0x7ff9e008c940 legacy=0x7ff9e0180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 >> v1:10.20.193.106:6789/0 conn(0x7ff9e008cd80 legacy=0x7ff9e01a2600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 monclient: found mon.noname-b 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e008af70 con 0x7ff9e008e0d0 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff9cc002dd0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 5 monclient: authenticate success, global_id 4475 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: dump: 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.171 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9cc003090 con 0x7ff9e008e0d0 2026-02-17T05:28:32.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 1 -- 10.20.193.106:0/31611092 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff9cc0034a0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9deffd640 10 monclient: dump: 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.173 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 4 set_mon_vals no callback set 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 10 monclient: shutdown 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 1 -- 10.20.193.106:0/31611092 >> v1:10.20.193.106:6790/0 conn(0x7ff9e008e0d0 legacy=0x7ff9e008c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 1 -- 10.20.193.106:0/31611092 shutdown_connections 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 1 -- 10.20.193.106:0/31611092 >> 10.20.193.106:0/31611092 conn(0x7ff9e00915f0 msgr2=0x7ff9e00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 1 -- 10.20.193.106:0/31611092 shutdown_connections 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 1 -- 10.20.193.106:0/31611092 wait complete. 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.159+0000 7ff9e68cc640 10 monclient: monmap: 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.175 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 1 Processor -- start 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 1 -- start start 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient: init 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:28:32.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff9e008c940 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff9e008cd80 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff9e008e0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e01302c0 con 0x7ff9e008c940 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e013d850 con 0x7ff9e008e0d0 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e005e8e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dffff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7ff9e008c940 legacy=0x7ff9e013d140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9e68cc640 10 monclient(hunting): authenticate will time out at 640.788415s 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9df7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff9e008cd80 0x7ff9e01933c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35944/0 (socket says 10.20.193.106:35944) 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9df7fe640 1 -- 10.20.193.106:0/1668857495 learned_addr learned my addr 10.20.193.106:0/1668857495 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38687217 0 0) 0x7ff9e005e8e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): my global_id is 4478 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b00035e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4179140739 0 0) 0x7ff9b00035e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9e005e8e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff9d0003090 con 0x7ff9e008cd80 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): dump: 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.178 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367955181 0 0) 0x7ff9e013d850 con 0x7ff9e008e0d0 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 10 monclient(hunting): my global_id is 4471 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.160+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b00035e0 con 0x7ff9e008e0d0 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 336459049 0 0) 0x7ff9e005e8e0 con 0x7ff9e008cd80 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6789/0 conn(0x7ff9e008e0d0 legacy=0x7ff9e0194ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.106:6789/0 conn(0x7ff9e008c940 legacy=0x7ff9e013d140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 monclient: found mon.c 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e012e800 con 0x7ff9e008cd80 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 5 monclient: authenticate success, global_id 4478 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _renew_subs 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e0130b60 con 0x7ff9e008cd80 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _renew_subs 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9e012f360 con 0x7ff9e008cd80 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9d00036d0 con 0x7ff9e008cd80 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff9d0003a70 con 0x7ff9e008cd80 2026-02-17T05:28:32.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9de7fc640 4 set_mon_vals no callback set 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 10 monclient: dump: 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.182 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e00008d0 con 0x7ff9e008cd80 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.161+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff9d0003bd0 con 0x7ff9e008cd80 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 419629383 0 0) 0x7ff9d004fd80 con 0x7ff9e008cd80 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dffff640 10 monclient: get_auth_request con 0x7ff9b0040870 auth_method 0 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dffff640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6812/703720803 conn(0x7ff9b0040870 legacy=0x7ff9b0060d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dffff640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6812/703720803 conn(0x7ff9b0040870 legacy=0x7ff9b0060d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dffff640 1 --1- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6812/703720803 conn(0x7ff9b0040870 0x7ff9b0060d20 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-17T05:28:32.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dffff640 1 --1- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6812/703720803 conn(0x7ff9b0040870 0x7ff9b0060d20 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).fault on lossy channel, failing 2026-02-17T05:28:32.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.162+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.118:6812/703720803 conn(0x7ff9b0040870 legacy=0x7ff9b0060d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:32.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.164+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7ff9d0004290 con 0x7ff9e008cd80 2026-02-17T05:28:32.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.164+0000 7ff9dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.164+0000 7ff9dcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:32.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3ec12cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:28:32.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3ec12cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:32.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3ec12cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3ebc13d650 con 0x7f3ea00694f0 2026-02-17T05:28:32.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3e9b7fe640 1 -- 10.20.193.106:0/1504654402 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 3150416028) 0x7f3eb0016d50 con 0x7f3ea00694f0 2026-02-17T05:28:32.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3e9b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:28:32.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.168+0000 7f3e9b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:32.186 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":8,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 >> v1:10.20.193.118:6812/703720803 conn(0x7f3e880406f0 legacy=0x7f3e88060ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 10 monclient: shutdown 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 >> v1:10.20.193.106:6790/0 conn(0x7f3ea00694f0 legacy=0x7f3ebc0885f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 shutdown_connections 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 >> 10.20.193.106:0/1504654402 conn(0x7f3ebc0915f0 msgr2=0x7f3ebc058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 shutdown_connections 2026-02-17T05:28:32.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.171+0000 7f3ec12cc640 1 -- 10.20.193.106:0/1504654402 wait complete. 2026-02-17T05:28:32.189 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:28:32.189 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:28:32.189 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:28:32.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: get_monmap_and_config 2026-02-17T05:28:32.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: monmap: 2026-02-17T05:28:32.256 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.256 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:32.255413+0000 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:32.255413+0000 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:32.257 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 1 Processor -- start 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 1 -- start start 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: init 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-c con 0x7fd2800849e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-b con 0x7fd28013feb0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-a con 0x7fd2801402d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28008d100 con 0x7fd2801402d0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28008b1f0 con 0x7fd2800849e0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28008d3e0 con 0x7fd28013feb0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd2849d2640 10 monclient(hunting): authenticate will time out at 640.883939s 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.255+0000 7fd27ffff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fd2801402d0 legacy=0x7fd2801a23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27effd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd28013feb0 0x7fd280180cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35960/0 (socket says 10.20.193.106:35960) 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27effd640 1 -- 10.20.193.106:0/2133332589 learned_addr learned my addr 10.20.193.106:0/2133332589 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206169747 0 0) 0x7fd28008d3e0 con 0x7fd28013feb0 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient(hunting): my global_id is 4481 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2640035e0 con 0x7fd28013feb0 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216822183 0 0) 0x7fd2640035e0 con 0x7fd28013feb0 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 >> v1:10.20.193.118:6789/0 conn(0x7fd2800849e0 legacy=0x7fd280084db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 >> v1:10.20.193.106:6789/0 conn(0x7fd2801402d0 legacy=0x7fd2801a23f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 monclient: found mon.noname-b 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28008d6c0 con 0x7fd28013feb0 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd270002dd0 con 0x7fd28013feb0 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:32.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: dump: 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.272 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 5 monclient: authenticate success, global_id 4481 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd270002fa0 con 0x7fd28013feb0 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 1 -- 10.20.193.106:0/2133332589 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2700033b0 con 0x7fd28013feb0 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd27e7fc640 10 monclient: dump: 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.273 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 4 set_mon_vals no callback set 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 10 monclient: shutdown 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 1 -- 10.20.193.106:0/2133332589 >> v1:10.20.193.106:6790/0 conn(0x7fd28013feb0 legacy=0x7fd280180cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 1 -- 10.20.193.106:0/2133332589 shutdown_connections 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 1 -- 10.20.193.106:0/2133332589 >> 10.20.193.106:0/2133332589 conn(0x7fd280091b30 msgr2=0x7fd280091f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 1 -- 10.20.193.106:0/2133332589 shutdown_connections 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.256+0000 7fd2849d2640 1 -- 10.20.193.106:0/2133332589 wait complete. 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient: monmap: 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:32.275 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 1 Processor -- start 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 1 -- start start 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient: init 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:28:32.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-b con 0x7fd2800849e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-a con 0x7fd28013feb0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient(hunting): picked mon.noname-c con 0x7fd2801402d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28008a9c0 con 0x7fd28013feb0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800890c0 con 0x7fd2800849e0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28007db40 con 0x7fd2801402d0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd2849d2640 10 monclient(hunting): authenticate will time out at 640.885929s 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.257+0000 7fd27effd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fd28013feb0 legacy=0x7fd2801a0850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd27ffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd2801402d0 0x7fd2801a1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35978/0 (socket says 10.20.193.106:35978) 2026-02-17T05:28:32.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd27ffff640 1 -- 10.20.193.106:0/4185125345 learned_addr learned my addr 10.20.193.106:0/4185125345 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441506628 0 0) 0x7fd28007db40 con 0x7fd2801402d0 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): my global_id is 4484 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2500035e0 con 0x7fd2801402d0 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937119335 0 0) 0x7fd2800890c0 con 0x7fd2800849e0 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): my global_id is 4477 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd28007db40 con 0x7fd2800849e0 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1333566037 0 0) 0x7fd2500035e0 con 0x7fd2801402d0 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2800890c0 con 0x7fd2801402d0 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2740051c0 con 0x7fd2801402d0 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.279 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4198878224 0 0) 0x7fd28007db40 con 0x7fd2800849e0 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2500035e0 con 0x7fd2800849e0 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd26c003070 con 0x7fd2800849e0 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:32.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient(hunting): dump: 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.281 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 384581961 0 0) 0x7fd2800890c0 con 0x7fd2801402d0 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.118:6789/0 conn(0x7fd2800849e0 legacy=0x7fd280130c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6789/0 conn(0x7fd28013feb0 legacy=0x7fd2801a0850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 monclient: found mon.c 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd280089500 con 0x7fd2801402d0 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 5 monclient: authenticate success, global_id 4484 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 10 monclient: _renew_subs 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd2800880e0 con 0x7fd2801402d0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 10 monclient: _renew_subs 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2801a3690 con 0x7fd2801402d0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd274005400 con 0x7fd2801402d0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2740057e0 con 0x7fd2801402d0 2026-02-17T05:28:32.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd25bfff640 10 monclient: dump: 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.284 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.258+0000 7fd27dffb640 4 set_mon_vals no callback set 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd2849d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd28005e150 con 0x7fd28005dd80 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd274005940 con 0x7fd2801402d0 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 419629383 0 0) 0x7fd274050d00 con 0x7fd2801402d0 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158963813 0 0) 0x7fd28005e150 con 0x7fd28005dd80 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient(hunting): my global_id is 4487 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2800890c0 con 0x7fd28005dd80 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd27effd640 10 monclient: get_auth_request con 0x7fd250040b10 auth_method 0 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3642727363 0 0) 0x7fd2800890c0 con 0x7fd28005dd80 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd28005e150 con 0x7fd28005dd80 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd26c0036d0 con 0x7fd28005dd80 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient: dump: 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.286 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3933843893 0 0) 0x7fd28005e150 con 0x7fd28005dd80 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd28008a350 con 0x7fd28005dd80 2026-02-17T05:28:32.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd26c005910 con 0x7fd28005dd80 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.259+0000 7fd25bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.260+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6790/0 conn(0x7fd28005dd80 legacy=0x7fd280058640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.260+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6790/0 conn(0x7fd28005dd80 legacy=0x7fd280058640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd2849d2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd2801a3de0 con 0x7fd2801a39e0 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367817427 0 0) 0x7fd2801a3de0 con 0x7fd2801a39e0 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient(hunting): my global_id is 4490 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd28005e150 con 0x7fd2801a39e0 2026-02-17T05:28:32.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3590204378 0 0) 0x7fd28005e150 con 0x7fd2801a39e0 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2801a3de0 con 0x7fd2801a39e0 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd26c003ed0 con 0x7fd2801a39e0 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 10 monclient: dump: 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.289 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 75016617 0 0) 0x7fd2801a3de0 con 0x7fd2801a39e0 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.263+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd28008ad50 con 0x7fd2801a39e0 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4501 (unknown 0 0 786423639) 0x7fd26c0054b0 con 0x7fd2801a39e0 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd25bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd25bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6790/0 conn(0x7fd2801a39e0 legacy=0x7fd280058d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd25bfff640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6790/0 conn(0x7fd2801a39e0 legacy=0x7fd280058d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 8, 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 37024, 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:28:32.291 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.292 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.293 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.294 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:28:32.295 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.296 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.297 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.298 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.299 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:28:32.300 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.301 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:28:32.302 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.302 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.302 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.302 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:28:32.302 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.118:6812/703720803 conn(0x7fd250040b10 legacy=0x7fd250060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 10 monclient: shutdown 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 >> v1:10.20.193.106:6790/0 conn(0x7fd2801402d0 legacy=0x7fd2801a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd27ffff640 1 -- 10.20.193.106:0/4185125345 reap_dead start 2026-02-17T05:28:32.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd27ffff640 1 -- 10.20.193.106:0/4185125345 reap_dead start 2026-02-17T05:28:32.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 shutdown_connections 2026-02-17T05:28:32.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 >> 10.20.193.106:0/4185125345 conn(0x7fd280091b30 msgr2=0x7fd280084db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 shutdown_connections 2026-02-17T05:28:32.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.264+0000 7fd2849d2640 1 -- 10.20.193.106:0/4185125345 wait complete. 2026-02-17T05:28:32.304 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:28:32.304 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:28:32.304 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:28:32.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.269+0000 7ff9e68cc640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T05:28:32.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.269+0000 7ff9e68cc640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T05:28:32.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.269+0000 7ff9e68cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.269+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} v 0) -- 0x7ff9e008d640 con 0x7ff9e008cd80 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.369+0000 7f13ea30c640 10 monclient: get_monmap_and_config 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.369+0000 7f13ea30c640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.369+0000 7f13ea30c640 10 monclient: monmap: 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:28:32.370010+0000 2026-02-17T05:28:32.370 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:28:32.370010+0000 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:28:32.371 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 1 Processor -- start 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 1 -- start start 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient: init 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-a con 0x7f13e4141dc0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-c con 0x7f13e4142190 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-b con 0x7f13e4184340 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40575f0 con 0x7f13e4141dc0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40578d0 con 0x7f13e4142190 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e3fff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f13e4141dc0 legacy=0x7f13e408fe20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e4057bb0 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient(hunting): authenticate will time out at 640.998454s 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e8882640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f13e4184340 0x7f13e41a4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36014/0 (socket says 10.20.193.106:36014) 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e8882640 1 -- 10.20.193.106:0/4215599990 learned_addr learned my addr 10.20.193.106:0/4215599990 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945761089 0 0) 0x7f13e4057bb0 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient(hunting): my global_id is 4493 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c80035e0 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4092147417 0 0) 0x7f13c80035e0 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 >> v1:10.20.193.118:6789/0 conn(0x7f13e4142190 legacy=0x7f13e41425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 >> v1:10.20.193.106:6789/0 conn(0x7f13e4141dc0 legacy=0x7f13e408fe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 monclient: found mon.noname-b 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e4057e90 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d8003eb0 con 0x7f13e4184340 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: dump: 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 5 monclient: authenticate success, global_id 4493 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d80040f0 con 0x7f13e4184340 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 1 -- 10.20.193.106:0/4215599990 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d8004500 con 0x7f13e4184340 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 10 monclient: get_monmap_and_config success 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13ea30c640 4 set_mon_vals no callback set 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.370+0000 7f13e2ffd640 10 monclient: dump: 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.374 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 10 monclient: shutdown 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 -- 10.20.193.106:0/4215599990 >> v1:10.20.193.106:6790/0 conn(0x7f13e4184340 legacy=0x7f13e41a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 -- 10.20.193.106:0/4215599990 shutdown_connections 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 -- 10.20.193.106:0/4215599990 >> 10.20.193.106:0/4215599990 conn(0x7f13e405e3c0 msgr2=0x7f13e4095420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 -- 10.20.193.106:0/4215599990 shutdown_connections 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 -- 10.20.193.106:0/4215599990 wait complete. 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 10 monclient: build_initial_monmap 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 10 monclient: monmap: 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:28:32.375 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.371+0000 7f13ea30c640 1 Processor -- start 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- start start 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: init 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _reopen_session rank -1 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-a con 0x7f13e4141dc0 addr v1:10.20.193.106:6789/0 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-b con 0x7f13e4142190 addr v1:10.20.193.118:6789/0 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient(hunting): picked mon.noname-c con 0x7f13e4184340 addr v1:10.20.193.106:6790/0 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e408d680 con 0x7f13e4141dc0 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e41a1cb0 con 0x7f13e4142190 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e41a1060 con 0x7f13e4184340 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient(hunting): _renew_subs 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient(hunting): authenticate will time out at 641.000246s 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e3fff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f13e4141dc0 legacy=0x7f13e41a0240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:28:32.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e8882640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f13e4184340 0x7f13e418c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36020/0 (socket says 10.20.193.106:36020) 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e8882640 1 -- 10.20.193.106:0/2910375110 learned_addr learned my addr 10.20.193.106:0/2910375110 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197456473 0 0) 0x7f13e41a1060 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): my global_id is 4496 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b40035e0 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3821874204 0 0) 0x7f13b40035e0 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e41a1060 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d8004410 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): dump: 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2343524463 0 0) 0x7f13e41a1060 con 0x7f13e4184340 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6789/0 conn(0x7f13e4142190 legacy=0x7f13e41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.106:6789/0 conn(0x7f13e4141dc0 legacy=0x7f13e41a0240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 monclient: found mon.c 2026-02-17T05:28:32.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e408c610 con 0x7f13e4184340 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: _finish_auth 0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 5 monclient: authenticate success, global_id 4496 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _renew_subs 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41a4010 con 0x7f13e4184340 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _renew_subs 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13e41a58a0 con 0x7f13e4184340 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d8004640 con 0x7f13e4184340 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d8005f40 con 0x7f13e4184340 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e0ff9640 10 monclient: dump: 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.372+0000 7f13e27fc640 4 set_mon_vals no callback set 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13ea30c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13e41a3e80 con 0x7f13e41a5dc0 2026-02-17T05:28:32.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f13d8012ee0 con 0x7f13e4184340 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 419629383 0 0) 0x7f13d8050ef0 con 0x7f13e4184340 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344725489 0 0) 0x7f13e41a3e80 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient(hunting): my global_id is 4483 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e41a1060 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e37fe640 10 monclient: get_auth_request con 0x7f13b4040740 auth_method 0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 502012429 0 0) 0x7f13e41a1060 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e41a3e80 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d0003fc0 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.373+0000 7f13e0ff9640 10 monclient: dump: 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4153488476 0 0) 0x7f13e41a3e80 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13e41a3770 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f13d0006350 con 0x7f13e41a5dc0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:28:32.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6789/0 conn(0x7f13e41a5dc0 legacy=0x7f13e4088e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.374+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6789/0 conn(0x7f13e41a5dc0 legacy=0x7f13e4088e80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.377+0000 7f13ea30c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.377+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13e41a2c10 con 0x7f13e41a2810 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.377+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193778886 0 0) 0x7f13d00044c0 con 0x7f13e41a2810 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient(hunting): my global_id is 4486 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e41a3e80 con 0x7f13e41a2810 2026-02-17T05:28:32.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 351232920 0 0) 0x7f13e41a3e80 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d00044c0 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13d0004ab0 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient: dump: 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1462260574 0 0) 0x7f13d00044c0 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13e41a3ba0 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4670 (unknown 0 0 3098310019) 0x7f13d0006050 con 0x7f13e41a2810 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6789/0 conn(0x7f13e41a2810 legacy=0x7f13e4089590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e0ff9640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6789/0 conn(0x7f13e41a2810 legacy=0x7f13e4089590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:32.382 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 8, 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 37104, 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.383 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:28:32.384 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.385 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.386 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.387 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:28:32.388 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.118:6812/703720803 conn(0x7f13b4040740 legacy=0x7f13b4060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 10 monclient: shutdown 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 >> v1:10.20.193.106:6790/0 conn(0x7f13e4184340 legacy=0x7f13e418c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e8882640 1 -- 10.20.193.106:0/2910375110 reap_dead start 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13e8882640 1 -- 10.20.193.106:0/2910375110 reap_dead start 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 shutdown_connections 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 >> 10.20.193.106:0/2910375110 conn(0x7f13e405e3c0 msgr2=0x7f13e4090670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 shutdown_connections 2026-02-17T05:28:32.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:32.378+0000 7f13ea30c640 1 -- 10.20.193.106:0/2910375110 wait complete. 2026-02-17T05:28:32.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:28:32.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:28:33.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.078+0000 7ff9dcff9640 1 -- 10.20.193.106:0/1668857495 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]=0 enabled application 'rados' on pool 'unique_pool_0' v21) ==== 197+0+0 (unknown 555284988 0 0) 0x7ff9d0016be0 con 0x7ff9e008cd80 2026-02-17T05:28:33.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.078+0000 7ff9dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-17T05:28:33.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.078+0000 7ff9dcff9640 10 monclient: _finish_command 2 = system:0 enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T05:28:33.080 INFO:teuthology.orchestra.run.trial106.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T05:28:33.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 10 monclient: shutdown 2026-02-17T05:28:33.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:28:33.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 >> v1:10.20.193.106:6790/0 conn(0x7ff9e008cd80 legacy=0x7ff9e01933c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:28:33.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 shutdown_connections 2026-02-17T05:28:33.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 >> 10.20.193.106:0/1668857495 conn(0x7ff9e00915f0 msgr2=0x7ff9e013f410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:28:33.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 shutdown_connections 2026-02-17T05:28:33.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:28:33.082+0000 7ff9e68cc640 1 -- 10.20.193.106:0/1668857495 wait complete. 2026-02-17T05:28:34.092 DEBUG:teuthology.orchestra.run.trial118:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2026-02-17T05:28:34.133 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight read -> 100 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight write -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight delete -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight snap_create -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight snap_remove -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight rollback -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight copy_from -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:adding op weight write_excl -> 50 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - RelWithDebInfo) 2026-02-17T05:28:34.134 INFO:tasks.rados.rados.0.trial118.stdout:Configuration: 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Number of operations: 4000 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Number of objects: 50 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Max in flight operations: 16 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Object size (in bytes): 4000000 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Write stride min: 400000 2026-02-17T05:28:34.135 INFO:tasks.rados.rados.0.trial118.stdout: Write stride max: 800000 2026-02-17T05:28:35.087 INFO:tasks.rados.rados.0.trial118.stdout:1: write initial oid 1 2026-02-17T05:28:35.087 INFO:tasks.rados.rados.0.trial118.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-17T05:28:35.090 INFO:tasks.rados.rados.0.trial118.stdout:1: writing trial11845692-1 from 416807 to 892056 tid 1 2026-02-17T05:28:35.095 INFO:tasks.rados.rados.0.trial118.stdout:1: writing trial11845692-1 from 1542129 to 2016807 tid 2 2026-02-17T05:28:35.095 INFO:tasks.rados.rados.0.trial118.stdout:2: write initial oid 2 2026-02-17T05:28:35.095 INFO:tasks.rados.rados.0.trial118.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-17T05:28:35.098 INFO:tasks.rados.rados.0.trial118.stdout:2: writing trial11845692-2 from 416807 to 892056 tid 1 2026-02-17T05:28:35.103 INFO:tasks.rados.rados.0.trial118.stdout:2: writing trial11845692-2 from 1542129 to 2016807 tid 2 2026-02-17T05:28:35.103 INFO:tasks.rados.rados.0.trial118.stdout:3: write initial oid 3 2026-02-17T05:28:35.103 INFO:tasks.rados.rados.0.trial118.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-17T05:28:35.106 INFO:tasks.rados.rados.0.trial118.stdout:3: writing trial11845692-3 from 433614 to 984112 tid 1 2026-02-17T05:28:35.112 INFO:tasks.rados.rados.0.trial118.stdout:3: writing trial11845692-3 from 1600611 to 2033614 tid 2 2026-02-17T05:28:35.112 INFO:tasks.rados.rados.0.trial118.stdout:4: write initial oid 4 2026-02-17T05:28:35.112 INFO:tasks.rados.rados.0.trial118.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-17T05:28:35.116 INFO:tasks.rados.rados.0.trial118.stdout:4: writing trial11845692-4 from 450421 to 1076168 tid 1 2026-02-17T05:28:35.120 INFO:tasks.rados.rados.0.trial118.stdout:4: writing trial11845692-4 from 1659093 to 2050421 tid 2 2026-02-17T05:28:35.120 INFO:tasks.rados.rados.0.trial118.stdout:5: write initial oid 5 2026-02-17T05:28:35.120 INFO:tasks.rados.rados.0.trial118.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-17T05:28:35.124 INFO:tasks.rados.rados.0.trial118.stdout:5: writing trial11845692-5 from 467228 to 1168224 tid 1 2026-02-17T05:28:35.127 INFO:tasks.rados.rados.0.trial118.stdout:5: writing trial11845692-5 from 1717575 to 2067228 tid 2 2026-02-17T05:28:35.128 INFO:tasks.rados.rados.0.trial118.stdout:6: write initial oid 6 2026-02-17T05:28:35.128 INFO:tasks.rados.rados.0.trial118.stdout:1: finishing write tid 1 to trial11845692-1 2026-02-17T05:28:35.128 INFO:tasks.rados.rados.0.trial118.stdout:1: finishing write tid 2 to trial11845692-1 2026-02-17T05:28:35.128 INFO:tasks.rados.rados.0.trial118.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-17T05:28:35.132 INFO:tasks.rados.rados.0.trial118.stdout:6: writing trial11845692-6 from 484035 to 1260280 tid 1 2026-02-17T05:28:35.135 INFO:tasks.rados.rados.0.trial118.stdout:6: writing trial11845692-6 from 2059704 to 2084035 tid 2 2026-02-17T05:28:35.135 INFO:tasks.rados.rados.0.trial118.stdout:7: write initial oid 7 2026-02-17T05:28:35.135 INFO:tasks.rados.rados.0.trial118.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-17T05:28:35.138 INFO:tasks.rados.rados.0.trial118.stdout:7: writing trial11845692-7 from 500842 to 952336 tid 1 2026-02-17T05:28:35.143 INFO:tasks.rados.rados.0.trial118.stdout:7: writing trial11845692-7 from 1718186 to 2100842 tid 2 2026-02-17T05:28:35.143 INFO:tasks.rados.rados.0.trial118.stdout:8: write initial oid 8 2026-02-17T05:28:35.143 INFO:tasks.rados.rados.0.trial118.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-17T05:28:35.147 INFO:tasks.rados.rados.0.trial118.stdout:8: writing trial11845692-8 from 517649 to 1044392 tid 1 2026-02-17T05:28:35.151 INFO:tasks.rados.rados.0.trial118.stdout:8: writing trial11845692-8 from 1776668 to 2117649 tid 2 2026-02-17T05:28:35.151 INFO:tasks.rados.rados.0.trial118.stdout:9: write initial oid 9 2026-02-17T05:28:35.151 INFO:tasks.rados.rados.0.trial118.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-17T05:28:35.155 INFO:tasks.rados.rados.0.trial118.stdout:9: writing trial11845692-9 from 534456 to 1252801 tid 1 2026-02-17T05:28:35.159 INFO:tasks.rados.rados.0.trial118.stdout:9: writing trial11845692-9 from 1951503 to 2134456 tid 2 2026-02-17T05:28:35.159 INFO:tasks.rados.rados.0.trial118.stdout:10: write initial oid 10 2026-02-17T05:28:35.159 INFO:tasks.rados.rados.0.trial118.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-17T05:28:35.164 INFO:tasks.rados.rados.0.trial118.stdout:10: writing trial11845692-10 from 551263 to 1344857 tid 1 2026-02-17T05:28:35.167 INFO:tasks.rados.rados.0.trial118.stdout:10: writing trial11845692-10 from 1893632 to 2151263 tid 2 2026-02-17T05:28:35.167 INFO:tasks.rados.rados.0.trial118.stdout:11: write initial oid 11 2026-02-17T05:28:35.167 INFO:tasks.rados.rados.0.trial118.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-17T05:28:35.171 INFO:tasks.rados.rados.0.trial118.stdout:11: writing trial11845692-11 from 568070 to 1036913 tid 1 2026-02-17T05:28:35.175 INFO:tasks.rados.rados.0.trial118.stdout:11: writing trial11845692-11 from 1552114 to 2168070 tid 2 2026-02-17T05:28:35.176 INFO:tasks.rados.rados.0.trial118.stdout:12: write initial oid 12 2026-02-17T05:28:35.176 INFO:tasks.rados.rados.0.trial118.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-17T05:28:35.179 INFO:tasks.rados.rados.0.trial118.stdout:12: writing trial11845692-12 from 584877 to 1128969 tid 1 2026-02-17T05:28:35.183 INFO:tasks.rados.rados.0.trial118.stdout:12: writing trial11845692-12 from 1610596 to 2172599 tid 2 2026-02-17T05:28:35.183 INFO:tasks.rados.rados.0.trial118.stdout:13: write initial oid 13 2026-02-17T05:28:35.184 INFO:tasks.rados.rados.0.trial118.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-17T05:28:35.188 INFO:tasks.rados.rados.0.trial118.stdout:13: writing trial11845692-13 from 601684 to 1221025 tid 1 2026-02-17T05:28:35.192 INFO:tasks.rados.rados.0.trial118.stdout:13: writing trial11845692-13 from 1669078 to 2201684 tid 2 2026-02-17T05:28:35.192 INFO:tasks.rados.rados.0.trial118.stdout:14: write initial oid 14 2026-02-17T05:28:35.192 INFO:tasks.rados.rados.0.trial118.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-17T05:28:35.197 INFO:tasks.rados.rados.0.trial118.stdout:14: writing trial11845692-14 from 618491 to 1313081 tid 1 2026-02-17T05:28:35.200 INFO:tasks.rados.rados.0.trial118.stdout:14: writing trial11845692-14 from 2011207 to 2218491 tid 2 2026-02-17T05:28:35.200 INFO:tasks.rados.rados.0.trial118.stdout:15: write initial oid 15 2026-02-17T05:28:35.200 INFO:tasks.rados.rados.0.trial118.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-17T05:28:35.205 INFO:tasks.rados.rados.0.trial118.stdout:15: writing trial11845692-15 from 635298 to 1405137 tid 1 2026-02-17T05:28:35.208 INFO:tasks.rados.rados.0.trial118.stdout:15: writing trial11845692-15 from 2069689 to 2235298 tid 2 2026-02-17T05:28:35.208 INFO:tasks.rados.rados.0.trial118.stdout:16: write initial oid 16 2026-02-17T05:28:35.208 INFO:tasks.rados.rados.0.trial118.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-17T05:28:35.212 INFO:tasks.rados.rados.0.trial118.stdout:16: writing trial11845692-16 from 652105 to 1097193 tid 1 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:16: writing trial11845692-16 from 1728171 to 2181159 tid 2 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: finishing write tid 3 to trial11845692-1 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: finishing write tid 4 to trial11845692-1 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: oid 1 updating version 0 to 2 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: oid 1 updating version 2 to 3 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: oid 1 version 3 is already newer than 1 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:2: finishing write tid 1 to trial11845692-2 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:1: done (15 left) 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:17: write initial oid 17 2026-02-17T05:28:35.217 INFO:tasks.rados.rados.0.trial118.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-17T05:28:35.221 INFO:tasks.rados.rados.0.trial118.stdout:17: writing trial11845692-17 from 668912 to 1305602 tid 1 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:17: writing trial11845692-17 from 1903006 to 2268912 tid 2 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: finishing write tid 2 to trial11845692-2 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: finishing write tid 3 to trial11845692-2 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: finishing write tid 4 to trial11845692-2 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: oid 2 updating version 0 to 1 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: oid 2 updating version 1 to 3 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:2: oid 2 version 3 is already newer than 2 2026-02-17T05:28:35.225 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:3: finishing write tid 1 to trial11845692-3 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:3: finishing write tid 2 to trial11845692-3 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:3: finishing write tid 3 to trial11845692-3 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:2: done (15 left) 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:18: write initial oid 18 2026-02-17T05:28:35.226 INFO:tasks.rados.rados.0.trial118.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-17T05:28:35.230 INFO:tasks.rados.rados.0.trial118.stdout:18: writing trial11845692-18 from 685719 to 1397658 tid 1 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:18: writing trial11845692-18 from 1845135 to 2285719 tid 2 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:3: finishing write tid 4 to trial11845692-3 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:3: oid 3 updating version 0 to 1 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:3: oid 3 updating version 1 to 3 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:3: oid 3 version 3 is already newer than 2 2026-02-17T05:28:35.234 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-17T05:28:35.235 INFO:tasks.rados.rados.0.trial118.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-17T05:28:35.235 INFO:tasks.rados.rados.0.trial118.stdout:4: finishing write tid 1 to trial11845692-4 2026-02-17T05:28:35.235 INFO:tasks.rados.rados.0.trial118.stdout:3: done (15 left) 2026-02-17T05:28:35.235 INFO:tasks.rados.rados.0.trial118.stdout:19: write initial oid 19 2026-02-17T05:28:35.235 INFO:tasks.rados.rados.0.trial118.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-17T05:28:35.239 INFO:tasks.rados.rados.0.trial118.stdout:19: writing trial11845692-19 from 702526 to 1489714 tid 1 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:19: writing trial11845692-19 from 1903617 to 2302526 tid 2 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: finishing write tid 2 to trial11845692-4 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: finishing write tid 3 to trial11845692-4 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: finishing write tid 4 to trial11845692-4 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: oid 4 updating version 0 to 1 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: oid 4 updating version 1 to 2 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: oid 4 updating version 2 to 3 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:5: finishing write tid 1 to trial11845692-5 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:5: finishing write tid 2 to trial11845692-5 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:4: done (15 left) 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:20: write initial oid 20 2026-02-17T05:28:35.243 INFO:tasks.rados.rados.0.trial118.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-17T05:28:35.247 INFO:tasks.rados.rados.0.trial118.stdout:20: writing trial11845692-20 from 719333 to 1181770 tid 1 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout:20: writing trial11845692-20 from 1962099 to 2319333 tid 2 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout:5: finishing write tid 3 to trial11845692-5 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout:5: finishing write tid 4 to trial11845692-5 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout:5: oid 5 updating version 0 to 2 2026-02-17T05:28:35.251 INFO:tasks.rados.rados.0.trial118.stdout:5: oid 5 updating version 2 to 3 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:5: oid 5 version 3 is already newer than 1 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: finishing write tid 1 to trial11845692-6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: finishing write tid 2 to trial11845692-6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: finishing write tid 3 to trial11845692-6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: finishing write tid 4 to trial11845692-6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: oid 6 updating version 0 to 1 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: oid 6 updating version 1 to 2 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: oid 6 updating version 2 to 3 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: finishing write tid 1 to trial11845692-7 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: finishing write tid 2 to trial11845692-7 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: finishing write tid 3 to trial11845692-7 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: finishing write tid 4 to trial11845692-7 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: oid 7 updating version 0 to 4 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: oid 7 updating version 4 to 5 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: oid 7 updating version 5 to 6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: finishing write tid 1 to trial11845692-8 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: finishing write tid 2 to trial11845692-8 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: finishing write tid 3 to trial11845692-8 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: finishing write tid 4 to trial11845692-8 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: oid 8 updating version 0 to 4 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: oid 8 updating version 4 to 6 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:8: oid 8 version 6 is already newer than 5 2026-02-17T05:28:35.252 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:9: finishing write tid 1 to trial11845692-9 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:9: finishing write tid 2 to trial11845692-9 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:5: done (15 left) 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:6: done (14 left) 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:7: done (13 left) 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:8: done (12 left) 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:21: write initial oid 21 2026-02-17T05:28:35.253 INFO:tasks.rados.rados.0.trial118.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-17T05:28:35.256 INFO:tasks.rados.rados.0.trial118.stdout:21: writing trial11845692-21 from 736140 to 1273826 tid 1 2026-02-17T05:28:35.261 INFO:tasks.rados.rados.0.trial118.stdout:21: writing trial11845692-21 from 2020581 to 2336140 tid 2 2026-02-17T05:28:35.261 INFO:tasks.rados.rados.0.trial118.stdout:22: write initial oid 22 2026-02-17T05:28:35.261 INFO:tasks.rados.rados.0.trial118.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-17T05:28:35.265 INFO:tasks.rados.rados.0.trial118.stdout:22: writing trial11845692-22 from 752947 to 1365882 tid 1 2026-02-17T05:28:35.269 INFO:tasks.rados.rados.0.trial118.stdout:22: writing trial11845692-22 from 1962710 to 2352947 tid 2 2026-02-17T05:28:35.269 INFO:tasks.rados.rados.0.trial118.stdout:23: write initial oid 23 2026-02-17T05:28:35.269 INFO:tasks.rados.rados.0.trial118.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-17T05:28:35.274 INFO:tasks.rados.rados.0.trial118.stdout:23: writing trial11845692-23 from 769754 to 1457938 tid 1 2026-02-17T05:28:35.278 INFO:tasks.rados.rados.0.trial118.stdout:23: writing trial11845692-23 from 2021192 to 2369754 tid 2 2026-02-17T05:28:35.278 INFO:tasks.rados.rados.0.trial118.stdout:24: write initial oid 24 2026-02-17T05:28:35.278 INFO:tasks.rados.rados.0.trial118.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-17T05:28:35.283 INFO:tasks.rados.rados.0.trial118.stdout:24: writing trial11845692-24 from 786561 to 1266347 tid 1 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:24: writing trial11845692-24 from 1796027 to 2263691 tid 2 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: finishing write tid 3 to trial11845692-9 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: finishing write tid 4 to trial11845692-9 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: oid 9 updating version 0 to 7 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: oid 9 updating version 7 to 8 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: oid 9 updating version 8 to 9 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 9 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: finishing write tid 1 to trial11845692-10 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: finishing write tid 2 to trial11845692-10 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: finishing write tid 3 to trial11845692-10 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: finishing write tid 4 to trial11845692-10 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: oid 10 updating version 0 to 1 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: oid 10 updating version 1 to 2 2026-02-17T05:28:35.287 INFO:tasks.rados.rados.0.trial118.stdout:10: oid 10 updating version 2 to 3 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: finishing write tid 1 to trial11845692-11 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: finishing write tid 2 to trial11845692-11 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: finishing write tid 3 to trial11845692-11 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: finishing write tid 4 to trial11845692-11 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: oid 11 updating version 0 to 8 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: oid 11 updating version 8 to 9 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: oid 11 version 9 is already newer than 7 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 9 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: finishing write tid 1 to trial11845692-12 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:9: done (15 left) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:10: done (14 left) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:11: done (13 left) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:25: write initial oid 25 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: finishing write tid 2 to trial11845692-12 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: finishing write tid 3 to trial11845692-12 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: finishing write tid 4 to trial11845692-12 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: oid 12 updating version 0 to 1 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: oid 12 updating version 1 to 2 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: oid 12 updating version 2 to 3 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:13: finishing write tid 1 to trial11845692-13 2026-02-17T05:28:35.288 INFO:tasks.rados.rados.0.trial118.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-17T05:28:35.291 INFO:tasks.rados.rados.0.trial118.stdout:25: writing trial11845692-25 from 403368 to 958403 tid 1 2026-02-17T05:28:35.296 INFO:tasks.rados.rados.0.trial118.stdout:25: writing trial11845692-25 from 1454509 to 2182184 tid 2 2026-02-17T05:28:35.296 INFO:tasks.rados.rados.0.trial118.stdout:12: done (13 left) 2026-02-17T05:28:35.296 INFO:tasks.rados.rados.0.trial118.stdout:26: write initial oid 26 2026-02-17T05:28:35.296 INFO:tasks.rados.rados.0.trial118.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-17T05:28:35.300 INFO:tasks.rados.rados.0.trial118.stdout:26: writing trial11845692-26 from 420175 to 1050459 tid 1 2026-02-17T05:28:35.304 INFO:tasks.rados.rados.0.trial118.stdout:26: writing trial11845692-26 from 1796638 to 2267971 tid 2 2026-02-17T05:28:35.304 INFO:tasks.rados.rados.0.trial118.stdout:27: write initial oid 27 2026-02-17T05:28:35.304 INFO:tasks.rados.rados.0.trial118.stdout:13: finishing write tid 2 to trial11845692-13 2026-02-17T05:28:35.304 INFO:tasks.rados.rados.0.trial118.stdout:13: finishing write tid 3 to trial11845692-13 2026-02-17T05:28:35.304 INFO:tasks.rados.rados.0.trial118.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-17T05:28:35.308 INFO:tasks.rados.rados.0.trial118.stdout:27: writing trial11845692-27 from 436982 to 1142515 tid 1 2026-02-17T05:28:35.313 INFO:tasks.rados.rados.0.trial118.stdout:27: writing trial11845692-27 from 1855120 to 2436982 tid 2 2026-02-17T05:28:35.313 INFO:tasks.rados.rados.0.trial118.stdout:28: write initial oid 28 2026-02-17T05:28:35.313 INFO:tasks.rados.rados.0.trial118.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-17T05:28:35.318 INFO:tasks.rados.rados.0.trial118.stdout:28: writing trial11845692-28 from 453789 to 1234571 tid 1 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:28: writing trial11845692-28 from 1913602 to 2388604 tid 2 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:13: finishing write tid 4 to trial11845692-13 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:13: oid 13 updating version 0 to 4 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:13: oid 13 updating version 4 to 5 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:13: oid 13 updating version 5 to 6 2026-02-17T05:28:35.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:14: finishing write tid 1 to trial11845692-14 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:14: finishing write tid 2 to trial11845692-14 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:14: finishing write tid 3 to trial11845692-14 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:13: done (15 left) 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:29: write initial oid 29 2026-02-17T05:28:35.323 INFO:tasks.rados.rados.0.trial118.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-17T05:28:35.325 INFO:tasks.rados.rados.0.trial118.stdout:29: writing trial11845692-29 from 470596 to 926627 tid 1 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout:29: writing trial11845692-29 from 1572084 to 2190744 tid 2 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout:14: finishing write tid 4 to trial11845692-14 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout:14: oid 14 updating version 0 to 6 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout:14: oid 14 version 6 is already newer than 5 2026-02-17T05:28:35.330 INFO:tasks.rados.rados.0.trial118.stdout:14: oid 14 version 6 is already newer than 4 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 6 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:15: finishing write tid 1 to trial11845692-15 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:14: done (15 left) 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:30: write initial oid 30 2026-02-17T05:28:35.331 INFO:tasks.rados.rados.0.trial118.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-17T05:28:35.334 INFO:tasks.rados.rados.0.trial118.stdout:30: writing trial11845692-30 from 487403 to 1018683 tid 1 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:30: writing trial11845692-30 from 1514213 to 1992884 tid 2 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:15: finishing write tid 2 to trial11845692-15 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:15: finishing write tid 3 to trial11845692-15 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:15: finishing write tid 4 to trial11845692-15 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:15: oid 15 updating version 0 to 2 2026-02-17T05:28:35.338 INFO:tasks.rados.rados.0.trial118.stdout:15: oid 15 updating version 2 to 3 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:15: oid 15 version 3 is already newer than 1 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 3 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: finishing write tid 1 to trial11845692-16 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: finishing write tid 2 to trial11845692-16 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: finishing write tid 3 to trial11845692-16 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: finishing write tid 4 to trial11845692-16 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: oid 16 updating version 0 to 10 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: oid 16 updating version 10 to 12 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: oid 16 version 12 is already newer than 11 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 12 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: finishing write tid 1 to trial11845692-17 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: finishing write tid 2 to trial11845692-17 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: finishing write tid 3 to trial11845692-17 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: finishing write tid 4 to trial11845692-17 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: oid 17 updating version 0 to 2 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: oid 17 version 2 is already newer than 1 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: oid 17 updating version 2 to 3 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 3 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: finishing write tid 1 to trial11845692-18 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: finishing write tid 2 to trial11845692-18 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: finishing write tid 3 to trial11845692-18 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: finishing write tid 4 to trial11845692-18 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: oid 18 updating version 0 to 1 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: oid 18 updating version 1 to 3 2026-02-17T05:28:35.339 INFO:tasks.rados.rados.0.trial118.stdout:18: oid 18 version 3 is already newer than 2 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 3 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: finishing write tid 1 to trial11845692-19 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: finishing write tid 2 to trial11845692-19 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: finishing write tid 3 to trial11845692-19 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: finishing write tid 4 to trial11845692-19 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: oid 19 updating version 0 to 9 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: oid 19 version 9 is already newer than 8 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: oid 19 version 9 is already newer than 7 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 9 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: finishing write tid 1 to trial11845692-20 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: finishing write tid 2 to trial11845692-20 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: finishing write tid 3 to trial11845692-20 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: finishing write tid 4 to trial11845692-20 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: oid 20 updating version 0 to 11 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: oid 20 version 11 is already newer than 10 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: oid 20 updating version 11 to 12 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 12 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: finishing write tid 1 to trial11845692-21 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: finishing write tid 2 to trial11845692-21 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: finishing write tid 3 to trial11845692-21 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: finishing write tid 4 to trial11845692-21 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: oid 21 updating version 0 to 5 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: oid 21 updating version 5 to 6 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: oid 21 version 6 is already newer than 4 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-17T05:28:35.340 INFO:tasks.rados.rados.0.trial118.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: finishing write tid 1 to trial11845692-22 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: finishing write tid 2 to trial11845692-22 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: finishing write tid 3 to trial11845692-22 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: finishing write tid 4 to trial11845692-22 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: oid 22 updating version 0 to 4 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: oid 22 updating version 4 to 5 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: oid 22 updating version 5 to 6 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:23: finishing write tid 1 to trial11845692-23 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:15: done (15 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:16: done (14 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:17: done (13 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:18: done (12 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:19: done (11 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:20: done (10 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:21: done (9 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:22: done (8 left) 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:31: write initial oid 31 2026-02-17T05:28:35.341 INFO:tasks.rados.rados.0.trial118.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-17T05:28:35.342 INFO:tasks.rados.rados.0.trial118.stdout:31: writing trial11845692-31 from 504210 to 1110739 tid 1 2026-02-17T05:28:35.346 INFO:tasks.rados.rados.0.trial118.stdout:31: writing trial11845692-31 from 1572695 to 2195024 tid 2 2026-02-17T05:28:35.346 INFO:tasks.rados.rados.0.trial118.stdout:32: write initial oid 32 2026-02-17T05:28:35.346 INFO:tasks.rados.rados.0.trial118.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-17T05:28:35.351 INFO:tasks.rados.rados.0.trial118.stdout:32: writing trial11845692-32 from 521017 to 1319148 tid 1 2026-02-17T05:28:35.354 INFO:tasks.rados.rados.0.trial118.stdout:32: writing trial11845692-32 from 1747530 to 2229870 tid 2 2026-02-17T05:28:35.354 INFO:tasks.rados.rados.0.trial118.stdout:33: write initial oid 33 2026-02-17T05:28:35.354 INFO:tasks.rados.rados.0.trial118.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-17T05:28:35.358 INFO:tasks.rados.rados.0.trial118.stdout:33: writing trial11845692-33 from 537824 to 1011204 tid 1 2026-02-17T05:28:35.363 INFO:tasks.rados.rados.0.trial118.stdout:33: writing trial11845692-33 from 1806012 to 2432010 tid 2 2026-02-17T05:28:35.363 INFO:tasks.rados.rados.0.trial118.stdout:34: write initial oid 34 2026-02-17T05:28:35.363 INFO:tasks.rados.rados.0.trial118.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-17T05:28:35.367 INFO:tasks.rados.rados.0.trial118.stdout:34: writing trial11845692-34 from 554631 to 1103260 tid 1 2026-02-17T05:28:35.372 INFO:tasks.rados.rados.0.trial118.stdout:34: writing trial11845692-34 from 1748141 to 2234150 tid 2 2026-02-17T05:28:35.372 INFO:tasks.rados.rados.0.trial118.stdout:35: write initial oid 35 2026-02-17T05:28:35.372 INFO:tasks.rados.rados.0.trial118.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-17T05:28:35.376 INFO:tasks.rados.rados.0.trial118.stdout:35: writing trial11845692-35 from 571438 to 1195316 tid 1 2026-02-17T05:28:35.381 INFO:tasks.rados.rados.0.trial118.stdout:35: writing trial11845692-35 from 1806623 to 2436290 tid 2 2026-02-17T05:28:35.381 INFO:tasks.rados.rados.0.trial118.stdout:36: write initial oid 36 2026-02-17T05:28:35.381 INFO:tasks.rados.rados.0.trial118.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-17T05:28:35.385 INFO:tasks.rados.rados.0.trial118.stdout:36: writing trial11845692-36 from 588245 to 1287372 tid 1 2026-02-17T05:28:35.389 INFO:tasks.rados.rados.0.trial118.stdout:36: writing trial11845692-36 from 1865105 to 2354783 tid 2 2026-02-17T05:28:35.390 INFO:tasks.rados.rados.0.trial118.stdout:37: write initial oid 37 2026-02-17T05:28:35.390 INFO:tasks.rados.rados.0.trial118.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-17T05:28:35.395 INFO:tasks.rados.rados.0.trial118.stdout:37: writing trial11845692-37 from 605052 to 1379428 tid 1 2026-02-17T05:28:35.399 INFO:tasks.rados.rados.0.trial118.stdout:37: writing trial11845692-37 from 1923587 to 2556923 tid 2 2026-02-17T05:28:35.399 INFO:tasks.rados.rados.0.trial118.stdout:38: write initial oid 38 2026-02-17T05:28:35.399 INFO:tasks.rados.rados.0.trial118.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-17T05:28:35.403 INFO:tasks.rados.rados.0.trial118.stdout:38: writing trial11845692-38 from 621859 to 1071484 tid 1 2026-02-17T05:28:35.409 INFO:tasks.rados.rados.0.trial118.stdout:38: writing trial11845692-38 from 1865716 to 2621859 tid 2 2026-02-17T05:28:35.409 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.409 INFO:tasks.rados.rados.0.trial118.stdout:23: finishing write tid 2 to trial11845692-23 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: finishing write tid 3 to trial11845692-23 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: finishing write tid 4 to trial11845692-23 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: oid 23 updating version 0 to 4 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: oid 23 updating version 4 to 5 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: oid 23 updating version 5 to 6 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: finishing write tid 1 to trial11845692-24 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: finishing write tid 2 to trial11845692-24 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: finishing write tid 3 to trial11845692-24 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: finishing write tid 4 to trial11845692-24 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: oid 24 updating version 0 to 1 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: oid 24 updating version 1 to 3 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: oid 24 version 3 is already newer than 2 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 3 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: finishing write tid 1 to trial11845692-25 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: finishing write tid 2 to trial11845692-25 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: finishing write tid 3 to trial11845692-25 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: finishing write tid 4 to trial11845692-25 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: oid 25 updating version 0 to 9 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: oid 25 version 9 is already newer than 7 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: oid 25 version 9 is already newer than 8 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 9 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:26: finishing write tid 1 to trial11845692-26 2026-02-17T05:28:35.410 INFO:tasks.rados.rados.0.trial118.stdout:26: finishing write tid 2 to trial11845692-26 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: finishing write tid 3 to trial11845692-26 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: finishing write tid 4 to trial11845692-26 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: oid 26 updating version 0 to 1 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: oid 26 updating version 1 to 3 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: oid 26 version 3 is already newer than 2 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 3 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: finishing write tid 1 to trial11845692-27 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: finishing write tid 2 to trial11845692-27 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: finishing write tid 3 to trial11845692-27 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: finishing write tid 4 to trial11845692-27 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: oid 27 updating version 0 to 14 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: oid 27 updating version 14 to 15 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: oid 27 version 15 is already newer than 13 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 15 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:28: finishing write tid 1 to trial11845692-28 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:23: done (15 left) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:24: done (14 left) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:25: done (13 left) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:26: done (12 left) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:27: done (11 left) 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:39: write initial oid 39 2026-02-17T05:28:35.411 INFO:tasks.rados.rados.0.trial118.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-17T05:28:35.414 INFO:tasks.rados.rados.0.trial118.stdout:39: writing trial11845692-39 from 638666 to 1163540 tid 1 2026-02-17T05:28:35.419 INFO:tasks.rados.rados.0.trial118.stdout:39: writing trial11845692-39 from 1924198 to 2561203 tid 2 2026-02-17T05:28:35.419 INFO:tasks.rados.rados.0.trial118.stdout:40: write initial oid 40 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: finishing write tid 2 to trial11845692-28 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: finishing write tid 3 to trial11845692-28 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: finishing write tid 4 to trial11845692-28 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: oid 28 updating version 0 to 6 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: oid 28 version 6 is already newer than 4 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: oid 28 version 6 is already newer than 5 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:29: finishing write tid 1 to trial11845692-29 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:29: finishing write tid 2 to trial11845692-29 2026-02-17T05:28:35.420 INFO:tasks.rados.rados.0.trial118.stdout:29: finishing write tid 3 to trial11845692-29 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:29: finishing write tid 4 to trial11845692-29 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:29: oid 29 updating version 0 to 14 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:29: oid 29 updating version 14 to 15 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:29: oid 29 version 15 is already newer than 13 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 15 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:30: finishing write tid 1 to trial11845692-30 2026-02-17T05:28:35.421 INFO:tasks.rados.rados.0.trial118.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-17T05:28:35.424 INFO:tasks.rados.rados.0.trial118.stdout:40: writing trial11845692-40 from 655473 to 1371949 tid 1 2026-02-17T05:28:35.429 INFO:tasks.rados.rados.0.trial118.stdout:40: writing trial11845692-40 from 2099033 to 2655473 tid 2 2026-02-17T05:28:35.429 INFO:tasks.rados.rados.0.trial118.stdout:28: done (12 left) 2026-02-17T05:28:35.429 INFO:tasks.rados.rados.0.trial118.stdout:29: done (11 left) 2026-02-17T05:28:35.429 INFO:tasks.rados.rados.0.trial118.stdout:41: write initial oid 41 2026-02-17T05:28:35.429 INFO:tasks.rados.rados.0.trial118.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-17T05:28:35.434 INFO:tasks.rados.rados.0.trial118.stdout:41: writing trial11845692-41 from 672280 to 1464005 tid 1 2026-02-17T05:28:35.439 INFO:tasks.rados.rados.0.trial118.stdout:41: writing trial11845692-41 from 2157515 to 2672280 tid 2 2026-02-17T05:28:35.439 INFO:tasks.rados.rados.0.trial118.stdout:42: write initial oid 42 2026-02-17T05:28:35.439 INFO:tasks.rados.rados.0.trial118.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-17T05:28:35.443 INFO:tasks.rados.rados.0.trial118.stdout:42: writing trial11845692-42 from 689087 to 1156061 tid 1 2026-02-17T05:28:35.448 INFO:tasks.rados.rados.0.trial118.stdout:42: writing trial11845692-42 from 1699644 to 2483976 tid 2 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:43: write initial oid 43 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: finishing write tid 2 to trial11845692-30 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: finishing write tid 3 to trial11845692-30 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: finishing write tid 4 to trial11845692-30 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: oid 30 updating version 0 to 11 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: oid 30 updating version 11 to 12 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: oid 30 version 12 is already newer than 10 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 12 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-17T05:28:35.449 INFO:tasks.rados.rados.0.trial118.stdout:31: finishing write tid 1 to trial11845692-31 2026-02-17T05:28:35.450 INFO:tasks.rados.rados.0.trial118.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-17T05:28:35.453 INFO:tasks.rados.rados.0.trial118.stdout:43: writing trial11845692-43 from 705894 to 1248117 tid 1 2026-02-17T05:28:35.457 INFO:tasks.rados.rados.0.trial118.stdout:43: writing trial11845692-43 from 1758126 to 2402469 tid 2 2026-02-17T05:28:35.457 INFO:tasks.rados.rados.0.trial118.stdout:30: done (13 left) 2026-02-17T05:28:35.457 INFO:tasks.rados.rados.0.trial118.stdout:44: write initial oid 44 2026-02-17T05:28:35.458 INFO:tasks.rados.rados.0.trial118.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-17T05:28:35.462 INFO:tasks.rados.rados.0.trial118.stdout:44: writing trial11845692-44 from 722701 to 1340173 tid 1 2026-02-17T05:28:35.467 INFO:tasks.rados.rados.0.trial118.stdout:44: writing trial11845692-44 from 1816608 to 2604609 tid 2 2026-02-17T05:28:35.467 INFO:tasks.rados.rados.0.trial118.stdout:45: write initial oid 45 2026-02-17T05:28:35.467 INFO:tasks.rados.rados.0.trial118.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-17T05:28:35.472 INFO:tasks.rados.rados.0.trial118.stdout:45: writing trial11845692-45 from 739508 to 1432229 tid 1 2026-02-17T05:28:35.477 INFO:tasks.rados.rados.0.trial118.stdout:45: writing trial11845692-45 from 1875090 to 2523102 tid 2 2026-02-17T05:28:35.477 INFO:tasks.rados.rados.0.trial118.stdout:46: write initial oid 46 2026-02-17T05:28:35.477 INFO:tasks.rados.rados.0.trial118.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-17T05:28:35.482 INFO:tasks.rados.rados.0.trial118.stdout:46: writing trial11845692-46 from 756315 to 1524285 tid 1 2026-02-17T05:28:35.489 INFO:tasks.rados.rados.0.trial118.stdout:46: writing trial11845692-46 from 1933572 to 2725242 tid 2 2026-02-17T05:28:35.489 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 16 2026-02-17T05:28:35.489 INFO:tasks.rados.rados.0.trial118.stdout:31: finishing write tid 2 to trial11845692-31 2026-02-17T05:28:35.489 INFO:tasks.rados.rados.0.trial118.stdout:31: finishing write tid 3 to trial11845692-31 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:31: finishing write tid 4 to trial11845692-31 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:31: oid 31 updating version 0 to 17 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:31: oid 31 version 17 is already newer than 16 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:31: oid 31 updating version 17 to 18 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 18 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-17T05:28:35.490 INFO:tasks.rados.rados.0.trial118.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: finishing write tid 1 to trial11845692-32 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: finishing write tid 2 to trial11845692-32 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: finishing write tid 3 to trial11845692-32 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: finishing write tid 4 to trial11845692-32 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: oid 32 updating version 0 to 5 2026-02-17T05:28:35.491 INFO:tasks.rados.rados.0.trial118.stdout:32: oid 32 version 5 is already newer than 4 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:32: oid 32 updating version 5 to 6 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:33: finishing write tid 1 to trial11845692-33 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:33: finishing write tid 2 to trial11845692-33 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:33: finishing write tid 3 to trial11845692-33 2026-02-17T05:28:35.492 INFO:tasks.rados.rados.0.trial118.stdout:33: finishing write tid 4 to trial11845692-33 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:33: oid 33 updating version 0 to 15 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:33: oid 33 version 15 is already newer than 14 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:33: oid 33 version 15 is already newer than 13 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 15 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:34: finishing write tid 1 to trial11845692-34 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:34: finishing write tid 2 to trial11845692-34 2026-02-17T05:28:35.493 INFO:tasks.rados.rados.0.trial118.stdout:34: finishing write tid 3 to trial11845692-34 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:34: finishing write tid 4 to trial11845692-34 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:34: oid 34 updating version 0 to 9 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:34: oid 34 version 9 is already newer than 7 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:34: oid 34 version 9 is already newer than 8 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 9 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-17T05:28:35.494 INFO:tasks.rados.rados.0.trial118.stdout:35: finishing write tid 1 to trial11845692-35 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: finishing write tid 2 to trial11845692-35 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: finishing write tid 3 to trial11845692-35 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: finishing write tid 4 to trial11845692-35 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: oid 35 updating version 0 to 4 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: oid 35 updating version 4 to 6 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:35: oid 35 version 6 is already newer than 5 2026-02-17T05:28:35.495 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:36: finishing write tid 1 to trial11845692-36 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:36: finishing write tid 2 to trial11845692-36 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:36: finishing write tid 3 to trial11845692-36 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:31: done (15 left) 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:32: done (14 left) 2026-02-17T05:28:35.496 INFO:tasks.rados.rados.0.trial118.stdout:33: done (13 left) 2026-02-17T05:28:35.497 INFO:tasks.rados.rados.0.trial118.stdout:34: done (12 left) 2026-02-17T05:28:35.497 INFO:tasks.rados.rados.0.trial118.stdout:35: done (11 left) 2026-02-17T05:28:35.497 INFO:tasks.rados.rados.0.trial118.stdout:47: write initial oid 47 2026-02-17T05:28:35.497 INFO:tasks.rados.rados.0.trial118.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-17T05:28:35.498 INFO:tasks.rados.rados.0.trial118.stdout:47: writing trial11845692-47 from 773122 to 1332694 tid 1 2026-02-17T05:28:35.498 INFO:tasks.rados.rados.0.trial118.stdout:47: writing trial11845692-47 from 1992054 to 2643735 tid 2 2026-02-17T05:28:35.498 INFO:tasks.rados.rados.0.trial118.stdout:48: write initial oid 48 2026-02-17T05:28:35.498 INFO:tasks.rados.rados.0.trial118.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-17T05:28:35.502 INFO:tasks.rados.rados.0.trial118.stdout:48: writing trial11845692-48 from 789929 to 1424750 tid 1 2026-02-17T05:28:35.507 INFO:tasks.rados.rados.0.trial118.stdout:48: writing trial11845692-48 from 2050536 to 2789929 tid 2 2026-02-17T05:28:35.507 INFO:tasks.rados.rados.0.trial118.stdout:49: write initial oid 49 2026-02-17T05:28:35.507 INFO:tasks.rados.rados.0.trial118.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-17T05:28:35.511 INFO:tasks.rados.rados.0.trial118.stdout:49: writing trial11845692-49 from 406736 to 1116806 tid 1 2026-02-17T05:28:35.516 INFO:tasks.rados.rados.0.trial118.stdout:49: writing trial11845692-49 from 1709018 to 2364368 tid 2 2026-02-17T05:28:35.516 INFO:tasks.rados.rados.0.trial118.stdout:50: write initial oid 50 2026-02-17T05:28:35.516 INFO:tasks.rados.rados.0.trial118.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-17T05:28:35.520 INFO:tasks.rados.rados.0.trial118.stdout:50: writing trial11845692-50 from 423543 to 1208862 tid 1 2026-02-17T05:28:35.526 INFO:tasks.rados.rados.0.trial118.stdout:50: writing trial11845692-50 from 1767500 to 2566508 tid 2 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:51: snap_create 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:36: finishing write tid 4 to trial11845692-36 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:36: oid 36 updating version 0 to 7 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:36: oid 36 updating version 7 to 8 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:36: oid 36 updating version 8 to 9 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 9 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:37: finishing write tid 1 to trial11845692-37 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:37: finishing write tid 2 to trial11845692-37 2026-02-17T05:28:35.527 INFO:tasks.rados.rados.0.trial118.stdout:37: finishing write tid 3 to trial11845692-37 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:37: finishing write tid 4 to trial11845692-37 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:37: oid 37 updating version 0 to 2 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:37: oid 37 updating version 2 to 3 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:37: oid 37 version 3 is already newer than 1 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 3 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:38: finishing write tid 1 to trial11845692-38 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:38: finishing write tid 2 to trial11845692-38 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:38: finishing write tid 3 to trial11845692-38 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:38: finishing write tid 4 to trial11845692-38 2026-02-17T05:28:35.528 INFO:tasks.rados.rados.0.trial118.stdout:38: oid 38 updating version 0 to 3 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:38: oid 38 version 3 is already newer than 2 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:38: oid 38 version 3 is already newer than 1 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 3 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: finishing write tid 1 to trial11845692-39 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: finishing write tid 2 to trial11845692-39 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: finishing write tid 3 to trial11845692-39 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: finishing write tid 4 to trial11845692-39 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: oid 39 updating version 0 to 4 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: oid 39 updating version 4 to 5 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: oid 39 updating version 5 to 6 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T05:28:35.529 INFO:tasks.rados.rados.0.trial118.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: finishing write tid 1 to trial11845692-40 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: finishing write tid 2 to trial11845692-40 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: finishing write tid 3 to trial11845692-40 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: finishing write tid 4 to trial11845692-40 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: oid 40 updating version 0 to 17 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: oid 40 updating version 17 to 18 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: oid 40 version 18 is already newer than 16 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 18 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:41: finishing write tid 1 to trial11845692-41 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:41: finishing write tid 2 to trial11845692-41 2026-02-17T05:28:35.530 INFO:tasks.rados.rados.0.trial118.stdout:41: finishing write tid 3 to trial11845692-41 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:41: finishing write tid 4 to trial11845692-41 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:41: oid 41 updating version 0 to 17 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:41: oid 41 version 17 is already newer than 16 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:41: oid 41 updating version 17 to 18 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 18 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: finishing write tid 1 to trial11845692-42 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: finishing write tid 2 to trial11845692-42 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: finishing write tid 3 to trial11845692-42 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: finishing write tid 4 to trial11845692-42 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: oid 42 updating version 0 to 7 2026-02-17T05:28:35.531 INFO:tasks.rados.rados.0.trial118.stdout:42: oid 42 updating version 7 to 8 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:42: oid 42 updating version 8 to 9 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 9 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: finishing write tid 1 to trial11845692-43 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: finishing write tid 2 to trial11845692-43 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: finishing write tid 3 to trial11845692-43 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: finishing write tid 4 to trial11845692-43 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: oid 43 updating version 0 to 6 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: oid 43 version 6 is already newer than 4 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: oid 43 version 6 is already newer than 5 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-17T05:28:35.532 INFO:tasks.rados.rados.0.trial118.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: finishing write tid 1 to trial11845692-44 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: finishing write tid 2 to trial11845692-44 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: finishing write tid 3 to trial11845692-44 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: finishing write tid 4 to trial11845692-44 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: oid 44 updating version 0 to 7 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: oid 44 updating version 7 to 9 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: oid 44 version 9 is already newer than 8 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 9 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:45: finishing write tid 1 to trial11845692-45 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:45: finishing write tid 2 to trial11845692-45 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:45: finishing write tid 3 to trial11845692-45 2026-02-17T05:28:35.533 INFO:tasks.rados.rados.0.trial118.stdout:45: finishing write tid 4 to trial11845692-45 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:45: oid 45 updating version 0 to 11 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:45: oid 45 updating version 11 to 12 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:45: oid 45 version 12 is already newer than 10 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 12 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: finishing write tid 1 to trial11845692-46 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: finishing write tid 2 to trial11845692-46 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: finishing write tid 3 to trial11845692-46 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: finishing write tid 4 to trial11845692-46 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: oid 46 updating version 0 to 5 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: oid 46 updating version 5 to 6 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:46: oid 46 version 6 is already newer than 4 2026-02-17T05:28:35.534 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 6 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: finishing write tid 1 to trial11845692-47 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: finishing write tid 2 to trial11845692-47 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: finishing write tid 3 to trial11845692-47 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: finishing write tid 4 to trial11845692-47 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: oid 47 updating version 0 to 12 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: oid 47 version 12 is already newer than 11 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: oid 47 version 12 is already newer than 10 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:48: finishing write tid 1 to trial11845692-48 2026-02-17T05:28:35.535 INFO:tasks.rados.rados.0.trial118.stdout:48: finishing write tid 2 to trial11845692-48 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: finishing write tid 3 to trial11845692-48 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: finishing write tid 4 to trial11845692-48 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: oid 48 updating version 0 to 15 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: oid 48 version 15 is already newer than 14 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: oid 48 version 15 is already newer than 13 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 15 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: finishing write tid 1 to trial11845692-49 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: finishing write tid 2 to trial11845692-49 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: finishing write tid 3 to trial11845692-49 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: finishing write tid 4 to trial11845692-49 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: oid 49 updating version 0 to 7 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: oid 49 updating version 7 to 9 2026-02-17T05:28:35.536 INFO:tasks.rados.rados.0.trial118.stdout:49: oid 49 version 9 is already newer than 8 2026-02-17T05:28:35.537 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T05:28:35.537 INFO:tasks.rados.rados.0.trial118.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:28:35.537 INFO:tasks.rados.rados.0.trial118.stdout:50: finishing write tid 1 to trial11845692-50 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: finishing write tid 2 to trial11845692-50 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: finishing write tid 3 to trial11845692-50 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: finishing write tid 4 to trial11845692-50 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: oid 50 updating version 0 to 8 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: oid 50 version 8 is already newer than 7 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: oid 50 updating version 8 to 9 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-17T05:28:35.538 INFO:tasks.rados.rados.0.trial118.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-17T05:28:36.091 INFO:tasks.rados.rados.0.trial118.stdout:36: done (15 left) 2026-02-17T05:28:36.091 INFO:tasks.rados.rados.0.trial118.stdout:37: done (14 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:38: done (13 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:39: done (12 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:40: done (11 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:41: done (10 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:42: done (9 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:43: done (8 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:44: done (7 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:45: done (6 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:46: done (5 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:47: done (4 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:48: done (3 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:49: done (2 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:50: done (1 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:51: done (0 left) 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:52: rollback oid 42 current snap is 1 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 0 2026-02-17T05:28:36.092 INFO:tasks.rados.rados.0.trial118.stdout:53: delete oid 44 current snap is 1 2026-02-17T05:28:36.094 INFO:tasks.rados.rados.0.trial118.stdout:53: done (1 left) 2026-02-17T05:28:36.094 INFO:tasks.rados.rados.0.trial118.stdout:54: write oid 36 current snap is 1 2026-02-17T05:28:36.094 INFO:tasks.rados.rados.0.trial118.stdout:54: seq_num 51 ranges {457157=535817,1768111=402677} 2026-02-17T05:28:36.098 INFO:tasks.rados.rados.0.trial118.stdout:54: writing trial11845692-36 from 457157 to 992974 tid 1 2026-02-17T05:28:36.103 INFO:tasks.rados.rados.0.trial118.stdout:54: writing trial11845692-36 from 1768111 to 2170788 tid 2 2026-02-17T05:28:36.103 INFO:tasks.rados.rados.0.trial118.stdout:55: write oid 33 current snap is 1 2026-02-17T05:28:36.103 INFO:tasks.rados.rados.0.trial118.stdout:52: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:28:36.103 INFO:tasks.rados.rados.0.trial118.stdout:52: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:28:36.103 INFO:tasks.rados.rados.0.trial118.stdout:55: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-17T05:28:36.107 INFO:tasks.rados.rados.0.trial118.stdout:55: writing trial11845692-33 from 473964 to 1085030 tid 1 2026-02-17T05:28:36.112 INFO:tasks.rados.rados.0.trial118.stdout:55: writing trial11845692-33 from 1826593 to 2372928 tid 2 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:55: writing trial11845692-33 from 2778819 to 2873964 tid 3 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:56: read oid 7 snap 0 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:56: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:57: rollback oid 4 current snap is 1 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 0 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:52: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 16 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: finishing write tid 1 to trial11845692-36 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: finishing write tid 2 to trial11845692-36 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: finishing write tid 3 to trial11845692-36 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: finishing write tid 4 to trial11845692-36 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: oid 36 updating version 0 to 17 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: oid 36 updating version 17 to 19 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: oid 36 version 19 is already newer than 18 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 19 (ObjNum 51 snap 1 seq_num 51) dirty exists 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:54: left oid 36 (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:28:36.114 INFO:tasks.rados.rados.0.trial118.stdout:55: finishing write tid 1 to trial11845692-33 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:55: finishing write tid 2 to trial11845692-33 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:52: done (4 left) 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:54: done (3 left) 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:58: copy_from oid 23 from oid 49 current snap is 1 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:59: read oid 32 snap -1 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:59: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:60: write (excl) oid 18 current snap is 1 2026-02-17T05:28:36.115 INFO:tasks.rados.rados.0.trial118.stdout:60: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-17T05:28:36.118 INFO:tasks.rados.rados.0.trial118.stdout:60: writing trial11845692-18 from 490771 to 1177086 tid 1 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:60: writing trial11845692-18 from 1885075 to 2291421 tid 2 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:61: write oid 9 current snap is 1 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:55: finishing write tid 3 to trial11845692-33 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:55: finishing write tid 4 to trial11845692-33 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:55: finishing write tid 5 to trial11845692-33 2026-02-17T05:28:36.122 INFO:tasks.rados.rados.0.trial118.stdout:55: oid 33 updating version 0 to 20 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:55: oid 33 updating version 20 to 23 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:55: oid 33 version 23 is already newer than 21 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:55: oid 33 version 23 is already newer than 22 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 23 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:55: left oid 33 (ObjNum 52 snap 1 seq_num 52) 2026-02-17T05:28:36.123 INFO:tasks.rados.rados.0.trial118.stdout:61: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-17T05:28:36.126 INFO:tasks.rados.rados.0.trial118.stdout:61: writing trial11845692-9 from 507578 to 985495 tid 1 2026-02-17T05:28:36.130 INFO:tasks.rados.rados.0.trial118.stdout:61: writing trial11845692-9 from 1543557 to 2093561 tid 2 2026-02-17T05:28:36.134 INFO:tasks.rados.rados.0.trial118.stdout:61: writing trial11845692-9 from 2833665 to 2907578 tid 3 2026-02-17T05:28:36.134 INFO:tasks.rados.rados.0.trial118.stdout:55: done (6 left) 2026-02-17T05:28:36.134 INFO:tasks.rados.rados.0.trial118.stdout:62: write oid 12 current snap is 1 2026-02-17T05:28:36.134 INFO:tasks.rados.rados.0.trial118.stdout:62: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2026-02-17T05:28:36.138 INFO:tasks.rados.rados.0.trial118.stdout:62: writing trial11845692-12 from 524385 to 1077551 tid 1 2026-02-17T05:28:36.142 INFO:tasks.rados.rados.0.trial118.stdout:62: writing trial11845692-12 from 1602039 to 2012054 tid 2 2026-02-17T05:28:36.146 INFO:tasks.rados.rados.0.trial118.stdout:62: writing trial11845692-12 from 2577441 to 2924385 tid 3 2026-02-17T05:28:36.146 INFO:tasks.rados.rados.0.trial118.stdout:63: write oid 34 current snap is 1 2026-02-17T05:28:36.146 INFO:tasks.rados.rados.0.trial118.stdout:63: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-17T05:28:36.150 INFO:tasks.rados.rados.0.trial118.stdout:63: writing trial11845692-34 from 541192 to 1169607 tid 1 2026-02-17T05:28:36.154 INFO:tasks.rados.rados.0.trial118.stdout:63: writing trial11845692-34 from 1660521 to 2214194 tid 2 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:63: writing trial11845692-34 from 2888511 to 2941192 tid 3 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:64: read oid 22 snap -1 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:64: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:65: read oid 41 snap -1 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:65: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:66: copy_from oid 19 from oid 47 current snap is 1 2026-02-17T05:28:36.157 INFO:tasks.rados.rados.0.trial118.stdout:59: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T05:28:36.159 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 615164 2026-02-17T05:28:36.172 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:36.190 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:36.207 INFO:tasks.rados.rados.0.trial118.stdout:56: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T05:28:36.215 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:36.231 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:36.250 INFO:tasks.rados.rados.0.trial118.stdout:57: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:28:36.250 INFO:tasks.rados.rados.0.trial118.stdout:56: done (10 left) 2026-02-17T05:28:36.250 INFO:tasks.rados.rados.0.trial118.stdout:59: done (9 left) 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:67: snap_create 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:57: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:57: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 22 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:60: finishing write tid 1 to trial11845692-18 2026-02-17T05:28:36.251 INFO:tasks.rados.rados.0.trial118.stdout:58: finishing copy_from racing read to trial11845692-23 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: finishing write tid 2 to trial11845692-18 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: finishing write tid 3 to trial11845692-18 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: finishing write tid 4 to trial11845692-18 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: oid 18 updating version 0 to 13 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: oid 18 version 13 is already newer than 11 2026-02-17T05:28:36.252 INFO:tasks.rados.rados.0.trial118.stdout:60: oid 18 version 13 is already newer than 12 2026-02-17T05:28:36.253 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 13 (ObjNum 53 snap 1 seq_num 53) dirty exists 2026-02-17T05:28:36.253 INFO:tasks.rados.rados.0.trial118.stdout:60: left oid 18 (ObjNum 53 snap 1 seq_num 53) 2026-02-17T05:28:36.253 INFO:tasks.rados.rados.0.trial118.stdout:58: finishing copy_from to trial11845692-23 2026-02-17T05:28:36.253 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T05:28:36.253 INFO:tasks.rados.rados.0.trial118.stdout:61: finishing write tid 1 to trial11845692-9 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: finishing write tid 2 to trial11845692-9 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: finishing write tid 3 to trial11845692-9 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: finishing write tid 4 to trial11845692-9 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: finishing write tid 5 to trial11845692-9 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: oid 9 updating version 0 to 26 2026-02-17T05:28:36.254 INFO:tasks.rados.rados.0.trial118.stdout:61: oid 9 version 26 is already newer than 24 2026-02-17T05:28:36.255 INFO:tasks.rados.rados.0.trial118.stdout:61: oid 9 version 26 is already newer than 25 2026-02-17T05:28:36.255 INFO:tasks.rados.rados.0.trial118.stdout:61: oid 9 updating version 26 to 27 2026-02-17T05:28:36.255 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 27 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-17T05:28:36.255 INFO:tasks.rados.rados.0.trial118.stdout:61: left oid 9 (ObjNum 54 snap 1 seq_num 54) 2026-02-17T05:28:36.255 INFO:tasks.rados.rados.0.trial118.stdout:62: finishing write tid 1 to trial11845692-12 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: finishing write tid 2 to trial11845692-12 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: finishing write tid 3 to trial11845692-12 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: finishing write tid 4 to trial11845692-12 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: finishing write tid 5 to trial11845692-12 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: oid 12 updating version 0 to 11 2026-02-17T05:28:36.256 INFO:tasks.rados.rados.0.trial118.stdout:62: oid 12 updating version 11 to 13 2026-02-17T05:28:36.257 INFO:tasks.rados.rados.0.trial118.stdout:62: oid 12 version 13 is already newer than 12 2026-02-17T05:28:36.257 INFO:tasks.rados.rados.0.trial118.stdout:62: oid 12 updating version 13 to 14 2026-02-17T05:28:36.257 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 14 (ObjNum 55 snap 1 seq_num 55) dirty exists 2026-02-17T05:28:36.257 INFO:tasks.rados.rados.0.trial118.stdout:62: left oid 12 (ObjNum 55 snap 1 seq_num 55) 2026-02-17T05:28:36.257 INFO:tasks.rados.rados.0.trial118.stdout:63: finishing write tid 1 to trial11845692-34 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: finishing write tid 2 to trial11845692-34 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: finishing write tid 3 to trial11845692-34 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: finishing write tid 4 to trial11845692-34 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: finishing write tid 5 to trial11845692-34 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: oid 34 updating version 0 to 18 2026-02-17T05:28:36.258 INFO:tasks.rados.rados.0.trial118.stdout:63: oid 34 version 18 is already newer than 15 2026-02-17T05:28:36.259 INFO:tasks.rados.rados.0.trial118.stdout:63: oid 34 version 18 is already newer than 17 2026-02-17T05:28:36.259 INFO:tasks.rados.rados.0.trial118.stdout:63: oid 34 version 18 is already newer than 16 2026-02-17T05:28:36.259 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 18 (ObjNum 56 snap 1 seq_num 56) dirty exists 2026-02-17T05:28:36.259 INFO:tasks.rados.rados.0.trial118.stdout:63: left oid 34 (ObjNum 56 snap 1 seq_num 56) 2026-02-17T05:28:36.259 INFO:tasks.rados.rados.0.trial118.stdout:65: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-17T05:28:36.260 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1206127 2026-02-17T05:28:36.290 INFO:tasks.rados.rados.0.trial118.stdout:64: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:36.290 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:36.307 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 746518 2026-02-17T05:28:36.330 INFO:tasks.rados.rados.0.trial118.stdout:66: finishing copy_from racing read to trial11845692-19 2026-02-17T05:28:36.330 INFO:tasks.rados.rados.0.trial118.stdout:66: finishing copy_from to trial11845692-19 2026-02-17T05:28:36.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:57: done (9 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:58: done (8 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:60: done (7 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:61: done (6 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:62: done (5 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:63: done (4 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:64: done (3 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:65: done (2 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:66: done (1 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:67: done (0 left) 2026-02-17T05:28:37.095 INFO:tasks.rados.rados.0.trial118.stdout:68: snap_remove snap 1 2026-02-17T05:28:38.096 INFO:tasks.rados.rados.0.trial118.stdout:68: done (0 left) 2026-02-17T05:28:38.096 INFO:tasks.rados.rados.0.trial118.stdout:69: write (excl) oid 19 current snap is 2 2026-02-17T05:28:38.096 INFO:tasks.rados.rados.0.trial118.stdout:69: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-17T05:28:38.101 INFO:tasks.rados.rados.0.trial118.stdout:69: writing trial11845692-19 from 557999 to 1261663 tid 1 2026-02-17T05:28:38.104 INFO:tasks.rados.rados.0.trial118.stdout:69: writing trial11845692-19 from 1719003 to 2132687 tid 2 2026-02-17T05:28:38.107 INFO:tasks.rados.rados.0.trial118.stdout:69: writing trial11845692-19 from 2632287 to 2957999 tid 3 2026-02-17T05:28:38.107 INFO:tasks.rados.rados.0.trial118.stdout:70: rollback oid 13 current snap is 2 2026-02-17T05:28:38.107 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 0 2026-02-17T05:28:38.108 INFO:tasks.rados.rados.0.trial118.stdout:69: finishing write tid 1 to trial11845692-19 2026-02-17T05:28:38.108 INFO:tasks.rados.rados.0.trial118.stdout:69: finishing write tid 2 to trial11845692-19 2026-02-17T05:28:38.108 INFO:tasks.rados.rados.0.trial118.stdout:71: write oid 10 current snap is 2 2026-02-17T05:28:38.108 INFO:tasks.rados.rados.0.trial118.stdout:71: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-17T05:28:38.112 INFO:tasks.rados.rados.0.trial118.stdout:71: writing trial11845692-10 from 574806 to 1353719 tid 1 2026-02-17T05:28:38.118 INFO:tasks.rados.rados.0.trial118.stdout:71: writing trial11845692-10 from 2061132 to 2618474 tid 2 2026-02-17T05:28:38.118 INFO:tasks.rados.rados.0.trial118.stdout:72: snap_create 2026-02-17T05:28:38.118 INFO:tasks.rados.rados.0.trial118.stdout:69: finishing write tid 3 to trial11845692-19 2026-02-17T05:28:38.118 INFO:tasks.rados.rados.0.trial118.stdout:69: finishing write tid 4 to trial11845692-19 2026-02-17T05:28:38.118 INFO:tasks.rados.rados.0.trial118.stdout:69: finishing write tid 5 to trial11845692-19 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:69: oid 19 updating version 0 to 14 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:69: oid 19 updating version 14 to 16 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:69: oid 19 version 16 is already newer than 13 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:69: oid 19 version 16 is already newer than 15 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 16 (ObjNum 57 snap 2 seq_num 57) dirty exists 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:69: left oid 19 (ObjNum 57 snap 2 seq_num 57) 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:70: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:70: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:70: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 19 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-17T05:28:38.119 INFO:tasks.rados.rados.0.trial118.stdout:71: finishing write tid 1 to trial11845692-10 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: finishing write tid 2 to trial11845692-10 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: finishing write tid 3 to trial11845692-10 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: finishing write tid 4 to trial11845692-10 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: oid 10 updating version 0 to 13 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: oid 10 version 13 is already newer than 11 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:71: oid 10 version 13 is already newer than 12 2026-02-17T05:28:38.121 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 13 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-17T05:28:38.122 INFO:tasks.rados.rados.0.trial118.stdout:71: left oid 10 (ObjNum 58 snap 2 seq_num 58) 2026-02-17T05:28:39.099 INFO:tasks.rados.rados.0.trial118.stdout:69: done (3 left) 2026-02-17T05:28:39.099 INFO:tasks.rados.rados.0.trial118.stdout:70: done (2 left) 2026-02-17T05:28:39.099 INFO:tasks.rados.rados.0.trial118.stdout:71: done (1 left) 2026-02-17T05:28:39.099 INFO:tasks.rados.rados.0.trial118.stdout:72: done (0 left) 2026-02-17T05:28:39.099 INFO:tasks.rados.rados.0.trial118.stdout:73: delete oid 34 current snap is 3 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:73: done (0 left) 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:74: rollback oid 7 current snap is 3 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 2 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:75: read oid 32 snap -1 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:75: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T05:28:39.102 INFO:tasks.rados.rados.0.trial118.stdout:76: delete oid 1 current snap is 3 2026-02-17T05:28:39.103 INFO:tasks.rados.rados.0.trial118.stdout:76: done (2 left) 2026-02-17T05:28:39.103 INFO:tasks.rados.rados.0.trial118.stdout:77: snap_remove snap 0 2026-02-17T05:28:40.103 INFO:tasks.rados.rados.0.trial118.stdout:77: done (2 left) 2026-02-17T05:28:40.103 INFO:tasks.rados.rados.0.trial118.stdout:78: snap_create 2026-02-17T05:28:40.104 INFO:tasks.rados.rados.0.trial118.stdout:75: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-17T05:28:40.105 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 616831 2026-02-17T05:28:40.154 INFO:tasks.rados.rados.0.trial118.stdout:74: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:28:40.154 INFO:tasks.rados.rados.0.trial118.stdout:74: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:28:40.154 INFO:tasks.rados.rados.0.trial118.stdout:74: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:28:40.154 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 31 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-17T05:28:41.105 INFO:tasks.rados.rados.0.trial118.stdout:74: done (2 left) 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:75: done (1 left) 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:78: done (0 left) 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:79: read oid 49 snap 3 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:79: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:80: rollback oid 23 current snap is 4 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 23 to 3 2026-02-17T05:28:41.106 INFO:tasks.rados.rados.0.trial118.stdout:81: delete oid 40 current snap is 4 2026-02-17T05:28:41.108 INFO:tasks.rados.rados.0.trial118.stdout:81: done (2 left) 2026-02-17T05:28:41.108 INFO:tasks.rados.rados.0.trial118.stdout:82: write (excl) oid 12 current snap is 4 2026-02-17T05:28:41.108 INFO:tasks.rados.rados.0.trial118.stdout:82: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-17T05:28:41.113 INFO:tasks.rados.rados.0.trial118.stdout:82: writing trial11845692-12 from 642034 to 1438296 tid 1 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:82: writing trial11845692-12 from 1895060 to 2459740 tid 2 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:83: snap_create 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:80: finishing rollback tid 0 to trial11845692-23 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:80: finishing rollback tid 1 to trial11845692-23 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:80: finishing rollback tid 2 to trial11845692-23 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 14 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:79: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:28:41.118 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:41.137 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:41.160 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 801568 2026-02-17T05:28:41.174 INFO:tasks.rados.rados.0.trial118.stdout:82: finishing write tid 1 to trial11845692-12 2026-02-17T05:28:41.174 INFO:tasks.rados.rados.0.trial118.stdout:82: finishing write tid 2 to trial11845692-12 2026-02-17T05:28:41.174 INFO:tasks.rados.rados.0.trial118.stdout:82: finishing write tid 3 to trial11845692-12 2026-02-17T05:28:41.174 INFO:tasks.rados.rados.0.trial118.stdout:82: finishing write tid 4 to trial11845692-12 2026-02-17T05:28:41.175 INFO:tasks.rados.rados.0.trial118.stdout:82: oid 12 updating version 0 to 20 2026-02-17T05:28:41.175 INFO:tasks.rados.rados.0.trial118.stdout:82: oid 12 version 20 is already newer than 19 2026-02-17T05:28:41.175 INFO:tasks.rados.rados.0.trial118.stdout:82: oid 12 version 20 is already newer than 18 2026-02-17T05:28:41.175 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 20 (ObjNum 62 snap 4 seq_num 62) dirty exists 2026-02-17T05:28:41.175 INFO:tasks.rados.rados.0.trial118.stdout:82: left oid 12 (ObjNum 62 snap 4 seq_num 62) 2026-02-17T05:28:42.108 INFO:tasks.rados.rados.0.trial118.stdout:79: done (3 left) 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:80: done (2 left) 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:82: done (1 left) 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:83: done (0 left) 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:84: rollback oid 31 current snap is 5 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 2 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:85: read oid 33 snap -1 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:85: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:86: rollback oid 7 current snap is 5 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 3 2026-02-17T05:28:42.109 INFO:tasks.rados.rados.0.trial118.stdout:87: rollback oid 15 current snap is 5 2026-02-17T05:28:42.110 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 4 2026-02-17T05:28:42.110 INFO:tasks.rados.rados.0.trial118.stdout:88: write oid 30 current snap is 5 2026-02-17T05:28:42.110 INFO:tasks.rados.rados.0.trial118.stdout:88: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-17T05:28:42.112 INFO:tasks.rados.rados.0.trial118.stdout:88: writing trial11845692-30 from 658841 to 1130352 tid 1 2026-02-17T05:28:42.116 INFO:tasks.rados.rados.0.trial118.stdout:88: writing trial11845692-30 from 1553542 to 2261880 tid 2 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:88: writing trial11845692-30 from 2964119 to 3058841 tid 3 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:89: read oid 14 snap -1 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:89: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:90: read oid 18 snap 4 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:90: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:91: snap_create 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:84: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:28:42.120 INFO:tasks.rados.rados.0.trial118.stdout:84: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:86: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:84: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 22 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:86: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:86: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 41 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:87: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:87: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:28:42.121 INFO:tasks.rados.rados.0.trial118.stdout:87: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:28:42.122 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 25 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-17T05:28:42.122 INFO:tasks.rados.rados.0.trial118.stdout:85: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-17T05:28:42.147 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:42.207 INFO:tasks.rados.rados.0.trial118.stdout:88: finishing write tid 1 to trial11845692-30 2026-02-17T05:28:42.207 INFO:tasks.rados.rados.0.trial118.stdout:88: finishing write tid 2 to trial11845692-30 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: finishing write tid 3 to trial11845692-30 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: finishing write tid 4 to trial11845692-30 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: finishing write tid 5 to trial11845692-30 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: oid 30 updating version 0 to 35 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: oid 30 updating version 35 to 36 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: oid 30 version 36 is already newer than 33 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: oid 30 version 36 is already newer than 34 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 36 (ObjNum 63 snap 5 seq_num 63) dirty exists 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:88: left oid 30 (ObjNum 63 snap 5 seq_num 63) 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:89: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-17T05:28:42.208 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:42.246 INFO:tasks.rados.rados.0.trial118.stdout:90: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-17T05:28:42.246 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:42.299 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:84: done (7 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:85: done (6 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:86: done (5 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:87: done (4 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:88: done (3 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:89: done (2 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:90: done (1 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:91: done (0 left) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:92: read oid 18 snap 3 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:92: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:93: copy_from oid 34 from oid 42 current snap is 6 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:94: rollback oid 38 current snap is 6 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 4 2026-02-17T05:28:43.109 INFO:tasks.rados.rados.0.trial118.stdout:95: write (excl) oid 31 current snap is 6 2026-02-17T05:28:43.110 INFO:tasks.rados.rados.0.trial118.stdout:95: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-17T05:28:43.114 INFO:tasks.rados.rados.0.trial118.stdout:95: writing trial11845692-31 from 675648 to 1222408 tid 1 2026-02-17T05:28:43.120 INFO:tasks.rados.rados.0.trial118.stdout:95: writing trial11845692-31 from 2012024 to 2580373 tid 2 2026-02-17T05:28:43.120 INFO:tasks.rados.rados.0.trial118.stdout:96: delete oid 46 current snap is 6 2026-02-17T05:28:43.120 INFO:tasks.rados.rados.0.trial118.stdout:94: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:28:43.120 INFO:tasks.rados.rados.0.trial118.stdout:94: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:28:43.120 INFO:tasks.rados.rados.0.trial118.stdout:94: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:28:43.121 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 22 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-17T05:28:43.121 INFO:tasks.rados.rados.0.trial118.stdout:92: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-17T05:28:43.181 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1325471 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:95: finishing write tid 1 to trial11845692-31 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:93: finishing copy_from racing read to trial11845692-34 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:93: finishing copy_from to trial11845692-34 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 16 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:92: done (4 left) 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:93: done (3 left) 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:94: done (2 left) 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:96: done (1 left) 2026-02-17T05:28:43.200 INFO:tasks.rados.rados.0.trial118.stdout:97: read oid 6 snap -1 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:97: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:98: delete oid 24 current snap is 6 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: finishing write tid 2 to trial11845692-31 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: finishing write tid 3 to trial11845692-31 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: finishing write tid 4 to trial11845692-31 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: oid 31 updating version 0 to 25 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: oid 31 updating version 25 to 26 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: oid 31 version 26 is already newer than 24 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 26 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:28:43.201 INFO:tasks.rados.rados.0.trial118.stdout:95: left oid 31 (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:95: done (2 left) 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:98: done (1 left) 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:99: read oid 13 snap -1 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:99: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:100: read oid 11 snap 3 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:100: expect (ObjNum 10 snap 0 seq_num 10) 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:101: write oid 43 current snap is 6 2026-02-17T05:28:43.202 INFO:tasks.rados.rados.0.trial118.stdout:101: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-17T05:28:43.207 INFO:tasks.rados.rados.0.trial118.stdout:101: writing trial11845692-43 from 726069 to 1498576 tid 1 2026-02-17T05:28:43.212 INFO:tasks.rados.rados.0.trial118.stdout:101: writing trial11845692-43 from 2071117 to 2786793 tid 2 2026-02-17T05:28:43.212 INFO:tasks.rados.rados.0.trial118.stdout:102: read oid 25 snap -1 2026-02-17T05:28:43.212 INFO:tasks.rados.rados.0.trial118.stdout:102: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T05:28:43.212 INFO:tasks.rados.rados.0.trial118.stdout:103: delete oid 21 current snap is 6 2026-02-17T05:28:43.212 INFO:tasks.rados.rados.0.trial118.stdout:97: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-17T05:28:43.224 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:43.252 INFO:tasks.rados.rados.0.trial118.stdout:100: expect (ObjNum 10 snap 0 seq_num 10) 2026-02-17T05:28:43.267 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2056042 2026-02-17T05:28:43.283 INFO:tasks.rados.rados.0.trial118.stdout:99: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-17T05:28:43.285 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1668888 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:101: finishing write tid 1 to trial11845692-43 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:97: done (5 left) 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:99: done (4 left) 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:100: done (3 left) 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:103: done (2 left) 2026-02-17T05:28:43.316 INFO:tasks.rados.rados.0.trial118.stdout:104: snap_remove snap 4 2026-02-17T05:28:44.114 INFO:tasks.rados.rados.0.trial118.stdout:104: done (2 left) 2026-02-17T05:28:44.114 INFO:tasks.rados.rados.0.trial118.stdout:105: delete oid 24 current snap is 6 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: finishing write tid 2 to trial11845692-43 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: finishing write tid 3 to trial11845692-43 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: finishing write tid 4 to trial11845692-43 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: oid 43 updating version 0 to 22 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: oid 43 updating version 22 to 24 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: oid 43 version 24 is already newer than 23 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 24 (ObjNum 67 snap 6 seq_num 67) dirty exists 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:101: left oid 43 (ObjNum 67 snap 6 seq_num 67) 2026-02-17T05:28:44.115 INFO:tasks.rados.rados.0.trial118.stdout:102: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T05:28:44.126 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1422184 2026-02-17T05:28:44.136 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 306736 2026-02-17T05:28:44.151 INFO:tasks.rados.rados.0.trial118.stdout:101: done (2 left) 2026-02-17T05:28:44.151 INFO:tasks.rados.rados.0.trial118.stdout:102: done (1 left) 2026-02-17T05:28:44.151 INFO:tasks.rados.rados.0.trial118.stdout:105: done (0 left) 2026-02-17T05:28:44.151 INFO:tasks.rados.rados.0.trial118.stdout:106: snap_remove snap 3 2026-02-17T05:28:45.114 INFO:tasks.rados.rados.0.trial118.stdout:106: done (0 left) 2026-02-17T05:28:45.114 INFO:tasks.rados.rados.0.trial118.stdout:107: snap_remove snap 2 2026-02-17T05:28:45.280 INFO:tasks.rados.rados.0.trial118.stdout:107: done (0 left) 2026-02-17T05:28:45.281 INFO:tasks.rados.rados.0.trial118.stdout:108: rollback oid 4 current snap is 6 2026-02-17T05:28:45.281 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 5 2026-02-17T05:28:45.281 INFO:tasks.rados.rados.0.trial118.stdout:109: copy_from oid 21 from oid 27 current snap is 6 2026-02-17T05:28:45.281 INFO:tasks.rados.rados.0.trial118.stdout:110: delete oid 5 current snap is 6 2026-02-17T05:28:45.282 INFO:tasks.rados.rados.0.trial118.stdout:110: done (2 left) 2026-02-17T05:28:45.283 INFO:tasks.rados.rados.0.trial118.stdout:111: read oid 28 snap 5 2026-02-17T05:28:45.283 INFO:tasks.rados.rados.0.trial118.stdout:111: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:28:45.283 INFO:tasks.rados.rados.0.trial118.stdout:112: write (excl) oid 35 current snap is 6 2026-02-17T05:28:45.283 INFO:tasks.rados.rados.0.trial118.stdout:112: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-17T05:28:45.289 INFO:tasks.rados.rados.0.trial118.stdout:112: writing trial11845692-35 from 793297 to 1583153 tid 1 2026-02-17T05:28:45.295 INFO:tasks.rados.rados.0.trial118.stdout:112: writing trial11845692-35 from 2305045 to 3028059 tid 2 2026-02-17T05:28:45.295 INFO:tasks.rados.rados.0.trial118.stdout:113: snap_create 2026-02-17T05:28:45.296 INFO:tasks.rados.rados.0.trial118.stdout:108: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:28:45.296 INFO:tasks.rados.rados.0.trial118.stdout:108: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:28:45.296 INFO:tasks.rados.rados.0.trial118.stdout:108: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:28:45.296 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 49 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-17T05:28:45.296 INFO:tasks.rados.rados.0.trial118.stdout:111: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:28:45.297 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1440613 2026-02-17T05:28:45.309 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:109: finishing copy_from racing read to trial11845692-21 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:109: finishing copy_from to trial11845692-21 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 15 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: finishing write tid 1 to trial11845692-35 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: finishing write tid 2 to trial11845692-35 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: finishing write tid 3 to trial11845692-35 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: finishing write tid 4 to trial11845692-35 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: oid 35 updating version 0 to 26 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: oid 35 version 26 is already newer than 25 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: oid 35 version 26 is already newer than 24 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 26 (ObjNum 71 snap 6 seq_num 71) dirty exists 2026-02-17T05:28:45.344 INFO:tasks.rados.rados.0.trial118.stdout:112: left oid 35 (ObjNum 71 snap 6 seq_num 71) 2026-02-17T05:28:46.282 INFO:tasks.rados.rados.0.trial118.stdout:108: done (4 left) 2026-02-17T05:28:46.283 INFO:tasks.rados.rados.0.trial118.stdout:109: done (3 left) 2026-02-17T05:28:46.283 INFO:tasks.rados.rados.0.trial118.stdout:111: done (2 left) 2026-02-17T05:28:46.283 INFO:tasks.rados.rados.0.trial118.stdout:112: done (1 left) 2026-02-17T05:28:46.283 INFO:tasks.rados.rados.0.trial118.stdout:113: done (0 left) 2026-02-17T05:28:46.283 INFO:tasks.rados.rados.0.trial118.stdout:114: snap_create 2026-02-17T05:28:47.283 INFO:tasks.rados.rados.0.trial118.stdout:114: done (0 left) 2026-02-17T05:28:47.283 INFO:tasks.rados.rados.0.trial118.stdout:115: read oid 45 snap -1 2026-02-17T05:28:47.283 INFO:tasks.rados.rados.0.trial118.stdout:115: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-17T05:28:47.283 INFO:tasks.rados.rados.0.trial118.stdout:116: delete oid 41 current snap is 8 2026-02-17T05:28:47.285 INFO:tasks.rados.rados.0.trial118.stdout:116: done (1 left) 2026-02-17T05:28:47.285 INFO:tasks.rados.rados.0.trial118.stdout:117: delete oid 43 current snap is 8 2026-02-17T05:28:47.287 INFO:tasks.rados.rados.0.trial118.stdout:115: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-17T05:28:47.290 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1695992 2026-02-17T05:28:47.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2104333 2026-02-17T05:28:47.331 INFO:tasks.rados.rados.0.trial118.stdout:115: done (1 left) 2026-02-17T05:28:47.332 INFO:tasks.rados.rados.0.trial118.stdout:117: done (0 left) 2026-02-17T05:28:47.332 INFO:tasks.rados.rados.0.trial118.stdout:118: snap_remove snap 5 2026-02-17T05:28:48.287 INFO:tasks.rados.rados.0.trial118.stdout:118: done (0 left) 2026-02-17T05:28:48.287 INFO:tasks.rados.rados.0.trial118.stdout:119: snap_create 2026-02-17T05:28:49.289 INFO:tasks.rados.rados.0.trial118.stdout:119: done (0 left) 2026-02-17T05:28:49.289 INFO:tasks.rados.rados.0.trial118.stdout:120: write oid 41 current snap is 9 2026-02-17T05:28:49.289 INFO:tasks.rados.rados.0.trial118.stdout:120: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-17T05:28:49.293 INFO:tasks.rados.rados.0.trial118.stdout:120: writing trial11845692-41 from 443718 to 1059321 tid 1 2026-02-17T05:28:49.297 INFO:tasks.rados.rados.0.trial118.stdout:120: writing trial11845692-41 from 1564138 to 2034479 tid 2 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:120: writing trial11845692-41 from 2633066 to 3243718 tid 3 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:121: read oid 40 snap -1 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:121: expect deleted 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:122: write oid 19 current snap is 9 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:120: finishing write tid 1 to trial11845692-41 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:120: finishing write tid 2 to trial11845692-41 2026-02-17T05:28:49.302 INFO:tasks.rados.rados.0.trial118.stdout:122: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2026-02-17T05:28:49.306 INFO:tasks.rados.rados.0.trial118.stdout:122: writing trial11845692-19 from 460525 to 1151377 tid 1 2026-02-17T05:28:49.310 INFO:tasks.rados.rados.0.trial118.stdout:122: writing trial11845692-19 from 1622620 to 2352972 tid 2 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:122: writing trial11845692-19 from 3060489 to 3260525 tid 3 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:123: write (excl) oid 16 current snap is 9 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: finishing write tid 3 to trial11845692-41 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: finishing write tid 4 to trial11845692-41 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: finishing write tid 5 to trial11845692-41 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: oid 41 updating version 0 to 58 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: oid 41 updating version 58 to 59 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: oid 41 updating version 59 to 60 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: oid 41 updating version 60 to 61 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 61 (ObjNum 74 snap 9 seq_num 74) dirty exists 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:120: left oid 41 (ObjNum 74 snap 9 seq_num 74) 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:122: finishing write tid 1 to trial11845692-19 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:122: finishing write tid 2 to trial11845692-19 2026-02-17T05:28:49.314 INFO:tasks.rados.rados.0.trial118.stdout:123: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2026-02-17T05:28:49.319 INFO:tasks.rados.rados.0.trial118.stdout:123: writing trial11845692-16 from 477332 to 1243433 tid 1 2026-02-17T05:28:49.322 INFO:tasks.rados.rados.0.trial118.stdout:123: writing trial11845692-16 from 1681102 to 2155112 tid 2 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:123: writing trial11845692-16 from 2687912 to 3277332 tid 3 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:120: done (3 left) 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:121: done (2 left) 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:124: rollback oid 5 current snap is 9 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 5 to 7 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: finishing write tid 3 to trial11845692-19 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: finishing write tid 4 to trial11845692-19 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: finishing write tid 5 to trial11845692-19 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: oid 19 updating version 0 to 26 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: oid 19 updating version 26 to 27 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: oid 19 version 27 is already newer than 25 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: oid 19 updating version 27 to 28 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 28 (ObjNum 75 snap 9 seq_num 75) dirty exists 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: left oid 19 (ObjNum 75 snap 9 seq_num 75) 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:123: finishing write tid 1 to trial11845692-16 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:123: finishing write tid 2 to trial11845692-16 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:122: done (2 left) 2026-02-17T05:28:49.327 INFO:tasks.rados.rados.0.trial118.stdout:125: snap_remove snap 6 2026-02-17T05:28:50.281 INFO:tasks.rados.rados.0.trial118.stdout:125: done (2 left) 2026-02-17T05:28:50.281 INFO:tasks.rados.rados.0.trial118.stdout:126: rollback oid 6 current snap is 9 2026-02-17T05:28:50.281 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 7 2026-02-17T05:28:50.281 INFO:tasks.rados.rados.0.trial118.stdout:124: finishing rollback tid 1 to trial11845692-5 2026-02-17T05:28:50.281 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 0 (ObjNum 129 snap 0 seq_num 12983032) dirty dne 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: finishing write tid 3 to trial11845692-16 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: finishing write tid 4 to trial11845692-16 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: finishing write tid 5 to trial11845692-16 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: oid 16 updating version 0 to 63 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: oid 16 updating version 63 to 66 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: oid 16 version 66 is already newer than 65 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: oid 16 version 66 is already newer than 64 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 66 (ObjNum 76 snap 9 seq_num 76) dirty exists 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: left oid 16 (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:123: done (2 left) 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:124: done (1 left) 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:127: read oid 3 snap -1 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:127: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:128: read oid 25 snap -1 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:128: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:129: rollback oid 9 current snap is 9 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 7 2026-02-17T05:28:50.282 INFO:tasks.rados.rados.0.trial118.stdout:130: snap_create 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:126: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:129: finishing rollback tid 0 to trial11845692-9 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:126: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:126: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 22 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-17T05:28:50.284 INFO:tasks.rados.rados.0.trial118.stdout:129: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:28:50.285 INFO:tasks.rados.rados.0.trial118.stdout:129: finishing rollback tid 2 to trial11845692-9 2026-02-17T05:28:50.285 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 70 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-17T05:28:50.286 INFO:tasks.rados.rados.0.trial118.stdout:128: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-17T05:28:50.294 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1941769 2026-02-17T05:28:50.300 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 799245 2026-02-17T05:28:50.311 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 276132 2026-02-17T05:28:50.326 INFO:tasks.rados.rados.0.trial118.stdout:127: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T05:28:50.336 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:51.282 INFO:tasks.rados.rados.0.trial118.stdout:126: done (4 left) 2026-02-17T05:28:51.282 INFO:tasks.rados.rados.0.trial118.stdout:127: done (3 left) 2026-02-17T05:28:51.282 INFO:tasks.rados.rados.0.trial118.stdout:128: done (2 left) 2026-02-17T05:28:51.283 INFO:tasks.rados.rados.0.trial118.stdout:129: done (1 left) 2026-02-17T05:28:51.283 INFO:tasks.rados.rados.0.trial118.stdout:130: done (0 left) 2026-02-17T05:28:51.283 INFO:tasks.rados.rados.0.trial118.stdout:131: read oid 41 snap 8 2026-02-17T05:28:51.283 INFO:tasks.rados.rados.0.trial118.stdout:131: expect deleted 2026-02-17T05:28:51.283 INFO:tasks.rados.rados.0.trial118.stdout:132: delete oid 38 current snap is 10 2026-02-17T05:28:51.285 INFO:tasks.rados.rados.0.trial118.stdout:131: done (1 left) 2026-02-17T05:28:51.285 INFO:tasks.rados.rados.0.trial118.stdout:132: done (0 left) 2026-02-17T05:28:51.285 INFO:tasks.rados.rados.0.trial118.stdout:133: read oid 8 snap 7 2026-02-17T05:28:51.285 INFO:tasks.rados.rados.0.trial118.stdout:133: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:28:51.285 INFO:tasks.rados.rados.0.trial118.stdout:134: snap_remove snap 9 2026-02-17T05:28:52.283 INFO:tasks.rados.rados.0.trial118.stdout:134: done (1 left) 2026-02-17T05:28:52.283 INFO:tasks.rados.rados.0.trial118.stdout:135: rollback oid 30 current snap is 10 2026-02-17T05:28:52.283 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 30 to 8 2026-02-17T05:28:52.283 INFO:tasks.rados.rados.0.trial118.stdout:133: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:28:52.299 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 394539 2026-02-17T05:28:52.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1405654 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:135: finishing rollback tid 0 to trial11845692-30 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:135: finishing rollback tid 1 to trial11845692-30 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:135: finishing rollback tid 2 to trial11845692-30 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 63 (ObjNum 63 snap 5 seq_num 63) dirty exists 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:133: done (1 left) 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:135: done (0 left) 2026-02-17T05:28:52.323 INFO:tasks.rados.rados.0.trial118.stdout:136: snap_create 2026-02-17T05:28:53.294 INFO:tasks.rados.rados.0.trial118.stdout:136: done (0 left) 2026-02-17T05:28:53.294 INFO:tasks.rados.rados.0.trial118.stdout:137: read oid 9 snap 8 2026-02-17T05:28:53.294 INFO:tasks.rados.rados.0.trial118.stdout:137: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-17T05:28:53.294 INFO:tasks.rados.rados.0.trial118.stdout:138: snap_create 2026-02-17T05:28:53.301 INFO:tasks.rados.rados.0.trial118.stdout:137: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-17T05:28:53.301 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:53.360 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:54.296 INFO:tasks.rados.rados.0.trial118.stdout:137: done (1 left) 2026-02-17T05:28:54.297 INFO:tasks.rados.rados.0.trial118.stdout:138: done (0 left) 2026-02-17T05:28:54.297 INFO:tasks.rados.rados.0.trial118.stdout:139: write oid 12 current snap is 12 2026-02-17T05:28:54.297 INFO:tasks.rados.rados.0.trial118.stdout:139: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2026-02-17T05:28:54.301 INFO:tasks.rados.rados.0.trial118.stdout:139: writing trial11845692-12 from 510946 to 1143898 tid 1 2026-02-17T05:28:54.306 INFO:tasks.rados.rados.0.trial118.stdout:139: writing trial11845692-12 from 1798066 to 2275745 tid 2 2026-02-17T05:28:54.309 INFO:tasks.rados.rados.0.trial118.stdout:139: writing trial11845692-12 from 2742758 to 3199975 tid 3 2026-02-17T05:28:54.310 INFO:tasks.rados.rados.0.trial118.stdout:140: write oid 41 current snap is 12 2026-02-17T05:28:54.310 INFO:tasks.rados.rados.0.trial118.stdout:139: finishing write tid 1 to trial11845692-12 2026-02-17T05:28:54.310 INFO:tasks.rados.rados.0.trial118.stdout:139: finishing write tid 2 to trial11845692-12 2026-02-17T05:28:54.310 INFO:tasks.rados.rados.0.trial118.stdout:140: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-17T05:28:54.314 INFO:tasks.rados.rados.0.trial118.stdout:140: writing trial11845692-41 from 527753 to 1235954 tid 1 2026-02-17T05:28:54.319 INFO:tasks.rados.rados.0.trial118.stdout:140: writing trial11845692-41 from 1856548 to 2594238 tid 2 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:140: writing trial11845692-41 from 3286534 to 3327753 tid 3 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:141: delete oid 33 current snap is 12 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: finishing write tid 3 to trial11845692-12 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: finishing write tid 4 to trial11845692-12 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: finishing write tid 5 to trial11845692-12 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: oid 12 updating version 0 to 44 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: oid 12 version 44 is already newer than 42 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: oid 12 version 44 is already newer than 43 2026-02-17T05:28:54.323 INFO:tasks.rados.rados.0.trial118.stdout:139: oid 12 updating version 44 to 45 2026-02-17T05:28:54.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 45 (ObjNum 78 snap 12 seq_num 78) dirty exists 2026-02-17T05:28:54.324 INFO:tasks.rados.rados.0.trial118.stdout:139: left oid 12 (ObjNum 78 snap 12 seq_num 78) 2026-02-17T05:28:54.324 INFO:tasks.rados.rados.0.trial118.stdout:140: finishing write tid 1 to trial11845692-41 2026-02-17T05:28:54.324 INFO:tasks.rados.rados.0.trial118.stdout:140: finishing write tid 2 to trial11845692-41 2026-02-17T05:28:54.325 INFO:tasks.rados.rados.0.trial118.stdout:140: finishing write tid 3 to trial11845692-41 2026-02-17T05:28:54.325 INFO:tasks.rados.rados.0.trial118.stdout:140: finishing write tid 4 to trial11845692-41 2026-02-17T05:28:54.325 INFO:tasks.rados.rados.0.trial118.stdout:140: finishing write tid 5 to trial11845692-41 2026-02-17T05:28:54.325 INFO:tasks.rados.rados.0.trial118.stdout:140: oid 41 updating version 0 to 79 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:140: oid 41 version 79 is already newer than 77 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:140: oid 41 version 79 is already newer than 76 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:140: oid 41 version 79 is already newer than 78 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 79 (ObjNum 79 snap 12 seq_num 79) dirty exists 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:140: left oid 41 (ObjNum 79 snap 12 seq_num 79) 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:139: done (2 left) 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:140: done (1 left) 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:141: done (0 left) 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:142: read oid 22 snap -1 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:142: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:143: rollback oid 28 current snap is 12 2026-02-17T05:28:54.326 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 8 2026-02-17T05:28:54.327 INFO:tasks.rados.rados.0.trial118.stdout:144: write (excl) oid 23 current snap is 12 2026-02-17T05:28:54.327 INFO:tasks.rados.rados.0.trial118.stdout:144: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2026-02-17T05:28:54.328 INFO:tasks.rados.rados.0.trial118.stdout:144: writing trial11845692-23 from 561367 to 1020066 tid 1 2026-02-17T05:28:54.333 INFO:tasks.rados.rados.0.trial118.stdout:144: writing trial11845692-23 from 1573512 to 2314871 tid 2 2026-02-17T05:28:54.337 INFO:tasks.rados.rados.0.trial118.stdout:144: writing trial11845692-23 from 2941380 to 3361367 tid 3 2026-02-17T05:28:54.337 INFO:tasks.rados.rados.0.trial118.stdout:145: write oid 21 current snap is 12 2026-02-17T05:28:54.337 INFO:tasks.rados.rados.0.trial118.stdout:145: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-17T05:28:54.341 INFO:tasks.rados.rados.0.trial118.stdout:145: writing trial11845692-21 from 578174 to 1112122 tid 1 2026-02-17T05:28:54.344 INFO:tasks.rados.rados.0.trial118.stdout:145: writing trial11845692-21 from 1515641 to 2000658 tid 2 2026-02-17T05:28:54.349 INFO:tasks.rados.rados.0.trial118.stdout:145: writing trial11845692-21 from 2736097 to 3238402 tid 3 2026-02-17T05:28:54.349 INFO:tasks.rados.rados.0.trial118.stdout:146: copy_from oid 18 from oid 16 current snap is 12 2026-02-17T05:28:54.350 INFO:tasks.rados.rados.0.trial118.stdout:142: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:54.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:54.400 INFO:tasks.rados.rados.0.trial118.stdout:143: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:28:54.400 INFO:tasks.rados.rados.0.trial118.stdout:143: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:28:54.400 INFO:tasks.rados.rados.0.trial118.stdout:142: done (4 left) 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:147: delete oid 2 current snap is 12 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:143: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 31 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: finishing write tid 1 to trial11845692-23 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: finishing write tid 2 to trial11845692-23 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: finishing write tid 3 to trial11845692-23 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: finishing write tid 4 to trial11845692-23 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: finishing write tid 5 to trial11845692-23 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: oid 23 updating version 0 to 26 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: oid 23 version 26 is already newer than 24 2026-02-17T05:28:54.401 INFO:tasks.rados.rados.0.trial118.stdout:144: oid 23 updating version 26 to 27 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:144: oid 23 version 27 is already newer than 25 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 27 (ObjNum 81 snap 12 seq_num 81) dirty exists 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:144: left oid 23 (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: finishing write tid 1 to trial11845692-21 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: finishing write tid 2 to trial11845692-21 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: finishing write tid 3 to trial11845692-21 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: finishing write tid 4 to trial11845692-21 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: finishing write tid 5 to trial11845692-21 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: oid 21 updating version 0 to 68 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: oid 21 updating version 68 to 70 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: oid 21 version 70 is already newer than 67 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:145: oid 21 version 70 is already newer than 69 2026-02-17T05:28:54.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 70 (ObjNum 82 snap 12 seq_num 82) dirty exists 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:145: left oid 21 (ObjNum 82 snap 12 seq_num 82) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:146: finishing copy_from racing read to trial11845692-18 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:146: finishing copy_from to trial11845692-18 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 66 (ObjNum 76 snap 9 seq_num 76) dirty exists 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:143: done (4 left) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:144: done (3 left) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:145: done (2 left) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:146: done (1 left) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:147: done (0 left) 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:148: write oid 50 current snap is 12 2026-02-17T05:28:54.403 INFO:tasks.rados.rados.0.trial118.stdout:148: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2026-02-17T05:28:54.404 INFO:tasks.rados.rados.0.trial118.stdout:148: writing trial11845692-50 from 611788 to 1012587 tid 1 2026-02-17T05:28:54.408 INFO:tasks.rados.rados.0.trial118.stdout:148: writing trial11845692-50 from 1748958 to 2237644 tid 2 2026-02-17T05:28:54.413 INFO:tasks.rados.rados.0.trial118.stdout:148: writing trial11845692-50 from 2907296 to 3411788 tid 3 2026-02-17T05:28:54.413 INFO:tasks.rados.rados.0.trial118.stdout:149: write (excl) oid 11 current snap is 12 2026-02-17T05:28:54.413 INFO:tasks.rados.rados.0.trial118.stdout:148: finishing write tid 1 to trial11845692-50 2026-02-17T05:28:54.413 INFO:tasks.rados.rados.0.trial118.stdout:149: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-17T05:28:54.417 INFO:tasks.rados.rados.0.trial118.stdout:149: writing trial11845692-11 from 628595 to 1104643 tid 1 2026-02-17T05:28:54.422 INFO:tasks.rados.rados.0.trial118.stdout:149: writing trial11845692-11 from 1807440 to 2439784 tid 2 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:149: writing trial11845692-11 from 2934719 to 3387193 tid 3 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:150: delete oid 17 current snap is 12 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: finishing write tid 2 to trial11845692-50 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: finishing write tid 3 to trial11845692-50 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: finishing write tid 4 to trial11845692-50 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: finishing write tid 5 to trial11845692-50 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: oid 50 updating version 0 to 49 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: oid 50 version 49 is already newer than 47 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: oid 50 version 49 is already newer than 48 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:148: oid 50 updating version 49 to 50 2026-02-17T05:28:54.427 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 50 (ObjNum 84 snap 12 seq_num 84) dirty exists 2026-02-17T05:28:54.428 INFO:tasks.rados.rados.0.trial118.stdout:148: left oid 50 (ObjNum 84 snap 12 seq_num 84) 2026-02-17T05:28:54.428 INFO:tasks.rados.rados.0.trial118.stdout:149: finishing write tid 1 to trial11845692-11 2026-02-17T05:28:54.428 INFO:tasks.rados.rados.0.trial118.stdout:149: finishing write tid 2 to trial11845692-11 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:149: finishing write tid 3 to trial11845692-11 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:149: finishing write tid 4 to trial11845692-11 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:148: done (2 left) 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:150: done (1 left) 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:151: delete oid 18 current snap is 12 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:149: finishing write tid 5 to trial11845692-11 2026-02-17T05:28:54.429 INFO:tasks.rados.rados.0.trial118.stdout:149: oid 11 updating version 0 to 39 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:149: oid 11 updating version 39 to 40 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:149: oid 11 version 40 is already newer than 38 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:149: oid 11 updating version 40 to 41 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 41 (ObjNum 85 snap 12 seq_num 85) dirty exists 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:149: left oid 11 (ObjNum 85 snap 12 seq_num 85) 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:149: done (1 left) 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:151: done (0 left) 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:152: read oid 7 snap -1 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:152: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T05:28:54.430 INFO:tasks.rados.rados.0.trial118.stdout:153: snap_create 2026-02-17T05:28:54.431 INFO:tasks.rados.rados.0.trial118.stdout:152: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-17T05:28:54.431 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:54.460 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1624593 2026-02-17T05:28:55.284 INFO:tasks.rados.rados.0.trial118.stdout:152: done (1 left) 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:153: done (0 left) 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:154: read oid 22 snap -1 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:154: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:155: read oid 46 snap -1 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:155: expect deleted 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:156: read oid 10 snap -1 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:156: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:157: rollback oid 3 current snap is 13 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 10 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:158: write (excl) oid 21 current snap is 13 2026-02-17T05:28:55.285 INFO:tasks.rados.rados.0.trial118.stdout:158: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-17T05:28:55.289 INFO:tasks.rados.rados.0.trial118.stdout:158: writing trial11845692-21 from 679016 to 1380811 tid 1 2026-02-17T05:28:55.293 INFO:tasks.rados.rados.0.trial118.stdout:158: writing trial11845692-21 from 1866533 to 2362557 tid 2 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:158: writing trial11845692-21 from 2900635 to 3303278 tid 3 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:159: read oid 19 snap -1 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:159: expect (ObjNum 75 snap 9 seq_num 75) 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:160: read oid 38 snap -1 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:160: expect deleted 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:161: read oid 11 snap 12 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:161: expect (ObjNum 85 snap 12 seq_num 85) 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:162: copy_from oid 9 from oid 23 current snap is 13 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:157: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:28:55.298 INFO:tasks.rados.rados.0.trial118.stdout:157: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:28:55.299 INFO:tasks.rados.rados.0.trial118.stdout:154: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-17T05:28:55.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:55.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 566895 2026-02-17T05:28:55.345 INFO:tasks.rados.rados.0.trial118.stdout:157: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:28:55.346 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 34 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-17T05:28:55.346 INFO:tasks.rados.rados.0.trial118.stdout:156: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:158: finishing write tid 1 to trial11845692-21 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:158: finishing write tid 2 to trial11845692-21 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:154: done (8 left) 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:155: done (7 left) 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:156: done (6 left) 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:157: done (5 left) 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:163: copy_from oid 15 from oid 24 current snap is 13 2026-02-17T05:28:55.429 INFO:tasks.rados.rados.0.trial118.stdout:158: finishing write tid 3 to trial11845692-21 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: finishing write tid 4 to trial11845692-21 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: finishing write tid 5 to trial11845692-21 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: oid 21 updating version 0 to 75 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: oid 21 version 75 is already newer than 74 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: oid 21 version 75 is already newer than 73 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: oid 21 version 75 is already newer than 72 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 75 (ObjNum 88 snap 13 seq_num 88) dirty exists 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:158: left oid 21 (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:28:55.430 INFO:tasks.rados.rados.0.trial118.stdout:161: expect (ObjNum 85 snap 12 seq_num 85) 2026-02-17T05:28:55.464 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:55.536 INFO:tasks.rados.rados.0.trial118.stdout:159: expect (ObjNum 75 snap 9 seq_num 75) 2026-02-17T05:28:55.653 INFO:tasks.rados.rados.0.trial118.stdout:162: finishing copy_from racing read to trial11845692-9 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:162: finishing copy_from to trial11845692-9 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 27 (ObjNum 81 snap 12 seq_num 81) dirty exists 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:163: finishing copy_from to trial11845692-15 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:163: got expected ENOENT (src dne) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:163: finishing copy_from racing read to trial11845692-15 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:158: done (5 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:159: done (4 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:160: done (3 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:161: done (2 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:162: done (1 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:163: done (0 left) 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:164: write (excl) oid 48 current snap is 13 2026-02-17T05:28:55.654 INFO:tasks.rados.rados.0.trial118.stdout:164: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-17T05:28:55.659 INFO:tasks.rados.rados.0.trial118.stdout:164: writing trial11845692-48 from 695823 to 1472867 tid 1 2026-02-17T05:28:55.663 INFO:tasks.rados.rados.0.trial118.stdout:164: writing trial11845692-48 from 1925015 to 2564697 tid 2 2026-02-17T05:28:55.666 INFO:tasks.rados.rados.0.trial118.stdout:164: writing trial11845692-48 from 3328058 to 3495823 tid 3 2026-02-17T05:28:55.666 INFO:tasks.rados.rados.0.trial118.stdout:165: write oid 1 current snap is 13 2026-02-17T05:28:55.666 INFO:tasks.rados.rados.0.trial118.stdout:165: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2026-02-17T05:28:55.670 INFO:tasks.rados.rados.0.trial118.stdout:165: writing trial11845692-1 from 712630 to 1164923 tid 1 2026-02-17T05:28:55.674 INFO:tasks.rados.rados.0.trial118.stdout:165: writing trial11845692-1 from 1583497 to 2083190 tid 2 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:165: writing trial11845692-1 from 2555481 to 2980668 tid 3 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:166: snap_create 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: finishing write tid 1 to trial11845692-48 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: finishing write tid 2 to trial11845692-48 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: finishing write tid 3 to trial11845692-48 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: finishing write tid 4 to trial11845692-48 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: finishing write tid 5 to trial11845692-48 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: oid 48 updating version 0 to 35 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: oid 48 updating version 35 to 36 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: oid 48 version 36 is already newer than 33 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: oid 48 version 36 is already newer than 34 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 36 (ObjNum 89 snap 13 seq_num 89) dirty exists 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:164: left oid 48 (ObjNum 89 snap 13 seq_num 89) 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:165: finishing write tid 1 to trial11845692-1 2026-02-17T05:28:55.678 INFO:tasks.rados.rados.0.trial118.stdout:165: finishing write tid 2 to trial11845692-1 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: finishing write tid 3 to trial11845692-1 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: finishing write tid 4 to trial11845692-1 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: finishing write tid 5 to trial11845692-1 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: oid 1 updating version 0 to 76 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: oid 1 updating version 76 to 78 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: oid 1 version 78 is already newer than 77 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: oid 1 updating version 78 to 79 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 79 (ObjNum 90 snap 13 seq_num 90) dirty exists 2026-02-17T05:28:55.679 INFO:tasks.rados.rados.0.trial118.stdout:165: left oid 1 (ObjNum 90 snap 13 seq_num 90) 2026-02-17T05:28:56.301 INFO:tasks.rados.rados.0.trial118.stdout:164: done (2 left) 2026-02-17T05:28:56.301 INFO:tasks.rados.rados.0.trial118.stdout:165: done (1 left) 2026-02-17T05:28:56.302 INFO:tasks.rados.rados.0.trial118.stdout:166: done (0 left) 2026-02-17T05:28:56.302 INFO:tasks.rados.rados.0.trial118.stdout:167: write (excl) oid 19 current snap is 14 2026-02-17T05:28:56.302 INFO:tasks.rados.rados.0.trial118.stdout:167: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-17T05:28:56.306 INFO:tasks.rados.rados.0.trial118.stdout:167: writing trial11845692-19 from 729437 to 1256979 tid 1 2026-02-17T05:28:56.311 INFO:tasks.rados.rados.0.trial118.stdout:167: writing trial11845692-19 from 1925626 to 2568977 tid 2 2026-02-17T05:28:56.315 INFO:tasks.rados.rados.0.trial118.stdout:167: writing trial11845692-19 from 3266551 to 3529437 tid 3 2026-02-17T05:28:56.315 INFO:tasks.rados.rados.0.trial118.stdout:168: snap_create 2026-02-17T05:28:56.315 INFO:tasks.rados.rados.0.trial118.stdout:167: finishing write tid 1 to trial11845692-19 2026-02-17T05:28:56.315 INFO:tasks.rados.rados.0.trial118.stdout:167: finishing write tid 2 to trial11845692-19 2026-02-17T05:28:56.316 INFO:tasks.rados.rados.0.trial118.stdout:167: finishing write tid 3 to trial11845692-19 2026-02-17T05:28:56.316 INFO:tasks.rados.rados.0.trial118.stdout:167: finishing write tid 4 to trial11845692-19 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: finishing write tid 5 to trial11845692-19 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: oid 19 updating version 0 to 36 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: oid 19 updating version 36 to 39 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: oid 19 version 39 is already newer than 38 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: oid 19 version 39 is already newer than 37 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 39 (ObjNum 91 snap 14 seq_num 91) dirty exists 2026-02-17T05:28:56.317 INFO:tasks.rados.rados.0.trial118.stdout:167: left oid 19 (ObjNum 91 snap 14 seq_num 91) 2026-02-17T05:28:57.303 INFO:tasks.rados.rados.0.trial118.stdout:167: done (1 left) 2026-02-17T05:28:57.304 INFO:tasks.rados.rados.0.trial118.stdout:168: done (0 left) 2026-02-17T05:28:57.304 INFO:tasks.rados.rados.0.trial118.stdout:169: write (excl) oid 38 current snap is 15 2026-02-17T05:28:57.304 INFO:tasks.rados.rados.0.trial118.stdout:169: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2026-02-17T05:28:57.309 INFO:tasks.rados.rados.0.trial118.stdout:169: writing trial11845692-38 from 746244 to 1465388 tid 1 2026-02-17T05:28:57.314 INFO:tasks.rados.rados.0.trial118.stdout:169: writing trial11845692-38 from 2100461 to 2603823 tid 2 2026-02-17T05:28:57.318 INFO:tasks.rados.rados.0.trial118.stdout:169: writing trial11845692-38 from 3126680 to 3546244 tid 3 2026-02-17T05:28:57.318 INFO:tasks.rados.rados.0.trial118.stdout:170: read oid 3 snap 14 2026-02-17T05:28:57.318 INFO:tasks.rados.rados.0.trial118.stdout:170: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T05:28:57.319 INFO:tasks.rados.rados.0.trial118.stdout:171: snap_create 2026-02-17T05:28:57.319 INFO:tasks.rados.rados.0.trial118.stdout:169: finishing write tid 1 to trial11845692-38 2026-02-17T05:28:57.319 INFO:tasks.rados.rados.0.trial118.stdout:169: finishing write tid 2 to trial11845692-38 2026-02-17T05:28:57.320 INFO:tasks.rados.rados.0.trial118.stdout:169: finishing write tid 3 to trial11845692-38 2026-02-17T05:28:57.321 INFO:tasks.rados.rados.0.trial118.stdout:169: finishing write tid 4 to trial11845692-38 2026-02-17T05:28:57.321 INFO:tasks.rados.rados.0.trial118.stdout:169: finishing write tid 5 to trial11845692-38 2026-02-17T05:28:57.321 INFO:tasks.rados.rados.0.trial118.stdout:169: oid 38 updating version 0 to 37 2026-02-17T05:28:57.321 INFO:tasks.rados.rados.0.trial118.stdout:169: oid 38 version 37 is already newer than 35 2026-02-17T05:28:57.321 INFO:tasks.rados.rados.0.trial118.stdout:169: oid 38 updating version 37 to 38 2026-02-17T05:28:57.322 INFO:tasks.rados.rados.0.trial118.stdout:169: oid 38 version 38 is already newer than 36 2026-02-17T05:28:57.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 38 (ObjNum 92 snap 15 seq_num 92) dirty exists 2026-02-17T05:28:57.322 INFO:tasks.rados.rados.0.trial118.stdout:169: left oid 38 (ObjNum 92 snap 15 seq_num 92) 2026-02-17T05:28:57.323 INFO:tasks.rados.rados.0.trial118.stdout:170: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-17T05:28:57.323 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1134247 2026-02-17T05:28:57.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:28:58.306 INFO:tasks.rados.rados.0.trial118.stdout:169: done (2 left) 2026-02-17T05:28:58.306 INFO:tasks.rados.rados.0.trial118.stdout:170: done (1 left) 2026-02-17T05:28:58.306 INFO:tasks.rados.rados.0.trial118.stdout:171: done (0 left) 2026-02-17T05:28:58.306 INFO:tasks.rados.rados.0.trial118.stdout:172: copy_from oid 10 from oid 12 current snap is 16 2026-02-17T05:28:58.306 INFO:tasks.rados.rados.0.trial118.stdout:173: snap_remove snap 8 2026-02-17T05:28:59.306 INFO:tasks.rados.rados.0.trial118.stdout:173: done (1 left) 2026-02-17T05:28:59.306 INFO:tasks.rados.rados.0.trial118.stdout:174: write (excl) oid 15 current snap is 16 2026-02-17T05:28:59.306 INFO:tasks.rados.rados.0.trial118.stdout:174: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-17T05:28:59.314 INFO:tasks.rados.rados.0.trial118.stdout:174: writing trial11845692-15 from 763051 to 1557444 tid 1 2026-02-17T05:28:59.318 INFO:tasks.rados.rados.0.trial118.stdout:174: writing trial11845692-15 from 2158943 to 2805963 tid 2 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:174: writing trial11845692-15 from 3437750 to 3563051 tid 3 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:175: snap_create 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:172: finishing copy_from racing read to trial11845692-10 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:172: finishing copy_from to trial11845692-10 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 45 (ObjNum 78 snap 12 seq_num 78) dirty exists 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:174: finishing write tid 1 to trial11845692-15 2026-02-17T05:28:59.321 INFO:tasks.rados.rados.0.trial118.stdout:174: finishing write tid 2 to trial11845692-15 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: finishing write tid 3 to trial11845692-15 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: finishing write tid 4 to trial11845692-15 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: finishing write tid 5 to trial11845692-15 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: oid 15 updating version 0 to 40 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: oid 15 updating version 40 to 41 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: oid 15 updating version 41 to 42 2026-02-17T05:28:59.322 INFO:tasks.rados.rados.0.trial118.stdout:174: oid 15 updating version 42 to 43 2026-02-17T05:28:59.323 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 43 (ObjNum 93 snap 16 seq_num 93) dirty exists 2026-02-17T05:28:59.323 INFO:tasks.rados.rados.0.trial118.stdout:174: left oid 15 (ObjNum 93 snap 16 seq_num 93) 2026-02-17T05:29:00.283 INFO:tasks.rados.rados.0.trial118.stdout:172: done (2 left) 2026-02-17T05:29:00.283 INFO:tasks.rados.rados.0.trial118.stdout:174: done (1 left) 2026-02-17T05:29:00.283 INFO:tasks.rados.rados.0.trial118.stdout:175: done (0 left) 2026-02-17T05:29:00.283 INFO:tasks.rados.rados.0.trial118.stdout:176: write (excl) oid 34 current snap is 17 2026-02-17T05:29:00.283 INFO:tasks.rados.rados.0.trial118.stdout:176: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2026-02-17T05:29:00.288 INFO:tasks.rados.rados.0.trial118.stdout:176: writing trial11845692-34 from 779858 to 1249500 tid 1 2026-02-17T05:29:00.293 INFO:tasks.rados.rados.0.trial118.stdout:176: writing trial11845692-34 from 1817425 to 2324456 tid 2 2026-02-17T05:29:00.297 INFO:tasks.rados.rados.0.trial118.stdout:176: writing trial11845692-34 from 2781526 to 3368154 tid 3 2026-02-17T05:29:00.297 INFO:tasks.rados.rados.0.trial118.stdout:177: snap_remove snap 14 2026-02-17T05:29:01.283 INFO:tasks.rados.rados.0.trial118.stdout:177: done (1 left) 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:178: copy_from oid 1 from oid 23 current snap is 17 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: finishing write tid 1 to trial11845692-34 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: finishing write tid 2 to trial11845692-34 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: finishing write tid 3 to trial11845692-34 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: finishing write tid 4 to trial11845692-34 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: finishing write tid 5 to trial11845692-34 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: oid 34 updating version 0 to 71 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: oid 34 version 71 is already newer than 69 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: oid 34 version 71 is already newer than 68 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: oid 34 version 71 is already newer than 70 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 71 (ObjNum 94 snap 17 seq_num 94) dirty exists 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: left oid 34 (ObjNum 94 snap 17 seq_num 94) 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:176: done (1 left) 2026-02-17T05:29:01.284 INFO:tasks.rados.rados.0.trial118.stdout:179: snap_create 2026-02-17T05:29:01.293 INFO:tasks.rados.rados.0.trial118.stdout:178: finishing copy_from racing read to trial11845692-1 2026-02-17T05:29:01.295 INFO:tasks.rados.rados.0.trial118.stdout:178: finishing copy_from to trial11845692-1 2026-02-17T05:29:01.296 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 27 (ObjNum 81 snap 12 seq_num 81) dirty exists 2026-02-17T05:29:02.284 INFO:tasks.rados.rados.0.trial118.stdout:178: done (1 left) 2026-02-17T05:29:02.284 INFO:tasks.rados.rados.0.trial118.stdout:179: done (0 left) 2026-02-17T05:29:02.284 INFO:tasks.rados.rados.0.trial118.stdout:180: write (excl) oid 23 current snap is 18 2026-02-17T05:29:02.284 INFO:tasks.rados.rados.0.trial118.stdout:180: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2026-02-17T05:29:02.290 INFO:tasks.rados.rados.0.trial118.stdout:180: writing trial11845692-23 from 796665 to 1341556 tid 1 2026-02-17T05:29:02.294 INFO:tasks.rados.rados.0.trial118.stdout:180: writing trial11845692-23 from 1759554 to 2410243 tid 2 2026-02-17T05:29:02.299 INFO:tasks.rados.rados.0.trial118.stdout:180: writing trial11845692-23 from 2976243 to 3596665 tid 3 2026-02-17T05:29:02.299 INFO:tasks.rados.rados.0.trial118.stdout:181: snap_create 2026-02-17T05:29:02.299 INFO:tasks.rados.rados.0.trial118.stdout:180: finishing write tid 1 to trial11845692-23 2026-02-17T05:29:02.299 INFO:tasks.rados.rados.0.trial118.stdout:180: finishing write tid 2 to trial11845692-23 2026-02-17T05:29:02.300 INFO:tasks.rados.rados.0.trial118.stdout:180: finishing write tid 3 to trial11845692-23 2026-02-17T05:29:02.300 INFO:tasks.rados.rados.0.trial118.stdout:180: finishing write tid 4 to trial11845692-23 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: finishing write tid 5 to trial11845692-23 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: oid 23 updating version 0 to 33 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: oid 23 updating version 33 to 35 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: oid 23 updating version 35 to 36 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: oid 23 version 36 is already newer than 34 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 36 (ObjNum 95 snap 18 seq_num 95) dirty exists 2026-02-17T05:29:02.301 INFO:tasks.rados.rados.0.trial118.stdout:180: left oid 23 (ObjNum 95 snap 18 seq_num 95) 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:180: done (1 left) 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:181: done (0 left) 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:182: read oid 10 snap 12 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:182: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:183: rollback oid 43 current snap is 19 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 10 2026-02-17T05:29:03.286 INFO:tasks.rados.rados.0.trial118.stdout:184: snap_create 2026-02-17T05:29:03.287 INFO:tasks.rados.rados.0.trial118.stdout:183: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:29:03.288 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 36 (ObjNum 49 snap 0 seq_num 12903408) dirty dne 2026-02-17T05:29:03.294 INFO:tasks.rados.rados.0.trial118.stdout:182: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-17T05:29:03.299 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 698968 2026-02-17T05:29:03.322 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:03.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:04.288 INFO:tasks.rados.rados.0.trial118.stdout:182: done (2 left) 2026-02-17T05:29:04.288 INFO:tasks.rados.rados.0.trial118.stdout:183: done (1 left) 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:184: done (0 left) 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:185: read oid 23 snap -1 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:185: expect (ObjNum 95 snap 18 seq_num 95) 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:186: read oid 10 snap -1 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:186: expect (ObjNum 78 snap 12 seq_num 78) 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:187: read oid 34 snap -1 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:187: expect (ObjNum 94 snap 17 seq_num 94) 2026-02-17T05:29:04.289 INFO:tasks.rados.rados.0.trial118.stdout:188: snap_create 2026-02-17T05:29:04.292 INFO:tasks.rados.rados.0.trial118.stdout:185: expect (ObjNum 95 snap 18 seq_num 95) 2026-02-17T05:29:04.411 INFO:tasks.rados.rados.0.trial118.stdout:186: expect (ObjNum 78 snap 12 seq_num 78) 2026-02-17T05:29:04.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:04.563 INFO:tasks.rados.rados.0.trial118.stdout:187: expect (ObjNum 94 snap 17 seq_num 94) 2026-02-17T05:29:04.594 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:05.289 INFO:tasks.rados.rados.0.trial118.stdout:185: done (3 left) 2026-02-17T05:29:05.290 INFO:tasks.rados.rados.0.trial118.stdout:186: done (2 left) 2026-02-17T05:29:05.290 INFO:tasks.rados.rados.0.trial118.stdout:187: done (1 left) 2026-02-17T05:29:05.290 INFO:tasks.rados.rados.0.trial118.stdout:188: done (0 left) 2026-02-17T05:29:05.290 INFO:tasks.rados.rados.0.trial118.stdout:189: write (excl) oid 25 current snap is 21 2026-02-17T05:29:05.290 INFO:tasks.rados.rados.0.trial118.stdout:189: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2026-02-17T05:29:05.293 INFO:tasks.rados.rados.0.trial118.stdout:189: writing trial11845692-25 from 413472 to 1033612 tid 1 2026-02-17T05:29:05.298 INFO:tasks.rados.rados.0.trial118.stdout:189: writing trial11845692-25 from 1818036 to 2328736 tid 2 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:189: writing trial11845692-25 from 3120019 to 3613472 tid 3 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:189: finishing write tid 1 to trial11845692-25 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:189: finishing write tid 2 to trial11845692-25 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:190: read oid 19 snap -1 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:190: expect (ObjNum 91 snap 14 seq_num 91) 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:191: copy_from oid 13 from oid 10 current snap is 21 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:192: read oid 43 snap -1 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:192: expect deleted 2026-02-17T05:29:05.303 INFO:tasks.rados.rados.0.trial118.stdout:193: snap_remove snap 11 2026-02-17T05:29:06.295 INFO:tasks.rados.rados.0.trial118.stdout:193: done (4 left) 2026-02-17T05:29:06.295 INFO:tasks.rados.rados.0.trial118.stdout:194: read oid 8 snap 20 2026-02-17T05:29:06.295 INFO:tasks.rados.rados.0.trial118.stdout:194: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:29:06.295 INFO:tasks.rados.rados.0.trial118.stdout:195: write oid 20 current snap is 21 2026-02-17T05:29:06.295 INFO:tasks.rados.rados.0.trial118.stdout:195: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2026-02-17T05:29:06.299 INFO:tasks.rados.rados.0.trial118.stdout:195: writing trial11845692-20 from 430279 to 1125668 tid 1 2026-02-17T05:29:06.304 INFO:tasks.rados.rados.0.trial118.stdout:195: writing trial11845692-20 from 1876518 to 2530876 tid 2 2026-02-17T05:29:06.308 INFO:tasks.rados.rados.0.trial118.stdout:195: writing trial11845692-20 from 3031089 to 3567886 tid 3 2026-02-17T05:29:06.308 INFO:tasks.rados.rados.0.trial118.stdout:192: done (5 left) 2026-02-17T05:29:06.308 INFO:tasks.rados.rados.0.trial118.stdout:196: write oid 46 current snap is 21 2026-02-17T05:29:06.308 INFO:tasks.rados.rados.0.trial118.stdout:196: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2026-02-17T05:29:06.313 INFO:tasks.rados.rados.0.trial118.stdout:196: writing trial11845692-46 from 447086 to 1217724 tid 1 2026-02-17T05:29:06.318 INFO:tasks.rados.rados.0.trial118.stdout:196: writing trial11845692-46 from 1935000 to 2733016 tid 2 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:196: writing trial11845692-46 from 3458512 to 3647086 tid 3 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:197: delete oid 49 current snap is 21 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: finishing write tid 3 to trial11845692-25 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: finishing write tid 4 to trial11845692-25 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: finishing write tid 5 to trial11845692-25 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: oid 25 updating version 0 to 92 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: oid 25 version 92 is already newer than 91 2026-02-17T05:29:06.323 INFO:tasks.rados.rados.0.trial118.stdout:189: oid 25 version 92 is already newer than 90 2026-02-17T05:29:06.324 INFO:tasks.rados.rados.0.trial118.stdout:189: oid 25 version 92 is already newer than 89 2026-02-17T05:29:06.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 92 (ObjNum 96 snap 21 seq_num 96) dirty exists 2026-02-17T05:29:06.324 INFO:tasks.rados.rados.0.trial118.stdout:189: left oid 25 (ObjNum 96 snap 21 seq_num 96) 2026-02-17T05:29:06.324 INFO:tasks.rados.rados.0.trial118.stdout:190: expect (ObjNum 91 snap 14 seq_num 91) 2026-02-17T05:29:06.324 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:06.427 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:06.481 INFO:tasks.rados.rados.0.trial118.stdout:191: finishing copy_from racing read to trial11845692-13 2026-02-17T05:29:06.481 INFO:tasks.rados.rados.0.trial118.stdout:191: finishing copy_from to trial11845692-13 2026-02-17T05:29:06.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 45 (ObjNum 78 snap 12 seq_num 78) dirty exists 2026-02-17T05:29:06.481 INFO:tasks.rados.rados.0.trial118.stdout:194: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:29:06.488 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1992097 2026-02-17T05:29:06.489 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 432937 2026-02-17T05:29:06.502 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:195: finishing write tid 1 to trial11845692-20 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:189: done (6 left) 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:190: done (5 left) 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:191: done (4 left) 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:194: done (3 left) 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:197: done (2 left) 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:198: read oid 24 snap 19 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:198: expect deleted 2026-02-17T05:29:06.519 INFO:tasks.rados.rados.0.trial118.stdout:199: snap_create 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: finishing write tid 2 to trial11845692-20 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: finishing write tid 3 to trial11845692-20 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: finishing write tid 4 to trial11845692-20 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: finishing write tid 5 to trial11845692-20 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: oid 20 updating version 0 to 52 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: oid 20 version 52 is already newer than 51 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: oid 20 updating version 52 to 53 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: oid 20 updating version 53 to 54 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 54 (ObjNum 97 snap 21 seq_num 97) dirty exists 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:195: left oid 20 (ObjNum 97 snap 21 seq_num 97) 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:196: finishing write tid 1 to trial11845692-46 2026-02-17T05:29:06.520 INFO:tasks.rados.rados.0.trial118.stdout:196: finishing write tid 2 to trial11845692-46 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: finishing write tid 3 to trial11845692-46 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: finishing write tid 4 to trial11845692-46 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: finishing write tid 5 to trial11845692-46 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: oid 46 updating version 0 to 23 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: oid 46 updating version 23 to 26 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: oid 46 version 26 is already newer than 24 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: oid 46 version 26 is already newer than 25 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 26 (ObjNum 98 snap 21 seq_num 98) dirty exists 2026-02-17T05:29:06.521 INFO:tasks.rados.rados.0.trial118.stdout:196: left oid 46 (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:195: done (3 left) 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:196: done (2 left) 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:198: done (1 left) 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:199: done (0 left) 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:200: rollback oid 40 current snap is 22 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 19 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:201: rollback oid 1 current snap is 22 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 7 2026-02-17T05:29:07.296 INFO:tasks.rados.rados.0.trial118.stdout:202: delete oid 15 current snap is 22 2026-02-17T05:29:07.297 INFO:tasks.rados.rados.0.trial118.stdout:200: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:29:07.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:200: done (2 left) 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:202: done (1 left) 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:203: rollback oid 42 current snap is 22 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 7 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:204: delete oid 10 current snap is 22 2026-02-17T05:29:07.299 INFO:tasks.rados.rados.0.trial118.stdout:201: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:29:07.300 INFO:tasks.rados.rados.0.trial118.stdout:201: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:29:07.300 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 101 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:203: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:203: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:203: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 44 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:201: done (2 left) 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:203: done (1 left) 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:204: done (0 left) 2026-02-17T05:29:07.301 INFO:tasks.rados.rados.0.trial118.stdout:205: snap_remove snap 20 2026-02-17T05:29:08.300 INFO:tasks.rados.rados.0.trial118.stdout:205: done (0 left) 2026-02-17T05:29:08.300 INFO:tasks.rados.rados.0.trial118.stdout:206: rollback oid 29 current snap is 22 2026-02-17T05:29:08.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 17 2026-02-17T05:29:08.300 INFO:tasks.rados.rados.0.trial118.stdout:207: delete oid 39 current snap is 22 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:207: done (1 left) 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:208: delete oid 6 current snap is 22 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:206: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:206: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:206: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 93 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:206: done (1 left) 2026-02-17T05:29:08.303 INFO:tasks.rados.rados.0.trial118.stdout:208: done (0 left) 2026-02-17T05:29:08.304 INFO:tasks.rados.rados.0.trial118.stdout:209: write (excl) oid 30 current snap is 22 2026-02-17T05:29:08.304 INFO:tasks.rados.rados.0.trial118.stdout:209: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2026-02-17T05:29:08.307 INFO:tasks.rados.rados.0.trial118.stdout:209: writing trial11845692-30 from 547928 to 1086413 tid 1 2026-02-17T05:29:08.312 INFO:tasks.rados.rados.0.trial118.stdout:209: writing trial11845692-30 from 1769539 to 2178562 tid 2 2026-02-17T05:29:08.316 INFO:tasks.rados.rados.0.trial118.stdout:209: writing trial11845692-30 from 2706697 to 3238751 tid 3 2026-02-17T05:29:08.316 INFO:tasks.rados.rados.0.trial118.stdout:210: copy_from oid 41 from oid 19 current snap is 22 2026-02-17T05:29:08.316 INFO:tasks.rados.rados.0.trial118.stdout:209: finishing write tid 1 to trial11845692-30 2026-02-17T05:29:08.316 INFO:tasks.rados.rados.0.trial118.stdout:209: finishing write tid 2 to trial11845692-30 2026-02-17T05:29:08.316 INFO:tasks.rados.rados.0.trial118.stdout:211: snap_create 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: finishing write tid 3 to trial11845692-30 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: finishing write tid 4 to trial11845692-30 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: finishing write tid 5 to trial11845692-30 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: oid 30 updating version 0 to 110 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: oid 30 version 110 is already newer than 109 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: oid 30 version 110 is already newer than 107 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: oid 30 version 110 is already newer than 108 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 110 (ObjNum 104 snap 22 seq_num 104) dirty exists 2026-02-17T05:29:08.318 INFO:tasks.rados.rados.0.trial118.stdout:209: left oid 30 (ObjNum 104 snap 22 seq_num 104) 2026-02-17T05:29:08.326 INFO:tasks.rados.rados.0.trial118.stdout:210: finishing copy_from racing read to trial11845692-41 2026-02-17T05:29:08.328 INFO:tasks.rados.rados.0.trial118.stdout:210: finishing copy_from to trial11845692-41 2026-02-17T05:29:08.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 39 (ObjNum 91 snap 14 seq_num 91) dirty exists 2026-02-17T05:29:09.303 INFO:tasks.rados.rados.0.trial118.stdout:209: done (2 left) 2026-02-17T05:29:09.303 INFO:tasks.rados.rados.0.trial118.stdout:210: done (1 left) 2026-02-17T05:29:09.303 INFO:tasks.rados.rados.0.trial118.stdout:211: done (0 left) 2026-02-17T05:29:09.303 INFO:tasks.rados.rados.0.trial118.stdout:212: rollback oid 1 current snap is 23 2026-02-17T05:29:09.303 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 17 2026-02-17T05:29:09.304 INFO:tasks.rados.rados.0.trial118.stdout:213: rollback oid 42 current snap is 23 2026-02-17T05:29:09.304 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 19 2026-02-17T05:29:09.304 INFO:tasks.rados.rados.0.trial118.stdout:214: copy_from oid 6 from oid 30 current snap is 23 2026-02-17T05:29:09.304 INFO:tasks.rados.rados.0.trial118.stdout:215: write oid 38 current snap is 23 2026-02-17T05:29:09.304 INFO:tasks.rados.rados.0.trial118.stdout:215: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2026-02-17T05:29:09.307 INFO:tasks.rados.rados.0.trial118.stdout:215: writing trial11845692-38 from 564735 to 1178469 tid 1 2026-02-17T05:29:09.312 INFO:tasks.rados.rados.0.trial118.stdout:215: writing trial11845692-38 from 1828021 to 2497055 tid 2 2026-02-17T05:29:09.317 INFO:tasks.rados.rados.0.trial118.stdout:215: writing trial11845692-38 from 3134120 to 3764735 tid 3 2026-02-17T05:29:09.317 INFO:tasks.rados.rados.0.trial118.stdout:216: snap_remove snap 10 2026-02-17T05:29:10.284 INFO:tasks.rados.rados.0.trial118.stdout:216: done (4 left) 2026-02-17T05:29:10.284 INFO:tasks.rados.rados.0.trial118.stdout:217: read oid 27 snap 7 2026-02-17T05:29:10.284 INFO:tasks.rados.rados.0.trial118.stdout:217: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-17T05:29:10.284 INFO:tasks.rados.rados.0.trial118.stdout:218: write oid 45 current snap is 23 2026-02-17T05:29:10.284 INFO:tasks.rados.rados.0.trial118.stdout:218: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2026-02-17T05:29:10.289 INFO:tasks.rados.rados.0.trial118.stdout:218: writing trial11845692-45 from 581542 to 1270525 tid 1 2026-02-17T05:29:10.293 INFO:tasks.rados.rados.0.trial118.stdout:218: writing trial11845692-45 from 1886503 to 2299195 tid 2 2026-02-17T05:29:10.297 INFO:tasks.rados.rados.0.trial118.stdout:218: writing trial11845692-45 from 2761543 to 3432494 tid 3 2026-02-17T05:29:10.297 INFO:tasks.rados.rados.0.trial118.stdout:219: rollback oid 49 current snap is 23 2026-02-17T05:29:10.297 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 22 2026-02-17T05:29:10.298 INFO:tasks.rados.rados.0.trial118.stdout:213: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:29:10.298 INFO:tasks.rados.rados.0.trial118.stdout:220: read oid 8 snap -1 2026-02-17T05:29:10.298 INFO:tasks.rados.rados.0.trial118.stdout:220: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:29:10.298 INFO:tasks.rados.rados.0.trial118.stdout:221: snap_remove snap 12 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:221: done (8 left) 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:222: copy_from oid 15 from oid 46 current snap is 23 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:213: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:213: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 52 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:212: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:212: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:29:11.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 112 (ObjNum 81 snap 12 seq_num 81) dirty exists 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: finishing write tid 1 to trial11845692-38 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: finishing write tid 2 to trial11845692-38 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:214: finishing copy_from racing read to trial11845692-6 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:214: finishing copy_from to trial11845692-6 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 110 (ObjNum 104 snap 22 seq_num 104) dirty exists 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: finishing write tid 3 to trial11845692-38 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: finishing write tid 4 to trial11845692-38 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: finishing write tid 5 to trial11845692-38 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: oid 38 updating version 0 to 56 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: oid 38 version 56 is already newer than 55 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: oid 38 version 56 is already newer than 54 2026-02-17T05:29:11.287 INFO:tasks.rados.rados.0.trial118.stdout:215: oid 38 updating version 56 to 57 2026-02-17T05:29:11.288 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 57 (ObjNum 105 snap 23 seq_num 105) dirty exists 2026-02-17T05:29:11.288 INFO:tasks.rados.rados.0.trial118.stdout:215: left oid 38 (ObjNum 105 snap 23 seq_num 105) 2026-02-17T05:29:11.288 INFO:tasks.rados.rados.0.trial118.stdout:217: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-17T05:29:11.288 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:11.313 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:11.330 INFO:tasks.rados.rados.0.trial118.stdout:218: finishing write tid 1 to trial11845692-45 2026-02-17T05:29:11.330 INFO:tasks.rados.rados.0.trial118.stdout:218: finishing write tid 2 to trial11845692-45 2026-02-17T05:29:11.330 INFO:tasks.rados.rados.0.trial118.stdout:220: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-17T05:29:11.358 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1548857 2026-02-17T05:29:11.366 INFO:tasks.rados.rados.0.trial118.stdout:219: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 46 (ObjNum 529 snap 0 seq_num 12873969) dirty dne 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: finishing write tid 3 to trial11845692-45 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: finishing write tid 4 to trial11845692-45 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: finishing write tid 5 to trial11845692-45 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: oid 45 updating version 0 to 59 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: oid 45 updating version 59 to 60 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: oid 45 updating version 60 to 61 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: oid 45 updating version 61 to 62 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 62 (ObjNum 106 snap 23 seq_num 106) dirty exists 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:218: left oid 45 (ObjNum 106 snap 23 seq_num 106) 2026-02-17T05:29:11.367 INFO:tasks.rados.rados.0.trial118.stdout:222: finishing copy_from racing read to trial11845692-15 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:222: finishing copy_from to trial11845692-15 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 26 (ObjNum 98 snap 21 seq_num 98) dirty exists 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:212: done (8 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:213: done (7 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:214: done (6 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:215: done (5 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:217: done (4 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:218: done (3 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:219: done (2 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:220: done (1 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:222: done (0 left) 2026-02-17T05:29:11.368 INFO:tasks.rados.rados.0.trial118.stdout:223: rollback oid 50 current snap is 23 2026-02-17T05:29:11.369 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 7 2026-02-17T05:29:11.369 INFO:tasks.rados.rados.0.trial118.stdout:224: delete oid 43 current snap is 23 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:223: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:223: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:223: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 67 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:223: done (1 left) 2026-02-17T05:29:11.370 INFO:tasks.rados.rados.0.trial118.stdout:224: done (0 left) 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:225: rollback oid 26 current snap is 23 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 22 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:226: delete oid 7 current snap is 23 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:225: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:225: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:225: finishing rollback tid 2 to trial11845692-26 2026-02-17T05:29:11.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 7 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:225: done (1 left) 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:226: done (0 left) 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:227: read oid 26 snap 22 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:227: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:228: delete oid 22 current snap is 23 2026-02-17T05:29:11.372 INFO:tasks.rados.rados.0.trial118.stdout:228: done (1 left) 2026-02-17T05:29:11.373 INFO:tasks.rados.rados.0.trial118.stdout:229: write oid 42 current snap is 23 2026-02-17T05:29:11.373 INFO:tasks.rados.rados.0.trial118.stdout:229: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-17T05:29:11.377 INFO:tasks.rados.rados.0.trial118.stdout:229: writing trial11845692-42 from 648770 to 1355102 tid 1 2026-02-17T05:29:11.382 INFO:tasks.rados.rados.0.trial118.stdout:229: writing trial11845692-42 from 2120431 to 2540461 tid 2 2026-02-17T05:29:11.386 INFO:tasks.rados.rados.0.trial118.stdout:229: writing trial11845692-42 from 3271235 to 3703627 tid 3 2026-02-17T05:29:11.386 INFO:tasks.rados.rados.0.trial118.stdout:230: copy_from oid 28 from oid 18 current snap is 23 2026-02-17T05:29:11.386 INFO:tasks.rados.rados.0.trial118.stdout:227: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-17T05:29:11.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2207340 2026-02-17T05:29:11.424 INFO:tasks.rados.rados.0.trial118.stdout:229: finishing write tid 1 to trial11845692-42 2026-02-17T05:29:11.424 INFO:tasks.rados.rados.0.trial118.stdout:229: finishing write tid 2 to trial11845692-42 2026-02-17T05:29:11.424 INFO:tasks.rados.rados.0.trial118.stdout:230: finishing copy_from to trial11845692-28 2026-02-17T05:29:11.424 INFO:tasks.rados.rados.0.trial118.stdout:230: got expected ENOENT (src dne) 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:230: finishing copy_from racing read to trial11845692-28 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:227: done (2 left) 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:230: done (1 left) 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:231: read oid 34 snap -1 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:231: expect (ObjNum 94 snap 17 seq_num 94) 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:232: write oid 7 current snap is 23 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:229: finishing write tid 3 to trial11845692-42 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:229: finishing write tid 4 to trial11845692-42 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:229: finishing write tid 5 to trial11845692-42 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:229: oid 42 updating version 0 to 69 2026-02-17T05:29:11.425 INFO:tasks.rados.rados.0.trial118.stdout:229: oid 42 version 69 is already newer than 66 2026-02-17T05:29:11.426 INFO:tasks.rados.rados.0.trial118.stdout:229: oid 42 version 69 is already newer than 67 2026-02-17T05:29:11.426 INFO:tasks.rados.rados.0.trial118.stdout:229: oid 42 version 69 is already newer than 68 2026-02-17T05:29:11.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 69 (ObjNum 110 snap 23 seq_num 110) dirty exists 2026-02-17T05:29:11.426 INFO:tasks.rados.rados.0.trial118.stdout:229: left oid 42 (ObjNum 110 snap 23 seq_num 110) 2026-02-17T05:29:11.426 INFO:tasks.rados.rados.0.trial118.stdout:232: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-17T05:29:11.429 INFO:tasks.rados.rados.0.trial118.stdout:232: writing trial11845692-7 from 665577 to 1447158 tid 1 2026-02-17T05:29:11.434 INFO:tasks.rados.rados.0.trial118.stdout:232: writing trial11845692-7 from 2062560 to 2626248 tid 2 2026-02-17T05:29:11.438 INFO:tasks.rados.rados.0.trial118.stdout:232: writing trial11845692-7 from 3182305 to 3825969 tid 3 2026-02-17T05:29:11.439 INFO:tasks.rados.rados.0.trial118.stdout:229: done (2 left) 2026-02-17T05:29:11.439 INFO:tasks.rados.rados.0.trial118.stdout:233: snap_create 2026-02-17T05:29:11.439 INFO:tasks.rados.rados.0.trial118.stdout:231: expect (ObjNum 94 snap 17 seq_num 94) 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: finishing write tid 1 to trial11845692-7 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: finishing write tid 2 to trial11845692-7 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: finishing write tid 3 to trial11845692-7 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: finishing write tid 4 to trial11845692-7 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: finishing write tid 5 to trial11845692-7 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: oid 7 updating version 0 to 113 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: oid 7 version 113 is already newer than 112 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: oid 7 version 113 is already newer than 110 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: oid 7 version 113 is already newer than 111 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 113 (ObjNum 111 snap 23 seq_num 111) dirty exists 2026-02-17T05:29:11.542 INFO:tasks.rados.rados.0.trial118.stdout:232: left oid 7 (ObjNum 111 snap 23 seq_num 111) 2026-02-17T05:29:12.308 INFO:tasks.rados.rados.0.trial118.stdout:231: done (2 left) 2026-02-17T05:29:12.308 INFO:tasks.rados.rados.0.trial118.stdout:232: done (1 left) 2026-02-17T05:29:12.309 INFO:tasks.rados.rados.0.trial118.stdout:233: done (0 left) 2026-02-17T05:29:12.309 INFO:tasks.rados.rados.0.trial118.stdout:234: write oid 49 current snap is 24 2026-02-17T05:29:12.309 INFO:tasks.rados.rados.0.trial118.stdout:234: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2026-02-17T05:29:12.312 INFO:tasks.rados.rados.0.trial118.stdout:234: writing trial11845692-49 from 682384 to 1139214 tid 1 2026-02-17T05:29:12.316 INFO:tasks.rados.rados.0.trial118.stdout:234: writing trial11845692-49 from 1721042 to 2144741 tid 2 2026-02-17T05:29:12.320 INFO:tasks.rados.rados.0.trial118.stdout:234: writing trial11845692-49 from 2809728 to 3264664 tid 3 2026-02-17T05:29:12.323 INFO:tasks.rados.rados.0.trial118.stdout:234: writing trial11845692-49 from 3731357 to 3882384 tid 4 2026-02-17T05:29:12.323 INFO:tasks.rados.rados.0.trial118.stdout:235: write oid 3 current snap is 24 2026-02-17T05:29:12.323 INFO:tasks.rados.rados.0.trial118.stdout:235: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2026-02-17T05:29:12.327 INFO:tasks.rados.rados.0.trial118.stdout:235: writing trial11845692-3 from 699191 to 1231270 tid 1 2026-02-17T05:29:12.332 INFO:tasks.rados.rados.0.trial118.stdout:235: writing trial11845692-3 from 1779524 to 2346881 tid 2 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:235: writing trial11845692-3 from 2837151 to 3503359 tid 3 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:236: snap_remove snap 19 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 1 to trial11845692-49 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 2 to trial11845692-49 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 3 to trial11845692-49 2026-02-17T05:29:12.337 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 4 to trial11845692-49 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 5 to trial11845692-49 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: finishing write tid 6 to trial11845692-49 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: oid 49 updating version 0 to 50 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: oid 49 version 50 is already newer than 48 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: oid 49 version 50 is already newer than 49 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: oid 49 updating version 50 to 51 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: oid 49 updating version 51 to 52 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 52 (ObjNum 112 snap 24 seq_num 112) dirty exists 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:234: left oid 49 (ObjNum 112 snap 24 seq_num 112) 2026-02-17T05:29:12.338 INFO:tasks.rados.rados.0.trial118.stdout:235: finishing write tid 1 to trial11845692-3 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:234: done (2 left) 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:236: done (1 left) 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:237: rollback oid 45 current snap is 24 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 23 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: finishing write tid 2 to trial11845692-3 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: finishing write tid 3 to trial11845692-3 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: finishing write tid 4 to trial11845692-3 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: finishing write tid 5 to trial11845692-3 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: oid 3 updating version 0 to 69 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: oid 3 version 69 is already newer than 68 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: oid 3 version 69 is already newer than 67 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: oid 3 updating version 69 to 70 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 70 (ObjNum 113 snap 24 seq_num 113) dirty exists 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: left oid 3 (ObjNum 113 snap 24 seq_num 113) 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:235: done (1 left) 2026-02-17T05:29:13.310 INFO:tasks.rados.rados.0.trial118.stdout:238: delete oid 11 current snap is 24 2026-02-17T05:29:13.312 INFO:tasks.rados.rados.0.trial118.stdout:238: done (1 left) 2026-02-17T05:29:13.312 INFO:tasks.rados.rados.0.trial118.stdout:239: write oid 16 current snap is 24 2026-02-17T05:29:13.312 INFO:tasks.rados.rados.0.trial118.stdout:239: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2026-02-17T05:29:13.318 INFO:tasks.rados.rados.0.trial118.stdout:239: writing trial11845692-16 from 732805 to 1531735 tid 1 2026-02-17T05:29:13.323 INFO:tasks.rados.rados.0.trial118.stdout:239: writing trial11845692-16 from 2296488 to 2867514 tid 2 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:239: writing trial11845692-16 from 3291997 to 3697102 tid 3 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:240: rollback oid 49 current snap is 24 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 16 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:237: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:237: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:237: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 79 (ObjNum 106 snap 23 seq_num 106) dirty exists 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:239: finishing write tid 1 to trial11845692-16 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:239: finishing write tid 2 to trial11845692-16 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:237: done (2 left) 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:241: write (excl) oid 1 current snap is 24 2026-02-17T05:29:13.327 INFO:tasks.rados.rados.0.trial118.stdout:241: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-17T05:29:13.331 INFO:tasks.rados.rados.0.trial118.stdout:241: writing trial11845692-1 from 749612 to 1223791 tid 1 2026-02-17T05:29:13.336 INFO:tasks.rados.rados.0.trial118.stdout:241: writing trial11845692-1 from 1954970 to 2386007 tid 2 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:241: writing trial11845692-1 from 2919420 to 3535797 tid 3 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:242: copy_from oid 10 from oid 37 current snap is 24 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: finishing write tid 3 to trial11845692-16 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:240: finishing rollback tid 0 to trial11845692-49 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: finishing write tid 4 to trial11845692-16 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:240: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: finishing write tid 5 to trial11845692-16 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: oid 16 updating version 0 to 124 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: oid 16 version 124 is already newer than 122 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: oid 16 version 124 is already newer than 123 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: oid 16 version 124 is already newer than 121 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 124 (ObjNum 115 snap 24 seq_num 115) dirty exists 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: left oid 16 (ObjNum 115 snap 24 seq_num 115) 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:240: finishing rollback tid 2 to trial11845692-49 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 55 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:241: finishing write tid 1 to trial11845692-1 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:239: done (3 left) 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:240: done (2 left) 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:243: delete oid 8 current snap is 24 2026-02-17T05:29:13.341 INFO:tasks.rados.rados.0.trial118.stdout:241: finishing write tid 2 to trial11845692-1 2026-02-17T05:29:13.342 INFO:tasks.rados.rados.0.trial118.stdout:243: done (2 left) 2026-02-17T05:29:13.342 INFO:tasks.rados.rados.0.trial118.stdout:244: copy_from oid 41 from oid 18 current snap is 24 2026-02-17T05:29:13.342 INFO:tasks.rados.rados.0.trial118.stdout:245: write oid 47 current snap is 24 2026-02-17T05:29:13.342 INFO:tasks.rados.rados.0.trial118.stdout:245: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2026-02-17T05:29:13.347 INFO:tasks.rados.rados.0.trial118.stdout:245: writing trial11845692-47 from 783226 to 1407903 tid 1 2026-02-17T05:29:13.351 INFO:tasks.rados.rados.0.trial118.stdout:245: writing trial11845692-47 from 2071934 to 2506640 tid 2 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:245: writing trial11845692-47 from 2974266 to 3613187 tid 3 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:246: copy_from oid 32 from oid 21 current snap is 24 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: finishing write tid 3 to trial11845692-1 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: finishing write tid 4 to trial11845692-1 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:244: finishing copy_from to trial11845692-41 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:244: got expected ENOENT (src dne) 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:244: finishing copy_from racing read to trial11845692-41 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: finishing write tid 5 to trial11845692-1 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: oid 1 updating version 0 to 135 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: oid 1 version 135 is already newer than 128 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: oid 1 updating version 135 to 137 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: oid 1 version 137 is already newer than 136 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 137 (ObjNum 116 snap 24 seq_num 116) dirty exists 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: left oid 1 (ObjNum 116 snap 24 seq_num 116) 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:242: finishing copy_from racing read to trial11845692-10 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:242: finishing copy_from to trial11845692-10 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 3 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:245: finishing write tid 1 to trial11845692-47 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:245: finishing write tid 2 to trial11845692-47 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:241: done (4 left) 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:242: done (3 left) 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:244: done (2 left) 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:247: read oid 17 snap -1 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:247: expect deleted 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:248: write oid 23 current snap is 24 2026-02-17T05:29:13.356 INFO:tasks.rados.rados.0.trial118.stdout:248: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-17T05:29:13.359 INFO:tasks.rados.rados.0.trial118.stdout:248: writing trial11845692-23 from 400033 to 1099959 tid 1 2026-02-17T05:29:13.363 INFO:tasks.rados.rados.0.trial118.stdout:248: writing trial11845692-23 from 1614063 to 2000033 tid 2 2026-02-17T05:29:13.363 INFO:tasks.rados.rados.0.trial118.stdout:249: write (excl) oid 38 current snap is 24 2026-02-17T05:29:13.363 INFO:tasks.rados.rados.0.trial118.stdout:249: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-17T05:29:13.368 INFO:tasks.rados.rados.0.trial118.stdout:249: writing trial11845692-38 from 416840 to 1192015 tid 1 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:249: writing trial11845692-38 from 1672545 to 2016840 tid 2 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:250: read oid 48 snap -1 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:250: expect (ObjNum 89 snap 13 seq_num 89) 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:251: copy_from oid 5 from oid 2 current snap is 24 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:245: finishing write tid 3 to trial11845692-47 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:245: finishing write tid 4 to trial11845692-47 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:245: finishing write tid 5 to trial11845692-47 2026-02-17T05:29:13.371 INFO:tasks.rados.rados.0.trial118.stdout:245: oid 47 updating version 0 to 79 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:245: oid 47 version 79 is already newer than 77 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:245: oid 47 updating version 79 to 80 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:245: oid 47 version 80 is already newer than 78 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 80 (ObjNum 118 snap 24 seq_num 118) dirty exists 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:245: left oid 47 (ObjNum 118 snap 24 seq_num 118) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: finishing write tid 1 to trial11845692-23 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:245: done (6 left) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:247: done (5 left) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:252: rollback oid 13 current snap is 24 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 23 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: finishing write tid 2 to trial11845692-23 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: finishing write tid 3 to trial11845692-23 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: finishing write tid 4 to trial11845692-23 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: oid 23 updating version 0 to 113 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: oid 23 version 113 is already newer than 111 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: oid 23 version 113 is already newer than 112 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 113 (ObjNum 119 snap 24 seq_num 119) dirty exists 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: left oid 23 (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:246: finishing copy_from racing read to trial11845692-32 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:246: finishing copy_from to trial11845692-32 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 75 (ObjNum 88 snap 13 seq_num 88) dirty exists 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:249: finishing write tid 1 to trial11845692-38 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:246: done (5 left) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:248: done (4 left) 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:253: write (excl) oid 43 current snap is 24 2026-02-17T05:29:13.372 INFO:tasks.rados.rados.0.trial118.stdout:253: seq_num 121 ranges {433647=450424,1331027=582033} 2026-02-17T05:29:13.375 INFO:tasks.rados.rados.0.trial118.stdout:253: writing trial11845692-43 from 433647 to 884071 tid 1 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:253: writing trial11845692-43 from 1331027 to 1913060 tid 2 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:254: delete oid 4 current snap is 24 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:251: finishing copy_from to trial11845692-5 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:251: got expected ENOENT (src dne) 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:251: finishing copy_from racing read to trial11845692-5 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: finishing write tid 2 to trial11845692-38 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: finishing write tid 3 to trial11845692-38 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: finishing write tid 4 to trial11845692-38 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: oid 38 updating version 0 to 84 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: oid 38 version 84 is already newer than 83 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: oid 38 version 84 is already newer than 82 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 84 (ObjNum 120 snap 24 seq_num 120) dirty exists 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:249: left oid 38 (ObjNum 120 snap 24 seq_num 120) 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:252: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:252: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:252: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 78 (ObjNum 78 snap 12 seq_num 78) dirty exists 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:250: expect (ObjNum 89 snap 13 seq_num 89) 2026-02-17T05:29:13.379 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:13.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3314262 2026-02-17T05:29:13.476 INFO:tasks.rados.rados.0.trial118.stdout:253: finishing write tid 1 to trial11845692-43 2026-02-17T05:29:13.476 INFO:tasks.rados.rados.0.trial118.stdout:253: finishing write tid 2 to trial11845692-43 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: finishing write tid 3 to trial11845692-43 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: finishing write tid 4 to trial11845692-43 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: oid 43 updating version 0 to 72 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: oid 43 version 72 is already newer than 71 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: oid 43 updating version 72 to 73 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 73 (ObjNum 121 snap 24 seq_num 121) dirty exists 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:253: left oid 43 (ObjNum 121 snap 24 seq_num 121) 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:249: done (5 left) 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:250: done (4 left) 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:251: done (3 left) 2026-02-17T05:29:13.477 INFO:tasks.rados.rados.0.trial118.stdout:252: done (2 left) 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:253: done (1 left) 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:254: done (0 left) 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:255: read oid 9 snap -1 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:255: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:256: copy_from oid 7 from oid 33 current snap is 24 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:257: read oid 11 snap -1 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:257: expect deleted 2026-02-17T05:29:13.478 INFO:tasks.rados.rados.0.trial118.stdout:258: delete oid 14 current snap is 24 2026-02-17T05:29:13.479 INFO:tasks.rados.rados.0.trial118.stdout:257: done (3 left) 2026-02-17T05:29:13.479 INFO:tasks.rados.rados.0.trial118.stdout:258: done (2 left) 2026-02-17T05:29:13.479 INFO:tasks.rados.rados.0.trial118.stdout:259: write (excl) oid 42 current snap is 24 2026-02-17T05:29:13.479 INFO:tasks.rados.rados.0.trial118.stdout:259: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-17T05:29:13.482 INFO:tasks.rados.rados.0.trial118.stdout:259: writing trial11845692-42 from 484068 to 1276592 tid 1 2026-02-17T05:29:13.485 INFO:tasks.rados.rados.0.trial118.stdout:259: writing trial11845692-42 from 1906473 to 2084068 tid 2 2026-02-17T05:29:13.485 INFO:tasks.rados.rados.0.trial118.stdout:260: rollback oid 39 current snap is 24 2026-02-17T05:29:13.485 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 13 2026-02-17T05:29:13.485 INFO:tasks.rados.rados.0.trial118.stdout:255: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:13.485 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:13.584 INFO:tasks.rados.rados.0.trial118.stdout:256: finishing copy_from to trial11845692-7 2026-02-17T05:29:13.584 INFO:tasks.rados.rados.0.trial118.stdout:256: got expected ENOENT (src dne) 2026-02-17T05:29:13.584 INFO:tasks.rados.rados.0.trial118.stdout:256: finishing copy_from racing read to trial11845692-7 2026-02-17T05:29:13.584 INFO:tasks.rados.rados.0.trial118.stdout:259: finishing write tid 1 to trial11845692-42 2026-02-17T05:29:13.584 INFO:tasks.rados.rados.0.trial118.stdout:259: finishing write tid 2 to trial11845692-42 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: finishing write tid 3 to trial11845692-42 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: finishing write tid 4 to trial11845692-42 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: oid 42 updating version 0 to 86 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: oid 42 updating version 86 to 88 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: oid 42 version 88 is already newer than 87 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 88 (ObjNum 124 snap 24 seq_num 124) dirty exists 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:259: left oid 42 (ObjNum 124 snap 24 seq_num 124) 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:260: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:260: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 90 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T05:29:13.585 INFO:tasks.rados.rados.0.trial118.stdout:255: done (3 left) 2026-02-17T05:29:13.586 INFO:tasks.rados.rados.0.trial118.stdout:256: done (2 left) 2026-02-17T05:29:13.586 INFO:tasks.rados.rados.0.trial118.stdout:259: done (1 left) 2026-02-17T05:29:13.586 INFO:tasks.rados.rados.0.trial118.stdout:260: done (0 left) 2026-02-17T05:29:13.586 INFO:tasks.rados.rados.0.trial118.stdout:261: snap_remove snap 15 2026-02-17T05:29:14.315 INFO:tasks.rados.rados.0.trial118.stdout:261: done (0 left) 2026-02-17T05:29:14.315 INFO:tasks.rados.rados.0.trial118.stdout:262: delete oid 19 current snap is 24 2026-02-17T05:29:14.317 INFO:tasks.rados.rados.0.trial118.stdout:262: done (0 left) 2026-02-17T05:29:14.317 INFO:tasks.rados.rados.0.trial118.stdout:263: snap_remove snap 21 2026-02-17T05:29:15.316 INFO:tasks.rados.rados.0.trial118.stdout:263: done (0 left) 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:264: read oid 12 snap 23 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:264: expect (ObjNum 78 snap 12 seq_num 78) 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:265: read oid 48 snap -1 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:265: expect (ObjNum 89 snap 13 seq_num 89) 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:266: write (excl) oid 5 current snap is 24 2026-02-17T05:29:15.317 INFO:tasks.rados.rados.0.trial118.stdout:266: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-17T05:29:15.320 INFO:tasks.rados.rados.0.trial118.stdout:266: writing trial11845692-5 from 517682 to 1060704 tid 1 2026-02-17T05:29:15.325 INFO:tasks.rados.rados.0.trial118.stdout:266: writing trial11845692-5 from 1623437 to 2117682 tid 2 2026-02-17T05:29:15.325 INFO:tasks.rados.rados.0.trial118.stdout:267: copy_from oid 42 from oid 28 current snap is 24 2026-02-17T05:29:15.325 INFO:tasks.rados.rados.0.trial118.stdout:264: expect (ObjNum 78 snap 12 seq_num 78) 2026-02-17T05:29:15.475 INFO:tasks.rados.rados.0.trial118.stdout:265: expect (ObjNum 89 snap 13 seq_num 89) 2026-02-17T05:29:15.511 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:15.545 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:15.580 INFO:tasks.rados.rados.0.trial118.stdout:266: finishing write tid 1 to trial11845692-5 2026-02-17T05:29:15.580 INFO:tasks.rados.rados.0.trial118.stdout:264: done (3 left) 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:265: done (2 left) 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:268: write (excl) oid 43 current snap is 24 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: finishing write tid 2 to trial11845692-5 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: finishing write tid 3 to trial11845692-5 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: finishing write tid 4 to trial11845692-5 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: oid 5 updating version 0 to 17 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: oid 5 updating version 17 to 19 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: oid 5 version 19 is already newer than 18 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 19 (ObjNum 126 snap 24 seq_num 126) dirty exists 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:266: left oid 5 (ObjNum 126 snap 24 seq_num 126) 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:267: finishing copy_from racing read to trial11845692-42 2026-02-17T05:29:15.581 INFO:tasks.rados.rados.0.trial118.stdout:267: finishing copy_from to trial11845692-42 2026-02-17T05:29:15.582 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 31 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:29:15.582 INFO:tasks.rados.rados.0.trial118.stdout:268: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-17T05:29:15.584 INFO:tasks.rados.rados.0.trial118.stdout:268: writing trial11845692-43 from 534489 to 1152760 tid 1 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:268: writing trial11845692-43 from 1565566 to 2134489 tid 2 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:266: done (2 left) 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:267: done (1 left) 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:269: read oid 49 snap -1 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:269: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:270: snap_create 2026-02-17T05:29:15.589 INFO:tasks.rados.rados.0.trial118.stdout:268: finishing write tid 1 to trial11845692-43 2026-02-17T05:29:15.590 INFO:tasks.rados.rados.0.trial118.stdout:268: finishing write tid 2 to trial11845692-43 2026-02-17T05:29:15.590 INFO:tasks.rados.rados.0.trial118.stdout:268: finishing write tid 3 to trial11845692-43 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:268: finishing write tid 4 to trial11845692-43 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:268: oid 43 updating version 0 to 80 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:268: oid 43 version 80 is already newer than 78 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:268: oid 43 version 80 is already newer than 79 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 80 (ObjNum 127 snap 24 seq_num 127) dirty exists 2026-02-17T05:29:15.591 INFO:tasks.rados.rados.0.trial118.stdout:268: left oid 43 (ObjNum 127 snap 24 seq_num 127) 2026-02-17T05:29:15.592 INFO:tasks.rados.rados.0.trial118.stdout:269: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:29:15.625 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:16.320 INFO:tasks.rados.rados.0.trial118.stdout:268: done (2 left) 2026-02-17T05:29:16.320 INFO:tasks.rados.rados.0.trial118.stdout:269: done (1 left) 2026-02-17T05:29:16.320 INFO:tasks.rados.rados.0.trial118.stdout:270: done (0 left) 2026-02-17T05:29:16.321 INFO:tasks.rados.rados.0.trial118.stdout:271: snap_remove snap 13 2026-02-17T05:29:17.320 INFO:tasks.rados.rados.0.trial118.stdout:271: done (0 left) 2026-02-17T05:29:17.320 INFO:tasks.rados.rados.0.trial118.stdout:272: write (excl) oid 34 current snap is 25 2026-02-17T05:29:17.320 INFO:tasks.rados.rados.0.trial118.stdout:272: seq_num 128 ranges {551296=693520,2024048=127248} 2026-02-17T05:29:17.325 INFO:tasks.rados.rados.0.trial118.stdout:272: writing trial11845692-34 from 551296 to 1244816 tid 1 2026-02-17T05:29:17.329 INFO:tasks.rados.rados.0.trial118.stdout:272: writing trial11845692-34 from 2024048 to 2151296 tid 2 2026-02-17T05:29:17.329 INFO:tasks.rados.rados.0.trial118.stdout:273: copy_from oid 38 from oid 11 current snap is 25 2026-02-17T05:29:17.329 INFO:tasks.rados.rados.0.trial118.stdout:272: finishing write tid 1 to trial11845692-34 2026-02-17T05:29:17.329 INFO:tasks.rados.rados.0.trial118.stdout:274: snap_remove snap 23 2026-02-17T05:29:18.326 INFO:tasks.rados.rados.0.trial118.stdout:274: done (2 left) 2026-02-17T05:29:18.326 INFO:tasks.rados.rados.0.trial118.stdout:275: write (excl) oid 47 current snap is 25 2026-02-17T05:29:18.326 INFO:tasks.rados.rados.0.trial118.stdout:275: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-17T05:29:18.331 INFO:tasks.rados.rados.0.trial118.stdout:275: writing trial11845692-47 from 568103 to 1336872 tid 1 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:275: writing trial11845692-47 from 2082530 to 2168103 tid 2 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:276: read oid 33 snap -1 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:276: expect deleted 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:273: finishing copy_from to trial11845692-38 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:273: got expected ENOENT (src dne) 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:273: finishing copy_from racing read to trial11845692-38 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:272: finishing write tid 2 to trial11845692-34 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:272: finishing write tid 3 to trial11845692-34 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:272: finishing write tid 4 to trial11845692-34 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:272: oid 34 updating version 0 to 74 2026-02-17T05:29:18.335 INFO:tasks.rados.rados.0.trial118.stdout:272: oid 34 version 74 is already newer than 73 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:272: oid 34 version 74 is already newer than 72 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 74 (ObjNum 128 snap 25 seq_num 128) dirty exists 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:272: left oid 34 (ObjNum 128 snap 25 seq_num 128) 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:275: finishing write tid 1 to trial11845692-47 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:277: read oid 35 snap -1 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:277: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:272: done (4 left) 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:273: done (3 left) 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:278: delete oid 18 current snap is 25 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:276: done (3 left) 2026-02-17T05:29:18.336 INFO:tasks.rados.rados.0.trial118.stdout:278: done (2 left) 2026-02-17T05:29:18.337 INFO:tasks.rados.rados.0.trial118.stdout:279: snap_remove snap 7 2026-02-17T05:29:19.328 INFO:tasks.rados.rados.0.trial118.stdout:279: done (2 left) 2026-02-17T05:29:19.328 INFO:tasks.rados.rados.0.trial118.stdout:280: read oid 24 snap -1 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:280: expect deleted 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:281: read oid 19 snap 22 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:281: expect (ObjNum 91 snap 14 seq_num 91) 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:282: rollback oid 16 current snap is 25 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 17 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: finishing write tid 2 to trial11845692-47 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: finishing write tid 3 to trial11845692-47 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: finishing write tid 4 to trial11845692-47 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: oid 47 updating version 0 to 123 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: oid 47 version 123 is already newer than 121 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: oid 47 version 123 is already newer than 122 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 123 (ObjNum 129 snap 25 seq_num 129) dirty exists 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:275: left oid 47 (ObjNum 129 snap 25 seq_num 129) 2026-02-17T05:29:19.329 INFO:tasks.rados.rados.0.trial118.stdout:277: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-17T05:29:19.361 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1508094 2026-02-17T05:29:19.405 INFO:tasks.rados.rados.0.trial118.stdout:282: finishing rollback tid 0 to trial11845692-16 2026-02-17T05:29:19.405 INFO:tasks.rados.rados.0.trial118.stdout:282: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:29:19.405 INFO:tasks.rados.rados.0.trial118.stdout:282: finishing rollback tid 2 to trial11845692-16 2026-02-17T05:29:19.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 164 (ObjNum 76 snap 9 seq_num 76) dirty exists 2026-02-17T05:29:19.406 INFO:tasks.rados.rados.0.trial118.stdout:281: expect (ObjNum 91 snap 14 seq_num 91) 2026-02-17T05:29:19.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1121937 2026-02-17T05:29:19.470 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1436002 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:275: done (4 left) 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:277: done (3 left) 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:280: done (2 left) 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:281: done (1 left) 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:282: done (0 left) 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:283: write oid 46 current snap is 25 2026-02-17T05:29:19.552 INFO:tasks.rados.rados.0.trial118.stdout:283: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-17T05:29:19.557 INFO:tasks.rados.rados.0.trial118.stdout:283: writing trial11845692-46 from 601717 to 1237337 tid 1 2026-02-17T05:29:19.560 INFO:tasks.rados.rados.0.trial118.stdout:283: writing trial11845692-46 from 1799494 to 2201717 tid 2 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:284: delete oid 18 current snap is 25 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:283: finishing write tid 1 to trial11845692-46 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:284: done (1 left) 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:285: read oid 1 snap 16 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:285: expect (ObjNum 90 snap 13 seq_num 90) 2026-02-17T05:29:19.561 INFO:tasks.rados.rados.0.trial118.stdout:286: snap_create 2026-02-17T05:29:19.562 INFO:tasks.rados.rados.0.trial118.stdout:283: finishing write tid 2 to trial11845692-46 2026-02-17T05:29:19.562 INFO:tasks.rados.rados.0.trial118.stdout:283: finishing write tid 3 to trial11845692-46 2026-02-17T05:29:19.562 INFO:tasks.rados.rados.0.trial118.stdout:283: finishing write tid 4 to trial11845692-46 2026-02-17T05:29:19.562 INFO:tasks.rados.rados.0.trial118.stdout:283: oid 46 updating version 0 to 33 2026-02-17T05:29:19.562 INFO:tasks.rados.rados.0.trial118.stdout:283: oid 46 updating version 33 to 34 2026-02-17T05:29:19.563 INFO:tasks.rados.rados.0.trial118.stdout:283: oid 46 version 34 is already newer than 32 2026-02-17T05:29:19.563 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 34 (ObjNum 131 snap 25 seq_num 131) dirty exists 2026-02-17T05:29:19.563 INFO:tasks.rados.rados.0.trial118.stdout:283: left oid 46 (ObjNum 131 snap 25 seq_num 131) 2026-02-17T05:29:19.566 INFO:tasks.rados.rados.0.trial118.stdout:285: expect (ObjNum 90 snap 13 seq_num 90) 2026-02-17T05:29:19.592 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:20.286 INFO:tasks.rados.rados.0.trial118.stdout:283: done (2 left) 2026-02-17T05:29:20.286 INFO:tasks.rados.rados.0.trial118.stdout:285: done (1 left) 2026-02-17T05:29:20.286 INFO:tasks.rados.rados.0.trial118.stdout:286: done (0 left) 2026-02-17T05:29:20.287 INFO:tasks.rados.rados.0.trial118.stdout:287: read oid 42 snap -1 2026-02-17T05:29:20.287 INFO:tasks.rados.rados.0.trial118.stdout:287: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:29:20.287 INFO:tasks.rados.rados.0.trial118.stdout:288: snap_create 2026-02-17T05:29:20.293 INFO:tasks.rados.rados.0.trial118.stdout:287: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:29:20.297 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1138057 2026-02-17T05:29:20.322 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:21.286 INFO:tasks.rados.rados.0.trial118.stdout:287: done (1 left) 2026-02-17T05:29:21.286 INFO:tasks.rados.rados.0.trial118.stdout:288: done (0 left) 2026-02-17T05:29:21.286 INFO:tasks.rados.rados.0.trial118.stdout:289: snap_remove snap 16 2026-02-17T05:29:22.287 INFO:tasks.rados.rados.0.trial118.stdout:289: done (0 left) 2026-02-17T05:29:22.287 INFO:tasks.rados.rados.0.trial118.stdout:290: snap_create 2026-02-17T05:29:23.287 INFO:tasks.rados.rados.0.trial118.stdout:290: done (0 left) 2026-02-17T05:29:23.287 INFO:tasks.rados.rados.0.trial118.stdout:291: copy_from oid 20 from oid 23 current snap is 28 2026-02-17T05:29:23.288 INFO:tasks.rados.rados.0.trial118.stdout:292: write oid 3 current snap is 28 2026-02-17T05:29:23.288 INFO:tasks.rados.rados.0.trial118.stdout:292: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-17T05:29:23.293 INFO:tasks.rados.rados.0.trial118.stdout:292: writing trial11845692-3 from 635331 to 1421449 tid 1 2026-02-17T05:29:23.296 INFO:tasks.rados.rados.0.trial118.stdout:292: writing trial11845692-3 from 1916458 to 2235331 tid 2 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:293: read oid 38 snap -1 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:293: expect (ObjNum 120 snap 24 seq_num 120) 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:294: snap_create 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:291: finishing copy_from racing read to trial11845692-20 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:291: finishing copy_from to trial11845692-20 2026-02-17T05:29:23.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 113 (ObjNum 119 snap 24 seq_num 119) dirty exists 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: finishing write tid 1 to trial11845692-3 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: finishing write tid 2 to trial11845692-3 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: finishing write tid 3 to trial11845692-3 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: finishing write tid 4 to trial11845692-3 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: oid 3 updating version 0 to 116 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: oid 3 updating version 116 to 117 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: oid 3 updating version 117 to 118 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 118 (ObjNum 133 snap 28 seq_num 133) dirty exists 2026-02-17T05:29:23.301 INFO:tasks.rados.rados.0.trial118.stdout:292: left oid 3 (ObjNum 133 snap 28 seq_num 133) 2026-02-17T05:29:23.302 INFO:tasks.rados.rados.0.trial118.stdout:293: expect (ObjNum 120 snap 24 seq_num 120) 2026-02-17T05:29:23.321 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:24.293 INFO:tasks.rados.rados.0.trial118.stdout:291: done (3 left) 2026-02-17T05:29:24.293 INFO:tasks.rados.rados.0.trial118.stdout:292: done (2 left) 2026-02-17T05:29:24.293 INFO:tasks.rados.rados.0.trial118.stdout:293: done (1 left) 2026-02-17T05:29:24.293 INFO:tasks.rados.rados.0.trial118.stdout:294: done (0 left) 2026-02-17T05:29:24.293 INFO:tasks.rados.rados.0.trial118.stdout:295: read oid 14 snap -1 2026-02-17T05:29:24.294 INFO:tasks.rados.rados.0.trial118.stdout:295: expect deleted 2026-02-17T05:29:24.294 INFO:tasks.rados.rados.0.trial118.stdout:296: write oid 2 current snap is 29 2026-02-17T05:29:24.294 INFO:tasks.rados.rados.0.trial118.stdout:296: seq_num 134 ranges {652138=461367,1574940=677198} 2026-02-17T05:29:24.297 INFO:tasks.rados.rados.0.trial118.stdout:296: writing trial11845692-2 from 652138 to 1113505 tid 1 2026-02-17T05:29:24.301 INFO:tasks.rados.rados.0.trial118.stdout:296: writing trial11845692-2 from 1574940 to 2252138 tid 2 2026-02-17T05:29:24.302 INFO:tasks.rados.rados.0.trial118.stdout:297: snap_remove snap 17 2026-02-17T05:29:25.286 INFO:tasks.rados.rados.0.trial118.stdout:297: done (2 left) 2026-02-17T05:29:25.286 INFO:tasks.rados.rados.0.trial118.stdout:298: write (excl) oid 34 current snap is 29 2026-02-17T05:29:25.286 INFO:tasks.rados.rados.0.trial118.stdout:298: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-17T05:29:25.290 INFO:tasks.rados.rados.0.trial118.stdout:298: writing trial11845692-34 from 668945 to 1205561 tid 1 2026-02-17T05:29:25.294 INFO:tasks.rados.rados.0.trial118.stdout:298: writing trial11845692-34 from 1633422 to 2124785 tid 2 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:299: read oid 43 snap 18 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:299: expect deleted 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:300: delete oid 48 current snap is 29 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: finishing write tid 1 to trial11845692-2 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: finishing write tid 2 to trial11845692-2 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: finishing write tid 3 to trial11845692-2 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: finishing write tid 4 to trial11845692-2 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: oid 2 updating version 0 to 114 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: oid 2 updating version 114 to 115 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:296: oid 2 updating version 115 to 116 2026-02-17T05:29:25.295 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 116 (ObjNum 134 snap 29 seq_num 134) dirty exists 2026-02-17T05:29:25.296 INFO:tasks.rados.rados.0.trial118.stdout:296: left oid 2 (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:29:25.296 INFO:tasks.rados.rados.0.trial118.stdout:298: finishing write tid 1 to trial11845692-34 2026-02-17T05:29:25.296 INFO:tasks.rados.rados.0.trial118.stdout:295: done (4 left) 2026-02-17T05:29:25.296 INFO:tasks.rados.rados.0.trial118.stdout:296: done (3 left) 2026-02-17T05:29:25.297 INFO:tasks.rados.rados.0.trial118.stdout:299: done (2 left) 2026-02-17T05:29:25.297 INFO:tasks.rados.rados.0.trial118.stdout:300: done (1 left) 2026-02-17T05:29:25.297 INFO:tasks.rados.rados.0.trial118.stdout:301: write oid 33 current snap is 29 2026-02-17T05:29:25.297 INFO:tasks.rados.rados.0.trial118.stdout:301: seq_num 137 ranges {702559=403467,1750386=495032} 2026-02-17T05:29:25.300 INFO:tasks.rados.rados.0.trial118.stdout:301: writing trial11845692-33 from 702559 to 1106026 tid 1 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:301: writing trial11845692-33 from 1750386 to 2245418 tid 2 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:302: write oid 45 current snap is 29 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:298: finishing write tid 2 to trial11845692-34 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:298: finishing write tid 3 to trial11845692-34 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:298: finishing write tid 4 to trial11845692-34 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:298: oid 34 updating version 0 to 83 2026-02-17T05:29:25.305 INFO:tasks.rados.rados.0.trial118.stdout:298: oid 34 updating version 83 to 84 2026-02-17T05:29:25.306 INFO:tasks.rados.rados.0.trial118.stdout:298: oid 34 updating version 84 to 85 2026-02-17T05:29:25.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 85 (ObjNum 135 snap 29 seq_num 135) dirty exists 2026-02-17T05:29:25.306 INFO:tasks.rados.rados.0.trial118.stdout:298: left oid 34 (ObjNum 135 snap 29 seq_num 135) 2026-02-17T05:29:25.306 INFO:tasks.rados.rados.0.trial118.stdout:301: finishing write tid 1 to trial11845692-33 2026-02-17T05:29:25.306 INFO:tasks.rados.rados.0.trial118.stdout:302: seq_num 138 ranges {719366=478716,1808868=510498} 2026-02-17T05:29:25.309 INFO:tasks.rados.rados.0.trial118.stdout:302: writing trial11845692-45 from 719366 to 1198082 tid 1 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:302: writing trial11845692-45 from 1808868 to 2319366 tid 2 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:298: done (2 left) 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:303: read oid 39 snap -1 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:303: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:304: snap_create 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:301: finishing write tid 2 to trial11845692-33 2026-02-17T05:29:25.314 INFO:tasks.rados.rados.0.trial118.stdout:301: finishing write tid 3 to trial11845692-33 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:301: finishing write tid 4 to trial11845692-33 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:301: oid 33 updating version 0 to 176 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:301: oid 33 updating version 176 to 178 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:301: oid 33 version 178 is already newer than 177 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 178 (ObjNum 137 snap 29 seq_num 137) dirty exists 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:301: left oid 33 (ObjNum 137 snap 29 seq_num 137) 2026-02-17T05:29:25.315 INFO:tasks.rados.rados.0.trial118.stdout:302: finishing write tid 1 to trial11845692-45 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: finishing write tid 2 to trial11845692-45 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: finishing write tid 3 to trial11845692-45 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: finishing write tid 4 to trial11845692-45 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: oid 45 updating version 0 to 127 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: oid 45 version 127 is already newer than 125 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: oid 45 version 127 is already newer than 126 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 127 (ObjNum 138 snap 29 seq_num 138) dirty exists 2026-02-17T05:29:25.316 INFO:tasks.rados.rados.0.trial118.stdout:302: left oid 45 (ObjNum 138 snap 29 seq_num 138) 2026-02-17T05:29:25.319 INFO:tasks.rados.rados.0.trial118.stdout:303: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T05:29:25.319 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:25.339 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:26.297 INFO:tasks.rados.rados.0.trial118.stdout:301: done (3 left) 2026-02-17T05:29:26.298 INFO:tasks.rados.rados.0.trial118.stdout:302: done (2 left) 2026-02-17T05:29:26.298 INFO:tasks.rados.rados.0.trial118.stdout:303: done (1 left) 2026-02-17T05:29:26.298 INFO:tasks.rados.rados.0.trial118.stdout:304: done (0 left) 2026-02-17T05:29:26.298 INFO:tasks.rados.rados.0.trial118.stdout:305: delete oid 19 current snap is 30 2026-02-17T05:29:26.299 INFO:tasks.rados.rados.0.trial118.stdout:305: done (0 left) 2026-02-17T05:29:26.299 INFO:tasks.rados.rados.0.trial118.stdout:306: delete oid 46 current snap is 30 2026-02-17T05:29:26.300 INFO:tasks.rados.rados.0.trial118.stdout:306: done (0 left) 2026-02-17T05:29:26.300 INFO:tasks.rados.rados.0.trial118.stdout:307: rollback oid 7 current snap is 30 2026-02-17T05:29:26.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 28 2026-02-17T05:29:26.300 INFO:tasks.rados.rados.0.trial118.stdout:308: delete oid 11 current snap is 30 2026-02-17T05:29:26.301 INFO:tasks.rados.rados.0.trial118.stdout:308: done (1 left) 2026-02-17T05:29:26.301 INFO:tasks.rados.rados.0.trial118.stdout:309: delete oid 6 current snap is 30 2026-02-17T05:29:26.304 INFO:tasks.rados.rados.0.trial118.stdout:307: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:29:26.304 INFO:tasks.rados.rados.0.trial118.stdout:307: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:29:26.304 INFO:tasks.rados.rados.0.trial118.stdout:307: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:29:26.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 200 (ObjNum 111 snap 23 seq_num 111) dirty exists 2026-02-17T05:29:26.304 INFO:tasks.rados.rados.0.trial118.stdout:307: done (1 left) 2026-02-17T05:29:26.305 INFO:tasks.rados.rados.0.trial118.stdout:309: done (0 left) 2026-02-17T05:29:26.305 INFO:tasks.rados.rados.0.trial118.stdout:310: read oid 46 snap 18 2026-02-17T05:29:26.305 INFO:tasks.rados.rados.0.trial118.stdout:310: expect deleted 2026-02-17T05:29:26.305 INFO:tasks.rados.rados.0.trial118.stdout:311: write oid 1 current snap is 30 2026-02-17T05:29:26.305 INFO:tasks.rados.rados.0.trial118.stdout:311: seq_num 143 ranges {403401=454961,1584925=506039} 2026-02-17T05:29:26.306 INFO:tasks.rados.rados.0.trial118.stdout:311: writing trial11845692-1 from 403401 to 858362 tid 1 2026-02-17T05:29:26.311 INFO:tasks.rados.rados.0.trial118.stdout:311: writing trial11845692-1 from 1584925 to 2090964 tid 2 2026-02-17T05:29:26.311 INFO:tasks.rados.rados.0.trial118.stdout:312: snap_remove snap 27 2026-02-17T05:29:27.299 INFO:tasks.rados.rados.0.trial118.stdout:312: done (2 left) 2026-02-17T05:29:27.299 INFO:tasks.rados.rados.0.trial118.stdout:313: write oid 12 current snap is 30 2026-02-17T05:29:27.299 INFO:tasks.rados.rados.0.trial118.stdout:313: seq_num 144 ranges {420208=530210,1527054=766050} 2026-02-17T05:29:27.303 INFO:tasks.rados.rados.0.trial118.stdout:313: writing trial11845692-12 from 420208 to 950418 tid 1 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:313: writing trial11845692-12 from 1527054 to 2293104 tid 2 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:314: copy_from oid 38 from oid 18 current snap is 30 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: finishing write tid 1 to trial11845692-1 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: finishing write tid 2 to trial11845692-1 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: finishing write tid 3 to trial11845692-1 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: finishing write tid 4 to trial11845692-1 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: oid 1 updating version 0 to 181 2026-02-17T05:29:27.309 INFO:tasks.rados.rados.0.trial118.stdout:311: oid 1 version 181 is already newer than 180 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:311: oid 1 updating version 181 to 182 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 182 (ObjNum 143 snap 30 seq_num 143) dirty exists 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:311: left oid 1 (ObjNum 143 snap 30 seq_num 143) 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:313: finishing write tid 1 to trial11845692-12 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:310: done (3 left) 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:311: done (2 left) 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:315: read oid 21 snap -1 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:315: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:316: copy_from oid 37 from oid 5 current snap is 30 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:317: snap_create 2026-02-17T05:29:27.310 INFO:tasks.rados.rados.0.trial118.stdout:314: finishing copy_from to trial11845692-38 2026-02-17T05:29:27.311 INFO:tasks.rados.rados.0.trial118.stdout:314: got expected ENOENT (src dne) 2026-02-17T05:29:27.311 INFO:tasks.rados.rados.0.trial118.stdout:313: finishing write tid 2 to trial11845692-12 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: finishing write tid 3 to trial11845692-12 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: finishing write tid 4 to trial11845692-12 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: oid 12 updating version 0 to 94 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: oid 12 updating version 94 to 95 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: oid 12 updating version 95 to 96 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 96 (ObjNum 144 snap 30 seq_num 144) dirty exists 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:313: left oid 12 (ObjNum 144 snap 30 seq_num 144) 2026-02-17T05:29:27.312 INFO:tasks.rados.rados.0.trial118.stdout:314: finishing copy_from racing read to trial11845692-38 2026-02-17T05:29:27.313 INFO:tasks.rados.rados.0.trial118.stdout:315: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:29:27.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:27.453 INFO:tasks.rados.rados.0.trial118.stdout:316: finishing copy_from racing read to trial11845692-37 2026-02-17T05:29:27.453 INFO:tasks.rados.rados.0.trial118.stdout:316: finishing copy_from to trial11845692-37 2026-02-17T05:29:27.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 19 (ObjNum 126 snap 24 seq_num 126) dirty exists 2026-02-17T05:29:28.302 INFO:tasks.rados.rados.0.trial118.stdout:313: done (4 left) 2026-02-17T05:29:28.303 INFO:tasks.rados.rados.0.trial118.stdout:314: done (3 left) 2026-02-17T05:29:28.303 INFO:tasks.rados.rados.0.trial118.stdout:315: done (2 left) 2026-02-17T05:29:28.303 INFO:tasks.rados.rados.0.trial118.stdout:316: done (1 left) 2026-02-17T05:29:28.303 INFO:tasks.rados.rados.0.trial118.stdout:317: done (0 left) 2026-02-17T05:29:28.303 INFO:tasks.rados.rados.0.trial118.stdout:318: snap_create 2026-02-17T05:29:29.303 INFO:tasks.rados.rados.0.trial118.stdout:318: done (0 left) 2026-02-17T05:29:29.304 INFO:tasks.rados.rados.0.trial118.stdout:319: read oid 30 snap 24 2026-02-17T05:29:29.304 INFO:tasks.rados.rados.0.trial118.stdout:319: expect (ObjNum 104 snap 22 seq_num 104) 2026-02-17T05:29:29.304 INFO:tasks.rados.rados.0.trial118.stdout:320: delete oid 17 current snap is 32 2026-02-17T05:29:29.305 INFO:tasks.rados.rados.0.trial118.stdout:320: done (1 left) 2026-02-17T05:29:29.306 INFO:tasks.rados.rados.0.trial118.stdout:321: copy_from oid 47 from oid 39 current snap is 32 2026-02-17T05:29:29.306 INFO:tasks.rados.rados.0.trial118.stdout:322: snap_create 2026-02-17T05:29:29.309 INFO:tasks.rados.rados.0.trial118.stdout:319: expect (ObjNum 104 snap 22 seq_num 104) 2026-02-17T05:29:29.358 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:29.453 INFO:tasks.rados.rados.0.trial118.stdout:321: finishing copy_from racing read to trial11845692-47 2026-02-17T05:29:29.454 INFO:tasks.rados.rados.0.trial118.stdout:321: finishing copy_from to trial11845692-47 2026-02-17T05:29:29.454 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 90 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T05:29:30.286 INFO:tasks.rados.rados.0.trial118.stdout:319: done (2 left) 2026-02-17T05:29:30.286 INFO:tasks.rados.rados.0.trial118.stdout:321: done (1 left) 2026-02-17T05:29:30.286 INFO:tasks.rados.rados.0.trial118.stdout:322: done (0 left) 2026-02-17T05:29:30.287 INFO:tasks.rados.rados.0.trial118.stdout:323: snap_create 2026-02-17T05:29:31.287 INFO:tasks.rados.rados.0.trial118.stdout:323: done (0 left) 2026-02-17T05:29:31.287 INFO:tasks.rados.rados.0.trial118.stdout:324: read oid 25 snap -1 2026-02-17T05:29:31.288 INFO:tasks.rados.rados.0.trial118.stdout:324: expect (ObjNum 96 snap 21 seq_num 96) 2026-02-17T05:29:31.288 INFO:tasks.rados.rados.0.trial118.stdout:325: read oid 16 snap -1 2026-02-17T05:29:31.288 INFO:tasks.rados.rados.0.trial118.stdout:325: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:31.288 INFO:tasks.rados.rados.0.trial118.stdout:326: write (excl) oid 27 current snap is 34 2026-02-17T05:29:31.288 INFO:tasks.rados.rados.0.trial118.stdout:326: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-17T05:29:31.293 INFO:tasks.rados.rados.0.trial118.stdout:326: writing trial11845692-27 from 453822 to 1250883 tid 1 2026-02-17T05:29:31.298 INFO:tasks.rados.rados.0.trial118.stdout:326: writing trial11845692-27 from 1760371 to 2413737 tid 2 2026-02-17T05:29:31.298 INFO:tasks.rados.rados.0.trial118.stdout:327: snap_create 2026-02-17T05:29:31.298 INFO:tasks.rados.rados.0.trial118.stdout:325: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:31.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:31.361 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:31.391 INFO:tasks.rados.rados.0.trial118.stdout:324: expect (ObjNum 96 snap 21 seq_num 96) 2026-02-17T05:29:31.399 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1577779 2026-02-17T05:29:31.419 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:31.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2655165 2026-02-17T05:29:31.479 INFO:tasks.rados.rados.0.trial118.stdout:326: finishing write tid 1 to trial11845692-27 2026-02-17T05:29:31.479 INFO:tasks.rados.rados.0.trial118.stdout:326: finishing write tid 2 to trial11845692-27 2026-02-17T05:29:31.479 INFO:tasks.rados.rados.0.trial118.stdout:326: finishing write tid 3 to trial11845692-27 2026-02-17T05:29:31.479 INFO:tasks.rados.rados.0.trial118.stdout:326: finishing write tid 4 to trial11845692-27 2026-02-17T05:29:31.479 INFO:tasks.rados.rados.0.trial118.stdout:326: oid 27 updating version 0 to 121 2026-02-17T05:29:31.480 INFO:tasks.rados.rados.0.trial118.stdout:326: oid 27 version 121 is already newer than 120 2026-02-17T05:29:31.480 INFO:tasks.rados.rados.0.trial118.stdout:326: oid 27 updating version 121 to 122 2026-02-17T05:29:31.480 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 122 (ObjNum 146 snap 34 seq_num 146) dirty exists 2026-02-17T05:29:31.480 INFO:tasks.rados.rados.0.trial118.stdout:326: left oid 27 (ObjNum 146 snap 34 seq_num 146) 2026-02-17T05:29:32.288 INFO:tasks.rados.rados.0.trial118.stdout:324: done (3 left) 2026-02-17T05:29:32.288 INFO:tasks.rados.rados.0.trial118.stdout:325: done (2 left) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:326: done (1 left) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:327: done (0 left) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:328: read oid 26 snap -1 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:328: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:329: read oid 12 snap -1 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:329: expect (ObjNum 144 snap 30 seq_num 144) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:330: read oid 2 snap -1 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:330: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:29:32.289 INFO:tasks.rados.rados.0.trial118.stdout:331: delete oid 44 current snap is 35 2026-02-17T05:29:32.290 INFO:tasks.rados.rados.0.trial118.stdout:331: done (3 left) 2026-02-17T05:29:32.290 INFO:tasks.rados.rados.0.trial118.stdout:332: snap_remove snap 32 2026-02-17T05:29:33.290 INFO:tasks.rados.rados.0.trial118.stdout:332: done (3 left) 2026-02-17T05:29:33.291 INFO:tasks.rados.rados.0.trial118.stdout:333: write (excl) oid 41 current snap is 35 2026-02-17T05:29:33.291 INFO:tasks.rados.rados.0.trial118.stdout:333: seq_num 148 ranges {487436=547559,1760982=657035} 2026-02-17T05:29:33.295 INFO:tasks.rados.rados.0.trial118.stdout:333: writing trial11845692-41 from 487436 to 1034995 tid 1 2026-02-17T05:29:33.301 INFO:tasks.rados.rados.0.trial118.stdout:333: writing trial11845692-41 from 1760982 to 2418017 tid 2 2026-02-17T05:29:33.301 INFO:tasks.rados.rados.0.trial118.stdout:334: snap_create 2026-02-17T05:29:33.301 INFO:tasks.rados.rados.0.trial118.stdout:330: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:29:33.301 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 469196 2026-02-17T05:29:33.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:33.339 INFO:tasks.rados.rados.0.trial118.stdout:329: expect (ObjNum 144 snap 30 seq_num 144) 2026-02-17T05:29:33.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2241755 2026-02-17T05:29:33.410 INFO:tasks.rados.rados.0.trial118.stdout:328: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-17T05:29:33.427 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:33.445 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1434218 2026-02-17T05:29:33.456 INFO:tasks.rados.rados.0.trial118.stdout:333: finishing write tid 1 to trial11845692-41 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: finishing write tid 2 to trial11845692-41 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: finishing write tid 3 to trial11845692-41 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: finishing write tid 4 to trial11845692-41 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: oid 41 updating version 0 to 206 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: oid 41 version 206 is already newer than 205 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: oid 41 version 206 is already newer than 204 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 206 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:29:33.457 INFO:tasks.rados.rados.0.trial118.stdout:333: left oid 41 (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:29:34.293 INFO:tasks.rados.rados.0.trial118.stdout:328: done (4 left) 2026-02-17T05:29:34.293 INFO:tasks.rados.rados.0.trial118.stdout:329: done (3 left) 2026-02-17T05:29:34.293 INFO:tasks.rados.rados.0.trial118.stdout:330: done (2 left) 2026-02-17T05:29:34.293 INFO:tasks.rados.rados.0.trial118.stdout:333: done (1 left) 2026-02-17T05:29:34.294 INFO:tasks.rados.rados.0.trial118.stdout:334: done (0 left) 2026-02-17T05:29:34.294 INFO:tasks.rados.rados.0.trial118.stdout:335: snap_remove snap 29 2026-02-17T05:29:35.287 INFO:tasks.rados.rados.0.trial118.stdout:335: done (0 left) 2026-02-17T05:29:35.287 INFO:tasks.rados.rados.0.trial118.stdout:336: snap_create 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:336: done (0 left) 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:337: copy_from oid 46 from oid 31 current snap is 37 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:338: copy_from oid 10 from oid 36 current snap is 37 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:339: rollback oid 30 current snap is 37 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 30 to 31 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:340: copy_from oid 2 from oid 40 current snap is 37 2026-02-17T05:29:36.289 INFO:tasks.rados.rados.0.trial118.stdout:341: read oid 34 snap 34 2026-02-17T05:29:36.290 INFO:tasks.rados.rados.0.trial118.stdout:341: expect (ObjNum 135 snap 29 seq_num 135) 2026-02-17T05:29:36.290 INFO:tasks.rados.rados.0.trial118.stdout:342: snap_create 2026-02-17T05:29:36.292 INFO:tasks.rados.rados.0.trial118.stdout:339: finishing rollback tid 0 to trial11845692-30 2026-02-17T05:29:36.293 INFO:tasks.rados.rados.0.trial118.stdout:339: finishing rollback tid 1 to trial11845692-30 2026-02-17T05:29:36.293 INFO:tasks.rados.rados.0.trial118.stdout:339: finishing rollback tid 2 to trial11845692-30 2026-02-17T05:29:36.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 190 (ObjNum 104 snap 22 seq_num 104) dirty exists 2026-02-17T05:29:36.293 INFO:tasks.rados.rados.0.trial118.stdout:340: finishing copy_from to trial11845692-2 2026-02-17T05:29:36.294 INFO:tasks.rados.rados.0.trial118.stdout:340: got expected ENOENT (src dne) 2026-02-17T05:29:36.294 INFO:tasks.rados.rados.0.trial118.stdout:340: finishing copy_from racing read to trial11845692-2 2026-02-17T05:29:36.295 INFO:tasks.rados.rados.0.trial118.stdout:341: expect (ObjNum 135 snap 29 seq_num 135) 2026-02-17T05:29:36.320 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 662072 2026-02-17T05:29:36.355 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1496479 2026-02-17T05:29:36.366 INFO:tasks.rados.rados.0.trial118.stdout:338: finishing copy_from racing read to trial11845692-10 2026-02-17T05:29:36.366 INFO:tasks.rados.rados.0.trial118.stdout:338: finishing copy_from to trial11845692-10 2026-02-17T05:29:36.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 19 (ObjNum 51 snap 1 seq_num 51) dirty exists 2026-02-17T05:29:36.367 INFO:tasks.rados.rados.0.trial118.stdout:337: finishing copy_from racing read to trial11845692-46 2026-02-17T05:29:36.367 INFO:tasks.rados.rados.0.trial118.stdout:337: finishing copy_from to trial11845692-46 2026-02-17T05:29:36.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 26 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:29:37.290 INFO:tasks.rados.rados.0.trial118.stdout:337: done (5 left) 2026-02-17T05:29:37.291 INFO:tasks.rados.rados.0.trial118.stdout:338: done (4 left) 2026-02-17T05:29:37.291 INFO:tasks.rados.rados.0.trial118.stdout:339: done (3 left) 2026-02-17T05:29:37.291 INFO:tasks.rados.rados.0.trial118.stdout:340: done (2 left) 2026-02-17T05:29:37.291 INFO:tasks.rados.rados.0.trial118.stdout:341: done (1 left) 2026-02-17T05:29:37.291 INFO:tasks.rados.rados.0.trial118.stdout:342: done (0 left) 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:343: rollback oid 31 current snap is 38 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 34 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:344: read oid 42 snap -1 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:344: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:345: rollback oid 37 current snap is 38 2026-02-17T05:29:37.292 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 18 2026-02-17T05:29:37.293 INFO:tasks.rados.rados.0.trial118.stdout:346: snap_remove snap 33 2026-02-17T05:29:38.290 INFO:tasks.rados.rados.0.trial118.stdout:346: done (3 left) 2026-02-17T05:29:38.290 INFO:tasks.rados.rados.0.trial118.stdout:347: write oid 43 current snap is 38 2026-02-17T05:29:38.291 INFO:tasks.rados.rados.0.trial118.stdout:347: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-17T05:29:38.296 INFO:tasks.rados.rados.0.trial118.stdout:347: writing trial11845692-43 from 504243 to 1127051 tid 1 2026-02-17T05:29:38.301 INFO:tasks.rados.rados.0.trial118.stdout:347: writing trial11845692-43 from 1819464 to 2336510 tid 2 2026-02-17T05:29:38.301 INFO:tasks.rados.rados.0.trial118.stdout:348: write (excl) oid 26 current snap is 38 2026-02-17T05:29:38.301 INFO:tasks.rados.rados.0.trial118.stdout:348: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-17T05:29:38.306 INFO:tasks.rados.rados.0.trial118.stdout:348: writing trial11845692-26 from 521050 to 1219107 tid 1 2026-02-17T05:29:38.311 INFO:tasks.rados.rados.0.trial118.stdout:348: writing trial11845692-26 from 1877946 to 2521050 tid 2 2026-02-17T05:29:38.311 INFO:tasks.rados.rados.0.trial118.stdout:349: rollback oid 41 current snap is 38 2026-02-17T05:29:38.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 18 2026-02-17T05:29:38.311 INFO:tasks.rados.rados.0.trial118.stdout:344: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:29:38.316 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1036547 2026-02-17T05:29:38.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1774347 2026-02-17T05:29:38.346 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2267347 2026-02-17T05:29:38.348 INFO:tasks.rados.rados.0.trial118.stdout:345: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:29:38.348 INFO:tasks.rados.rados.0.trial118.stdout:345: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:29:38.348 INFO:tasks.rados.rados.0.trial118.stdout:343: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:343: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:345: finishing rollback tid 2 to trial11845692-37 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 22 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:343: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 130 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:29:38.349 INFO:tasks.rados.rados.0.trial118.stdout:347: finishing write tid 1 to trial11845692-43 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: finishing write tid 2 to trial11845692-43 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: finishing write tid 3 to trial11845692-43 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: finishing write tid 4 to trial11845692-43 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: oid 43 updating version 0 to 101 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: oid 43 version 101 is already newer than 100 2026-02-17T05:29:38.350 INFO:tasks.rados.rados.0.trial118.stdout:347: oid 43 updating version 101 to 102 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 102 (ObjNum 149 snap 38 seq_num 149) dirty exists 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:347: left oid 43 (ObjNum 149 snap 38 seq_num 149) 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:348: finishing write tid 1 to trial11845692-26 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:348: finishing write tid 2 to trial11845692-26 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:343: done (5 left) 2026-02-17T05:29:38.351 INFO:tasks.rados.rados.0.trial118.stdout:344: done (4 left) 2026-02-17T05:29:38.352 INFO:tasks.rados.rados.0.trial118.stdout:345: done (3 left) 2026-02-17T05:29:38.352 INFO:tasks.rados.rados.0.trial118.stdout:347: done (2 left) 2026-02-17T05:29:38.352 INFO:tasks.rados.rados.0.trial118.stdout:350: snap_remove snap 22 2026-02-17T05:29:39.295 INFO:tasks.rados.rados.0.trial118.stdout:350: done (2 left) 2026-02-17T05:29:39.295 INFO:tasks.rados.rados.0.trial118.stdout:351: read oid 15 snap -1 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:351: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:352: rollback oid 31 current snap is 38 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 31 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: finishing write tid 3 to trial11845692-26 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: finishing write tid 4 to trial11845692-26 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: oid 26 updating version 0 to 23 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: oid 26 updating version 23 to 24 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: oid 26 updating version 24 to 25 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 25 (ObjNum 150 snap 38 seq_num 150) dirty exists 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:348: left oid 26 (ObjNum 150 snap 38 seq_num 150) 2026-02-17T05:29:39.296 INFO:tasks.rados.rados.0.trial118.stdout:349: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:349: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:349: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 214 (ObjNum 79 snap 12 seq_num 79) dirty exists 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:348: done (3 left) 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:349: done (2 left) 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:353: read oid 20 snap -1 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:353: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:39.297 INFO:tasks.rados.rados.0.trial118.stdout:354: snap_remove snap 34 2026-02-17T05:29:40.288 INFO:tasks.rados.rados.0.trial118.stdout:354: done (3 left) 2026-02-17T05:29:40.288 INFO:tasks.rados.rados.0.trial118.stdout:355: read oid 25 snap -1 2026-02-17T05:29:40.288 INFO:tasks.rados.rados.0.trial118.stdout:355: expect (ObjNum 96 snap 21 seq_num 96) 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:356: read oid 23 snap 28 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:356: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:357: rollback oid 41 current snap is 38 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:352: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:352: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:352: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 137 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:29:40.289 INFO:tasks.rados.rados.0.trial118.stdout:353: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:40.350 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1839554 2026-02-17T05:29:40.351 INFO:tasks.rados.rados.0.trial118.stdout:351: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:29:40.351 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:40.378 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1882589 2026-02-17T05:29:40.397 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1653452 2026-02-17T05:29:40.416 INFO:tasks.rados.rados.0.trial118.stdout:356: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:40.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:40.486 INFO:tasks.rados.rados.0.trial118.stdout:355: expect (ObjNum 96 snap 21 seq_num 96) 2026-02-17T05:29:40.548 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1042545 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 37 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:351: done (5 left) 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:352: done (4 left) 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:353: done (3 left) 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:355: done (2 left) 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:356: done (1 left) 2026-02-17T05:29:40.575 INFO:tasks.rados.rados.0.trial118.stdout:358: snap_remove snap 25 2026-02-17T05:29:41.300 INFO:tasks.rados.rados.0.trial118.stdout:358: done (1 left) 2026-02-17T05:29:41.300 INFO:tasks.rados.rados.0.trial118.stdout:359: write oid 50 current snap is 38 2026-02-17T05:29:41.300 INFO:tasks.rados.rados.0.trial118.stdout:359: seq_num 151 ranges {537857=773306,1936428=520715} 2026-02-17T05:29:41.304 INFO:tasks.rados.rados.0.trial118.stdout:359: writing trial11845692-50 from 537857 to 1311163 tid 1 2026-02-17T05:29:41.309 INFO:tasks.rados.rados.0.trial118.stdout:359: writing trial11845692-50 from 1936428 to 2457143 tid 2 2026-02-17T05:29:41.309 INFO:tasks.rados.rados.0.trial118.stdout:360: snap_remove snap 26 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:360: done (2 left) 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:357: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:357: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:357: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:29:42.303 INFO:tasks.rados.rados.0.trial118.stdout:359: finishing write tid 1 to trial11845692-50 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: finishing write tid 2 to trial11845692-50 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: finishing write tid 3 to trial11845692-50 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: finishing write tid 4 to trial11845692-50 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: oid 50 updating version 0 to 116 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: oid 50 version 116 is already newer than 114 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: oid 50 version 116 is already newer than 115 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 116 (ObjNum 151 snap 38 seq_num 151) dirty exists 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: left oid 50 (ObjNum 151 snap 38 seq_num 151) 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:361: read oid 31 snap -1 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:361: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:357: done (2 left) 2026-02-17T05:29:42.304 INFO:tasks.rados.rados.0.trial118.stdout:359: done (1 left) 2026-02-17T05:29:42.305 INFO:tasks.rados.rados.0.trial118.stdout:362: snap_remove snap 31 2026-02-17T05:29:43.304 INFO:tasks.rados.rados.0.trial118.stdout:362: done (1 left) 2026-02-17T05:29:43.304 INFO:tasks.rados.rados.0.trial118.stdout:363: snap_remove snap 24 2026-02-17T05:29:44.306 INFO:tasks.rados.rados.0.trial118.stdout:363: done (1 left) 2026-02-17T05:29:44.307 INFO:tasks.rados.rados.0.trial118.stdout:364: read oid 49 snap 37 2026-02-17T05:29:44.307 INFO:tasks.rados.rados.0.trial118.stdout:364: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:29:44.307 INFO:tasks.rados.rados.0.trial118.stdout:365: copy_from oid 11 from oid 10 current snap is 38 2026-02-17T05:29:44.307 INFO:tasks.rados.rados.0.trial118.stdout:361: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:29:44.307 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:44.391 INFO:tasks.rados.rados.0.trial118.stdout:364: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:29:44.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:44.448 INFO:tasks.rados.rados.0.trial118.stdout:365: finishing copy_from racing read to trial11845692-11 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:365: finishing copy_from to trial11845692-11 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 19 (ObjNum 51 snap 1 seq_num 51) dirty exists 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:361: done (2 left) 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:364: done (1 left) 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:365: done (0 left) 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:366: write oid 37 current snap is 38 2026-02-17T05:29:44.449 INFO:tasks.rados.rados.0.trial118.stdout:366: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-17T05:29:44.452 INFO:tasks.rados.rados.0.trial118.stdout:366: writing trial11845692-37 from 554664 to 1003219 tid 1 2026-02-17T05:29:44.456 INFO:tasks.rados.rados.0.trial118.stdout:366: writing trial11845692-37 from 1478557 to 2142930 tid 2 2026-02-17T05:29:44.456 INFO:tasks.rados.rados.0.trial118.stdout:367: write (excl) oid 8 current snap is 38 2026-02-17T05:29:44.456 INFO:tasks.rados.rados.0.trial118.stdout:367: seq_num 153 ranges {571471=640157,1653392=524384} 2026-02-17T05:29:44.461 INFO:tasks.rados.rados.0.trial118.stdout:367: writing trial11845692-8 from 571471 to 1211628 tid 1 2026-02-17T05:29:44.465 INFO:tasks.rados.rados.0.trial118.stdout:367: writing trial11845692-8 from 1653392 to 2177776 tid 2 2026-02-17T05:29:44.465 INFO:tasks.rados.rados.0.trial118.stdout:368: read oid 10 snap -1 2026-02-17T05:29:44.465 INFO:tasks.rados.rados.0.trial118.stdout:368: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:29:44.465 INFO:tasks.rados.rados.0.trial118.stdout:369: read oid 2 snap -1 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:369: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:370: copy_from oid 20 from oid 41 current snap is 38 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: finishing write tid 1 to trial11845692-37 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: finishing write tid 2 to trial11845692-37 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: finishing write tid 3 to trial11845692-37 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: finishing write tid 4 to trial11845692-37 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: oid 37 updating version 0 to 27 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: oid 37 updating version 27 to 28 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: oid 37 version 28 is already newer than 26 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 28 (ObjNum 152 snap 38 seq_num 152) dirty exists 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:366: left oid 37 (ObjNum 152 snap 38 seq_num 152) 2026-02-17T05:29:44.466 INFO:tasks.rados.rados.0.trial118.stdout:367: finishing write tid 1 to trial11845692-8 2026-02-17T05:29:44.467 INFO:tasks.rados.rados.0.trial118.stdout:366: done (4 left) 2026-02-17T05:29:44.467 INFO:tasks.rados.rados.0.trial118.stdout:371: write (excl) oid 42 current snap is 38 2026-02-17T05:29:44.467 INFO:tasks.rados.rados.0.trial118.stdout:371: seq_num 154 ranges {588278=715406,1711874=668042} 2026-02-17T05:29:44.469 INFO:tasks.rados.rados.0.trial118.stdout:371: writing trial11845692-42 from 588278 to 1303684 tid 1 2026-02-17T05:29:44.474 INFO:tasks.rados.rados.0.trial118.stdout:371: writing trial11845692-42 from 1711874 to 2379916 tid 2 2026-02-17T05:29:44.474 INFO:tasks.rados.rados.0.trial118.stdout:372: snap_remove snap 18 2026-02-17T05:29:45.290 INFO:tasks.rados.rados.0.trial118.stdout:372: done (5 left) 2026-02-17T05:29:45.290 INFO:tasks.rados.rados.0.trial118.stdout:373: write oid 5 current snap is 38 2026-02-17T05:29:45.290 INFO:tasks.rados.rados.0.trial118.stdout:373: seq_num 155 ranges {605085=790655,2170356=434729} 2026-02-17T05:29:45.295 INFO:tasks.rados.rados.0.trial118.stdout:373: writing trial11845692-5 from 605085 to 1395740 tid 1 2026-02-17T05:29:45.300 INFO:tasks.rados.rados.0.trial118.stdout:373: writing trial11845692-5 from 2170356 to 2605085 tid 2 2026-02-17T05:29:45.300 INFO:tasks.rados.rados.0.trial118.stdout:374: snap_remove snap 36 2026-02-17T05:29:46.292 INFO:tasks.rados.rados.0.trial118.stdout:374: done (6 left) 2026-02-17T05:29:46.293 INFO:tasks.rados.rados.0.trial118.stdout:375: read oid 12 snap -1 2026-02-17T05:29:46.293 INFO:tasks.rados.rados.0.trial118.stdout:375: expect (ObjNum 144 snap 30 seq_num 144) 2026-02-17T05:29:46.293 INFO:tasks.rados.rados.0.trial118.stdout:376: snap_remove snap 30 2026-02-17T05:29:47.293 INFO:tasks.rados.rados.0.trial118.stdout:376: done (7 left) 2026-02-17T05:29:47.293 INFO:tasks.rados.rados.0.trial118.stdout:377: read oid 14 snap -1 2026-02-17T05:29:47.293 INFO:tasks.rados.rados.0.trial118.stdout:377: expect deleted 2026-02-17T05:29:47.294 INFO:tasks.rados.rados.0.trial118.stdout:378: write (excl) oid 32 current snap is 38 2026-02-17T05:29:47.294 INFO:tasks.rados.rados.0.trial118.stdout:378: seq_num 156 ranges {621892=465904,1712485=671711} 2026-02-17T05:29:47.298 INFO:tasks.rados.rados.0.trial118.stdout:378: writing trial11845692-32 from 621892 to 1087796 tid 1 2026-02-17T05:29:47.303 INFO:tasks.rados.rados.0.trial118.stdout:378: writing trial11845692-32 from 1712485 to 2384196 tid 2 2026-02-17T05:29:47.303 INFO:tasks.rados.rados.0.trial118.stdout:379: snap_create 2026-02-17T05:29:47.303 INFO:tasks.rados.rados.0.trial118.stdout:369: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:29:47.318 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1752406 2026-02-17T05:29:47.323 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1542838 2026-02-17T05:29:47.330 INFO:tasks.rados.rados.0.trial118.stdout:368: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:29:47.381 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: finishing write tid 2 to trial11845692-8 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: finishing write tid 3 to trial11845692-8 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: finishing write tid 4 to trial11845692-8 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: oid 8 updating version 0 to 173 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: oid 8 updating version 173 to 175 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: oid 8 version 175 is already newer than 174 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 175 (ObjNum 153 snap 38 seq_num 153) dirty exists 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:367: left oid 8 (ObjNum 153 snap 38 seq_num 153) 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:370: finishing copy_from racing read to trial11845692-20 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:370: finishing copy_from to trial11845692-20 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:371: finishing write tid 1 to trial11845692-42 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:371: finishing write tid 2 to trial11845692-42 2026-02-17T05:29:47.411 INFO:tasks.rados.rados.0.trial118.stdout:371: finishing write tid 3 to trial11845692-42 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:371: finishing write tid 4 to trial11845692-42 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:371: oid 42 updating version 0 to 168 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:371: oid 42 updating version 168 to 169 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:371: oid 42 version 169 is already newer than 167 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 169 (ObjNum 154 snap 38 seq_num 154) dirty exists 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:371: left oid 42 (ObjNum 154 snap 38 seq_num 154) 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: finishing write tid 1 to trial11845692-5 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: finishing write tid 2 to trial11845692-5 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: finishing write tid 3 to trial11845692-5 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: finishing write tid 4 to trial11845692-5 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: oid 5 updating version 0 to 37 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: oid 5 version 37 is already newer than 36 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: oid 5 version 37 is already newer than 35 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 37 (ObjNum 155 snap 38 seq_num 155) dirty exists 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:373: left oid 5 (ObjNum 155 snap 38 seq_num 155) 2026-02-17T05:29:47.412 INFO:tasks.rados.rados.0.trial118.stdout:375: expect (ObjNum 144 snap 30 seq_num 144) 2026-02-17T05:29:47.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1404527 2026-02-17T05:29:47.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: finishing write tid 1 to trial11845692-32 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: finishing write tid 2 to trial11845692-32 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: finishing write tid 3 to trial11845692-32 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: finishing write tid 4 to trial11845692-32 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: oid 32 updating version 0 to 119 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: oid 32 updating version 119 to 120 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: oid 32 updating version 120 to 121 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 121 (ObjNum 156 snap 38 seq_num 156) dirty exists 2026-02-17T05:29:47.489 INFO:tasks.rados.rados.0.trial118.stdout:378: left oid 32 (ObjNum 156 snap 38 seq_num 156) 2026-02-17T05:29:48.299 INFO:tasks.rados.rados.0.trial118.stdout:367: done (9 left) 2026-02-17T05:29:48.299 INFO:tasks.rados.rados.0.trial118.stdout:368: done (8 left) 2026-02-17T05:29:48.299 INFO:tasks.rados.rados.0.trial118.stdout:369: done (7 left) 2026-02-17T05:29:48.299 INFO:tasks.rados.rados.0.trial118.stdout:370: done (6 left) 2026-02-17T05:29:48.299 INFO:tasks.rados.rados.0.trial118.stdout:371: done (5 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:373: done (4 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:375: done (3 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:377: done (2 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:378: done (1 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:379: done (0 left) 2026-02-17T05:29:48.300 INFO:tasks.rados.rados.0.trial118.stdout:380: delete oid 32 current snap is 39 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:380: done (0 left) 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:381: read oid 16 snap -1 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:381: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:382: read oid 6 snap -1 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:382: expect deleted 2026-02-17T05:29:48.301 INFO:tasks.rados.rados.0.trial118.stdout:383: snap_remove snap 28 2026-02-17T05:29:49.301 INFO:tasks.rados.rados.0.trial118.stdout:383: done (2 left) 2026-02-17T05:29:49.301 INFO:tasks.rados.rados.0.trial118.stdout:384: delete oid 26 current snap is 39 2026-02-17T05:29:49.302 INFO:tasks.rados.rados.0.trial118.stdout:381: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:49.333 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:49.366 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1546474 2026-02-17T05:29:49.389 INFO:tasks.rados.rados.0.trial118.stdout:381: done (2 left) 2026-02-17T05:29:49.389 INFO:tasks.rados.rados.0.trial118.stdout:382: done (1 left) 2026-02-17T05:29:49.390 INFO:tasks.rados.rados.0.trial118.stdout:384: done (0 left) 2026-02-17T05:29:49.390 INFO:tasks.rados.rados.0.trial118.stdout:385: snap_remove snap 35 2026-02-17T05:29:50.289 INFO:tasks.rados.rados.0.trial118.stdout:385: done (0 left) 2026-02-17T05:29:50.290 INFO:tasks.rados.rados.0.trial118.stdout:386: delete oid 29 current snap is 39 2026-02-17T05:29:50.292 INFO:tasks.rados.rados.0.trial118.stdout:386: done (0 left) 2026-02-17T05:29:50.292 INFO:tasks.rados.rados.0.trial118.stdout:387: copy_from oid 32 from oid 24 current snap is 39 2026-02-17T05:29:50.292 INFO:tasks.rados.rados.0.trial118.stdout:388: delete oid 25 current snap is 39 2026-02-17T05:29:50.293 INFO:tasks.rados.rados.0.trial118.stdout:387: finishing copy_from to trial11845692-32 2026-02-17T05:29:50.293 INFO:tasks.rados.rados.0.trial118.stdout:387: got expected ENOENT (src dne) 2026-02-17T05:29:50.293 INFO:tasks.rados.rados.0.trial118.stdout:387: finishing copy_from racing read to trial11845692-32 2026-02-17T05:29:50.296 INFO:tasks.rados.rados.0.trial118.stdout:387: done (1 left) 2026-02-17T05:29:50.296 INFO:tasks.rados.rados.0.trial118.stdout:388: done (0 left) 2026-02-17T05:29:50.296 INFO:tasks.rados.rados.0.trial118.stdout:389: snap_create 2026-02-17T05:29:51.290 INFO:tasks.rados.rados.0.trial118.stdout:389: done (0 left) 2026-02-17T05:29:51.291 INFO:tasks.rados.rados.0.trial118.stdout:390: snap_create 2026-02-17T05:29:52.291 INFO:tasks.rados.rados.0.trial118.stdout:390: done (0 left) 2026-02-17T05:29:52.291 INFO:tasks.rados.rados.0.trial118.stdout:391: write oid 27 current snap is 41 2026-02-17T05:29:52.291 INFO:tasks.rados.rados.0.trial118.stdout:391: seq_num 161 ranges {705927=558502,2004895=422707} 2026-02-17T05:29:52.296 INFO:tasks.rados.rados.0.trial118.stdout:391: writing trial11845692-27 from 705927 to 1264429 tid 1 2026-02-17T05:29:52.301 INFO:tasks.rados.rados.0.trial118.stdout:391: writing trial11845692-27 from 2004895 to 2427602 tid 2 2026-02-17T05:29:52.301 INFO:tasks.rados.rados.0.trial118.stdout:392: snap_remove snap 37 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:392: done (1 left) 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:393: rollback oid 49 current snap is 41 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 40 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: finishing write tid 1 to trial11845692-27 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: finishing write tid 2 to trial11845692-27 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: finishing write tid 3 to trial11845692-27 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: finishing write tid 4 to trial11845692-27 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: oid 27 updating version 0 to 231 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: oid 27 version 231 is already newer than 230 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: oid 27 updating version 231 to 232 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 232 (ObjNum 161 snap 41 seq_num 161) dirty exists 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: left oid 27 (ObjNum 161 snap 41 seq_num 161) 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:391: done (1 left) 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:394: write (excl) oid 47 current snap is 41 2026-02-17T05:29:53.292 INFO:tasks.rados.rados.0.trial118.stdout:394: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-17T05:29:53.297 INFO:tasks.rados.rados.0.trial118.stdout:394: writing trial11845692-47 from 722734 to 1356485 tid 1 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:394: writing trial11845692-47 from 2063377 to 2722734 tid 2 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:395: copy_from oid 18 from oid 44 current snap is 41 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:393: finishing rollback tid 0 to trial11845692-49 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:393: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:393: finishing rollback tid 2 to trial11845692-49 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 137 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:394: finishing write tid 1 to trial11845692-47 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:393: done (2 left) 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:396: read oid 21 snap -1 2026-02-17T05:29:53.303 INFO:tasks.rados.rados.0.trial118.stdout:396: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:29:53.304 INFO:tasks.rados.rados.0.trial118.stdout:397: read oid 9 snap -1 2026-02-17T05:29:53.304 INFO:tasks.rados.rados.0.trial118.stdout:397: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:53.304 INFO:tasks.rados.rados.0.trial118.stdout:398: snap_remove snap 40 2026-02-17T05:29:54.295 INFO:tasks.rados.rados.0.trial118.stdout:398: done (4 left) 2026-02-17T05:29:54.296 INFO:tasks.rados.rados.0.trial118.stdout:399: snap_remove snap 39 2026-02-17T05:29:55.290 INFO:tasks.rados.rados.0.trial118.stdout:399: done (4 left) 2026-02-17T05:29:55.290 INFO:tasks.rados.rados.0.trial118.stdout:400: copy_from oid 43 from oid 15 current snap is 41 2026-02-17T05:29:55.290 INFO:tasks.rados.rados.0.trial118.stdout:395: finishing copy_from to trial11845692-18 2026-02-17T05:29:55.291 INFO:tasks.rados.rados.0.trial118.stdout:395: got expected ENOENT (src dne) 2026-02-17T05:29:55.291 INFO:tasks.rados.rados.0.trial118.stdout:395: finishing copy_from racing read to trial11845692-18 2026-02-17T05:29:55.291 INFO:tasks.rados.rados.0.trial118.stdout:396: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:29:55.332 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 403199 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: finishing write tid 2 to trial11845692-47 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: finishing write tid 3 to trial11845692-47 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: finishing write tid 4 to trial11845692-47 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: oid 47 updating version 0 to 194 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: oid 47 version 194 is already newer than 193 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: oid 47 updating version 194 to 195 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 195 (ObjNum 162 snap 41 seq_num 162) dirty exists 2026-02-17T05:29:55.423 INFO:tasks.rados.rados.0.trial118.stdout:394: left oid 47 (ObjNum 162 snap 41 seq_num 162) 2026-02-17T05:29:55.424 INFO:tasks.rados.rados.0.trial118.stdout:397: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:55.434 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2123682 2026-02-17T05:29:55.449 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:55.513 INFO:tasks.rados.rados.0.trial118.stdout:400: finishing copy_from racing read to trial11845692-43 2026-02-17T05:29:55.513 INFO:tasks.rados.rados.0.trial118.stdout:394: done (4 left) 2026-02-17T05:29:55.513 INFO:tasks.rados.rados.0.trial118.stdout:395: done (3 left) 2026-02-17T05:29:55.513 INFO:tasks.rados.rados.0.trial118.stdout:396: done (2 left) 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:397: done (1 left) 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:401: copy_from oid 17 from oid 18 current snap is 41 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:400: finishing copy_from to trial11845692-43 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 26 (ObjNum 98 snap 21 seq_num 98) dirty exists 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:400: done (1 left) 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:402: read oid 31 snap -1 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:402: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:403: read oid 11 snap -1 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:403: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:404: rollback oid 2 current snap is 41 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 38 2026-02-17T05:29:55.514 INFO:tasks.rados.rados.0.trial118.stdout:405: write oid 42 current snap is 41 2026-02-17T05:29:55.515 INFO:tasks.rados.rados.0.trial118.stdout:405: seq_num 163 ranges {739541=709000,2121859=426376} 2026-02-17T05:29:55.518 INFO:tasks.rados.rados.0.trial118.stdout:405: writing trial11845692-42 from 739541 to 1448541 tid 1 2026-02-17T05:29:55.523 INFO:tasks.rados.rados.0.trial118.stdout:405: writing trial11845692-42 from 2121859 to 2548235 tid 2 2026-02-17T05:29:55.523 INFO:tasks.rados.rados.0.trial118.stdout:406: read oid 16 snap 38 2026-02-17T05:29:55.523 INFO:tasks.rados.rados.0.trial118.stdout:406: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:407: copy_from oid 50 from oid 39 current snap is 41 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:401: finishing copy_from to trial11845692-17 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:401: got expected ENOENT (src dne) 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:401: finishing copy_from racing read to trial11845692-17 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:402: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:29:55.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:55.560 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1204276 2026-02-17T05:29:55.589 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1755676 2026-02-17T05:29:55.605 INFO:tasks.rados.rados.0.trial118.stdout:403: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:29:55.685 INFO:tasks.rados.rados.0.trial118.stdout:404: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:29:55.685 INFO:tasks.rados.rados.0.trial118.stdout:404: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:404: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 235 (ObjNum 134 snap 29 seq_num 134) dirty exists 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:405: finishing write tid 1 to trial11845692-42 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:401: done (6 left) 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:402: done (5 left) 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:403: done (4 left) 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:404: done (3 left) 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:408: write (excl) oid 29 current snap is 41 2026-02-17T05:29:55.686 INFO:tasks.rados.rados.0.trial118.stdout:408: seq_num 164 ranges {756348=784249,2063988=686387} 2026-02-17T05:29:55.691 INFO:tasks.rados.rados.0.trial118.stdout:408: writing trial11845692-29 from 756348 to 1540597 tid 1 2026-02-17T05:29:55.696 INFO:tasks.rados.rados.0.trial118.stdout:408: writing trial11845692-29 from 2063988 to 2750375 tid 2 2026-02-17T05:29:55.696 INFO:tasks.rados.rados.0.trial118.stdout:409: delete oid 36 current snap is 41 2026-02-17T05:29:55.696 INFO:tasks.rados.rados.0.trial118.stdout:405: finishing write tid 2 to trial11845692-42 2026-02-17T05:29:55.696 INFO:tasks.rados.rados.0.trial118.stdout:405: finishing write tid 3 to trial11845692-42 2026-02-17T05:29:55.697 INFO:tasks.rados.rados.0.trial118.stdout:406: expect (ObjNum 76 snap 9 seq_num 76) 2026-02-17T05:29:55.697 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:55.782 INFO:tasks.rados.rados.0.trial118.stdout:405: finishing write tid 4 to trial11845692-42 2026-02-17T05:29:55.782 INFO:tasks.rados.rados.0.trial118.stdout:405: oid 42 updating version 0 to 203 2026-02-17T05:29:55.782 INFO:tasks.rados.rados.0.trial118.stdout:405: oid 42 version 203 is already newer than 199 2026-02-17T05:29:55.782 INFO:tasks.rados.rados.0.trial118.stdout:405: oid 42 version 203 is already newer than 202 2026-02-17T05:29:55.782 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 203 (ObjNum 163 snap 41 seq_num 163) dirty exists 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:405: left oid 42 (ObjNum 163 snap 41 seq_num 163) 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:407: finishing copy_from racing read to trial11845692-50 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:407: finishing copy_from to trial11845692-50 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 90 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: finishing write tid 1 to trial11845692-29 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: finishing write tid 2 to trial11845692-29 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: finishing write tid 3 to trial11845692-29 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: finishing write tid 4 to trial11845692-29 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: oid 29 updating version 0 to 273 2026-02-17T05:29:55.783 INFO:tasks.rados.rados.0.trial118.stdout:408: oid 29 updating version 273 to 274 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:408: oid 29 version 274 is already newer than 272 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 274 (ObjNum 164 snap 41 seq_num 164) dirty exists 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:408: left oid 29 (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:405: done (4 left) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:406: done (3 left) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:407: done (2 left) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:408: done (1 left) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:409: done (0 left) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:410: read oid 47 snap 38 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:410: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:411: write (excl) oid 34 current snap is 41 2026-02-17T05:29:55.784 INFO:tasks.rados.rados.0.trial118.stdout:411: seq_num 166 ranges {789962=534747,1780952=690056} 2026-02-17T05:29:55.786 INFO:tasks.rados.rados.0.trial118.stdout:411: writing trial11845692-34 from 789962 to 1324709 tid 1 2026-02-17T05:29:55.791 INFO:tasks.rados.rados.0.trial118.stdout:411: writing trial11845692-34 from 1780952 to 2471008 tid 2 2026-02-17T05:29:55.791 INFO:tasks.rados.rados.0.trial118.stdout:412: read oid 23 snap 38 2026-02-17T05:29:55.792 INFO:tasks.rados.rados.0.trial118.stdout:412: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:55.792 INFO:tasks.rados.rados.0.trial118.stdout:413: rollback oid 41 current snap is 41 2026-02-17T05:29:55.792 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 38 2026-02-17T05:29:55.792 INFO:tasks.rados.rados.0.trial118.stdout:410: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-17T05:29:55.792 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 309701 2026-02-17T05:29:55.811 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1829199 2026-02-17T05:29:55.839 INFO:tasks.rados.rados.0.trial118.stdout:411: finishing write tid 1 to trial11845692-34 2026-02-17T05:29:55.839 INFO:tasks.rados.rados.0.trial118.stdout:412: expect (ObjNum 119 snap 24 seq_num 119) 2026-02-17T05:29:55.862 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:55.886 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:55.910 INFO:tasks.rados.rados.0.trial118.stdout:413: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:411: finishing write tid 2 to trial11845692-34 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:413: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:411: finishing write tid 3 to trial11845692-34 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:413: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 278 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:411: finishing write tid 4 to trial11845692-34 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:411: oid 34 updating version 0 to 103 2026-02-17T05:29:55.911 INFO:tasks.rados.rados.0.trial118.stdout:411: oid 34 version 103 is already newer than 101 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:411: oid 34 version 103 is already newer than 102 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 103 (ObjNum 166 snap 41 seq_num 166) dirty exists 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:411: left oid 34 (ObjNum 166 snap 41 seq_num 166) 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:410: done (3 left) 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:411: done (2 left) 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:412: done (1 left) 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:413: done (0 left) 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:414: write (excl) oid 15 current snap is 41 2026-02-17T05:29:55.912 INFO:tasks.rados.rados.0.trial118.stdout:414: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2026-02-17T05:29:55.914 INFO:tasks.rados.rados.0.trial118.stdout:414: writing trial11845692-15 from 406769 to 1016765 tid 1 2026-02-17T05:29:55.917 INFO:tasks.rados.rados.0.trial118.stdout:414: writing trial11845692-15 from 1439434 to 1873148 tid 2 2026-02-17T05:29:55.921 INFO:tasks.rados.rados.0.trial118.stdout:414: writing trial11845692-15 from 2303522 to 2806769 tid 3 2026-02-17T05:29:55.921 INFO:tasks.rados.rados.0.trial118.stdout:415: copy_from oid 47 from oid 20 current snap is 41 2026-02-17T05:29:55.921 INFO:tasks.rados.rados.0.trial118.stdout:414: finishing write tid 1 to trial11845692-15 2026-02-17T05:29:55.921 INFO:tasks.rados.rados.0.trial118.stdout:414: finishing write tid 2 to trial11845692-15 2026-02-17T05:29:55.921 INFO:tasks.rados.rados.0.trial118.stdout:416: snap_create 2026-02-17T05:29:55.922 INFO:tasks.rados.rados.0.trial118.stdout:414: finishing write tid 3 to trial11845692-15 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: finishing write tid 4 to trial11845692-15 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: finishing write tid 5 to trial11845692-15 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: oid 15 updating version 0 to 167 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: oid 15 version 167 is already newer than 166 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: oid 15 updating version 167 to 168 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: oid 15 version 168 is already newer than 165 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 168 (ObjNum 167 snap 41 seq_num 167) dirty exists 2026-02-17T05:29:55.923 INFO:tasks.rados.rados.0.trial118.stdout:414: left oid 15 (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:29:55.929 INFO:tasks.rados.rados.0.trial118.stdout:415: finishing copy_from racing read to trial11845692-47 2026-02-17T05:29:55.930 INFO:tasks.rados.rados.0.trial118.stdout:415: finishing copy_from to trial11845692-47 2026-02-17T05:29:55.930 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:29:56.301 INFO:tasks.rados.rados.0.trial118.stdout:414: done (2 left) 2026-02-17T05:29:56.301 INFO:tasks.rados.rados.0.trial118.stdout:415: done (1 left) 2026-02-17T05:29:56.302 INFO:tasks.rados.rados.0.trial118.stdout:416: done (0 left) 2026-02-17T05:29:56.302 INFO:tasks.rados.rados.0.trial118.stdout:417: write (excl) oid 12 current snap is 42 2026-02-17T05:29:56.302 INFO:tasks.rados.rados.0.trial118.stdout:417: seq_num 168 ranges {423576=401598,1497916=693725} 2026-02-17T05:29:56.304 INFO:tasks.rados.rados.0.trial118.stdout:417: writing trial11845692-12 from 423576 to 825174 tid 1 2026-02-17T05:29:56.310 INFO:tasks.rados.rados.0.trial118.stdout:417: writing trial11845692-12 from 1497916 to 2191641 tid 2 2026-02-17T05:29:56.310 INFO:tasks.rados.rados.0.trial118.stdout:418: read oid 9 snap -1 2026-02-17T05:29:56.310 INFO:tasks.rados.rados.0.trial118.stdout:418: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:419: rollback oid 21 current snap is 42 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 41 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:417: finishing write tid 1 to trial11845692-12 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:420: read oid 48 snap 41 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:420: expect deleted 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:421: read oid 6 snap 41 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:421: expect deleted 2026-02-17T05:29:56.311 INFO:tasks.rados.rados.0.trial118.stdout:422: snap_remove snap 38 2026-02-17T05:29:57.301 INFO:tasks.rados.rados.0.trial118.stdout:422: done (5 left) 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:423: copy_from oid 10 from oid 31 current snap is 42 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: finishing write tid 2 to trial11845692-12 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: finishing write tid 3 to trial11845692-12 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: finishing write tid 4 to trial11845692-12 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: oid 12 updating version 0 to 164 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: oid 12 updating version 164 to 166 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: oid 12 version 166 is already newer than 165 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 166 (ObjNum 168 snap 42 seq_num 168) dirty exists 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:417: left oid 12 (ObjNum 168 snap 42 seq_num 168) 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:419: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:419: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:419: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 234 (ObjNum 88 snap 13 seq_num 88) dirty exists 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:418: expect (ObjNum 81 snap 12 seq_num 81) 2026-02-17T05:29:57.302 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 317895 2026-02-17T05:29:57.335 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:57.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:29:57.402 INFO:tasks.rados.rados.0.trial118.stdout:423: finishing copy_from racing read to trial11845692-10 2026-02-17T05:29:57.402 INFO:tasks.rados.rados.0.trial118.stdout:423: finishing copy_from to trial11845692-10 2026-02-17T05:29:57.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 137 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:29:57.402 INFO:tasks.rados.rados.0.trial118.stdout:417: done (5 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:418: done (4 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:419: done (3 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:420: done (2 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:421: done (1 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:423: done (0 left) 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:424: read oid 48 snap -1 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:424: expect deleted 2026-02-17T05:29:57.403 INFO:tasks.rados.rados.0.trial118.stdout:425: snap_create 2026-02-17T05:29:58.306 INFO:tasks.rados.rados.0.trial118.stdout:424: done (1 left) 2026-02-17T05:29:58.306 INFO:tasks.rados.rados.0.trial118.stdout:425: done (0 left) 2026-02-17T05:29:58.306 INFO:tasks.rados.rados.0.trial118.stdout:426: rollback oid 13 current snap is 43 2026-02-17T05:29:58.306 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 41 2026-02-17T05:29:58.307 INFO:tasks.rados.rados.0.trial118.stdout:427: write oid 33 current snap is 43 2026-02-17T05:29:58.307 INFO:tasks.rados.rados.0.trial118.stdout:427: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2026-02-17T05:29:58.310 INFO:tasks.rados.rados.0.trial118.stdout:427: writing trial11845692-33 from 440383 to 917230 tid 1 2026-02-17T05:29:58.313 INFO:tasks.rados.rados.0.trial118.stdout:427: writing trial11845692-33 from 1556398 to 1993781 tid 2 2026-02-17T05:29:58.317 INFO:tasks.rados.rados.0.trial118.stdout:427: writing trial11845692-33 from 2474721 to 2840383 tid 3 2026-02-17T05:29:58.317 INFO:tasks.rados.rados.0.trial118.stdout:428: snap_create 2026-02-17T05:29:58.317 INFO:tasks.rados.rados.0.trial118.stdout:426: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:29:58.317 INFO:tasks.rados.rados.0.trial118.stdout:426: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:29:58.317 INFO:tasks.rados.rados.0.trial118.stdout:426: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:29:58.318 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 149 (ObjNum 78 snap 12 seq_num 78) dirty exists 2026-02-17T05:29:58.318 INFO:tasks.rados.rados.0.trial118.stdout:427: finishing write tid 1 to trial11845692-33 2026-02-17T05:29:58.318 INFO:tasks.rados.rados.0.trial118.stdout:427: finishing write tid 2 to trial11845692-33 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: finishing write tid 3 to trial11845692-33 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: finishing write tid 4 to trial11845692-33 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: finishing write tid 5 to trial11845692-33 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: oid 33 updating version 0 to 242 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: oid 33 updating version 242 to 243 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: oid 33 version 243 is already newer than 241 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: oid 33 version 243 is already newer than 240 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 243 (ObjNum 169 snap 43 seq_num 169) dirty exists 2026-02-17T05:29:58.319 INFO:tasks.rados.rados.0.trial118.stdout:427: left oid 33 (ObjNum 169 snap 43 seq_num 169) 2026-02-17T05:29:59.307 INFO:tasks.rados.rados.0.trial118.stdout:426: done (2 left) 2026-02-17T05:29:59.307 INFO:tasks.rados.rados.0.trial118.stdout:427: done (1 left) 2026-02-17T05:29:59.307 INFO:tasks.rados.rados.0.trial118.stdout:428: done (0 left) 2026-02-17T05:29:59.307 INFO:tasks.rados.rados.0.trial118.stdout:429: snap_create 2026-02-17T05:30:00.290 INFO:tasks.rados.rados.0.trial118.stdout:429: done (0 left) 2026-02-17T05:30:00.290 INFO:tasks.rados.rados.0.trial118.stdout:430: read oid 32 snap -1 2026-02-17T05:30:00.290 INFO:tasks.rados.rados.0.trial118.stdout:430: expect deleted 2026-02-17T05:30:00.290 INFO:tasks.rados.rados.0.trial118.stdout:431: write oid 40 current snap is 45 2026-02-17T05:30:00.290 INFO:tasks.rados.rados.0.trial118.stdout:431: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-17T05:30:00.295 INFO:tasks.rados.rados.0.trial118.stdout:431: writing trial11845692-40 from 457190 to 1009286 tid 1 2026-02-17T05:30:00.299 INFO:tasks.rados.rados.0.trial118.stdout:431: writing trial11845692-40 from 1614880 to 2195921 tid 2 2026-02-17T05:30:00.302 INFO:tasks.rados.rados.0.trial118.stdout:431: writing trial11845692-40 from 2785791 to 2857190 tid 3 2026-02-17T05:30:00.302 INFO:tasks.rados.rados.0.trial118.stdout:432: delete oid 1 current snap is 45 2026-02-17T05:30:00.302 INFO:tasks.rados.rados.0.trial118.stdout:431: finishing write tid 1 to trial11845692-40 2026-02-17T05:30:00.302 INFO:tasks.rados.rados.0.trial118.stdout:431: finishing write tid 2 to trial11845692-40 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: finishing write tid 3 to trial11845692-40 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: finishing write tid 4 to trial11845692-40 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: finishing write tid 5 to trial11845692-40 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: oid 40 updating version 0 to 244 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: oid 40 updating version 244 to 247 2026-02-17T05:30:00.304 INFO:tasks.rados.rados.0.trial118.stdout:431: oid 40 version 247 is already newer than 245 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:431: oid 40 version 247 is already newer than 246 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 247 (ObjNum 170 snap 45 seq_num 170) dirty exists 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:431: left oid 40 (ObjNum 170 snap 45 seq_num 170) 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:430: done (2 left) 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:431: done (1 left) 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:432: done (0 left) 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:433: read oid 45 snap -1 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:433: expect (ObjNum 138 snap 29 seq_num 138) 2026-02-17T05:30:00.305 INFO:tasks.rados.rados.0.trial118.stdout:434: snap_create 2026-02-17T05:30:00.306 INFO:tasks.rados.rados.0.trial118.stdout:433: expect (ObjNum 138 snap 29 seq_num 138) 2026-02-17T05:30:00.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2291154 2026-02-17T05:30:01.291 INFO:tasks.rados.rados.0.trial118.stdout:433: done (1 left) 2026-02-17T05:30:01.291 INFO:tasks.rados.rados.0.trial118.stdout:434: done (0 left) 2026-02-17T05:30:01.291 INFO:tasks.rados.rados.0.trial118.stdout:435: write oid 7 current snap is 46 2026-02-17T05:30:01.291 INFO:tasks.rados.rados.0.trial118.stdout:435: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2026-02-17T05:30:01.296 INFO:tasks.rados.rados.0.trial118.stdout:435: writing trial11845692-7 from 490804 to 1193398 tid 1 2026-02-17T05:30:01.300 INFO:tasks.rados.rados.0.trial118.stdout:435: writing trial11845692-7 from 1615491 to 2200201 tid 2 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:435: writing trial11845692-7 from 2724284 to 2890804 tid 3 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:436: read oid 34 snap -1 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:436: expect (ObjNum 166 snap 41 seq_num 166) 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:437: read oid 24 snap 42 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:437: expect deleted 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:438: write oid 35 current snap is 46 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:435: finishing write tid 1 to trial11845692-7 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:435: finishing write tid 2 to trial11845692-7 2026-02-17T05:30:01.304 INFO:tasks.rados.rados.0.trial118.stdout:438: seq_num 173 ranges {507611=777843,2073973=444721} 2026-02-17T05:30:01.308 INFO:tasks.rados.rados.0.trial118.stdout:438: writing trial11845692-35 from 507611 to 1285454 tid 1 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:438: writing trial11845692-35 from 2073973 to 2518694 tid 2 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:439: read oid 29 snap -1 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:439: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:440: delete oid 23 current snap is 46 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:435: finishing write tid 3 to trial11845692-7 2026-02-17T05:30:01.314 INFO:tasks.rados.rados.0.trial118.stdout:435: finishing write tid 4 to trial11845692-7 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: finishing write tid 5 to trial11845692-7 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: oid 7 updating version 0 to 284 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: oid 7 updating version 284 to 287 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: oid 7 version 287 is already newer than 286 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: oid 7 version 287 is already newer than 285 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 287 (ObjNum 172 snap 46 seq_num 172) dirty exists 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:435: left oid 7 (ObjNum 172 snap 46 seq_num 172) 2026-02-17T05:30:01.315 INFO:tasks.rados.rados.0.trial118.stdout:436: expect (ObjNum 166 snap 41 seq_num 166) 2026-02-17T05:30:01.387 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2170261 2026-02-17T05:30:01.394 INFO:tasks.rados.rados.0.trial118.stdout:438: finishing write tid 1 to trial11845692-35 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: finishing write tid 2 to trial11845692-35 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: finishing write tid 3 to trial11845692-35 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: finishing write tid 4 to trial11845692-35 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: oid 35 updating version 0 to 33 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: oid 35 updating version 33 to 34 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: oid 35 updating version 34 to 35 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 35 (ObjNum 173 snap 46 seq_num 173) dirty exists 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:438: left oid 35 (ObjNum 173 snap 46 seq_num 173) 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:439: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:30:01.395 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:01.429 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:01.450 INFO:tasks.rados.rados.0.trial118.stdout:435: done (5 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:436: done (4 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:437: done (3 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:438: done (2 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:439: done (1 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:440: done (0 left) 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:441: copy_from oid 48 from oid 47 current snap is 46 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:442: rollback oid 45 current snap is 46 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 43 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:443: write (excl) oid 50 current snap is 46 2026-02-17T05:30:01.451 INFO:tasks.rados.rados.0.trial118.stdout:443: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-17T05:30:01.455 INFO:tasks.rados.rados.0.trial118.stdout:443: writing trial11845692-50 from 541225 to 1185919 tid 1 2026-02-17T05:30:01.460 INFO:tasks.rados.rados.0.trial118.stdout:443: writing trial11845692-50 from 1907290 to 2355680 tid 2 2026-02-17T05:30:01.460 INFO:tasks.rados.rados.0.trial118.stdout:444: snap_remove snap 45 2026-02-17T05:30:02.316 INFO:tasks.rados.rados.0.trial118.stdout:444: done (3 left) 2026-02-17T05:30:02.316 INFO:tasks.rados.rados.0.trial118.stdout:445: read oid 20 snap -1 2026-02-17T05:30:02.316 INFO:tasks.rados.rados.0.trial118.stdout:445: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:02.316 INFO:tasks.rados.rados.0.trial118.stdout:446: write (excl) oid 14 current snap is 46 2026-02-17T05:30:02.316 INFO:tasks.rados.rados.0.trial118.stdout:446: seq_num 176 ranges {558032=719943,1849419=592048} 2026-02-17T05:30:02.320 INFO:tasks.rados.rados.0.trial118.stdout:446: writing trial11845692-14 from 558032 to 1277975 tid 1 2026-02-17T05:30:02.325 INFO:tasks.rados.rados.0.trial118.stdout:446: writing trial11845692-14 from 1849419 to 2441467 tid 2 2026-02-17T05:30:02.325 INFO:tasks.rados.rados.0.trial118.stdout:447: write (excl) oid 34 current snap is 46 2026-02-17T05:30:02.325 INFO:tasks.rados.rados.0.trial118.stdout:442: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:30:02.325 INFO:tasks.rados.rados.0.trial118.stdout:447: seq_num 177 ranges {574839=795192,1907901=452059} 2026-02-17T05:30:02.330 INFO:tasks.rados.rados.0.trial118.stdout:447: writing trial11845692-34 from 574839 to 1370031 tid 1 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:447: writing trial11845692-34 from 1907901 to 2359960 tid 2 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:448: read oid 11 snap -1 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:448: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:449: delete oid 12 current snap is 46 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:442: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:30:02.334 INFO:tasks.rados.rados.0.trial118.stdout:442: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 176 (ObjNum 138 snap 29 seq_num 138) dirty exists 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:441: finishing copy_from racing read to trial11845692-48 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:441: finishing copy_from to trial11845692-48 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: finishing write tid 1 to trial11845692-50 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: finishing write tid 2 to trial11845692-50 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: finishing write tid 3 to trial11845692-50 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: finishing write tid 4 to trial11845692-50 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: oid 50 updating version 0 to 175 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: oid 50 version 175 is already newer than 174 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:443: oid 50 updating version 175 to 176 2026-02-17T05:30:02.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 176 (ObjNum 175 snap 46 seq_num 175) dirty exists 2026-02-17T05:30:02.336 INFO:tasks.rados.rados.0.trial118.stdout:443: left oid 50 (ObjNum 175 snap 46 seq_num 175) 2026-02-17T05:30:02.336 INFO:tasks.rados.rados.0.trial118.stdout:445: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:02.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2232934 2026-02-17T05:30:02.369 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:02.390 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:30:02.390 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:30:02.390 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:30:02.391 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:30:02.404 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:30:02.404 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:30:02.404 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:02.409 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: finishing write tid 1 to trial11845692-14 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: finishing write tid 2 to trial11845692-14 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: finishing write tid 3 to trial11845692-14 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: finishing write tid 4 to trial11845692-14 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: oid 14 updating version 0 to 49 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: oid 14 version 49 is already newer than 48 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: oid 14 updating version 49 to 50 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 50 (ObjNum 176 snap 46 seq_num 176) dirty exists 2026-02-17T05:30:02.451 INFO:tasks.rados.rados.0.trial118.stdout:446: left oid 14 (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:30:02.452 INFO:tasks.rados.rados.0.trial118.stdout:447: finishing write tid 1 to trial11845692-34 2026-02-17T05:30:02.452 INFO:tasks.rados.rados.0.trial118.stdout:448: expect (ObjNum 51 snap 1 seq_num 51) 2026-02-17T05:30:02.452 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:02.464 INFO:tasks.ceph.mon.a.trial106.stderr:2026-02-17T05:30:02.463+0000 7f7ab525dc00 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 18 -> 0 (sync_force? mon rebuild?) 2026-02-17T05:30:02.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.480+0000 7f681cf0c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.480+0000 7f681cf0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.480+0000 7f681cf0c640 10 monclient: monmap: 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:02.480888+0000 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:02.480888+0000 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:02.482 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:02.483 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:02.483 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.480+0000 7f681cf0c640 1 Processor -- start 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 1 -- start start 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient: init 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f68180585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f681813f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f681808c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:02.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6818056bb0 con 0x7f681808c0d0 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180575d0 con 0x7f68180585c0 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180578b0 con 0x7f681813f6c0 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f681cf0c640 10 monclient(hunting): authenticate will time out at 731.109498s 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f681813f6c0 0x7f6818183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:56156/0 (socket says 10.20.193.106:56156) 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815d74640 1 -- 10.20.193.106:0/530275284 learned_addr learned my addr 10.20.193.106:0/530275284 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926319404 0 0) 0x7f68180578b0 con 0x7f681813f6c0 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:02.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): my global_id is 4505 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68040035e0 con 0x7f681813f6c0 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658386285 0 0) 0x7f68180575d0 con 0x7f68180585c0 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 10 monclient(hunting): my global_id is 4495 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68180578b0 con 0x7f68180585c0 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011251842 0 0) 0x7f68040035e0 con 0x7f681813f6c0 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.481+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 >> v1:10.20.193.118:6789/0 conn(0x7f68180585c0 legacy=0x7f681813efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 >> v1:10.20.193.106:6789/0 conn(0x7f681808c0d0 legacy=0x7f68181a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: _finish_hunting 0 2026-02-17T05:30:02.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 monclient: found mon.noname-b 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818057b90 con 0x7f681813f6c0 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: _finish_auth 0 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: _check_auth_tickets 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6800002dd0 con 0x7f681813f6c0 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 5 monclient: authenticate success, global_id 4505 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:02.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: dump: 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:02.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6800003010 con 0x7f681813f6c0 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 1 -- 10.20.193.106:0/530275284 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6800003420 con 0x7f681813f6c0 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 4 set_mon_vals no callback set 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f6815573640 10 monclient: dump: 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:02.495 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 10 monclient: shutdown 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 -- 10.20.193.106:0/530275284 >> v1:10.20.193.106:6790/0 conn(0x7f681813f6c0 legacy=0x7f6818183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 -- 10.20.193.106:0/530275284 shutdown_connections 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 -- 10.20.193.106:0/530275284 >> 10.20.193.106:0/530275284 conn(0x7f681805e410 msgr2=0x7f6818095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 -- 10.20.193.106:0/530275284 shutdown_connections 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 -- 10.20.193.106:0/530275284 wait complete. 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:02.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 10 monclient: monmap: 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.482+0000 7f681cf0c640 1 Processor -- start 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- start start 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: init 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f68180585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f681808c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f681813f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681812e7c0 con 0x7f681813f6c0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681813e4f0 con 0x7f68180585c0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681808c530 con 0x7f681808c0d0 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient(hunting): authenticate will time out at 731.111308s 2026-02-17T05:30:02.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f6815d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f681808c0d0 0x7f6818193470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:56172/0 (socket says 10.20.193.106:56172) 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f6815d74640 1 -- 10.20.193.106:0/2283370895 learned_addr learned my addr 10.20.193.106:0/2283370895 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177339424 0 0) 0x7f681808c530 con 0x7f681808c0d0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): my global_id is 4508 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e40035e0 con 0x7f681808c0d0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2324585910 0 0) 0x7f67e40035e0 con 0x7f681808c0d0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f681808c530 con 0x7f681808c0d0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6800002ce0 con 0x7f681808c0d0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:02.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): dump: 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:02.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3249407879 0 0) 0x7f681808c530 con 0x7f681808c0d0 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 >> v1:10.20.193.118:6789/0 conn(0x7f68180585c0 legacy=0x7f6818151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 >> v1:10.20.193.106:6789/0 conn(0x7f681813f6c0 legacy=0x7f6818194b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 monclient: found mon.c 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681808b980 con 0x7f681808c0d0 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient: _finish_auth 0 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f67feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 5 monclient: authenticate success, global_id 4508 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _renew_subs 2026-02-17T05:30:02.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f681812e4e0 con 0x7f681808c0d0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _renew_subs 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.483+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f681813d850 con 0x7f681808c0d0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6800004b90 con 0x7f681808c0d0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6800004f70 con 0x7f681808c0d0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 10 monclient: dump: 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:02.502 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f6814d72640 4 set_mon_vals no callback set 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f681cf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f681cf0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f681cf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6818093240 con 0x7f681808c0d0 2026-02-17T05:30:02.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6800005150 con 0x7f681808c0d0 2026-02-17T05:30:02.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(111..111 src has 1..111) ==== 3959+0+0 (unknown 3808372683 0 0) 0x7f6800050020 con 0x7f681808c0d0 2026-02-17T05:30:02.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.484+0000 7f6816575640 10 monclient: get_auth_request con 0x7f67e4040760 auth_method 0 2026-02-17T05:30:02.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.487+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f6800017790 con 0x7f681808c0d0 2026-02-17T05:30:02.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.487+0000 7f67feffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:02.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.487+0000 7f67feffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:02.504 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2568738 2026-02-17T05:30:02.525 INFO:tasks.rados.rados.0.trial118.stdout:447: finishing write tid 2 to trial11845692-34 2026-02-17T05:30:02.525 INFO:tasks.rados.rados.0.trial118.stdout:447: finishing write tid 3 to trial11845692-34 2026-02-17T05:30:02.525 INFO:tasks.rados.rados.0.trial118.stdout:447: finishing write tid 4 to trial11845692-34 2026-02-17T05:30:02.525 INFO:tasks.rados.rados.0.trial118.stdout:447: oid 34 updating version 0 to 109 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:447: oid 34 version 109 is already newer than 107 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:447: oid 34 version 109 is already newer than 108 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 109 (ObjNum 177 snap 46 seq_num 177) dirty exists 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:447: left oid 34 (ObjNum 177 snap 46 seq_num 177) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:441: done (7 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:442: done (6 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:443: done (5 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:445: done (4 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:446: done (3 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:447: done (2 left) 2026-02-17T05:30:02.526 INFO:tasks.rados.rados.0.trial118.stdout:448: done (1 left) 2026-02-17T05:30:02.527 INFO:tasks.rados.rados.0.trial118.stdout:449: done (0 left) 2026-02-17T05:30:02.527 INFO:tasks.rados.rados.0.trial118.stdout:450: delete oid 40 current snap is 46 2026-02-17T05:30:02.528 INFO:tasks.rados.rados.0.trial118.stdout:450: done (0 left) 2026-02-17T05:30:02.528 INFO:tasks.rados.rados.0.trial118.stdout:451: read oid 49 snap 41 2026-02-17T05:30:02.528 INFO:tasks.rados.rados.0.trial118.stdout:451: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:30:02.528 INFO:tasks.rados.rados.0.trial118.stdout:452: snap_create 2026-02-17T05:30:02.528 INFO:tasks.rados.rados.0.trial118.stdout:451: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-17T05:30:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.632+0000 7f681cf0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.632+0000 7f681cf0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.632+0000 7f681cf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.632+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6818094410 con 0x7f681808c0d0 2026-02-17T05:30:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.633+0000 7f67feffd640 1 -- 10.20.193.106:0/2283370895 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 622094962) 0x7f6800016f40 con 0x7f681808c0d0 2026-02-17T05:30:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.633+0000 7f67feffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.633+0000 7f67feffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:02.635 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":8,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":90,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:02.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 >> v1:10.20.193.118:6812/703720803 conn(0x7f67e4040760 legacy=0x7f67e4060c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 10 monclient: shutdown 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 >> v1:10.20.193.106:6790/0 conn(0x7f681808c0d0 legacy=0x7f6818193470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 shutdown_connections 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 >> 10.20.193.106:0/2283370895 conn(0x7f681805e410 msgr2=0x7f6818141730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 shutdown_connections 2026-02-17T05:30:02.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:02.634+0000 7f681cf0c640 1 -- 10.20.193.106:0/2283370895 wait complete. 2026-02-17T05:30:03.317 INFO:tasks.rados.rados.0.trial118.stdout:451: done (1 left) 2026-02-17T05:30:03.317 INFO:tasks.rados.rados.0.trial118.stdout:452: done (0 left) 2026-02-17T05:30:03.318 INFO:tasks.rados.rados.0.trial118.stdout:453: read oid 44 snap -1 2026-02-17T05:30:03.318 INFO:tasks.rados.rados.0.trial118.stdout:453: expect deleted 2026-02-17T05:30:03.318 INFO:tasks.rados.rados.0.trial118.stdout:454: copy_from oid 49 from oid 14 current snap is 47 2026-02-17T05:30:03.318 INFO:tasks.rados.rados.0.trial118.stdout:455: snap_create 2026-02-17T05:30:03.327 INFO:tasks.rados.rados.0.trial118.stdout:454: finishing copy_from racing read to trial11845692-49 2026-02-17T05:30:03.328 INFO:tasks.rados.rados.0.trial118.stdout:454: finishing copy_from to trial11845692-49 2026-02-17T05:30:03.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 50 (ObjNum 176 snap 46 seq_num 176) dirty exists 2026-02-17T05:30:04.320 INFO:tasks.rados.rados.0.trial118.stdout:453: done (2 left) 2026-02-17T05:30:04.320 INFO:tasks.rados.rados.0.trial118.stdout:454: done (1 left) 2026-02-17T05:30:04.320 INFO:tasks.rados.rados.0.trial118.stdout:455: done (0 left) 2026-02-17T05:30:04.320 INFO:tasks.rados.rados.0.trial118.stdout:456: write oid 30 current snap is 48 2026-02-17T05:30:04.320 INFO:tasks.rados.rados.0.trial118.stdout:456: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2026-02-17T05:30:04.324 INFO:tasks.rados.rados.0.trial118.stdout:456: writing trial11845692-30 from 625260 to 1246199 tid 1 2026-02-17T05:30:04.328 INFO:tasks.rados.rados.0.trial118.stdout:456: writing trial11845692-30 from 1683347 to 2282733 tid 2 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:456: writing trial11845692-30 from 2943668 to 3025260 tid 3 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:457: copy_from oid 38 from oid 20 current snap is 48 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:456: finishing write tid 1 to trial11845692-30 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:456: finishing write tid 2 to trial11845692-30 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:458: rollback oid 33 current snap is 48 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 43 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:459: copy_from oid 22 from oid 6 current snap is 48 2026-02-17T05:30:04.332 INFO:tasks.rados.rados.0.trial118.stdout:460: snap_create 2026-02-17T05:30:04.333 INFO:tasks.rados.rados.0.trial118.stdout:459: finishing copy_from to trial11845692-22 2026-02-17T05:30:04.333 INFO:tasks.rados.rados.0.trial118.stdout:459: got expected ENOENT (src dne) 2026-02-17T05:30:04.333 INFO:tasks.rados.rados.0.trial118.stdout:459: finishing copy_from racing read to trial11845692-22 2026-02-17T05:30:04.333 INFO:tasks.rados.rados.0.trial118.stdout:456: finishing write tid 3 to trial11845692-30 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: finishing write tid 4 to trial11845692-30 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: finishing write tid 5 to trial11845692-30 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: oid 30 updating version 0 to 255 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: oid 30 version 255 is already newer than 254 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: oid 30 version 255 is already newer than 252 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: oid 30 version 255 is already newer than 253 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 255 (ObjNum 180 snap 48 seq_num 180) dirty exists 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:456: left oid 30 (ObjNum 180 snap 48 seq_num 180) 2026-02-17T05:30:04.334 INFO:tasks.rados.rados.0.trial118.stdout:458: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:30:04.335 INFO:tasks.rados.rados.0.trial118.stdout:458: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:30:04.335 INFO:tasks.rados.rados.0.trial118.stdout:458: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:30:04.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 259 (ObjNum 169 snap 43 seq_num 169) dirty exists 2026-02-17T05:30:04.336 INFO:tasks.rados.rados.0.trial118.stdout:457: finishing copy_from racing read to trial11845692-38 2026-02-17T05:30:04.337 INFO:tasks.rados.rados.0.trial118.stdout:457: finishing copy_from to trial11845692-38 2026-02-17T05:30:04.337 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:05.292 INFO:tasks.rados.rados.0.trial118.stdout:456: done (4 left) 2026-02-17T05:30:05.292 INFO:tasks.rados.rados.0.trial118.stdout:457: done (3 left) 2026-02-17T05:30:05.292 INFO:tasks.rados.rados.0.trial118.stdout:458: done (2 left) 2026-02-17T05:30:05.292 INFO:tasks.rados.rados.0.trial118.stdout:459: done (1 left) 2026-02-17T05:30:05.292 INFO:tasks.rados.rados.0.trial118.stdout:460: done (0 left) 2026-02-17T05:30:05.293 INFO:tasks.rados.rados.0.trial118.stdout:461: rollback oid 46 current snap is 49 2026-02-17T05:30:05.293 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 41 2026-02-17T05:30:05.293 INFO:tasks.rados.rados.0.trial118.stdout:462: snap_remove snap 42 2026-02-17T05:30:05.644 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:05.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: get_monmap_and_config 2026-02-17T05:30:05.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: build_initial_monmap 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: monmap: 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:05.708419+0000 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:05.708419+0000 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:05.710 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:05.711 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 1 Processor -- start 2026-02-17T05:30:05.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 1 -- start start 2026-02-17T05:30:05.711 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: init 2026-02-17T05:30:05.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:05.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-c con 0x7fa9580585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-a con 0x7fa95813f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-b con 0x7fa95808c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa958056bb0 con 0x7fa95813f6c0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9580575d0 con 0x7fa9580585c0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9580578b0 con 0x7fa95808c0d0 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.708+0000 7fa95e2b8640 10 monclient(hunting): authenticate will time out at 734.336927s 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95c82e640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa95808c0d0 0x7fa9581a4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59150/0 (socket says 10.20.193.106:59150) 2026-02-17T05:30:05.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa9577fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa95813f6c0 0x7fa958183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59802/0 (socket says 10.20.193.106:59802) 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95c82e640 1 -- 10.20.193.106:0/595844815 learned_addr learned my addr 10.20.193.106:0/595844815 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935474393 0 0) 0x7fa9580578b0 con 0x7fa95808c0d0 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient(hunting): my global_id is 4511 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa93c0035e0 con 0x7fa95808c0d0 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3820023777 0 0) 0x7fa93c0035e0 con 0x7fa95808c0d0 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 >> v1:10.20.193.118:6789/0 conn(0x7fa9580585c0 legacy=0x7fa95813efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 >> v1:10.20.193.106:6789/0 conn(0x7fa95813f6c0 legacy=0x7fa958183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:05.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 monclient: found mon.noname-b 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa958057b90 con 0x7fa95808c0d0 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: _finish_auth 0 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa94c003eb0 con 0x7fa95808c0d0 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: dump: 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.721 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 5 monclient: authenticate success, global_id 4511 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:05.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa94c004170 con 0x7fa95808c0d0 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 1 -- 10.20.193.106:0/595844815 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa94c004580 con 0x7fa95808c0d0 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa956ffd640 10 monclient: dump: 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.723 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 4 set_mon_vals no callback set 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 10 monclient: shutdown 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 1 -- 10.20.193.106:0/595844815 >> v1:10.20.193.106:6790/0 conn(0x7fa95808c0d0 legacy=0x7fa9581a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 1 -- 10.20.193.106:0/595844815 shutdown_connections 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 1 -- 10.20.193.106:0/595844815 >> 10.20.193.106:0/595844815 conn(0x7fa95805e410 msgr2=0x7fa958095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.709+0000 7fa95e2b8640 1 -- 10.20.193.106:0/595844815 shutdown_connections 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 -- 10.20.193.106:0/595844815 wait complete. 2026-02-17T05:30:05.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient: build_initial_monmap 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient: monmap: 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 Processor -- start 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 -- start start 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient: init 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-b con 0x7fa9580585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-c con 0x7fa95808c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient(hunting): picked mon.noname-a con 0x7fa95813f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95808bc10 con 0x7fa95813f6c0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95808c530 con 0x7fa9580585c0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95812ea00 con 0x7fa95808c0d0 2026-02-17T05:30:05.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.710+0000 7fa95e2b8640 10 monclient(hunting): authenticate will time out at 734.338957s 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa9577fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa95808c0d0 0x7fa958193680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59162/0 (socket says 10.20.193.106:59162) 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa9577fe640 1 -- 10.20.193.106:0/1322564459 learned_addr learned my addr 10.20.193.106:0/1322564459 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040767684 0 0) 0x7fa95808bc10 con 0x7fa95813f6c0 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): my global_id is 64098 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9280035e0 con 0x7fa95813f6c0 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629921621 0 0) 0x7fa95812ea00 con 0x7fa95808c0d0 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): my global_id is 4514 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa95808bc10 con 0x7fa95808c0d0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439879287 0 0) 0x7fa95808c530 con 0x7fa9580585c0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): my global_id is 4501 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa95812ea00 con 0x7fa9580585c0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4243667150 0 0) 0x7fa9280035e0 con 0x7fa95813f6c0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa95808c530 con 0x7fa95813f6c0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa94c003890 con 0x7fa95813f6c0 2026-02-17T05:30:05.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): dump: 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.729 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4278102154 0 0) 0x7fa95808bc10 con 0x7fa95808c0d0 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9280035e0 con 0x7fa95808c0d0 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa9480030b0 con 0x7fa95808c0d0 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient(hunting): dump: 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.730 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2646273282 0 0) 0x7fa95808c530 con 0x7fa95813f6c0 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 >> v1:10.20.193.106:6790/0 conn(0x7fa95808c0d0 legacy=0x7fa958193680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 >> v1:10.20.193.118:6789/0 conn(0x7fa9580585c0 legacy=0x7fa95813d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 monclient: found mon.a 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:05.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95812d6c0 con 0x7fa95813f6c0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient: _finish_auth 0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa954ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 5 monclient: authenticate success, global_id 64098 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 10 monclient: _renew_subs 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa95812e160 con 0x7fa95813f6c0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 10 monclient: _renew_subs 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.711+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa958152800 con 0x7fa95813f6c0 2026-02-17T05:30:05.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa94c005ae0 con 0x7fa95813f6c0 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa94c005e00 con 0x7fa95813f6c0 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa9567fc640 4 set_mon_vals no callback set 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 10 monclient: dump: 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.733 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa95e2b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa95e2b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa95e2b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa958093240 con 0x7fa95813f6c0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa94c012da0 con 0x7fa95813f6c0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 3943+0+0 (unknown 2933597126 0 0) 0x7fa94c050dd0 con 0x7fa95813f6c0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.712+0000 7fa957fff640 10 monclient: get_auth_request con 0x7fa928040d80 auth_method 0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.714+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fa94c018550 con 0x7fa95813f6c0 2026-02-17T05:30:05.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.714+0000 7fa954ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:05.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.714+0000 7fa954ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:05.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa95e2b8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa95e2b8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa95e2b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa958058c70 con 0x7fa95813f6c0 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa954ff9640 1 -- 10.20.193.106:0/1322564459 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2139317405) 0x7fa94c017d00 con 0x7fa95813f6c0 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa954ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:05.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.861+0000 7fa954ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:05.864 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 >> v1:10.20.193.118:6812/703720803 conn(0x7fa928040d80 legacy=0x7fa928061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 10 monclient: shutdown 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 >> v1:10.20.193.106:6789/0 conn(0x7fa95813f6c0 legacy=0x7fa958194da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 shutdown_connections 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 >> 10.20.193.106:0/1322564459 conn(0x7fa95805e410 msgr2=0x7fa958141760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 shutdown_connections 2026-02-17T05:30:05.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.862+0000 7fa95e2b8640 1 -- 10.20.193.106:0/1322564459 wait complete. 2026-02-17T05:30:05.871 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:30:05.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:30:05.871 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:30:05.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: monmap: 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:05.935460+0000 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:05.935460+0000 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:05.947 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 1 Processor -- start 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 1 -- start start 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: init 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f99800585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f998013f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:05.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f998008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980056bb0 con 0x7f99800585c0 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99800575d0 con 0x7f998013f6c0 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99800578b0 con 0x7f998008c0d0 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.935+0000 7f9986d0c640 10 monclient(hunting): authenticate will time out at 734.563968s 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9984a81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f99800585c0 0x7f998013efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59830/0 (socket says 10.20.193.106:59830) 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9984a81640 1 -- 10.20.193.106:0/1330627334 learned_addr learned my addr 10.20.193.106:0/1330627334 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224009512 0 0) 0x7f99800578b0 con 0x7f998008c0d0 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): my global_id is 4517 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996c0035e0 con 0x7f998008c0d0 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299575244 0 0) 0x7f9980056bb0 con 0x7f99800585c0 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient(hunting): my global_id is 64101 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99800578b0 con 0x7f99800585c0 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582368098 0 0) 0x7f99800578b0 con 0x7f99800585c0 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 >> v1:10.20.193.106:6790/0 conn(0x7f998008c0d0 legacy=0x7f99801a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 >> v1:10.20.193.118:6789/0 conn(0x7f998013f6c0 legacy=0x7f9980183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:30:05.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: _finish_hunting 0 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 monclient: found mon.noname-a 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980057b90 con 0x7f99800585c0 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: _finish_auth 0 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: _check_auth_tickets 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9986d0c640 5 monclient: authenticate success, global_id 64101 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9970002d00 con 0x7f99800585c0 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9986d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:05.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: dump: 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.952 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9986d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9970002f80 con 0x7f99800585c0 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 1 -- 10.20.193.106:0/1330627334 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9970003390 con 0x7f99800585c0 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f99777fe640 10 monclient: dump: 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.953 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9986d0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.936+0000 7f9986d0c640 4 set_mon_vals no callback set 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: shutdown 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:05.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- 10.20.193.106:0/1330627334 >> v1:10.20.193.106:6789/0 conn(0x7f99800585c0 legacy=0x7f998013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- 10.20.193.106:0/1330627334 shutdown_connections 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- 10.20.193.106:0/1330627334 >> 10.20.193.106:0/1330627334 conn(0x7f998005e410 msgr2=0x7f9980095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- 10.20.193.106:0/1330627334 shutdown_connections 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- 10.20.193.106:0/1330627334 wait complete. 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: monmap: 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:05.955 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 Processor -- start 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- start start 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: init 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f99800585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f998008c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:05.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f998013f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998012e310 con 0x7f99800585c0 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998008b800 con 0x7f998013f6c0 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998012c7c0 con 0x7f998008c0d0 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.937+0000 7f9986d0c640 10 monclient(hunting): authenticate will time out at 734.565975s 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9984a81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f99800585c0 0x7f998012b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59836/0 (socket says 10.20.193.106:59836) 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9984a81640 1 -- 10.20.193.106:0/4220652884 learned_addr learned my addr 10.20.193.106:0/4220652884 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487535718 0 0) 0x7f998012e310 con 0x7f99800585c0 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): my global_id is 64104 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99500035e0 con 0x7f99800585c0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177001749 0 0) 0x7f998012c7c0 con 0x7f998008c0d0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): my global_id is 4520 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998012e310 con 0x7f998008c0d0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3855527345 0 0) 0x7f99500035e0 con 0x7f99800585c0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998012c7c0 con 0x7f99800585c0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9970002cc0 con 0x7f99800585c0 2026-02-17T05:30:05.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): dump: 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.959 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.960 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2183165233 0 0) 0x7f998012e310 con 0x7f998008c0d0 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99500035e0 con 0x7f998008c0d0 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9968002ca0 con 0x7f998008c0d0 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:05.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient(hunting): dump: 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.962 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 297234481 0 0) 0x7f998012c7c0 con 0x7f99800585c0 2026-02-17T05:30:05.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6790/0 conn(0x7f998008c0d0 legacy=0x7f998012c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.118:6789/0 conn(0x7f998013f6c0 legacy=0x7f9980194620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: _finish_hunting 0 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 monclient: found mon.a 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998013e4d0 con 0x7f99800585c0 2026-02-17T05:30:05.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: _finish_auth 0 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: _check_auth_tickets 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 5 monclient: authenticate success, global_id 64104 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 10 monclient: _renew_subs 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f998008c530 con 0x7f99800585c0 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 10 monclient: _renew_subs 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f998012cdf0 con 0x7f99800585c0 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9970002820 con 0x7f99800585c0 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:05.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9970004d00 con 0x7f99800585c0 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9976ffd640 4 set_mon_vals no callback set 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f99757fa640 10 monclient: dump: 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.967 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.968 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.938+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9980093240 con 0x7f998008d750 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9970004e60 con 0x7f99800585c0 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 3943+0+0 (unknown 2933597126 0 0) 0x7f997004fe80 con 0x7f99800585c0 2026-02-17T05:30:05.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443031918 0 0) 0x7f9980093240 con 0x7f998008d750 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): my global_id is 64107 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998012c7c0 con 0x7f998008d750 2026-02-17T05:30:05.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f9985282640 10 monclient: get_auth_request con 0x7f9950040ae0 auth_method 0 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 897495464 0 0) 0x7f998012c7c0 con 0x7f998008d750 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9980093240 con 0x7f998008d750 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9968003530 con 0x7f998008d750 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient: dump: 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.972 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f9977fff640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 legacy=0x7f998008db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f9977fff640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 legacy=0x7f998008db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f9977fff640 1 --1- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 0x7f998008db20 :-1 s=OPENED pgs=31 gs=4 cs=1 l=1).handle_message read tag failed 2026-02-17T05:30:05.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f9977fff640 1 --1- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 0x7f998008db20 :-1 s=OPENED pgs=31 gs=4 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 legacy=0x7f998008db20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008d750 legacy=0x7f998008db20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f998012c7c0 con 0x7f9950066bc0 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716981880 0 0) 0x7f998012c7c0 con 0x7f9950066bc0 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 10 monclient(hunting): my global_id is 64110 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99500035e0 con 0x7f9950066bc0 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3207940637 0 0) 0x7f99500035e0 con 0x7f9950066bc0 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.939+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998012c7c0 con 0x7f9950066bc0 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9968005180 con 0x7f9950066bc0 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 10 monclient: dump: 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.976 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3777743855 0 0) 0x7f998012c7c0 con 0x7f9950066bc0 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99500676a0 con 0x7f9950066bc0 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9968006740 con 0x7f9950066bc0 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:05.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f9950066bc0 legacy=0x7f9950066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.940+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f9950066bc0 legacy=0x7f9950066f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.943+0000 7f9986d0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.943+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9980058c70 con 0x7f998008e230 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003491608 0 0) 0x7f9980058c70 con 0x7f998008e230 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:05.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient(hunting): my global_id is 64113 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f998012c7c0 con 0x7f998008e230 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3094962667 0 0) 0x7f998012c7c0 con 0x7f998008e230 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9980058c70 con 0x7f998008e230 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9968005800 con 0x7f998008e230 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient: dump: 2026-02-17T05:30:05.979 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:05.980 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 851213167 0 0) 0x7f9980058c70 con 0x7f998008e230 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9980094410 con 0x7f998008e230 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 1907841506) 0x7f99680068b0 con 0x7f998008e230 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008e230 legacy=0x7f9980196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f99757fa640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f998008e230 legacy=0x7f9980196d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:05.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f9985282640 1 -- 10.20.193.106:0/4220652884 reap_dead start 2026-02-17T05:30:05.982 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:05.982 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:05.982 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:05.982 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 3481, 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 3, 2026-02-17T05:30:05.983 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:05.984 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:05.985 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:05.986 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:05.987 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:05.988 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:05.989 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.990 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.991 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:05.992 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:05.993 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:05.994 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:05.995 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.118:6812/703720803 conn(0x7f9950040ae0 legacy=0x7f9950060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f9986d0c640 10 monclient: shutdown 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f9986d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.944+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 >> v1:10.20.193.106:6789/0 conn(0x7f99800585c0 legacy=0x7f998012b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.945+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 shutdown_connections 2026-02-17T05:30:05.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.945+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 >> 10.20.193.106:0/4220652884 conn(0x7f998005e410 msgr2=0x7f9980140cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:05.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.945+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 shutdown_connections 2026-02-17T05:30:05.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:05.945+0000 7f9986d0c640 1 -- 10.20.193.106:0/4220652884 wait complete. 2026-02-17T05:30:05.997 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:05.997 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:30:05.997 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:30:06.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 10 monclient: get_monmap_and_config 2026-02-17T05:30:06.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 10 monclient: monmap: 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:06.060722+0000 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:06.060722+0000 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:06.062 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 1 Processor -- start 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 1 -- start start 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.060+0000 7fe1809fe640 10 monclient: init 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-c con 0x7fe17805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe17805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-b con 0x7fe178182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17808b060 con 0x7fe17805dee0 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17805dc90 con 0x7fe17805d1b0 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17808d6a0 con 0x7fe178182720 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient(hunting): authenticate will time out at 734.689143s 2026-02-17T05:30:06.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17ef74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe178182720 0x7fe1781a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59198/0 (socket says 10.20.193.106:59198) 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17df72640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe17805dee0 0x7fe178181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59890/0 (socket says 10.20.193.106:59890) 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17ef74640 1 -- 10.20.193.106:0/1125185462 learned_addr learned my addr 10.20.193.106:0/1125185462 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720261696 0 0) 0x7fe17808d6a0 con 0x7fe178182720 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): my global_id is 4523 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1680035e0 con 0x7fe178182720 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063434304 0 0) 0x7fe17808b060 con 0x7fe17805dee0 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient(hunting): my global_id is 64116 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17808d6a0 con 0x7fe17805dee0 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2051741901 0 0) 0x7fe1680035e0 con 0x7fe178182720 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 >> v1:10.20.193.118:6789/0 conn(0x7fe17805d1b0 legacy=0x7fe17805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 >> v1:10.20.193.106:6789/0 conn(0x7fe17805dee0 legacy=0x7fe178181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 monclient: found mon.noname-b 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178057960 con 0x7fe178182720 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe16c003eb0 con 0x7fe178182720 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: dump: 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.070 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 5 monclient: authenticate success, global_id 4523 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe16c004170 con 0x7fe178182720 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 1 -- 10.20.193.106:0/1125185462 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe16c004580 con 0x7fe178182720 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe17d771640 10 monclient: dump: 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.071 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 4 set_mon_vals no callback set 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 10 monclient: shutdown 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.061+0000 7fe1809fe640 1 -- 10.20.193.106:0/1125185462 >> v1:10.20.193.106:6790/0 conn(0x7fe178182720 legacy=0x7fe1781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- 10.20.193.106:0/1125185462 shutdown_connections 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- 10.20.193.106:0/1125185462 >> 10.20.193.106:0/1125185462 conn(0x7fe1780915f0 msgr2=0x7fe1780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- 10.20.193.106:0/1125185462 shutdown_connections 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- 10.20.193.106:0/1125185462 wait complete. 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient: monmap: 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:06.072 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 Processor -- start 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- start start 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient: init 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-c con 0x7fe17805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe17805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient(hunting): picked mon.noname-b con 0x7fe178182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17810f300 con 0x7fe17805dee0 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17810e490 con 0x7fe178182720 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17810cfa0 con 0x7fe17805d1b0 2026-02-17T05:30:06.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.062+0000 7fe1809fe640 10 monclient(hunting): authenticate will time out at 734.690942s 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe17df72640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe17805dee0 0x7fe178180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59894/0 (socket says 10.20.193.106:59894) 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe17df72640 1 -- 10.20.193.106:0/2597590816 learned_addr learned my addr 10.20.193.106:0/2597590816 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754182648 0 0) 0x7fe17810cfa0 con 0x7fe17805d1b0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): my global_id is 4526 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1480035e0 con 0x7fe17805d1b0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597532954 0 0) 0x7fe17810f300 con 0x7fe17805dee0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): my global_id is 64119 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17810cfa0 con 0x7fe17805dee0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 939203574 0 0) 0x7fe1480035e0 con 0x7fe17805d1b0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17810f300 con 0x7fe17805d1b0 2026-02-17T05:30:06.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe170003070 con 0x7fe17805d1b0 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432415962 0 0) 0x7fe17810e490 con 0x7fe178182720 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): my global_id is 4510 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1480035e0 con 0x7fe178182720 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2513071982 0 0) 0x7fe17810cfa0 con 0x7fe17805dee0 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17810e490 con 0x7fe17805dee0 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe164003090 con 0x7fe17805dee0 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 492650424 0 0) 0x7fe17810f300 con 0x7fe17805d1b0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.118:6789/0 conn(0x7fe178182720 legacy=0x7fe1781198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6789/0 conn(0x7fe17805dee0 legacy=0x7fe178180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 monclient: found mon.c 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1781824f0 con 0x7fe17805d1b0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 5 monclient: authenticate success, global_id 4526 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 10 monclient: _renew_subs 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe17810ea60 con 0x7fe17805d1b0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 10 monclient: _renew_subs 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe17813d530 con 0x7fe17805d1b0 2026-02-17T05:30:06.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe170003240 con 0x7fe17805d1b0 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe170003900 con 0x7fe17805d1b0 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe162ffd640 10 monclient: dump: 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe17cf70640 4 set_mon_vals no callback set 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.063+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe17810eef0 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174837523 0 0) 0x7fe17810e490 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient(hunting): my global_id is 4529 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17810f300 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe170003a60 con 0x7fe17805d1b0 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(114..114 src has 1..114) ==== 3943+0+0 (unknown 2933597126 0 0) 0x7fe17004eb50 con 0x7fe17805d1b0 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 41643123 0 0) 0x7fe17810f300 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17810e490 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe1640048a0 con 0x7fe17810db00 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient: dump: 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.079 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe17ef74640 10 monclient: get_auth_request con 0x7fe148040d30 auth_method 0 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3566377652 0 0) 0x7fe17810e490 con 0x7fe17810db00 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe178057cd0 con 0x7fe17810db00 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe164006b00 con 0x7fe17810db00 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6790/0 conn(0x7fe17810db00 legacy=0x7fe1781076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.064+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6790/0 conn(0x7fe17810db00 legacy=0x7fe1781076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:06.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.067+0000 7fe1809fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:06.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.067+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe17810ded0 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484784562 0 0) 0x7fe17810ded0 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient(hunting): my global_id is 4532 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17810e490 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2330995199 0 0) 0x7fe17810e490 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17810ded0 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe164005180 con 0x7fe17812a940 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient: dump: 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.082 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4061883541 0 0) 0x7fe17810ded0 con 0x7fe17812a940 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe17808cf30 con 0x7fe17812a940 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1996743475) 0x7fe1640066a0 con 0x7fe17812a940 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6790/0 conn(0x7fe17812a940 legacy=0x7fe178107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe162ffd640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6790/0 conn(0x7fe17812a940 legacy=0x7fe178107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:06.083 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 130829, 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 3, 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.084 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.085 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:06.086 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.087 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:06.088 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:06.089 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:06.090 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.091 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:06.092 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:06.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.118:6812/703720803 conn(0x7fe148040d30 legacy=0x7fe1480611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 10 monclient: shutdown 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 >> v1:10.20.193.106:6790/0 conn(0x7fe17805d1b0 legacy=0x7fe17813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe17ef74640 1 -- 10.20.193.106:0/2597590816 reap_dead start 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe17ef74640 1 -- 10.20.193.106:0/2597590816 reap_dead start 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 shutdown_connections 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 >> 10.20.193.106:0/2597590816 conn(0x7fe1780915f0 msgr2=0x7fe1780888b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 shutdown_connections 2026-02-17T05:30:06.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.068+0000 7fe1809fe640 1 -- 10.20.193.106:0/2597590816 wait complete. 2026-02-17T05:30:06.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:06.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:30:06.093 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:30:06.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:06.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: monmap: 2026-02-17T05:30:06.167 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.167 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:06.160582+0000 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:06.160582+0000 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 1 Processor -- start 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 1 -- start start 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: init 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-b con 0x7f5cdc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-a con 0x7f5cdc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-c con 0x7f5cdc182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc08b060 con 0x7f5cdc05dee0 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc05dc90 con 0x7f5cdc182720 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc08d6a0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.160+0000 7f5ce210c640 10 monclient(hunting): authenticate will time out at 734.788982s 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdb7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f5cdc05d1b0 0x7f5cdc05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59228/0 (socket says 10.20.193.106:59228) 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdb7fe640 1 -- 10.20.193.106:0/463146195 learned_addr learned my addr 10.20.193.106:0/463146195 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdaffd640 1 --1- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 0x7f5cdc181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59906/0 (socket says 10.20.193.106:59906) 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdaffd640 1 -- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 legacy=0x7f5cdc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdaffd640 1 -- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 legacy=0x7f5cdc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdaffd640 1 --1- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 0x7f5cdc181000 :-1 s=OPENED pgs=36 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-17T05:30:06.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cdaffd640 1 --1- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 0x7f5cdc181000 :-1 s=OPENED pgs=36 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.106:6789/0 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999222553 0 0) 0x7f5cdc08d6a0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient(hunting): my global_id is 4535 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc00035e0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1255574018 0 0) 0x7f5cc00035e0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc182720 legacy=0x7f5cdc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 legacy=0x7f5cdc181000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 monclient: found mon.noname-b 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc057960 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cc8002dd0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: dump: 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.171 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 5 monclient: authenticate success, global_id 4535 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cc8003090 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 1 -- 10.20.193.106:0/463146195 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cc80034a0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5cda7fc640 10 monclient: dump: 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.172 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 4 set_mon_vals no callback set 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 10 monclient: shutdown 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 1 -- 10.20.193.106:0/463146195 >> v1:10.20.193.106:6790/0 conn(0x7f5cdc05d1b0 legacy=0x7f5cdc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 1 -- 10.20.193.106:0/463146195 shutdown_connections 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 1 -- 10.20.193.106:0/463146195 >> 10.20.193.106:0/463146195 conn(0x7f5cdc0915f0 msgr2=0x7f5cdc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 1 -- 10.20.193.106:0/463146195 shutdown_connections 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.161+0000 7f5ce210c640 1 -- 10.20.193.106:0/463146195 wait complete. 2026-02-17T05:30:06.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient: monmap: 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 1 Processor -- start 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 1 -- start start 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient: init 2026-02-17T05:30:06.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-b con 0x7f5cdc05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-a con 0x7f5cdc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient(hunting): picked mon.noname-c con 0x7f5cdc182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc05cec0 con 0x7f5cdc05dee0 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc05e8e0 con 0x7f5cdc05d1b0 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc129f30 con 0x7f5cdc182720 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5ce210c640 10 monclient(hunting): authenticate will time out at 734.790801s 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5cdbfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f5cdc182720 0x7f5cdc12e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59240/0 (socket says 10.20.193.106:59240) 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5cdbfff640 1 -- 10.20.193.106:0/2974625724 learned_addr learned my addr 10.20.193.106:0/2974625724 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.162+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975931158 0 0) 0x7f5cdc129f30 con 0x7f5cdc182720 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): my global_id is 4538 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cac0035e0 con 0x7f5cdc182720 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233177804 0 0) 0x7f5cdc05cec0 con 0x7f5cdc05dee0 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): my global_id is 64125 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc129f30 con 0x7f5cdc05dee0 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2355615425 0 0) 0x7f5cac0035e0 con 0x7f5cdc182720 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cdc05cec0 con 0x7f5cdc182720 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cd0004140 con 0x7f5cdc182720 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): dump: 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.176 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3490697188 0 0) 0x7f5cdc05cec0 con 0x7f5cdc182720 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc05d1b0 legacy=0x7f5cdc1a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.106:6789/0 conn(0x7f5cdc05dee0 legacy=0x7f5cdc180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 monclient: found mon.c 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc1824f0 con 0x7f5cdc182720 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 5 monclient: authenticate success, global_id 4538 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 10 monclient: _renew_subs 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc12c290 con 0x7f5cdc182720 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 10 monclient: _renew_subs 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5cdc13d870 con 0x7f5cdc182720 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cd0004760 con 0x7f5cdc182720 2026-02-17T05:30:06.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cd0004b40 con 0x7f5cdc182720 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 10 monclient: dump: 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cd9ffb640 4 set_mon_vals no callback set 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cdc12be60 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.163+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f5cd0004ca0 con 0x7f5cdc182720 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(114..114 src has 1..114) ==== 3943+0+0 (unknown 2933597126 0 0) 0x7f5cd0050e00 con 0x7f5cdc182720 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675222082 0 0) 0x7f5cdc12be60 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient(hunting): my global_id is 4519 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc05cec0 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cdaffd640 10 monclient: get_auth_request con 0x7f5cac0408c0 auth_method 0 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3172802210 0 0) 0x7f5cdc05cec0 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cdc12be60 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cc8002d90 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient: dump: 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3068796938 0 0) 0x7f5cdc12be60 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cdc057cd0 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5cc8003470 con 0x7f5cdc1a3d10 2026-02-17T05:30:06.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:06.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc1a3d10 legacy=0x7f5cdc058e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.164+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc1a3d10 legacy=0x7f5cdc058e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:06.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.168+0000 7f5ce210c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:06.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.168+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cdc1298a0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225215574 0 0) 0x7f5cdc1298a0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient(hunting): my global_id is 4522 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc12be60 con 0x7f5cdc1294d0 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1439323682 0 0) 0x7f5cdc12be60 con 0x7f5cdc1294d0 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cdc1298a0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5cc8004da0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient: dump: 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.184 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 606545236 0 0) 0x7f5cdc1298a0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cdc12aa90 con 0x7f5cdc1294d0 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2120327709) 0x7f5cc80050e0 con 0x7f5cdc1294d0 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc1294d0 legacy=0x7f5cdc0595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cb7fff640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6789/0 conn(0x7f5cdc1294d0 legacy=0x7f5cdc0595a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 130895, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 3, 2026-02-17T05:30:06.186 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.187 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.188 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:06.189 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:06.190 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.191 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:06.192 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.193 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:06.194 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:06.195 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:06.196 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:06.196 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:06.196 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.118:6812/703720803 conn(0x7f5cac0408c0 legacy=0x7f5cac060d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 10 monclient: shutdown 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 >> v1:10.20.193.106:6790/0 conn(0x7f5cdc182720 legacy=0x7f5cdc12e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cdbfff640 1 -- 10.20.193.106:0/2974625724 reap_dead start 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5cdbfff640 1 -- 10.20.193.106:0/2974625724 reap_dead start 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 shutdown_connections 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 >> 10.20.193.106:0/2974625724 conn(0x7f5cdc0915f0 msgr2=0x7f5cdc05c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 shutdown_connections 2026-02-17T05:30:06.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.169+0000 7f5ce210c640 1 -- 10.20.193.106:0/2974625724 wait complete. 2026-02-17T05:30:06.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:06.198 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:30:06.198 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: monmap: 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:06.261646+0000 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:06.261646+0000 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 1 Processor -- start 2026-02-17T05:30:06.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 1 -- start start 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: init 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f31b805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f31b805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f31b8182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b808b060 con 0x7f31b8182720 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b805dc90 con 0x7f31b805dee0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b808d6a0 con 0x7f31b805d1b0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.261+0000 7f31bcf0c640 10 monclient(hunting): authenticate will time out at 734.889994s 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b6575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f31b805d1b0 0x7f31b805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59250/0 (socket says 10.20.193.106:59250) 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b6575640 1 -- 10.20.193.106:0/109720599 learned_addr learned my addr 10.20.193.106:0/109720599 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b6d76640 1 --1- 10.20.193.106:0/109720599 >> v1:10.20.193.106:6789/0 conn(0x7f31b8182720 0x7f31b81a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59926/0 (socket says 10.20.193.106:59926) 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217357685 0 0) 0x7f31b808b060 con 0x7f31b8182720 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): my global_id is 64128 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a40035e0 con 0x7f31b8182720 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171748847 0 0) 0x7f31b808d6a0 con 0x7f31b805d1b0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient(hunting): my global_id is 4541 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b808b060 con 0x7f31b805d1b0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1440922505 0 0) 0x7f31a40035e0 con 0x7f31b8182720 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 >> v1:10.20.193.106:6790/0 conn(0x7f31b805d1b0 legacy=0x7f31b805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 >> v1:10.20.193.118:6789/0 conn(0x7f31b805dee0 legacy=0x7f31b8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 monclient: found mon.noname-a 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b8057960 con 0x7f31b8182720 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f31a8003eb0 con 0x7f31b8182720 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: dump: 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 5 monclient: authenticate success, global_id 64128 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31a8004170 con 0x7f31b8182720 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 1 -- 10.20.193.106:0/109720599 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f31a8004580 con 0x7f31b8182720 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 4 set_mon_vals no callback set 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31b5573640 10 monclient: dump: 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 10 monclient: shutdown 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 1 -- 10.20.193.106:0/109720599 >> v1:10.20.193.106:6789/0 conn(0x7f31b8182720 legacy=0x7f31b81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 1 -- 10.20.193.106:0/109720599 shutdown_connections 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 1 -- 10.20.193.106:0/109720599 >> 10.20.193.106:0/109720599 conn(0x7f31b80915f0 msgr2=0x7f31b80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 1 -- 10.20.193.106:0/109720599 shutdown_connections 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.262+0000 7f31bcf0c640 1 -- 10.20.193.106:0/109720599 wait complete. 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient: monmap: 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 1 Processor -- start 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 1 -- start start 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient: init 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f31b805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f31b805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f31b8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b813f4c0 con 0x7f31b805d1b0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b812c300 con 0x7f31b8182720 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b805e8e0 con 0x7f31b805dee0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31bcf0c640 10 monclient(hunting): authenticate will time out at 734.891929s 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31b5d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f31b805dee0 0x7f31b8180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59254/0 (socket says 10.20.193.106:59254) 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.263+0000 7f31b5d74640 1 -- 10.20.193.106:0/3824239812 learned_addr learned my addr 10.20.193.106:0/3824239812 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268225449 0 0) 0x7f31b805e8e0 con 0x7f31b805dee0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): my global_id is 4544 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31840035e0 con 0x7f31b805dee0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882984063 0 0) 0x7f31b808b060 con 0x7f31b805d1b0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): my global_id is 64131 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b805e8e0 con 0x7f31b805d1b0 2026-02-17T05:30:06.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1367033535 0 0) 0x7f31840035e0 con 0x7f31b805dee0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31b808b060 con 0x7f31b805dee0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f31a0003090 con 0x7f31b805dee0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): dump: 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2850899372 0 0) 0x7f31b805e8e0 con 0x7f31b805d1b0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31840035e0 con 0x7f31b805d1b0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f31ac003090 con 0x7f31b805d1b0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): dump: 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039421840 0 0) 0x7f31b812c300 con 0x7f31b8182720 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient(hunting): my global_id is 4528 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b805e8e0 con 0x7f31b8182720 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 654874227 0 0) 0x7f31b808b060 con 0x7f31b805dee0 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 >> v1:10.20.193.118:6789/0 conn(0x7f31b8182720 legacy=0x7f31b812e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 >> v1:10.20.193.106:6789/0 conn(0x7f31b805d1b0 legacy=0x7f31b81a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 monclient: found mon.c 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b805cec0 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: _finish_auth 0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 5 monclient: authenticate success, global_id 4544 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _renew_subs 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31b8129fa0 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _renew_subs 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f31b812c020 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31a0003260 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f31a0003900 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31b4d72640 4 set_mon_vals no callback set 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f319effd640 10 monclient: dump: 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.264+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b80008d0 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.265+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f31a0003a60 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.265+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(114..114 src has 1..114) ==== 3943+0+0 (unknown 2933597126 0 0) 0x7f31a004fd80 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.265+0000 7f31b6575640 10 monclient: get_auth_request con 0x7f3184040dd0 auth_method 0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.267+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f31a00173e0 con 0x7f31b805dee0 2026-02-17T05:30:06.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.267+0000 7f319effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:06.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.267+0000 7f319effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:06.292 INFO:tasks.rados.rados.0.trial118.stdout:462: done (1 left) 2026-02-17T05:30:06.292 INFO:tasks.rados.rados.0.trial118.stdout:463: delete oid 27 current snap is 49 2026-02-17T05:30:06.292 INFO:tasks.rados.rados.0.trial118.stdout:461: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:30:06.293 INFO:tasks.rados.rados.0.trial118.stdout:461: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:30:06.293 INFO:tasks.rados.rados.0.trial118.stdout:461: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:30:06.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 56 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:30:06.294 INFO:tasks.rados.rados.0.trial118.stdout:461: done (1 left) 2026-02-17T05:30:06.294 INFO:tasks.rados.rados.0.trial118.stdout:463: done (0 left) 2026-02-17T05:30:06.294 INFO:tasks.rados.rados.0.trial118.stdout:464: write oid 1 current snap is 49 2026-02-17T05:30:06.295 INFO:tasks.rados.rados.0.trial118.stdout:464: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-17T05:30:06.300 INFO:tasks.rados.rados.0.trial118.stdout:464: writing trial11845692-1 from 658874 to 1430311 tid 1 2026-02-17T05:30:06.306 INFO:tasks.rados.rados.0.trial118.stdout:464: writing trial11845692-1 from 2083958 to 2687013 tid 2 2026-02-17T05:30:06.306 INFO:tasks.rados.rados.0.trial118.stdout:465: snap_create 2026-02-17T05:30:06.306 INFO:tasks.rados.rados.0.trial118.stdout:464: finishing write tid 1 to trial11845692-1 2026-02-17T05:30:06.307 INFO:tasks.rados.rados.0.trial118.stdout:464: finishing write tid 2 to trial11845692-1 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: finishing write tid 3 to trial11845692-1 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: finishing write tid 4 to trial11845692-1 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: oid 1 updating version 0 to 268 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: oid 1 version 268 is already newer than 267 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: oid 1 version 268 is already newer than 266 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 268 (ObjNum 182 snap 49 seq_num 182) dirty exists 2026-02-17T05:30:06.308 INFO:tasks.rados.rados.0.trial118.stdout:464: left oid 1 (ObjNum 182 snap 49 seq_num 182) 2026-02-17T05:30:06.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.414+0000 7f31bcf0c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:30:06.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.414+0000 7f31bcf0c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:30:06.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.414+0000 7f31bcf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:06.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.414+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f31b8057ca0 con 0x7f31b805dee0 2026-02-17T05:30:06.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.415+0000 7f319effd640 1 -- 10.20.193.106:0/3824239812 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f31a0016b90 con 0x7f31b805dee0 2026-02-17T05:30:06.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.415+0000 7f319effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:30:06.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.415+0000 7f319effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:06.416 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.416 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1881754327,config=1618278320,health=3286817296,kv=675723720,logm=3723479966}) 2026-02-17T05:30:06.416 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=2807281778,config=3625383534,health=3286817296,kv=27218079,logm=1343344804}) 2026-02-17T05:30:06.416 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.416 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1881754327,config=1618278320,health=3286817296,kv=675723720,logm=3723479966}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.413+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=11,kv=11,logm=65} crc {auth=4276458137,config=1618278320,health=3800237533,kv=675723720,logm=3608253879}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=811535823}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=419864587}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=811535823}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.414+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2433110614}) 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.417 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=99700510}) 2026-02-17T05:30:06.418 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3994647547}) 2026-02-17T05:30:06.418 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.418 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=99700510}) 2026-02-17T05:30:06.418 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=742865580}) 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 >> v1:10.20.193.118:6812/703720803 conn(0x7f3184040dd0 legacy=0x7f3184061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 10 monclient: shutdown 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 >> v1:10.20.193.106:6790/0 conn(0x7f31b805dee0 legacy=0x7f31b8180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 shutdown_connections 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 >> 10.20.193.106:0/3824239812 conn(0x7f31b80915f0 msgr2=0x7f31b805c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 shutdown_connections 2026-02-17T05:30:06.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:06.417+0000 7f31bcf0c640 1 -- 10.20.193.106:0/3824239812 wait complete. 2026-02-17T05:30:06.418 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=127703434}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3793198254}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=127703434}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.415+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=471083661}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2054157692}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153848302}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2054157692}) 2026-02-17T05:30:06.419 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.416+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3649334841}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=7} crc {logm=1231740242,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1993217117,mon_config_key=2797169828,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=1527314401,osd_snap=4086739190,osdmap=1344007608}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=8,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=8} crc {logm=545023968,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgrstat=1993217117,mon_config_key=597233681,monmap=3140514009,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=1527314401,osd_snap=4086739190,osdmap=3729754699}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=7} crc {logm=1231740242,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1993217117,mon_config_key=2797169828,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=1527314401,osd_snap=4086739190,osdmap=1344007608}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=7} crc {logm=4157065988,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1993217117,mon_config_key=597233681,monmap=2903182809,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=1527314401,osd_snap=4086739190,osdmap=1254065872}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1280225393}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=472143134}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1280225393}) 2026-02-17T05:30:06.420 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.417+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3932572108}) 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=76} crc {osdmap=2060876369}) 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=77} crc {osdmap=1874338545}) 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=76} crc {osdmap=2060876369}) 2026-02-17T05:30:06.422 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:30:06.419+0000 7f2aaadf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=1902557289}) 2026-02-17T05:30:06.426 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:30:07.293 INFO:tasks.rados.rados.0.trial118.stdout:464: done (1 left) 2026-02-17T05:30:07.294 INFO:tasks.rados.rados.0.trial118.stdout:465: done (0 left) 2026-02-17T05:30:07.294 INFO:tasks.rados.rados.0.trial118.stdout:466: write oid 18 current snap is 50 2026-02-17T05:30:07.294 INFO:tasks.rados.rados.0.trial118.stdout:466: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2026-02-17T05:30:07.297 INFO:tasks.rados.rados.0.trial118.stdout:466: writing trial11845692-18 from 675681 to 1238720 tid 1 2026-02-17T05:30:07.302 INFO:tasks.rados.rados.0.trial118.stdout:466: writing trial11845692-18 from 1858793 to 2605506 tid 2 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:466: writing trial11845692-18 from 3025937 to 3075681 tid 3 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:467: rollback oid 16 current snap is 50 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 49 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:466: finishing write tid 1 to trial11845692-18 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:468: copy_from oid 26 from oid 20 current snap is 50 2026-02-17T05:30:07.305 INFO:tasks.rados.rados.0.trial118.stdout:469: snap_create 2026-02-17T05:30:07.306 INFO:tasks.rados.rados.0.trial118.stdout:466: finishing write tid 2 to trial11845692-18 2026-02-17T05:30:07.306 INFO:tasks.rados.rados.0.trial118.stdout:466: finishing write tid 3 to trial11845692-18 2026-02-17T05:30:07.306 INFO:tasks.rados.rados.0.trial118.stdout:466: finishing write tid 4 to trial11845692-18 2026-02-17T05:30:07.306 INFO:tasks.rados.rados.0.trial118.stdout:466: finishing write tid 5 to trial11845692-18 2026-02-17T05:30:07.306 INFO:tasks.rados.rados.0.trial118.stdout:466: oid 18 updating version 0 to 113 2026-02-17T05:30:07.307 INFO:tasks.rados.rados.0.trial118.stdout:466: oid 18 updating version 113 to 115 2026-02-17T05:30:07.307 INFO:tasks.rados.rados.0.trial118.stdout:466: oid 18 version 115 is already newer than 114 2026-02-17T05:30:07.307 INFO:tasks.rados.rados.0.trial118.stdout:466: oid 18 version 115 is already newer than 112 2026-02-17T05:30:07.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 115 (ObjNum 183 snap 50 seq_num 183) dirty exists 2026-02-17T05:30:07.307 INFO:tasks.rados.rados.0.trial118.stdout:466: left oid 18 (ObjNum 183 snap 50 seq_num 183) 2026-02-17T05:30:07.308 INFO:tasks.rados.rados.0.trial118.stdout:467: finishing rollback tid 0 to trial11845692-16 2026-02-17T05:30:07.308 INFO:tasks.rados.rados.0.trial118.stdout:467: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:30:07.308 INFO:tasks.rados.rados.0.trial118.stdout:467: finishing rollback tid 2 to trial11845692-16 2026-02-17T05:30:07.308 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 295 (ObjNum 76 snap 9 seq_num 76) dirty exists 2026-02-17T05:30:07.310 INFO:tasks.rados.rados.0.trial118.stdout:468: finishing copy_from racing read to trial11845692-26 2026-02-17T05:30:07.312 INFO:tasks.rados.rados.0.trial118.stdout:468: finishing copy_from to trial11845692-26 2026-02-17T05:30:07.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 229 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:07.427 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:30:07.427 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.495+0000 7f858bfb9640 10 monclient: get_monmap_and_config 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.495+0000 7f858bfb9640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.495+0000 7f858bfb9640 10 monclient: monmap: 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:07.496206+0000 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:07.496206+0000 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 1 Processor -- start 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 1 -- start start 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient: init 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-c con 0x7f858405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-b con 0x7f858405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-a con 0x7f8584182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858408b060 con 0x7f8584182720 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858405dc90 con 0x7f858405d1b0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858408d6a0 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858bfb9640 10 monclient(hunting): authenticate will time out at 736.124624s 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858952d640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f858405dee0 0x7f8584181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59258/0 (socket says 10.20.193.106:59258) 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f858952d640 1 -- 10.20.193.106:0/3769342393 learned_addr learned my addr 10.20.193.106:0/3769342393 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285189 0 0) 0x7f858408d6a0 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): my global_id is 4547 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f856c0035e0 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841523486 0 0) 0x7f858408b060 con 0x7f8584182720 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 10 monclient(hunting): my global_id is 64134 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.496+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f858408d6a0 con 0x7f8584182720 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 146505287 0 0) 0x7f856c0035e0 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 >> v1:10.20.193.118:6789/0 conn(0x7f858405d1b0 legacy=0x7f858405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 >> v1:10.20.193.106:6789/0 conn(0x7f8584182720 legacy=0x7f85841a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 monclient: found mon.noname-b 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8584057960 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8578002dd0 con 0x7f858405dee0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: dump: 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.502 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 5 monclient: authenticate success, global_id 4547 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8578003010 con 0x7f858405dee0 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 1 -- 10.20.193.106:0/3769342393 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8578003420 con 0x7f858405dee0 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f8588d2c640 10 monclient: dump: 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 4 set_mon_vals no callback set 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 10 monclient: shutdown 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 1 -- 10.20.193.106:0/3769342393 >> v1:10.20.193.106:6790/0 conn(0x7f858405dee0 legacy=0x7f8584181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 1 -- 10.20.193.106:0/3769342393 shutdown_connections 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 1 -- 10.20.193.106:0/3769342393 >> 10.20.193.106:0/3769342393 conn(0x7f85840915f0 msgr2=0x7f85840919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 1 -- 10.20.193.106:0/3769342393 shutdown_connections 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 1 -- 10.20.193.106:0/3769342393 wait complete. 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.497+0000 7f858bfb9640 10 monclient: monmap: 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:07.503 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 1 Processor -- start 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 1 -- start start 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient: init 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-b con 0x7f858405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-c con 0x7f858405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient(hunting): picked mon.noname-a con 0x7f8584182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858412c160 con 0x7f8584182720 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858405e8e0 con 0x7f858405d1b0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858410bdd0 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858bfb9640 10 monclient(hunting): authenticate will time out at 736.126472s 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858952d640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f858405dee0 0x7f858412ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59270/0 (socket says 10.20.193.106:59270) 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f858952d640 1 -- 10.20.193.106:0/507831363 learned_addr learned my addr 10.20.193.106:0/507831363 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737091739 0 0) 0x7f858410bdd0 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): my global_id is 4550 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85540035e0 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279692981 0 0) 0x7f858412c160 con 0x7f8584182720 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): my global_id is 64137 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f858410bdd0 con 0x7f8584182720 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 700498834 0 0) 0x7f85540035e0 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f858412c160 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8578002ce0 con 0x7f858405dee0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): dump: 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.504 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3424049731 0 0) 0x7f858410bdd0 con 0x7f8584182720 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85540035e0 con 0x7f8584182720 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8580004170 con 0x7f8584182720 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 10 monclient(hunting): dump: 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.498+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3488122100 0 0) 0x7f858412c160 con 0x7f858405dee0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 >> v1:10.20.193.118:6789/0 conn(0x7f858405d1b0 legacy=0x7f858412b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 >> v1:10.20.193.106:6789/0 conn(0x7f8584182720 legacy=0x7f8584181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 monclient: found mon.c 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858410a8e0 con 0x7f858405dee0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 5 monclient: authenticate success, global_id 4550 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _renew_subs 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f85841824f0 con 0x7f858405dee0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _renew_subs 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f858410b670 con 0x7f858405dee0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8578004b50 con 0x7f858405dee0 2026-02-17T05:30:07.505 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8578004e70 con 0x7f858405dee0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 10 monclient: dump: 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f8573fff640 4 set_mon_vals no callback set 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8584057ca0 con 0x7f858405dee0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8578011e10 con 0x7f858405dee0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.499+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f857804fe00 con 0x7f858405dee0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.500+0000 7f8589d2e640 10 monclient: get_auth_request con 0x7f8554040b60 auth_method 0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.501+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f85780175a0 con 0x7f858405dee0 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.501+0000 7f85727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.501+0000 7f85727fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:07.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f858bfb9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:07.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f858bfb9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:07.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f858bfb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f858410c8c0 con 0x7f858405dee0 2026-02-17T05:30:07.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f85727fc640 1 -- 10.20.193.106:0/507831363 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 434900413) 0x7f8578016d50 con 0x7f858405dee0 2026-02-17T05:30:07.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f85727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:07.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.655+0000 7f85727fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:07.658 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:07.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 >> v1:10.20.193.118:6812/703720803 conn(0x7f8554040b60 legacy=0x7f8554061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 10 monclient: shutdown 2026-02-17T05:30:07.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 >> v1:10.20.193.106:6790/0 conn(0x7f858405dee0 legacy=0x7f858412ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 shutdown_connections 2026-02-17T05:30:07.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 >> 10.20.193.106:0/507831363 conn(0x7f85840915f0 msgr2=0x7f858405c040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 shutdown_connections 2026-02-17T05:30:07.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.656+0000 7f858bfb9640 1 -- 10.20.193.106:0/507831363 wait complete. 2026-02-17T05:30:07.666 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:30:07.666 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:30:07.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:30:07.666 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:30:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 10 monclient: get_monmap_and_config 2026-02-17T05:30:07.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 10 monclient: monmap: 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:07.730707+0000 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:07.730707+0000 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:07.743 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 1 Processor -- start 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 1 -- start start 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.730+0000 7f337965b640 10 monclient: init 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient(hunting): picked mon.noname-a con 0x7f337405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient(hunting): picked mon.noname-c con 0x7f337405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient(hunting): picked mon.noname-b con 0x7f3374182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337408b060 con 0x7f337405d1b0 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337405dc90 con 0x7f337405dee0 2026-02-17T05:30:07.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337408d6a0 con 0x7f3374182720 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient(hunting): authenticate will time out at 736.359188s 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3372ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f337405d1b0 0x7f337405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59972/0 (socket says 10.20.193.106:59972) 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3372ffd640 1 -- 10.20.193.106:0/2275860203 learned_addr learned my addr 10.20.193.106:0/2275860203 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856412232 0 0) 0x7f337408b060 con 0x7f337405d1b0 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): my global_id is 64140 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33600035e0 con 0x7f337405d1b0 2026-02-17T05:30:07.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056690745 0 0) 0x7f337408d6a0 con 0x7f3374182720 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient(hunting): my global_id is 4553 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337408b060 con 0x7f3374182720 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516650892 0 0) 0x7f33600035e0 con 0x7f337405d1b0 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 >> v1:10.20.193.106:6790/0 conn(0x7f3374182720 legacy=0x7f33741a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 >> v1:10.20.193.118:6789/0 conn(0x7f337405dee0 legacy=0x7f3374181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 monclient: found mon.noname-a 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3374057960 con 0x7f337405d1b0 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 5 monclient: authenticate success, global_id 64140 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3368002dd0 con 0x7f337405d1b0 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: dump: 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.747 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3368003090 con 0x7f337405d1b0 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 1 -- 10.20.193.106:0/2275860203 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f33680034a0 con 0x7f337405d1b0 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f3371ffb640 10 monclient: dump: 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.749 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.731+0000 7f337965b640 4 set_mon_vals no callback set 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: shutdown 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- 10.20.193.106:0/2275860203 >> v1:10.20.193.106:6789/0 conn(0x7f337405d1b0 legacy=0x7f337405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- 10.20.193.106:0/2275860203 shutdown_connections 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- 10.20.193.106:0/2275860203 >> 10.20.193.106:0/2275860203 conn(0x7f33740915f0 msgr2=0x7f33740919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- 10.20.193.106:0/2275860203 shutdown_connections 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- 10.20.193.106:0/2275860203 wait complete. 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: monmap: 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:07.751 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 Processor -- start 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 1 -- start start 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: init 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.732+0000 7f337965b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient(hunting): picked mon.noname-c con 0x7f337405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient(hunting): picked mon.noname-b con 0x7f337405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient(hunting): picked mon.noname-a con 0x7f3374182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337412c2f0 con 0x7f3374182720 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337405e8e0 con 0x7f337405dee0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337410bf60 con 0x7f337405d1b0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient(hunting): authenticate will time out at 736.361025s 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f3372ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f337405d1b0 0x7f337412b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59284/0 (socket says 10.20.193.106:59284) 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f3372ffd640 1 -- 10.20.193.106:0/2963944515 learned_addr learned my addr 10.20.193.106:0/2963944515 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166310720 0 0) 0x7f337410bf60 con 0x7f337405d1b0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): my global_id is 4556 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33400035e0 con 0x7f337405d1b0 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831167255 0 0) 0x7f337412c2f0 con 0x7f3374182720 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): my global_id is 64143 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337410bf60 con 0x7f3374182720 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355272203 0 0) 0x7f337405e8e0 con 0x7f337405dee0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): my global_id is 4534 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337412c2f0 con 0x7f337405dee0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1212673405 0 0) 0x7f33400035e0 con 0x7f337405d1b0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337405e8e0 con 0x7f337405d1b0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f33680033b0 con 0x7f337405d1b0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): dump: 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4151739836 0 0) 0x7f337410bf60 con 0x7f3374182720 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33400035e0 con 0x7f3374182720 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f33640040f0 con 0x7f3374182720 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient(hunting): dump: 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4099677751 0 0) 0x7f337405e8e0 con 0x7f337405d1b0 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.118:6789/0 conn(0x7f337405dee0 legacy=0x7f337412bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6789/0 conn(0x7f3374182720 legacy=0x7f3374181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 monclient: found mon.c 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337410aa70 con 0x7f337405d1b0 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 5 monclient: authenticate success, global_id 4556 2026-02-17T05:30:07.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient: _renew_subs 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f337410a420 con 0x7f337405d1b0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient: _renew_subs 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f337410cdd0 con 0x7f337405d1b0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33680028c0 con 0x7f337405d1b0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3368004e60 con 0x7f337405d1b0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33717fa640 4 set_mon_vals no callback set 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f33537fe640 10 monclient: dump: 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.755 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.733+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f337410b9a0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539845189 0 0) 0x7f337410b9a0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient(hunting): my global_id is 64146 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337405e8e0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3368011e00 con 0x7f337405d1b0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f336804fea0 con 0x7f337405d1b0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2942195802 0 0) 0x7f337405e8e0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337410b9a0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f335c002eb0 con 0x7f337410b5d0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient: dump: 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.756 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2026469304 0 0) 0x7f337410b9a0 con 0x7f337410b5d0 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3374057cd0 con 0x7f337410b5d0 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33737fe640 10 monclient: get_auth_request con 0x7f3340040d00 auth_method 0 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f335c004430 con 0x7f337410b5d0 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6789/0 conn(0x7f337410b5d0 legacy=0x7f337405a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.734+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6789/0 conn(0x7f337410b5d0 legacy=0x7f337405a010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.737+0000 7f337965b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.737+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3374128840 con 0x7f3374128430 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868366558 0 0) 0x7f3374128840 con 0x7f3374128430 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient(hunting): my global_id is 64149 2026-02-17T05:30:07.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337410b9a0 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 989243613 0 0) 0x7f337410b9a0 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3374128840 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f335c0034a0 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient: dump: 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3703886511 0 0) 0x7f3374128840 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f337410ca50 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2921796613) 0x7f335c003880 con 0x7f3374128430 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6789/0 conn(0x7f3374128430 legacy=0x7f337404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33537fe640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6789/0 conn(0x7f3374128430 legacy=0x7f337404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 5275, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 5, 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.759 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:07.760 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.761 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.762 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:07.763 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:07.764 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.118:6812/703720803 conn(0x7f3340040d00 legacy=0x7f33400611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 10 monclient: shutdown 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 >> v1:10.20.193.106:6790/0 conn(0x7f337405d1b0 legacy=0x7f337412b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33737fe640 1 -- 10.20.193.106:0/2963944515 reap_dead start 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f33737fe640 1 -- 10.20.193.106:0/2963944515 reap_dead start 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 shutdown_connections 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 >> 10.20.193.106:0/2963944515 conn(0x7f33740915f0 msgr2=0x7f337408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 shutdown_connections 2026-02-17T05:30:07.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.738+0000 7f337965b640 1 -- 10.20.193.106:0/2963944515 wait complete. 2026-02-17T05:30:07.765 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:07.765 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:30:07.765 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:30:07.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: get_monmap_and_config 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: monmap: 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:07.832609+0000 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:07.832609+0000 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.834 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:07.835 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:07.835 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 1 Processor -- start 2026-02-17T05:30:07.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 1 -- start start 2026-02-17T05:30:07.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: init 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-c con 0x7f837805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.832+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-b con 0x7f837805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-a con 0x7f8378182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837808b060 con 0x7f8378182720 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837805dc90 con 0x7f837805d1b0 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837808d6a0 con 0x7f837805dee0 2026-02-17T05:30:07.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 10 monclient(hunting): authenticate will time out at 736.461033s 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f83767fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f837805dee0 0x7f8378181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59296/0 (socket says 10.20.193.106:59296) 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f83767fc640 1 -- 10.20.193.106:0/3651324270 learned_addr learned my addr 10.20.193.106:0/3651324270 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f83777fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f8378182720 0x7f83781a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:60002/0 (socket says 10.20.193.106:60002) 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807905616 0 0) 0x7f837808d6a0 con 0x7f837805dee0 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): my global_id is 4559 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640035e0 con 0x7f837805dee0 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017130494 0 0) 0x7f837808b060 con 0x7f8378182720 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient(hunting): my global_id is 64152 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f837808d6a0 con 0x7f8378182720 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656487451 0 0) 0x7f83640035e0 con 0x7f837805dee0 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 >> v1:10.20.193.118:6789/0 conn(0x7f837805d1b0 legacy=0x7f837805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 >> v1:10.20.193.106:6789/0 conn(0x7f8378182720 legacy=0x7f83781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 monclient: found mon.noname-b 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8378057960 con 0x7f837805dee0 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8360002dd0 con 0x7f837805dee0 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: dump: 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 5 monclient: authenticate success, global_id 4559 2026-02-17T05:30:07.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8360002fd0 con 0x7f837805dee0 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 1 -- 10.20.193.106:0/3651324270 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f83600033e0 con 0x7f837805dee0 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f8375ffb640 10 monclient: dump: 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.847 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 4 set_mon_vals no callback set 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 10 monclient: shutdown 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- 10.20.193.106:0/3651324270 >> v1:10.20.193.106:6790/0 conn(0x7f837805dee0 legacy=0x7f8378181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- 10.20.193.106:0/3651324270 shutdown_connections 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- 10.20.193.106:0/3651324270 >> 10.20.193.106:0/3651324270 conn(0x7f83780915f0 msgr2=0x7f83780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- 10.20.193.106:0/3651324270 shutdown_connections 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.833+0000 7f837d65b640 1 -- 10.20.193.106:0/3651324270 wait complete. 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient: monmap: 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.848 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 1 Processor -- start 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 1 -- start start 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient: init 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-a con 0x7f837805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-b con 0x7f837805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient(hunting): picked mon.noname-c con 0x7f8378182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378128d00 con 0x7f837805d1b0 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837805e950 con 0x7f837805dee0 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837810cc00 con 0x7f8378182720 2026-02-17T05:30:07.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f837d65b640 10 monclient(hunting): authenticate will time out at 736.462729s 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83777fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8378182720 0x7f8378181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59308/0 (socket says 10.20.193.106:59308) 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83777fe640 1 -- 10.20.193.106:0/392253439 learned_addr learned my addr 10.20.193.106:0/392253439 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285972132 0 0) 0x7f837810cc00 con 0x7f8378182720 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): my global_id is 4562 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83440035e0 con 0x7f8378182720 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233302460 0 0) 0x7f8378128d00 con 0x7f837805d1b0 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 10 monclient(hunting): my global_id is 64155 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.834+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f837810cc00 con 0x7f837805d1b0 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1031928286 0 0) 0x7f83440035e0 con 0x7f8378182720 2026-02-17T05:30:07.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8378128d00 con 0x7f8378182720 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f83680039d0 con 0x7f8378182720 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): dump: 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:07.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3687360113 0 0) 0x7f837810cc00 con 0x7f837805d1b0 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83440035e0 con 0x7f837805d1b0 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f836c003070 con 0x7f837805d1b0 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): dump: 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2839625929 0 0) 0x7f8378128d00 con 0x7f8378182720 2026-02-17T05:30:07.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.118:6789/0 conn(0x7f837805dee0 legacy=0x7f837812ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6789/0 conn(0x7f837805d1b0 legacy=0x7f837812b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 monclient: found mon.c 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837812c120 con 0x7f8378182720 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 5 monclient: authenticate success, global_id 4562 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 10 monclient: _renew_subs 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f837810a8a0 con 0x7f8378182720 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 10 monclient: _renew_subs 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f837810c360 con 0x7f8378182720 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8368003b70 con 0x7f8378182720 2026-02-17T05:30:07.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8368005bb0 con 0x7f8378182720 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83757fa640 4 set_mon_vals no callback set 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient: dump: 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83780008d0 con 0x7f8378128240 2026-02-17T05:30:07.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8368012b50 con 0x7f8378182720 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421135104 0 0) 0x7f83780008d0 con 0x7f8378128240 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 10 monclient(hunting): my global_id is 4565 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8378128d00 con 0x7f8378128240 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.835+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f8368050e10 con 0x7f8378182720 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4148835116 0 0) 0x7f8378128d00 con 0x7f8378128240 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83780008d0 con 0x7f8378128240 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f836c003550 con 0x7f8378128240 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 10 monclient: dump: 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.855 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83767fc640 10 monclient: get_auth_request con 0x7f8344040920 auth_method 0 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3583383116 0 0) 0x7f83780008d0 con 0x7f8378128240 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8378057ca0 con 0x7f8378128240 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f836c0059c0 con 0x7f8378128240 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6790/0 conn(0x7f8378128240 legacy=0x7f8378059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.836+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6790/0 conn(0x7f8378128240 legacy=0x7f8378059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f837d65b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f837810b6f0 con 0x7f8378109dc0 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546130686 0 0) 0x7f837810b6f0 con 0x7f8378109dc0 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 10 monclient(hunting): my global_id is 4568 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83780008d0 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1967944812 0 0) 0x7f83780008d0 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f837810b6f0 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f836c003fc0 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.839+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 10 monclient: dump: 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1159926601 0 0) 0x7f837810b6f0 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f837804d910 con 0x7f8378109dc0 2026-02-17T05:30:07.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3917415296) 0x7f836c005540 con 0x7f8378109dc0 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6790/0 conn(0x7f8378109dc0 legacy=0x7f837804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83577fe640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6790/0 conn(0x7f8378109dc0 legacy=0x7f837804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 132601, 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:07.858 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 5, 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:07.859 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.860 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.861 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.863 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.864 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:07.865 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.118:6812/703720803 conn(0x7f8344040920 legacy=0x7f8344060dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 10 monclient: shutdown 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 >> v1:10.20.193.106:6790/0 conn(0x7f8378182720 legacy=0x7f8378181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83777fe640 1 -- 10.20.193.106:0/392253439 reap_dead start 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f83777fe640 1 -- 10.20.193.106:0/392253439 reap_dead start 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 shutdown_connections 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 >> 10.20.193.106:0/392253439 conn(0x7f83780915f0 msgr2=0x7f837808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 shutdown_connections 2026-02-17T05:30:07.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.840+0000 7f837d65b640 1 -- 10.20.193.106:0/392253439 wait complete. 2026-02-17T05:30:07.867 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:07.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:30:07.867 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:30:07.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: get_monmap_and_config 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: monmap: 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:07.935486+0000 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:07.935486+0000 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 1 Processor -- start 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 1 -- start start 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: init 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-b con 0x7ff11405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-a con 0x7ff11405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-c con 0x7ff114182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11408b060 con 0x7ff11405dee0 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11405dc90 con 0x7ff114182720 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11408d6a0 con 0x7ff11405d1b0 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff119acc640 10 monclient(hunting): authenticate will time out at 736.563894s 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff1137fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff11405d1b0 0x7ff11405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59318/0 (socket says 10.20.193.106:59318) 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.935+0000 7ff1137fe640 1 -- 10.20.193.106:0/462437855 learned_addr learned my addr 10.20.193.106:0/462437855 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598725622 0 0) 0x7ff11408d6a0 con 0x7ff11405d1b0 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): my global_id is 4571 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f80035e0 con 0x7ff11405d1b0 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938866974 0 0) 0x7ff11408b060 con 0x7ff11405dee0 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient(hunting): my global_id is 64158 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11408d6a0 con 0x7ff11405dee0 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3036727728 0 0) 0x7ff0f80035e0 con 0x7ff11405d1b0 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 >> v1:10.20.193.118:6789/0 conn(0x7ff114182720 legacy=0x7ff1141a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:30:07.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 >> v1:10.20.193.106:6789/0 conn(0x7ff11405dee0 legacy=0x7ff114181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 monclient: found mon.noname-b 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff114057960 con 0x7ff11405d1b0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff100002dd0 con 0x7ff11405d1b0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 5 monclient: authenticate success, global_id 4571 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: dump: 2026-02-17T05:30:07.947 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff100002fd0 con 0x7ff11405d1b0 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 4 set_mon_vals no callback set 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 1 -- 10.20.193.106:0/462437855 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff1000033e0 con 0x7ff11405d1b0 2026-02-17T05:30:07.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff1127fc640 10 monclient: dump: 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 10 monclient: shutdown 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 1 -- 10.20.193.106:0/462437855 >> v1:10.20.193.106:6790/0 conn(0x7ff11405d1b0 legacy=0x7ff11405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 1 -- 10.20.193.106:0/462437855 shutdown_connections 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 1 -- 10.20.193.106:0/462437855 >> 10.20.193.106:0/462437855 conn(0x7ff1140915f0 msgr2=0x7ff1140919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 1 -- 10.20.193.106:0/462437855 shutdown_connections 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.936+0000 7ff119acc640 1 -- 10.20.193.106:0/462437855 wait complete. 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient: build_initial_monmap 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient: monmap: 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:07.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 1 Processor -- start 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 1 -- start start 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient: init 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-b con 0x7ff11405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-c con 0x7ff11405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient(hunting): picked mon.noname-a con 0x7ff114182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11410edc0 con 0x7ff114182720 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11412ad60 con 0x7ff11405d1b0 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11405c610 con 0x7ff11405dee0 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff119acc640 10 monclient(hunting): authenticate will time out at 736.565713s 2026-02-17T05:30:07.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff112ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff11405dee0 0x7ff11412a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59330/0 (socket says 10.20.193.106:59330) 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff112ffd640 1 -- 10.20.193.106:0/4008067431 learned_addr learned my addr 10.20.193.106:0/4008067431 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282898311 0 0) 0x7ff11410edc0 con 0x7ff114182720 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 10 monclient(hunting): my global_id is 64161 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.937+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e40035e0 con 0x7ff114182720 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962516973 0 0) 0x7ff11405c610 con 0x7ff11405dee0 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): my global_id is 4574 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11410edc0 con 0x7ff11405dee0 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4284298200 0 0) 0x7ff0e40035e0 con 0x7ff114182720 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff11405c610 con 0x7ff114182720 2026-02-17T05:30:07.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff108003d80 con 0x7ff114182720 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): dump: 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2942949308 0 0) 0x7ff11410edc0 con 0x7ff11405dee0 2026-02-17T05:30:07.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0e40035e0 con 0x7ff11405dee0 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff104003170 con 0x7ff11405dee0 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): dump: 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859514967 0 0) 0x7ff11412ad60 con 0x7ff11405d1b0 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient(hunting): my global_id is 4540 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11410edc0 con 0x7ff11405d1b0 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2733135729 0 0) 0x7ff11405c610 con 0x7ff114182720 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.106:6790/0 conn(0x7ff11405dee0 legacy=0x7ff11412a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6789/0 conn(0x7ff11405d1b0 legacy=0x7ff114129f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: _finish_hunting 0 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 monclient: found mon.a 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11413f550 con 0x7ff114182720 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: _finish_auth 0 2026-02-17T05:30:07.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: _check_auth_tickets 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 5 monclient: authenticate success, global_id 64161 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 10 monclient: _renew_subs 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff11405e8e0 con 0x7ff114182720 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 10 monclient: _renew_subs 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff11410e800 con 0x7ff114182720 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1080043c0 con 0x7ff114182720 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff1080045f0 con 0x7ff114182720 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff111ffb640 4 set_mon_vals no callback set 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff0effff640 10 monclient: dump: 2026-02-17T05:30:07.956 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.938+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff11410d920 con 0x7ff11412df00 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff1080119d0 con 0x7ff114182720 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7ff10804fb90 con 0x7ff114182720 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888689174 0 0) 0x7ff11410d920 con 0x7ff11412df00 2026-02-17T05:30:07.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient(hunting): my global_id is 4543 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11405c610 con 0x7ff11412df00 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff112ffd640 10 monclient: get_auth_request con 0x7ff0e4040dd0 auth_method 0 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2304904827 0 0) 0x7ff11405c610 con 0x7ff11412df00 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff11410d920 con 0x7ff11412df00 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff1000029b0 con 0x7ff11412df00 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient: dump: 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.958 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3755360059 0 0) 0x7ff11410d920 con 0x7ff11412df00 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff114057ca0 con 0x7ff11412df00 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff1000048a0 con 0x7ff11412df00 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6789/0 conn(0x7ff11412df00 legacy=0x7ff114059df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.939+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6789/0 conn(0x7ff11412df00 legacy=0x7ff114059df0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff119acc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff11412e2d0 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610111156 0 0) 0x7ff11412e2d0 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient(hunting): my global_id is 4546 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11410d920 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1719437774 0 0) 0x7ff11410d920 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff11412e2d0 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff100004e60 con 0x7ff11404d200 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:07.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.943+0000 7ff0effff640 10 monclient: dump: 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4014200496 0 0) 0x7ff11412e2d0 con 0x7ff11404d200 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff114055570 con 0x7ff11404d200 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2339197704) 0x7ff100007020 con 0x7ff11404d200 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:07.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6789/0 conn(0x7ff11404d200 legacy=0x7ff11411b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff0effff640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6789/0 conn(0x7ff11404d200 legacy=0x7ff11411b2a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 10, 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 132669, 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:30:07.963 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 5, 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.964 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.965 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:07.966 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:07.967 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:07.968 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.969 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:07.970 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.971 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:07.972 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:07.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.118:6812/703720803 conn(0x7ff0e4040dd0 legacy=0x7ff0e4061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 10 monclient: shutdown 2026-02-17T05:30:07.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 >> v1:10.20.193.106:6789/0 conn(0x7ff114182720 legacy=0x7ff114181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff113fff640 1 -- 10.20.193.106:0/4008067431 reap_dead start 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff113fff640 1 -- 10.20.193.106:0/4008067431 reap_dead start 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 shutdown_connections 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 >> 10.20.193.106:0/4008067431 conn(0x7ff1140915f0 msgr2=0x7ff11405beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 shutdown_connections 2026-02-17T05:30:07.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:07.944+0000 7ff119acc640 1 -- 10.20.193.106:0/4008067431 wait complete. 2026-02-17T05:30:07.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:30:07.974 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T05:30:07.974 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:30:07.974 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T05:30:07.974 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T05:30:07.975 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T05:30:07.975 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:30:07.987 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T05:30:07.988 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:30:07.988 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 10 monclient: get_monmap_and_config 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 10 monclient: build_initial_monmap 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 10 monclient: monmap: 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.052 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:08.051852+0000 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:08.051852+0000 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:08.053 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 1 Processor -- start 2026-02-17T05:30:08.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 1 -- start start 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.051+0000 7f0394e47640 10 monclient: init 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-b con 0x7f039005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-a con 0x7f039005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-c con 0x7f0390182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039008b060 con 0x7f039005dee0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039005dc90 con 0x7f0390182720 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039008d6a0 con 0x7f039005d1b0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient(hunting): authenticate will time out at 736.680240s 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038ed76640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f0390182720 legacy=0x7f03901a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:08.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038e575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f039005d1b0 0x7f039005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59336/0 (socket says 10.20.193.106:59336) 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038e575640 1 -- 10.20.193.106:0/3906811653 learned_addr learned my addr 10.20.193.106:0/3906811653 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038dd74640 1 --1- 10.20.193.106:0/3906811653 >> v1:10.20.193.106:6789/0 conn(0x7f039005dee0 0x7f0390181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:60016/0 (socket says 10.20.193.106:60016) 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942230878 0 0) 0x7f039008b060 con 0x7f039005dee0 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): my global_id is 64164 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f037c0035e0 con 0x7f039005dee0 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220124390 0 0) 0x7f039008d6a0 con 0x7f039005d1b0 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient(hunting): my global_id is 4577 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f039008b060 con 0x7f039005d1b0 2026-02-17T05:30:08.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 21321919 0 0) 0x7f037c0035e0 con 0x7f039005dee0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 >> v1:10.20.193.106:6790/0 conn(0x7f039005d1b0 legacy=0x7f039005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 >> v1:10.20.193.118:6789/0 conn(0x7f0390182720 legacy=0x7f03901a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: _finish_hunting 0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 monclient: found mon.noname-a 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0390057960 con 0x7f039005dee0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: _finish_auth 0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: _check_auth_tickets 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0378002dd0 con 0x7f039005dee0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: dump: 2026-02-17T05:30:08.062 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 5 monclient: authenticate success, global_id 64164 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0378003010 con 0x7f039005dee0 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:08.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 1 -- 10.20.193.106:0/3906811653 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0378003420 con 0x7f039005dee0 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f0394e47640 4 set_mon_vals no callback set 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.052+0000 7f038d573640 10 monclient: dump: 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.064 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 10 monclient: shutdown 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- 10.20.193.106:0/3906811653 >> v1:10.20.193.106:6789/0 conn(0x7f039005dee0 legacy=0x7f0390181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- 10.20.193.106:0/3906811653 shutdown_connections 2026-02-17T05:30:08.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- 10.20.193.106:0/3906811653 >> 10.20.193.106:0/3906811653 conn(0x7f03900915f0 msgr2=0x7f03900919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- 10.20.193.106:0/3906811653 shutdown_connections 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- 10.20.193.106:0/3906811653 wait complete. 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 10 monclient: build_initial_monmap 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 10 monclient: monmap: 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:08.066 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 Processor -- start 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 1 -- start start 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.053+0000 7f0394e47640 10 monclient: init 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-c con 0x7f039005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-b con 0x7f039005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient(hunting): picked mon.noname-a con 0x7f0390182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:08.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039005ce20 con 0x7f0390182720 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039005e8e0 con 0x7f039005dee0 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0390129e90 con 0x7f039005d1b0 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient(hunting): authenticate will time out at 736.682099s 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f038e575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f039005d1b0 0x7f03901a3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59342/0 (socket says 10.20.193.106:59342) 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f038dd74640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f039005dee0 legacy=0x7f0390180dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f038e575640 1 -- 10.20.193.106:0/1617294611 learned_addr learned my addr 10.20.193.106:0/1617294611 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:08.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f038ed76640 1 --1- 10.20.193.106:0/1617294611 >> v1:10.20.193.106:6789/0 conn(0x7f0390182720 0x7f039012e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:60018/0 (socket says 10.20.193.106:60018) 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567596098 0 0) 0x7f039005ce20 con 0x7f0390182720 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): my global_id is 64167 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f035c0035e0 con 0x7f0390182720 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566113994 0 0) 0x7f0390129e90 con 0x7f039005d1b0 2026-02-17T05:30:08.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): my global_id is 4580 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f039005ce20 con 0x7f039005d1b0 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1524519566 0 0) 0x7f035c0035e0 con 0x7f0390182720 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0390129e90 con 0x7f0390182720 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0380005160 con 0x7f0390182720 2026-02-17T05:30:08.071 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.072 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 349444103 0 0) 0x7f039005ce20 con 0x7f039005d1b0 2026-02-17T05:30:08.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f035c0035e0 con 0x7f039005d1b0 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f03840030d0 con 0x7f039005d1b0 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.074 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3350787984 0 0) 0x7f0390129e90 con 0x7f0390182720 2026-02-17T05:30:08.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 >> v1:10.20.193.106:6790/0 conn(0x7f039005d1b0 legacy=0x7f03901a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 >> v1:10.20.193.118:6789/0 conn(0x7f039005dee0 legacy=0x7f0390180dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 monclient: found mon.a 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03901824f0 con 0x7f0390182720 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: _finish_auth 0 2026-02-17T05:30:08.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 5 monclient: authenticate success, global_id 64167 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _renew_subs 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f039012c1f0 con 0x7f0390182720 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _renew_subs 2026-02-17T05:30:08.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f039013d7d0 con 0x7f0390182720 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03800053a0 con 0x7f0390182720 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0380005780 con 0x7f0390182720 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f0376ffd640 10 monclient: dump: 2026-02-17T05:30:08.078 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:08.079 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.054+0000 7f038cd72640 4 set_mon_vals no callback set 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0394e47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0394e47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0394e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03900008d0 con 0x7f0390182720 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f03800058e0 con 0x7f0390182720 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f0380050c80 con 0x7f0390182720 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.055+0000 7f038e575640 10 monclient: get_auth_request con 0x7f035c040ac0 auth_method 0 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.057+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f0380006120 con 0x7f0390182720 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.057+0000 7f0376ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:08.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.057+0000 7f0376ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:08.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0394e47640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0394e47640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0394e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0390057ca0 con 0x7f0390182720 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0376ffd640 1 -- 10.20.193.106:0/1617294611 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 240023005) 0x7f0380017ab0 con 0x7f0390182720 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0376ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.204+0000 7f0376ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:08.206 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:08.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 >> v1:10.20.193.118:6812/703720803 conn(0x7f035c040ac0 legacy=0x7f035c060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:08.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 10 monclient: shutdown 2026-02-17T05:30:08.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:08.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 >> v1:10.20.193.106:6789/0 conn(0x7f0390182720 legacy=0x7f039012e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:08.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 shutdown_connections 2026-02-17T05:30:08.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 >> 10.20.193.106:0/1617294611 conn(0x7f03900915f0 msgr2=0x7f039005c340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:08.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 shutdown_connections 2026-02-17T05:30:08.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:08.205+0000 7f0394e47640 1 -- 10.20.193.106:0/1617294611 wait complete. 2026-02-17T05:30:11.215 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:11.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 10 monclient: get_monmap_and_config 2026-02-17T05:30:11.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 10 monclient: build_initial_monmap 2026-02-17T05:30:11.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 10 monclient: monmap: 2026-02-17T05:30:11.289 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:11.280850+0000 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:11.280850+0000 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 1 Processor -- start 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 1 -- start start 2026-02-17T05:30:11.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.279+0000 7f9730e1b640 10 monclient: init 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f972c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f972c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f972c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c08b060 con 0x7f972c05dee0 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c05dc90 con 0x7f972c182720 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c08d6a0 con 0x7f972c05d1b0 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient(hunting): authenticate will time out at 739.909219s 2026-02-17T05:30:11.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f972a575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f972c05d1b0 0x7f972c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59362/0 (socket says 10.20.193.106:59362) 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729d74640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f972c05dee0 0x7f972c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:60020/0 (socket says 10.20.193.106:60020) 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f972a575640 1 -- 10.20.193.106:0/1132127144 learned_addr learned my addr 10.20.193.106:0/1132127144 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f972ad76640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f972c182720 legacy=0x7f972c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280560932 0 0) 0x7f972c08b060 con 0x7f972c05dee0 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): my global_id is 64170 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97180035e0 con 0x7f972c05dee0 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396134195 0 0) 0x7f972c08d6a0 con 0x7f972c05d1b0 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:11.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient(hunting): my global_id is 4583 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f972c08b060 con 0x7f972c05d1b0 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 715906596 0 0) 0x7f97180035e0 con 0x7f972c05dee0 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 >> v1:10.20.193.106:6790/0 conn(0x7f972c05d1b0 legacy=0x7f972c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 >> v1:10.20.193.118:6789/0 conn(0x7f972c182720 legacy=0x7f972c1a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: _finish_hunting 0 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 monclient: found mon.noname-a 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c057960 con 0x7f972c05dee0 2026-02-17T05:30:11.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: _finish_auth 0 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: _check_auth_tickets 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9714002dd0 con 0x7f972c05dee0 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: dump: 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.294 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 5 monclient: authenticate success, global_id 64170 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9714003090 con 0x7f972c05dee0 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:11.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 1 -- 10.20.193.106:0/1132127144 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97140034a0 con 0x7f972c05dee0 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9729573640 10 monclient: dump: 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:11.296 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.280+0000 7f9730e1b640 4 set_mon_vals no callback set 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 10 monclient: shutdown 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- 10.20.193.106:0/1132127144 >> v1:10.20.193.106:6789/0 conn(0x7f972c05dee0 legacy=0x7f972c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- 10.20.193.106:0/1132127144 shutdown_connections 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- 10.20.193.106:0/1132127144 >> 10.20.193.106:0/1132127144 conn(0x7f972c0915f0 msgr2=0x7f972c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- 10.20.193.106:0/1132127144 shutdown_connections 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- 10.20.193.106:0/1132127144 wait complete. 2026-02-17T05:30:11.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 10 monclient: build_initial_monmap 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 10 monclient: monmap: 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 Processor -- start 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 1 -- start start 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.281+0000 7f9730e1b640 10 monclient: init 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f972c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f972c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f972c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c10efc0 con 0x7f972c05d1b0 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c12aef0 con 0x7f972c05dee0 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c089a60 con 0x7f972c182720 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:11.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient(hunting): authenticate will time out at 739.911126s 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972a575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f972c05d1b0 0x7f972c12a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:60030/0 (socket says 10.20.193.106:60030) 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972a575640 1 -- 10.20.193.106:0/1352562884 learned_addr learned my addr 10.20.193.106:0/1352562884 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9729d74640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.118:6789/0 conn(0x7f972c05dee0 legacy=0x7f972c12a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991940035 0 0) 0x7f972c089a60 con 0x7f972c182720 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): my global_id is 4586 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96f80035e0 con 0x7f972c182720 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589516286 0 0) 0x7f972c10efc0 con 0x7f972c05d1b0 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:11.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): my global_id is 64173 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f972c089a60 con 0x7f972c05d1b0 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2269109547 0 0) 0x7f96f80035e0 con 0x7f972c182720 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f972c10efc0 con 0x7f972c182720 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f971c005160 con 0x7f972c182720 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.301 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972ad76640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6790/0 conn(0x7f972c182720 legacy=0x7f972c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972ad76640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6790/0 conn(0x7f972c182720 legacy=0x7f972c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2956727299 0 0) 0x7f972c089a60 con 0x7f972c05d1b0 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972ad76640 1 --1- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6790/0 conn(0x7f972c182720 0x7f972c181de0 :-1 s=OPENED pgs=222 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-17T05:30:11.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f972ad76640 1 --1- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6790/0 conn(0x7f972c182720 0x7f972c181de0 :-1 s=OPENED pgs=222 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96f80035e0 con 0x7f972c05d1b0 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.106:6790/0 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97200030d0 con 0x7f972c05d1b0 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient(hunting): dump: 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:11.303 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 50492311 0 0) 0x7f96f80035e0 con 0x7f972c05d1b0 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6790/0 conn(0x7f972c182720 legacy=0x7f972c181de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.118:6789/0 conn(0x7f972c05dee0 legacy=0x7f972c12a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 monclient: found mon.a 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c05cd30 con 0x7f972c05d1b0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: _finish_auth 0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 5 monclient: authenticate success, global_id 64173 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _renew_subs 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f972c05e8e0 con 0x7f972c05d1b0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _renew_subs 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f972c10ece0 con 0x7f972c05d1b0 2026-02-17T05:30:11.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97200048a0 con 0x7f972c05d1b0 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9720004c80 con 0x7f972c05d1b0 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9728d72640 4 set_mon_vals no callback set 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.282+0000 7f9712ffd640 10 monclient: dump: 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:11.306 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9730e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9730e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9730e1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972c057ca0 con 0x7f972c05d1b0 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9720004de0 con 0x7f972c05d1b0 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f972004fd30 con 0x7f972c05d1b0 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.283+0000 7f9729d74640 10 monclient: get_auth_request con 0x7f96f8040a90 auth_method 0 2026-02-17T05:30:11.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.285+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9720017430 con 0x7f972c05d1b0 2026-02-17T05:30:11.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.285+0000 7f9712ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:11.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.285+0000 7f9712ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:11.431 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9730e1b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:11.431 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9730e1b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9730e1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f972c055570 con 0x7f972c05d1b0 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9712ffd640 1 -- 10.20.193.106:0/1352562884 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 4202049341) 0x7f9720016be0 con 0x7f972c05d1b0 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9712ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.429+0000 7f9712ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:11.432 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.118:6812/703720803 conn(0x7f96f8040a90 legacy=0x7f96f8060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 10 monclient: shutdown 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 >> v1:10.20.193.106:6789/0 conn(0x7f972c05d1b0 legacy=0x7f972c12a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 shutdown_connections 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 >> 10.20.193.106:0/1352562884 conn(0x7f972c0915f0 msgr2=0x7f972c1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 shutdown_connections 2026-02-17T05:30:11.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:11.431+0000 7f9730e1b640 1 -- 10.20.193.106:0/1352562884 wait complete. 2026-02-17T05:30:14.441 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.504+0000 7f2228c5b640 10 monclient: get_monmap_and_config 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.504+0000 7f2228c5b640 10 monclient: build_initial_monmap 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.504+0000 7f2228c5b640 10 monclient: monmap: 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:14.508 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:14.506329+0000 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:14.506329+0000 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 1 Processor -- start 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 1 -- start start 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient: init 2026-02-17T05:30:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f22240585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f22241631e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f2224184ce0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240575d0 con 0x7f2224184ce0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240578b0 con 0x7f22241631e0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2224057b90 con 0x7f22240585c0 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2228c5b640 10 monclient(hunting): authenticate will time out at 743.134744s 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2222575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f22240585c0 0x7f222413f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:47454/0 (socket says 10.20.193.106:47454) 2026-02-17T05:30:14.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2222575640 1 -- 10.20.193.106:0/3323335133 learned_addr learned my addr 10.20.193.106:0/3323335133 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:14.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2222d76640 1 --1- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6789/0 conn(0x7f2224184ce0 0x7f22241a50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42230/0 (socket says 10.20.193.106:42230) 2026-02-17T05:30:14.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.505+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f22241835c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:14.708 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:14.706+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f22241835c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:15.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:15.107+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f22241835c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:15.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:15.909+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f22241835c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): tick 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 monclient(hunting): continuing hunt 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6790/0 conn(0x7f22240585c0 legacy=0x7f222413f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f22241835c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6789/0 conn(0x7f2224184ce0 legacy=0x7f22241a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f22240585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f22241631e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f2224184ce0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2224057e70 con 0x7f2224184ce0 2026-02-17T05:30:17.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240578b0 con 0x7f22241631e0 2026-02-17T05:30:17.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2200069f80 con 0x7f22240585c0 2026-02-17T05:30:17.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f220bfff640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:17.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.506+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:17.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:17.707+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:18.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:18.108+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:18.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:18.909+0000 7f2221d74640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): tick 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 monclient(hunting): continuing hunt 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6790/0 conn(0x7f22240585c0 legacy=0x7f22000237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6789/0 conn(0x7f2224184ce0 legacy=0x7f2200066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f2200067fe0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f22240585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f22241631e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220006b1e0 con 0x7f2200067fe0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240578b0 con 0x7f22241631e0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220006aa60 con 0x7f22240585c0 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f220bfff640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:20.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.506+0000 7f2222d76640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:20.709 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:20.708+0000 7f2222d76640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:21.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:21.109+0000 7f2222d76640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:21.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:21.911+0000 7f2222d76640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754384788 0 0) 0x7f220006b1e0 con 0x7f2200067fe0 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient(hunting): my global_id is 64176 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22100035e0 con 0x7f2200067fe0 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927349874 0 0) 0x7f22100035e0 con 0x7f2200067fe0 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6790/0 conn(0x7f22240585c0 legacy=0x7f22000666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.118:6789/0 conn(0x7f22241631e0 legacy=0x7f2200044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:22.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 monclient: found mon.noname-a 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220006acb0 con 0x7f2200067fe0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2218002cc0 con 0x7f2200067fe0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:22.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: dump: 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2228c5b640 5 monclient: authenticate success, global_id 64176 2026-02-17T05:30:22.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2228c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2218002e50 con 0x7f2200067fe0 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 1 -- 10.20.193.106:0/3323335133 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2218003260 con 0x7f2200067fe0 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2221573640 10 monclient: dump: 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.305 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2228c5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.294+0000 7f2228c5b640 4 set_mon_vals no callback set 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 10 monclient: shutdown 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 1 -- 10.20.193.106:0/3323335133 >> v1:10.20.193.106:6789/0 conn(0x7f2200067fe0 legacy=0x7f220006a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 1 -- 10.20.193.106:0/3323335133 shutdown_connections 2026-02-17T05:30:22.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 1 -- 10.20.193.106:0/3323335133 >> 10.20.193.106:0/3323335133 conn(0x7f222405e410 msgr2=0x7f2224095420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 1 -- 10.20.193.106:0/3323335133 shutdown_connections 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.295+0000 7f2228c5b640 1 -- 10.20.193.106:0/3323335133 wait complete. 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient: build_initial_monmap 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient: monmap: 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:22.307 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 1 Processor -- start 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 1 -- start start 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient: init 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f2200067fe0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f22240585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f22241631e0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22241601e0 con 0x7f22240585c0 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222408c610 con 0x7f2200067fe0 2026-02-17T05:30:22.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22241433d0 con 0x7f22241631e0 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2228c5b640 10 monclient(hunting): authenticate will time out at 750.925777s 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2222575640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f2200067fe0 legacy=0x7f222415f3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2221d74640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f22240585c0 0x7f222415fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42262/0 (socket says 10.20.193.106:42262) 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.296+0000 7f2221d74640 1 -- 10.20.193.106:0/1381479132 learned_addr learned my addr 10.20.193.106:0/1381479132 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112003492 0 0) 0x7f22241601e0 con 0x7f22240585c0 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): my global_id is 64179 2026-02-17T05:30:22.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f00035e0 con 0x7f22240585c0 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2505408365 0 0) 0x7f21f00035e0 con 0x7f22240585c0 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22241601e0 con 0x7f22240585c0 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f220c003bc0 con 0x7f22240585c0 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): dump: 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.310 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3697556330 0 0) 0x7f22241601e0 con 0x7f22240585c0 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 >> v1:10.20.193.106:6790/0 conn(0x7f22241631e0 legacy=0x7f222412daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 >> v1:10.20.193.118:6789/0 conn(0x7f2200067fe0 legacy=0x7f222415f3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 monclient: found mon.a 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2224141ee0 con 0x7f22240585c0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 5 monclient: authenticate success, global_id 64179 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 10 monclient: _renew_subs 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2224144240 con 0x7f22240585c0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 10 monclient: _renew_subs 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2224143a50 con 0x7f22240585c0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f220c004760 con 0x7f22240585c0 2026-02-17T05:30:22.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f220c004b00 con 0x7f22240585c0 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f220affd640 10 monclient: dump: 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.313 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.297+0000 7f2220d72640 4 set_mon_vals no callback set 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f220c004c60 con 0x7f22240585c0 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3915+0+0 (unknown 4106853336 0 0) 0x7f220c04fd90 con 0x7f22240585c0 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f2228c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f2228c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f2228c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2224058c70 con 0x7f22240585c0 2026-02-17T05:30:22.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.298+0000 7f2222575640 10 monclient: get_auth_request con 0x7f21f0040740 auth_method 0 2026-02-17T05:30:22.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.302+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f220c017410 con 0x7f22240585c0 2026-02-17T05:30:22.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.302+0000 7f220affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.302+0000 7f220affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:466: done (3 left) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:467: done (2 left) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:468: done (1 left) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:469: done (0 left) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:470: read oid 33 snap -1 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:470: expect (ObjNum 169 snap 43 seq_num 169) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:471: read oid 42 snap -1 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:471: expect (ObjNum 163 snap 41 seq_num 163) 2026-02-17T05:30:22.354 INFO:tasks.rados.rados.0.trial118.stdout:472: snap_create 2026-02-17T05:30:22.359 INFO:tasks.rados.rados.0.trial118.stdout:471: expect (ObjNum 163 snap 41 seq_num 163) 2026-02-17T05:30:22.359 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:22.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.447+0000 7f2228c5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:30:22.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.447+0000 7f2228c5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:22.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.447+0000 7f2228c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:30:22.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.447+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2224140730 con 0x7f22240585c0 2026-02-17T05:30:22.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.448+0000 7f220affd640 1 -- 10.20.193.106:0/1381479132 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3871729986) 0x7f220c016bc0 con 0x7f22240585c0 2026-02-17T05:30:22.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.448+0000 7f220affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:30:22.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.448+0000 7f220affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:22.450 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:30:22.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 >> v1:10.20.193.118:6812/703720803 conn(0x7f21f0040740 legacy=0x7f21f0060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 10 monclient: shutdown 2026-02-17T05:30:22.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 >> v1:10.20.193.106:6789/0 conn(0x7f22240585c0 legacy=0x7f222415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 shutdown_connections 2026-02-17T05:30:22.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 >> 10.20.193.106:0/1381479132 conn(0x7f222405e410 msgr2=0x7f222408dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 shutdown_connections 2026-02-17T05:30:22.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.449+0000 7f2228c5b640 1 -- 10.20.193.106:0/1381479132 wait complete. 2026-02-17T05:30:22.460 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:30:22.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T05:30:22.460 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:30:22.469 INFO:tasks.rados.rados.0.trial118.stdout:470: expect (ObjNum 169 snap 43 seq_num 169) 2026-02-17T05:30:22.513 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:22.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: monmap: 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:22.527525+0000 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:22.527525+0000 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:22.538 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 1 Processor -- start 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 1 -- start start 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: init 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f799005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f799005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:22.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f7990182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799008b060 con 0x7f799005d1b0 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799005dc90 con 0x7f7990182720 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799008d6a0 con 0x7f799005dee0 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.526+0000 7f7996d0c640 10 monclient(hunting): authenticate will time out at 751.155952s 2026-02-17T05:30:22.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7995282640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f7990182720 legacy=0x7f79901a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7994a81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f799005d1b0 0x7f799005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42264/0 (socket says 10.20.193.106:42264) 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7994a81640 1 -- 10.20.193.106:0/1770201201 learned_addr learned my addr 10.20.193.106:0/1770201201 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927599871 0 0) 0x7f799008d6a0 con 0x7f799005dee0 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): my global_id is 4589 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f797c0035e0 con 0x7f799005dee0 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904928313 0 0) 0x7f799008b060 con 0x7f799005d1b0 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient(hunting): my global_id is 64182 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f799008d6a0 con 0x7f799005d1b0 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3696676678 0 0) 0x7f797c0035e0 con 0x7f799005dee0 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 >> v1:10.20.193.118:6789/0 conn(0x7f7990182720 legacy=0x7f79901a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 >> v1:10.20.193.106:6789/0 conn(0x7f799005d1b0 legacy=0x7f799005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 monclient: found mon.noname-b 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990057960 con 0x7f799005dee0 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7978002dd0 con 0x7f799005dee0 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: dump: 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.543 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 5 monclient: authenticate success, global_id 4589 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:22.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7978003010 con 0x7f799005dee0 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 1 -- 10.20.193.106:0/1770201201 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7978003420 con 0x7f799005dee0 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f79877fe640 10 monclient: dump: 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.545 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 4 set_mon_vals no callback set 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 10 monclient: shutdown 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 1 -- 10.20.193.106:0/1770201201 >> v1:10.20.193.106:6790/0 conn(0x7f799005dee0 legacy=0x7f7990181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 1 -- 10.20.193.106:0/1770201201 shutdown_connections 2026-02-17T05:30:22.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 1 -- 10.20.193.106:0/1770201201 >> 10.20.193.106:0/1770201201 conn(0x7f79900915f0 msgr2=0x7f79900919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 1 -- 10.20.193.106:0/1770201201 shutdown_connections 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.527+0000 7f7996d0c640 1 -- 10.20.193.106:0/1770201201 wait complete. 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient: build_initial_monmap 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient: monmap: 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:22.547 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 1 Processor -- start 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 1 -- start start 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient: init 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f799005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f799005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f7990182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799010e770 con 0x7f7990182720 2026-02-17T05:30:22.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799013d910 con 0x7f799005d1b0 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799005e8e0 con 0x7f799005dee0 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7996d0c640 10 monclient(hunting): authenticate will time out at 751.157755s 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7994a81640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f799005d1b0 legacy=0x7f799013caf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7987fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f799005dee0 0x7f799013d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:47506/0 (socket says 10.20.193.106:47506) 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f7987fff640 1 -- 10.20.193.106:0/543668268 learned_addr learned my addr 10.20.193.106:0/543668268 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472182373 0 0) 0x7f799005e8e0 con 0x7f799005dee0 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f79857fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f79857fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f79857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.528+0000 7f79857fa640 10 monclient(hunting): my global_id is 4592 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79600035e0 con 0x7f799005dee0 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283847662 0 0) 0x7f799010e770 con 0x7f7990182720 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): my global_id is 64185 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f799005e8e0 con 0x7f7990182720 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1369638036 0 0) 0x7f79600035e0 con 0x7f799005dee0 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f799010e770 con 0x7f799005dee0 2026-02-17T05:30:22.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7978002da0 con 0x7f799005dee0 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): dump: 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.551 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1130214003 0 0) 0x7f799005e8e0 con 0x7f7990182720 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f79600035e0 con 0x7f7990182720 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f798c005090 con 0x7f7990182720 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient(hunting): dump: 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 593184068 0 0) 0x7f799010e770 con 0x7f799005dee0 2026-02-17T05:30:22.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.118:6789/0 conn(0x7f799005d1b0 legacy=0x7f799013caf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6789/0 conn(0x7f7990182720 legacy=0x7f7990181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 monclient: found mon.c 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799010ed30 con 0x7f799005dee0 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 5 monclient: authenticate success, global_id 4592 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 10 monclient: _renew_subs 2026-02-17T05:30:22.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f799010f010 con 0x7f799005dee0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 10 monclient: _renew_subs 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f799008a050 con 0x7f799005dee0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7978003940 con 0x7f799005dee0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7978003ce0 con 0x7f799005dee0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 10 monclient: dump: 2026-02-17T05:30:22.555 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7986ffd640 4 set_mon_vals no callback set 2026-02-17T05:30:22.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f799012dac0 con 0x7f799012d6f0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.529+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7978003e40 con 0x7f799005dee0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(117..117 src has 1..117) ==== 3915+0+0 (unknown 1973311248 0 0) 0x7f797804fe30 con 0x7f799005dee0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430987061 0 0) 0x7f799012dac0 con 0x7f799012d6f0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient(hunting): my global_id is 64188 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f799010e770 con 0x7f799012d6f0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f7995282640 10 monclient: get_auth_request con 0x7f7960040b10 auth_method 0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3511977165 0 0) 0x7f799010e770 con 0x7f799012d6f0 2026-02-17T05:30:22.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f799012dac0 con 0x7f799012d6f0 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7980002e30 con 0x7f799012d6f0 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient: dump: 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.558 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 931409508 0 0) 0x7f799012dac0 con 0x7f799012d6f0 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7990057cd0 con 0x7f799012d6f0 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7980003300 con 0x7f799012d6f0 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6789/0 conn(0x7f799012d6f0 legacy=0x7f7990059f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.530+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6789/0 conn(0x7f799012d6f0 legacy=0x7f7990059f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.533+0000 7f7996d0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:22.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f79901824f0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714068141 0 0) 0x7f79901824f0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient(hunting): my global_id is 64191 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f799012dac0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1177284839 0 0) 0x7f799012dac0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f79901824f0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7980004ca0 con 0x7f799004d200 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient: dump: 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2052577197 0 0) 0x7f79901824f0 con 0x7f799004d200 2026-02-17T05:30:22.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7990055570 con 0x7f799004d200 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4502 (unknown 0 0 269622903) 0x7f79800061a0 con 0x7f799004d200 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6789/0 conn(0x7f799004d200 legacy=0x7f799011b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.534+0000 7f79857fa640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6789/0 conn(0x7f799004d200 legacy=0x7f799011b5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:22.562 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 12, 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 20072, 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:22.563 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.564 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.565 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:22.566 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.567 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.568 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:22.569 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.570 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.571 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.572 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:22.573 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:22.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.118:6812/703720803 conn(0x7f7960040b10 legacy=0x7f7960060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 10 monclient: shutdown 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 >> v1:10.20.193.106:6790/0 conn(0x7f799005dee0 legacy=0x7f799013d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7995282640 1 -- 10.20.193.106:0/543668268 reap_dead start 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 shutdown_connections 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 >> 10.20.193.106:0/543668268 conn(0x7f79900915f0 msgr2=0x7f799008c630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 shutdown_connections 2026-02-17T05:30:22.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.535+0000 7f7996d0c640 1 -- 10.20.193.106:0/543668268 wait complete. 2026-02-17T05:30:22.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:30:22.576 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:30:22.576 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 10 monclient: get_monmap_and_config 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 10 monclient: build_initial_monmap 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 10 monclient: monmap: 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:30:22.640815+0000 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:30:22.640815+0000 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:30:22.641 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 1 Processor -- start 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 1 -- start start 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.639+0000 7f67b828c640 10 monclient: init 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-a con 0x7f67b005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-c con 0x7f67b005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-b con 0x7f67b0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b008b060 con 0x7f67b005d1b0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b005dc90 con 0x7f67b005dee0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b008d6a0 con 0x7f67b0182720 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient(hunting): authenticate will time out at 751.269289s 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b5800640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f67b005dee0 legacy=0x7f67b0181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b6001640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f67b005d1b0 0x7f67b005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42300/0 (socket says 10.20.193.106:42300) 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b6001640 1 -- 10.20.193.106:0/1364756583 learned_addr learned my addr 10.20.193.106:0/1364756583 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140070485 0 0) 0x7f67b008d6a0 con 0x7f67b0182720 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): my global_id is 4595 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67980035e0 con 0x7f67b0182720 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485934850 0 0) 0x7f67b008b060 con 0x7f67b005d1b0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient(hunting): my global_id is 64194 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b008d6a0 con 0x7f67b005d1b0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3402567530 0 0) 0x7f67980035e0 con 0x7f67b0182720 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 >> v1:10.20.193.118:6789/0 conn(0x7f67b005dee0 legacy=0x7f67b0181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 >> v1:10.20.193.106:6789/0 conn(0x7f67b005d1b0 legacy=0x7f67b005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 monclient: found mon.noname-b 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b0057960 con 0x7f67b0182720 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67ac003eb0 con 0x7f67b0182720 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: dump: 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 5 monclient: authenticate success, global_id 4595 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67ac0040f0 con 0x7f67b0182720 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 1 -- 10.20.193.106:0/1364756583 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67ac004500 con 0x7f67b0182720 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b4fff640 10 monclient: dump: 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 10 monclient: get_monmap_and_config success 2026-02-17T05:30:22.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.640+0000 7f67b828c640 4 set_mon_vals no callback set 2026-02-17T05:30:22.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 10 monclient: shutdown 2026-02-17T05:30:22.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- 10.20.193.106:0/1364756583 >> v1:10.20.193.106:6790/0 conn(0x7f67b0182720 legacy=0x7f67b01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- 10.20.193.106:0/1364756583 shutdown_connections 2026-02-17T05:30:22.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- 10.20.193.106:0/1364756583 >> 10.20.193.106:0/1364756583 conn(0x7f67b00915f0 msgr2=0x7f67b00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- 10.20.193.106:0/1364756583 shutdown_connections 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- 10.20.193.106:0/1364756583 wait complete. 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 10 monclient: build_initial_monmap 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 10 monclient: monmap: 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 Processor -- start 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 1 -- start start 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.641+0000 7f67b828c640 10 monclient: init 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _reopen_session rank -1 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-c con 0x7f67b005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-a con 0x7f67b005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient(hunting): picked mon.noname-b con 0x7f67b0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b010bda0 con 0x7f67b005dee0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b005e8e0 con 0x7f67b0182720 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b010a8b0 con 0x7f67b005d1b0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient(hunting): _renew_subs 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient(hunting): authenticate will time out at 751.271167s 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b5800640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f67b005dee0 0x7f67b0180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42316/0 (socket says 10.20.193.106:42316) 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b5800640 1 -- 10.20.193.106:0/79527982 learned_addr learned my addr 10.20.193.106:0/79527982 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b6802640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.118:6789/0 conn(0x7f67b0182720 legacy=0x7f67b01141a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465682363 0 0) 0x7f67b010a8b0 con 0x7f67b005d1b0 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): my global_id is 4598 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67800035e0 con 0x7f67b005d1b0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708994954 0 0) 0x7f67b010bda0 con 0x7f67b005dee0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): my global_id is 64197 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b010a8b0 con 0x7f67b005dee0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3831084203 0 0) 0x7f67800035e0 con 0x7f67b005d1b0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67b010bda0 con 0x7f67b005d1b0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67a0003090 con 0x7f67b005d1b0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): dump: 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 567339589 0 0) 0x7f67b010a8b0 con 0x7f67b005dee0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67800035e0 con 0x7f67b005dee0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67a4005240 con 0x7f67b005dee0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient(hunting): dump: 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.648 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3941081621 0 0) 0x7f67b010bda0 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.118:6789/0 conn(0x7f67b0182720 legacy=0x7f67b01141a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6789/0 conn(0x7f67b005dee0 legacy=0x7f67b0180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 monclient: found mon.c 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b01824f0 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 5 monclient: authenticate success, global_id 4598 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _renew_subs 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67b010cc10 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _renew_subs 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f67b010b640 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67a00048a0 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67a0004bc0 con 0x7f67b005d1b0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679e7fc640 10 monclient: dump: 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.649 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.642+0000 7f679ffff640 4 set_mon_vals no callback set 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f67b828c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f67b0057ca0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f67a0011b60 con 0x7f67b005d1b0 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(117..117 src has 1..117) ==== 3915+0+0 (unknown 1973311248 0 0) 0x7f67a004fe30 con 0x7f67b005d1b0 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196750270 0 0) 0x7f67b0057ca0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient(hunting): my global_id is 4601 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b010bda0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 132601612 0 0) 0x7f67b010bda0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67b0057ca0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67a4005810 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient: dump: 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f67b6802640 10 monclient: get_auth_request con 0x7f6780040b10 auth_method 0 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3589904722 0 0) 0x7f67b0057ca0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67b00008d0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f67a4005ad0 con 0x7f67b0128980 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6790/0 conn(0x7f67b0128980 legacy=0x7f67b0059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.643+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6790/0 conn(0x7f67b0128980 legacy=0x7f67b0059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f67b828c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f67b008e3d0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063288000 0 0) 0x7f67b008e3d0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient(hunting): my global_id is 4604 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b0057ca0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3170066907 0 0) 0x7f67b0057ca0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67b008e3d0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67a40042c0 con 0x7f67b004d200 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 10 monclient: dump: 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:30:22.651 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3078662698 0 0) 0x7f67b008e3d0 con 0x7f67b004d200 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.647+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f67b008e560 con 0x7f67b004d200 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 2161375912) 0x7f67a40046c0 con 0x7f67b004d200 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f679e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f679e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6790/0 conn(0x7f67b004d200 legacy=0x7f67b01168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f679e7fc640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6790/0 conn(0x7f67b004d200 legacy=0x7f67b01168d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 12, 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 147409, 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.652 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:30:22.653 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:30:22.654 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:30:22.655 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:30:22.656 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.118:6812/703720803 conn(0x7f6780040b10 legacy=0x7f6780060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 10 monclient: shutdown 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 >> v1:10.20.193.106:6790/0 conn(0x7f67b005d1b0 legacy=0x7f67b0128270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b6802640 1 -- 10.20.193.106:0/79527982 reap_dead start 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b6802640 1 -- 10.20.193.106:0/79527982 reap_dead start 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 shutdown_connections 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 >> 10.20.193.106:0/79527982 conn(0x7f67b00915f0 msgr2=0x7f67b01a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 shutdown_connections 2026-02-17T05:30:22.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:30:22.648+0000 7f67b828c640 1 -- 10.20.193.106:0/79527982 wait complete. 2026-02-17T05:30:22.657 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:30:22.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:30:23.357 INFO:tasks.rados.rados.0.trial118.stdout:470: done (2 left) 2026-02-17T05:30:23.357 INFO:tasks.rados.rados.0.trial118.stdout:471: done (1 left) 2026-02-17T05:30:23.357 INFO:tasks.rados.rados.0.trial118.stdout:472: done (0 left) 2026-02-17T05:30:23.357 INFO:tasks.rados.rados.0.trial118.stdout:473: snap_remove snap 49 2026-02-17T05:30:24.361 INFO:tasks.rados.rados.0.trial118.stdout:473: done (0 left) 2026-02-17T05:30:24.361 INFO:tasks.rados.rados.0.trial118.stdout:474: rollback oid 48 current snap is 52 2026-02-17T05:30:24.361 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 51 2026-02-17T05:30:24.361 INFO:tasks.rados.rados.0.trial118.stdout:475: delete oid 41 current snap is 52 2026-02-17T05:30:24.364 INFO:tasks.rados.rados.0.trial118.stdout:475: done (1 left) 2026-02-17T05:30:24.364 INFO:tasks.rados.rados.0.trial118.stdout:476: write oid 19 current snap is 52 2026-02-17T05:30:24.364 INFO:tasks.rados.rados.0.trial118.stdout:476: seq_num 185 ranges {709295=713537,1859404=750382} 2026-02-17T05:30:24.369 INFO:tasks.rados.rados.0.trial118.stdout:476: writing trial11845692-19 from 709295 to 1422832 tid 1 2026-02-17T05:30:24.374 INFO:tasks.rados.rados.0.trial118.stdout:476: writing trial11845692-19 from 1859404 to 2609786 tid 2 2026-02-17T05:30:24.374 INFO:tasks.rados.rados.0.trial118.stdout:477: snap_remove snap 47 2026-02-17T05:30:25.254 INFO:tasks.rados.rados.0.trial118.stdout:477: done (2 left) 2026-02-17T05:30:25.254 INFO:tasks.rados.rados.0.trial118.stdout:478: read oid 49 snap -1 2026-02-17T05:30:25.254 INFO:tasks.rados.rados.0.trial118.stdout:478: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:30:25.255 INFO:tasks.rados.rados.0.trial118.stdout:479: read oid 27 snap -1 2026-02-17T05:30:25.255 INFO:tasks.rados.rados.0.trial118.stdout:479: expect deleted 2026-02-17T05:30:25.255 INFO:tasks.rados.rados.0.trial118.stdout:480: write oid 47 current snap is 52 2026-02-17T05:30:25.255 INFO:tasks.rados.rados.0.trial118.stdout:480: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2026-02-17T05:30:25.260 INFO:tasks.rados.rados.0.trial118.stdout:480: writing trial11845692-47 from 726102 to 1514888 tid 1 2026-02-17T05:30:25.264 INFO:tasks.rados.rados.0.trial118.stdout:480: writing trial11845692-47 from 1917886 to 2528279 tid 2 2026-02-17T05:30:25.266 INFO:tasks.rados.rados.0.trial118.stdout:480: writing trial11845692-47 from 3108206 to 3126102 tid 3 2026-02-17T05:30:25.266 INFO:tasks.rados.rados.0.trial118.stdout:481: write oid 35 current snap is 52 2026-02-17T05:30:25.266 INFO:tasks.rados.rados.0.trial118.stdout:481: seq_num 187 ranges {742909=464035,1976368=754051} 2026-02-17T05:30:25.270 INFO:tasks.rados.rados.0.trial118.stdout:481: writing trial11845692-35 from 742909 to 1206944 tid 1 2026-02-17T05:30:25.276 INFO:tasks.rados.rados.0.trial118.stdout:481: writing trial11845692-35 from 1976368 to 2730419 tid 2 2026-02-17T05:30:25.277 INFO:tasks.rados.rados.0.trial118.stdout:482: write (excl) oid 38 current snap is 52 2026-02-17T05:30:25.277 INFO:tasks.rados.rados.0.trial118.stdout:482: seq_num 188 ranges {759716=539284,2034850=614062} 2026-02-17T05:30:25.281 INFO:tasks.rados.rados.0.trial118.stdout:482: writing trial11845692-38 from 759716 to 1299000 tid 1 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:482: writing trial11845692-38 from 2034850 to 2648912 tid 2 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:483: rollback oid 30 current snap is 52 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 30 to 50 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:474: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:474: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:474: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 232 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: finishing write tid 1 to trial11845692-19 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: finishing write tid 2 to trial11845692-19 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: finishing write tid 3 to trial11845692-19 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: finishing write tid 4 to trial11845692-19 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: oid 19 updating version 0 to 152 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: oid 19 updating version 152 to 154 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: oid 19 version 154 is already newer than 153 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 154 (ObjNum 185 snap 52 seq_num 185) dirty exists 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:476: left oid 19 (ObjNum 185 snap 52 seq_num 185) 2026-02-17T05:30:25.286 INFO:tasks.rados.rados.0.trial118.stdout:478: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:30:25.349 INFO:tasks.rados.rados.0.trial118.stdout:480: finishing write tid 1 to trial11845692-47 2026-02-17T05:30:25.349 INFO:tasks.rados.rados.0.trial118.stdout:480: finishing write tid 2 to trial11845692-47 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: finishing write tid 3 to trial11845692-47 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: finishing write tid 4 to trial11845692-47 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: finishing write tid 5 to trial11845692-47 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: oid 47 updating version 0 to 230 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: oid 47 updating version 230 to 232 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: oid 47 version 232 is already newer than 231 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: oid 47 updating version 232 to 233 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 233 (ObjNum 186 snap 52 seq_num 186) dirty exists 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: left oid 47 (ObjNum 186 snap 52 seq_num 186) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: finishing write tid 1 to trial11845692-35 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: finishing write tid 2 to trial11845692-35 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: finishing write tid 3 to trial11845692-35 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: finishing write tid 4 to trial11845692-35 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: oid 35 updating version 0 to 42 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: oid 35 updating version 42 to 43 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: oid 35 version 43 is already newer than 41 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 43 (ObjNum 187 snap 52 seq_num 187) dirty exists 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: left oid 35 (ObjNum 187 snap 52 seq_num 187) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:482: finishing write tid 1 to trial11845692-38 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:474: done (7 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:476: done (6 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:478: done (5 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:479: done (4 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:480: done (3 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:481: done (2 left) 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:484: write oid 31 current snap is 52 2026-02-17T05:30:25.350 INFO:tasks.rados.rados.0.trial118.stdout:484: seq_num 189 ranges {776523=614533,1976979=757720} 2026-02-17T05:30:25.355 INFO:tasks.rados.rados.0.trial118.stdout:484: writing trial11845692-31 from 776523 to 1391056 tid 1 2026-02-17T05:30:25.361 INFO:tasks.rados.rados.0.trial118.stdout:484: writing trial11845692-31 from 1976979 to 2734699 tid 2 2026-02-17T05:30:25.361 INFO:tasks.rados.rados.0.trial118.stdout:485: write oid 9 current snap is 52 2026-02-17T05:30:25.362 INFO:tasks.rados.rados.0.trial118.stdout:482: finishing write tid 2 to trial11845692-38 2026-02-17T05:30:25.362 INFO:tasks.rados.rados.0.trial118.stdout:482: finishing write tid 3 to trial11845692-38 2026-02-17T05:30:25.362 INFO:tasks.rados.rados.0.trial118.stdout:482: finishing write tid 4 to trial11845692-38 2026-02-17T05:30:25.362 INFO:tasks.rados.rados.0.trial118.stdout:482: oid 38 updating version 0 to 234 2026-02-17T05:30:25.362 INFO:tasks.rados.rados.0.trial118.stdout:482: oid 38 updating version 234 to 235 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:482: oid 38 updating version 235 to 236 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 236 (ObjNum 188 snap 52 seq_num 188) dirty exists 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:482: left oid 38 (ObjNum 188 snap 52 seq_num 188) 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:483: finishing rollback tid 0 to trial11845692-30 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:483: finishing rollback tid 1 to trial11845692-30 2026-02-17T05:30:25.363 INFO:tasks.rados.rados.0.trial118.stdout:483: finishing rollback tid 2 to trial11845692-30 2026-02-17T05:30:25.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 276 (ObjNum 180 snap 48 seq_num 180) dirty exists 2026-02-17T05:30:25.364 INFO:tasks.rados.rados.0.trial118.stdout:484: finishing write tid 1 to trial11845692-31 2026-02-17T05:30:25.364 INFO:tasks.rados.rados.0.trial118.stdout:485: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2026-02-17T05:30:25.365 INFO:tasks.rados.rados.0.trial118.stdout:485: writing trial11845692-9 from 793330 to 1483112 tid 1 2026-02-17T05:30:25.369 INFO:tasks.rados.rados.0.trial118.stdout:485: writing trial11845692-9 from 2035461 to 2653192 tid 2 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:485: writing trial11845692-9 from 3101545 to 3193330 tid 3 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:482: done (3 left) 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:483: done (2 left) 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:486: delete oid 41 current snap is 52 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: finishing write tid 2 to trial11845692-31 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: finishing write tid 3 to trial11845692-31 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: finishing write tid 4 to trial11845692-31 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: oid 31 updating version 0 to 238 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: oid 31 updating version 238 to 239 2026-02-17T05:30:25.371 INFO:tasks.rados.rados.0.trial118.stdout:484: oid 31 version 239 is already newer than 237 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 239 (ObjNum 189 snap 52 seq_num 189) dirty exists 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:484: left oid 31 (ObjNum 189 snap 52 seq_num 189) 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: finishing write tid 1 to trial11845692-9 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: finishing write tid 2 to trial11845692-9 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: finishing write tid 3 to trial11845692-9 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: finishing write tid 4 to trial11845692-9 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: finishing write tid 5 to trial11845692-9 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: oid 9 updating version 0 to 305 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: oid 9 updating version 305 to 306 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: oid 9 updating version 306 to 307 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: oid 9 updating version 307 to 308 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 308 (ObjNum 190 snap 52 seq_num 190) dirty exists 2026-02-17T05:30:25.372 INFO:tasks.rados.rados.0.trial118.stdout:485: left oid 9 (ObjNum 190 snap 52 seq_num 190) 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:484: done (2 left) 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:485: done (1 left) 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:486: done (0 left) 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:487: delete oid 19 current snap is 52 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:487: done (0 left) 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:488: rollback oid 42 current snap is 52 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 44 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:489: write oid 23 current snap is 52 2026-02-17T05:30:25.373 INFO:tasks.rados.rados.0.trial118.stdout:489: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2026-02-17T05:30:25.378 INFO:tasks.rados.rados.0.trial118.stdout:489: writing trial11845692-23 from 443751 to 1075633 tid 1 2026-02-17T05:30:25.383 INFO:tasks.rados.rados.0.trial118.stdout:489: writing trial11845692-23 from 1810907 to 2575965 tid 2 2026-02-17T05:30:25.386 INFO:tasks.rados.rados.0.trial118.stdout:489: writing trial11845692-23 from 3067461 to 3243751 tid 3 2026-02-17T05:30:25.386 INFO:tasks.rados.rados.0.trial118.stdout:490: snap_create 2026-02-17T05:30:25.386 INFO:tasks.rados.rados.0.trial118.stdout:488: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:30:25.387 INFO:tasks.rados.rados.0.trial118.stdout:488: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:30:25.387 INFO:tasks.rados.rados.0.trial118.stdout:488: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:30:25.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 239 (ObjNum 163 snap 41 seq_num 163) dirty exists 2026-02-17T05:30:25.387 INFO:tasks.rados.rados.0.trial118.stdout:489: finishing write tid 1 to trial11845692-23 2026-02-17T05:30:25.387 INFO:tasks.rados.rados.0.trial118.stdout:489: finishing write tid 2 to trial11845692-23 2026-02-17T05:30:25.388 INFO:tasks.rados.rados.0.trial118.stdout:489: finishing write tid 3 to trial11845692-23 2026-02-17T05:30:25.388 INFO:tasks.rados.rados.0.trial118.stdout:489: finishing write tid 4 to trial11845692-23 2026-02-17T05:30:25.388 INFO:tasks.rados.rados.0.trial118.stdout:489: finishing write tid 5 to trial11845692-23 2026-02-17T05:30:25.388 INFO:tasks.rados.rados.0.trial118.stdout:489: oid 23 updating version 0 to 118 2026-02-17T05:30:25.388 INFO:tasks.rados.rados.0.trial118.stdout:489: oid 23 version 118 is already newer than 117 2026-02-17T05:30:25.389 INFO:tasks.rados.rados.0.trial118.stdout:489: oid 23 updating version 118 to 119 2026-02-17T05:30:25.389 INFO:tasks.rados.rados.0.trial118.stdout:489: oid 23 version 119 is already newer than 116 2026-02-17T05:30:25.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 119 (ObjNum 193 snap 52 seq_num 193) dirty exists 2026-02-17T05:30:25.389 INFO:tasks.rados.rados.0.trial118.stdout:489: left oid 23 (ObjNum 193 snap 52 seq_num 193) 2026-02-17T05:30:26.364 INFO:tasks.rados.rados.0.trial118.stdout:488: done (2 left) 2026-02-17T05:30:26.365 INFO:tasks.rados.rados.0.trial118.stdout:489: done (1 left) 2026-02-17T05:30:26.365 INFO:tasks.rados.rados.0.trial118.stdout:490: done (0 left) 2026-02-17T05:30:26.365 INFO:tasks.rados.rados.0.trial118.stdout:491: delete oid 16 current snap is 53 2026-02-17T05:30:26.367 INFO:tasks.rados.rados.0.trial118.stdout:491: done (0 left) 2026-02-17T05:30:26.368 INFO:tasks.rados.rados.0.trial118.stdout:492: write (excl) oid 23 current snap is 53 2026-02-17T05:30:26.368 INFO:tasks.rados.rados.0.trial118.stdout:492: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2026-02-17T05:30:26.372 INFO:tasks.rados.rados.0.trial118.stdout:492: writing trial11845692-23 from 477365 to 1259745 tid 1 2026-02-17T05:30:26.377 INFO:tasks.rados.rados.0.trial118.stdout:492: writing trial11845692-23 from 1927871 to 2696598 tid 2 2026-02-17T05:30:26.380 INFO:tasks.rados.rados.0.trial118.stdout:492: writing trial11845692-23 from 3122307 to 3277365 tid 3 2026-02-17T05:30:26.380 INFO:tasks.rados.rados.0.trial118.stdout:493: rollback oid 40 current snap is 53 2026-02-17T05:30:26.381 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 50 2026-02-17T05:30:26.381 INFO:tasks.rados.rados.0.trial118.stdout:492: finishing write tid 1 to trial11845692-23 2026-02-17T05:30:26.381 INFO:tasks.rados.rados.0.trial118.stdout:492: finishing write tid 2 to trial11845692-23 2026-02-17T05:30:26.381 INFO:tasks.rados.rados.0.trial118.stdout:494: write oid 27 current snap is 53 2026-02-17T05:30:26.381 INFO:tasks.rados.rados.0.trial118.stdout:494: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2026-02-17T05:30:26.383 INFO:tasks.rados.rados.0.trial118.stdout:494: writing trial11845692-27 from 494172 to 951801 tid 1 2026-02-17T05:30:26.387 INFO:tasks.rados.rados.0.trial118.stdout:494: writing trial11845692-27 from 1586353 to 2098738 tid 2 2026-02-17T05:30:26.392 INFO:tasks.rados.rados.0.trial118.stdout:494: writing trial11845692-27 from 2749730 to 3294172 tid 3 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:495: write (excl) oid 36 current snap is 53 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: finishing write tid 3 to trial11845692-23 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: finishing write tid 4 to trial11845692-23 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: finishing write tid 5 to trial11845692-23 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: oid 23 updating version 0 to 121 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: oid 23 updating version 121 to 123 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: oid 23 version 123 is already newer than 122 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: oid 23 version 123 is already newer than 120 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 123 (ObjNum 195 snap 53 seq_num 195) dirty exists 2026-02-17T05:30:26.393 INFO:tasks.rados.rados.0.trial118.stdout:492: left oid 23 (ObjNum 195 snap 53 seq_num 195) 2026-02-17T05:30:26.394 INFO:tasks.rados.rados.0.trial118.stdout:493: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:30:26.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 0 (ObjNum 225 snap 0 seq_num 12884912) dirty dne 2026-02-17T05:30:26.394 INFO:tasks.rados.rados.0.trial118.stdout:494: finishing write tid 1 to trial11845692-27 2026-02-17T05:30:26.394 INFO:tasks.rados.rados.0.trial118.stdout:494: finishing write tid 2 to trial11845692-27 2026-02-17T05:30:26.394 INFO:tasks.rados.rados.0.trial118.stdout:495: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2026-02-17T05:30:26.395 INFO:tasks.rados.rados.0.trial118.stdout:495: writing trial11845692-36 from 510979 to 1043857 tid 1 2026-02-17T05:30:26.400 INFO:tasks.rados.rados.0.trial118.stdout:495: writing trial11845692-36 from 1528482 to 2300878 tid 2 2026-02-17T05:30:26.406 INFO:tasks.rados.rados.0.trial118.stdout:495: writing trial11845692-36 from 3060800 to 3310979 tid 3 2026-02-17T05:30:26.406 INFO:tasks.rados.rados.0.trial118.stdout:492: done (3 left) 2026-02-17T05:30:26.406 INFO:tasks.rados.rados.0.trial118.stdout:493: done (2 left) 2026-02-17T05:30:26.406 INFO:tasks.rados.rados.0.trial118.stdout:496: read oid 20 snap 50 2026-02-17T05:30:26.406 INFO:tasks.rados.rados.0.trial118.stdout:496: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:497: rollback oid 41 current snap is 53 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 48 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:494: finishing write tid 3 to trial11845692-27 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:494: finishing write tid 4 to trial11845692-27 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:494: finishing write tid 5 to trial11845692-27 2026-02-17T05:30:26.407 INFO:tasks.rados.rados.0.trial118.stdout:494: oid 27 updating version 0 to 242 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:494: oid 27 updating version 242 to 243 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:494: oid 27 version 243 is already newer than 240 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:494: oid 27 version 243 is already newer than 241 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 243 (ObjNum 196 snap 53 seq_num 196) dirty exists 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:494: left oid 27 (ObjNum 196 snap 53 seq_num 196) 2026-02-17T05:30:26.408 INFO:tasks.rados.rados.0.trial118.stdout:495: finishing write tid 1 to trial11845692-36 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:495: finishing write tid 2 to trial11845692-36 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:494: done (3 left) 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:498: read oid 23 snap -1 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:498: expect (ObjNum 195 snap 53 seq_num 195) 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:499: rollback oid 45 current snap is 53 2026-02-17T05:30:26.409 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 50 2026-02-17T05:30:26.410 INFO:tasks.rados.rados.0.trial118.stdout:500: read oid 2 snap -1 2026-02-17T05:30:26.410 INFO:tasks.rados.rados.0.trial118.stdout:500: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:30:26.410 INFO:tasks.rados.rados.0.trial118.stdout:501: delete oid 42 current snap is 53 2026-02-17T05:30:26.410 INFO:tasks.rados.rados.0.trial118.stdout:501: done (6 left) 2026-02-17T05:30:26.410 INFO:tasks.rados.rados.0.trial118.stdout:502: snap_remove snap 44 2026-02-17T05:30:27.365 INFO:tasks.rados.rados.0.trial118.stdout:502: done (6 left) 2026-02-17T05:30:27.365 INFO:tasks.rados.rados.0.trial118.stdout:503: copy_from oid 42 from oid 21 current snap is 53 2026-02-17T05:30:27.365 INFO:tasks.rados.rados.0.trial118.stdout:496: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:27.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:27.423 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1397000 2026-02-17T05:30:27.443 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:497: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:497: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 313 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: finishing write tid 3 to trial11845692-36 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: finishing write tid 4 to trial11845692-36 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: finishing write tid 5 to trial11845692-36 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: oid 36 updating version 0 to 234 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: oid 36 updating version 234 to 235 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: oid 36 updating version 235 to 236 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: oid 36 version 236 is already newer than 233 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 236 (ObjNum 197 snap 53 seq_num 197) dirty exists 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:495: left oid 36 (ObjNum 197 snap 53 seq_num 197) 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:499: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:499: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:499: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 239 (ObjNum 138 snap 29 seq_num 138) dirty exists 2026-02-17T05:30:27.484 INFO:tasks.rados.rados.0.trial118.stdout:500: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:30:27.518 INFO:tasks.rados.rados.0.trial118.stdout:498: expect (ObjNum 195 snap 53 seq_num 195) 2026-02-17T05:30:27.518 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:27.551 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:27.585 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:27.618 INFO:tasks.rados.rados.0.trial118.stdout:503: finishing copy_from racing read to trial11845692-42 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:503: finishing copy_from to trial11845692-42 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 234 (ObjNum 88 snap 13 seq_num 88) dirty exists 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:495: done (6 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:496: done (5 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:497: done (4 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:498: done (3 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:499: done (2 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:500: done (1 left) 2026-02-17T05:30:27.619 INFO:tasks.rados.rados.0.trial118.stdout:503: done (0 left) 2026-02-17T05:30:27.620 INFO:tasks.rados.rados.0.trial118.stdout:504: rollback oid 30 current snap is 53 2026-02-17T05:30:27.620 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 30 to 43 2026-02-17T05:30:27.620 INFO:tasks.rados.rados.0.trial118.stdout:505: snap_remove snap 41 2026-02-17T05:30:28.369 INFO:tasks.rados.rados.0.trial118.stdout:505: done (1 left) 2026-02-17T05:30:28.370 INFO:tasks.rados.rados.0.trial118.stdout:506: write oid 14 current snap is 53 2026-02-17T05:30:28.370 INFO:tasks.rados.rados.0.trial118.stdout:506: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2026-02-17T05:30:28.375 INFO:tasks.rados.rados.0.trial118.stdout:506: writing trial11845692-14 from 544593 to 1344322 tid 1 2026-02-17T05:30:28.379 INFO:tasks.rados.rados.0.trial118.stdout:506: writing trial11845692-14 from 1761799 to 2537864 tid 2 2026-02-17T05:30:28.382 INFO:tasks.rados.rados.0.trial118.stdout:506: writing trial11845692-14 from 2948352 to 3344593 tid 3 2026-02-17T05:30:28.383 INFO:tasks.rados.rados.0.trial118.stdout:507: read oid 15 snap 50 2026-02-17T05:30:28.383 INFO:tasks.rados.rados.0.trial118.stdout:507: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:28.383 INFO:tasks.rados.rados.0.trial118.stdout:508: snap_remove snap 48 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:508: done (3 left) 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:509: snap_create 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:504: finishing rollback tid 0 to trial11845692-30 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:504: finishing rollback tid 1 to trial11845692-30 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:504: finishing rollback tid 2 to trial11845692-30 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 287 (ObjNum 104 snap 22 seq_num 104) dirty exists 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:506: finishing write tid 1 to trial11845692-14 2026-02-17T05:30:29.372 INFO:tasks.rados.rados.0.trial118.stdout:506: finishing write tid 2 to trial11845692-14 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: finishing write tid 3 to trial11845692-14 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: finishing write tid 4 to trial11845692-14 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: finishing write tid 5 to trial11845692-14 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: oid 14 updating version 0 to 52 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: oid 14 updating version 52 to 54 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: oid 14 updating version 54 to 55 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: oid 14 version 55 is already newer than 53 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 55 (ObjNum 199 snap 53 seq_num 199) dirty exists 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:506: left oid 14 (ObjNum 199 snap 53 seq_num 199) 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:507: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:29.373 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:29.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2067545 2026-02-17T05:30:29.418 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:30.255 INFO:tasks.rados.rados.0.trial118.stdout:504: done (3 left) 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:506: done (2 left) 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:507: done (1 left) 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:509: done (0 left) 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:510: read oid 12 snap -1 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:510: expect deleted 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:511: copy_from oid 11 from oid 38 current snap is 54 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:512: rollback oid 10 current snap is 54 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 51 2026-02-17T05:30:30.256 INFO:tasks.rados.rados.0.trial118.stdout:513: write (excl) oid 23 current snap is 54 2026-02-17T05:30:30.257 INFO:tasks.rados.rados.0.trial118.stdout:513: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-17T05:30:30.259 INFO:tasks.rados.rados.0.trial118.stdout:513: writing trial11845692-23 from 561400 to 1036378 tid 1 2026-02-17T05:30:30.264 INFO:tasks.rados.rados.0.trial118.stdout:513: writing trial11845692-23 from 1820281 to 2340004 tid 2 2026-02-17T05:30:30.269 INFO:tasks.rados.rados.0.trial118.stdout:513: writing trial11845692-23 from 2859422 to 3317001 tid 3 2026-02-17T05:30:30.269 INFO:tasks.rados.rados.0.trial118.stdout:514: read oid 21 snap -1 2026-02-17T05:30:30.269 INFO:tasks.rados.rados.0.trial118.stdout:514: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:30.269 INFO:tasks.rados.rados.0.trial118.stdout:515: write oid 44 current snap is 54 2026-02-17T05:30:30.269 INFO:tasks.rados.rados.0.trial118.stdout:515: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2026-02-17T05:30:30.273 INFO:tasks.rados.rados.0.trial118.stdout:515: writing trial11845692-44 from 578207 to 1128434 tid 1 2026-02-17T05:30:30.278 INFO:tasks.rados.rados.0.trial118.stdout:515: writing trial11845692-44 from 1762410 to 2542144 tid 2 2026-02-17T05:30:30.281 INFO:tasks.rados.rados.0.trial118.stdout:515: writing trial11845692-44 from 3286845 to 3378207 tid 3 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:516: read oid 25 snap -1 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:516: expect deleted 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:517: copy_from oid 47 from oid 2 current snap is 54 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:512: finishing rollback tid 0 to trial11845692-10 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:512: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:512: finishing rollback tid 2 to trial11845692-10 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 161 (ObjNum 64 snap 6 seq_num 64) dirty exists 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: finishing write tid 1 to trial11845692-23 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: finishing write tid 2 to trial11845692-23 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:510: done (7 left) 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:512: done (6 left) 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:518: copy_from oid 27 from oid 42 current snap is 54 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:511: finishing copy_from racing read to trial11845692-11 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:511: finishing copy_from to trial11845692-11 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 236 (ObjNum 188 snap 52 seq_num 188) dirty exists 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: finishing write tid 3 to trial11845692-23 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: finishing write tid 4 to trial11845692-23 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: finishing write tid 5 to trial11845692-23 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: oid 23 updating version 0 to 127 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: oid 23 version 127 is already newer than 126 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: oid 23 version 127 is already newer than 125 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: oid 23 version 127 is already newer than 124 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 127 (ObjNum 200 snap 54 seq_num 200) dirty exists 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:513: left oid 23 (ObjNum 200 snap 54 seq_num 200) 2026-02-17T05:30:30.282 INFO:tasks.rados.rados.0.trial118.stdout:514: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:30.321 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:30.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:30.414 INFO:tasks.rados.rados.0.trial118.stdout:515: finishing write tid 1 to trial11845692-44 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:515: finishing write tid 2 to trial11845692-44 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:511: done (6 left) 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:513: done (5 left) 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:514: done (4 left) 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:516: done (3 left) 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:519: write oid 3 current snap is 54 2026-02-17T05:30:30.415 INFO:tasks.rados.rados.0.trial118.stdout:519: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2026-02-17T05:30:30.419 INFO:tasks.rados.rados.0.trial118.stdout:519: writing trial11845692-3 from 595014 to 1220490 tid 1 2026-02-17T05:30:30.423 INFO:tasks.rados.rados.0.trial118.stdout:519: writing trial11845692-3 from 1820892 to 2344284 tid 2 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:519: writing trial11845692-3 from 2797915 to 3394391 tid 3 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:520: read oid 30 snap -1 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:520: expect (ObjNum 104 snap 22 seq_num 104) 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:521: write oid 10 current snap is 54 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:515: finishing write tid 3 to trial11845692-44 2026-02-17T05:30:30.428 INFO:tasks.rados.rados.0.trial118.stdout:515: finishing write tid 4 to trial11845692-44 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: finishing write tid 5 to trial11845692-44 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: oid 44 updating version 0 to 52 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: oid 44 version 52 is already newer than 51 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: oid 44 version 52 is already newer than 50 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: oid 44 updating version 52 to 53 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 53 (ObjNum 201 snap 54 seq_num 201) dirty exists 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:515: left oid 44 (ObjNum 201 snap 54 seq_num 201) 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:517: finishing copy_from racing read to trial11845692-47 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:517: finishing copy_from to trial11845692-47 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 235 (ObjNum 134 snap 29 seq_num 134) dirty exists 2026-02-17T05:30:30.429 INFO:tasks.rados.rados.0.trial118.stdout:518: finishing copy_from racing read to trial11845692-27 2026-02-17T05:30:30.430 INFO:tasks.rados.rados.0.trial118.stdout:521: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2026-02-17T05:30:30.432 INFO:tasks.rados.rados.0.trial118.stdout:521: writing trial11845692-10 from 611821 to 1312546 tid 1 2026-02-17T05:30:30.437 INFO:tasks.rados.rados.0.trial118.stdout:521: writing trial11845692-10 from 1879374 to 2662777 tid 2 2026-02-17T05:30:30.440 INFO:tasks.rados.rados.0.trial118.stdout:521: writing trial11845692-10 from 3341691 to 3411821 tid 3 2026-02-17T05:30:30.440 INFO:tasks.rados.rados.0.trial118.stdout:515: done (5 left) 2026-02-17T05:30:30.440 INFO:tasks.rados.rados.0.trial118.stdout:517: done (4 left) 2026-02-17T05:30:30.441 INFO:tasks.rados.rados.0.trial118.stdout:522: write oid 26 current snap is 54 2026-02-17T05:30:30.441 INFO:tasks.rados.rados.0.trial118.stdout:522: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2026-02-17T05:30:30.445 INFO:tasks.rados.rados.0.trial118.stdout:522: writing trial11845692-26 from 628628 to 1404602 tid 1 2026-02-17T05:30:30.449 INFO:tasks.rados.rados.0.trial118.stdout:522: writing trial11845692-26 from 1937856 to 2464917 tid 2 2026-02-17T05:30:30.454 INFO:tasks.rados.rados.0.trial118.stdout:522: writing trial11845692-26 from 3252761 to 3428628 tid 3 2026-02-17T05:30:30.454 INFO:tasks.rados.rados.0.trial118.stdout:523: read oid 46 snap -1 2026-02-17T05:30:30.454 INFO:tasks.rados.rados.0.trial118.stdout:523: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:30:30.454 INFO:tasks.rados.rados.0.trial118.stdout:524: read oid 5 snap -1 2026-02-17T05:30:30.454 INFO:tasks.rados.rados.0.trial118.stdout:524: expect (ObjNum 155 snap 38 seq_num 155) 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:525: read oid 41 snap -1 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:525: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:526: rollback oid 8 current snap is 54 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 53 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:518: finishing copy_from to trial11845692-27 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 234 (ObjNum 88 snap 13 seq_num 88) dirty exists 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:519: finishing write tid 1 to trial11845692-3 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:519: finishing write tid 2 to trial11845692-3 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:519: finishing write tid 3 to trial11845692-3 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:519: finishing write tid 4 to trial11845692-3 2026-02-17T05:30:30.455 INFO:tasks.rados.rados.0.trial118.stdout:519: finishing write tid 5 to trial11845692-3 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:519: oid 3 updating version 0 to 161 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:519: oid 3 updating version 161 to 162 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:519: oid 3 version 162 is already newer than 159 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:519: oid 3 version 162 is already newer than 160 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 162 (ObjNum 202 snap 54 seq_num 202) dirty exists 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:519: left oid 3 (ObjNum 202 snap 54 seq_num 202) 2026-02-17T05:30:30.456 INFO:tasks.rados.rados.0.trial118.stdout:520: expect (ObjNum 104 snap 22 seq_num 104) 2026-02-17T05:30:30.481 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2729544 2026-02-17T05:30:30.537 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 207952 2026-02-17T05:30:30.583 INFO:tasks.rados.rados.0.trial118.stdout:521: finishing write tid 1 to trial11845692-10 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: finishing write tid 2 to trial11845692-10 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: finishing write tid 3 to trial11845692-10 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: finishing write tid 4 to trial11845692-10 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: finishing write tid 5 to trial11845692-10 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: oid 10 updating version 0 to 165 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: oid 10 version 165 is already newer than 162 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: oid 10 version 165 is already newer than 163 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: oid 10 version 165 is already newer than 164 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 165 (ObjNum 203 snap 54 seq_num 203) dirty exists 2026-02-17T05:30:30.584 INFO:tasks.rados.rados.0.trial118.stdout:521: left oid 10 (ObjNum 203 snap 54 seq_num 203) 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: finishing write tid 1 to trial11845692-26 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: finishing write tid 2 to trial11845692-26 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:518: done (8 left) 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:519: done (7 left) 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:520: done (6 left) 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:521: done (5 left) 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:527: copy_from oid 36 from oid 9 current snap is 54 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: finishing write tid 3 to trial11845692-26 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: finishing write tid 4 to trial11845692-26 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: finishing write tid 5 to trial11845692-26 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: oid 26 updating version 0 to 232 2026-02-17T05:30:30.585 INFO:tasks.rados.rados.0.trial118.stdout:522: oid 26 version 232 is already newer than 230 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:522: oid 26 version 232 is already newer than 231 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:522: oid 26 updating version 232 to 233 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 233 (ObjNum 204 snap 54 seq_num 204) dirty exists 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:522: left oid 26 (ObjNum 204 snap 54 seq_num 204) 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:526: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:526: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:30:30.586 INFO:tasks.rados.rados.0.trial118.stdout:525: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-17T05:30:30.625 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 362720 2026-02-17T05:30:30.702 INFO:tasks.rados.rados.0.trial118.stdout:526: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:30:30.703 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 261 (ObjNum 153 snap 38 seq_num 153) dirty exists 2026-02-17T05:30:30.703 INFO:tasks.rados.rados.0.trial118.stdout:524: expect (ObjNum 155 snap 38 seq_num 155) 2026-02-17T05:30:30.709 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1315437 2026-02-17T05:30:30.725 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 558470 2026-02-17T05:30:30.762 INFO:tasks.rados.rados.0.trial118.stdout:523: expect (ObjNum 64 snap 6 seq_num 64) 2026-02-17T05:30:30.762 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:30.838 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2519974 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:527: finishing copy_from racing read to trial11845692-36 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:527: finishing copy_from to trial11845692-36 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 308 (ObjNum 190 snap 52 seq_num 190) dirty exists 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:522: done (5 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:523: done (4 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:524: done (3 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:525: done (2 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:526: done (1 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:527: done (0 left) 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:528: rollback oid 36 current snap is 54 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 52 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:529: write (excl) oid 20 current snap is 54 2026-02-17T05:30:30.846 INFO:tasks.rados.rados.0.trial118.stdout:529: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2026-02-17T05:30:30.851 INFO:tasks.rados.rados.0.trial118.stdout:529: writing trial11845692-20 from 645435 to 1096658 tid 1 2026-02-17T05:30:30.857 INFO:tasks.rados.rados.0.trial118.stdout:529: writing trial11845692-20 from 1879985 to 2667057 tid 2 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:529: writing trial11845692-20 from 3280184 to 3445435 tid 3 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:530: snap_create 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:528: finishing rollback tid 0 to trial11845692-36 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:528: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 310 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:529: finishing write tid 1 to trial11845692-20 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:529: finishing write tid 2 to trial11845692-20 2026-02-17T05:30:30.860 INFO:tasks.rados.rados.0.trial118.stdout:529: finishing write tid 3 to trial11845692-20 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: finishing write tid 4 to trial11845692-20 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: finishing write tid 5 to trial11845692-20 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: oid 20 updating version 0 to 266 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: oid 20 version 266 is already newer than 263 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: oid 20 version 266 is already newer than 265 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: oid 20 version 266 is already newer than 264 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 266 (ObjNum 205 snap 54 seq_num 205) dirty exists 2026-02-17T05:30:30.861 INFO:tasks.rados.rados.0.trial118.stdout:529: left oid 20 (ObjNum 205 snap 54 seq_num 205) 2026-02-17T05:30:31.379 INFO:tasks.rados.rados.0.trial118.stdout:528: done (2 left) 2026-02-17T05:30:31.379 INFO:tasks.rados.rados.0.trial118.stdout:529: done (1 left) 2026-02-17T05:30:31.380 INFO:tasks.rados.rados.0.trial118.stdout:530: done (0 left) 2026-02-17T05:30:31.380 INFO:tasks.rados.rados.0.trial118.stdout:531: delete oid 50 current snap is 55 2026-02-17T05:30:31.382 INFO:tasks.rados.rados.0.trial118.stdout:531: done (0 left) 2026-02-17T05:30:31.382 INFO:tasks.rados.rados.0.trial118.stdout:532: write oid 8 current snap is 55 2026-02-17T05:30:31.382 INFO:tasks.rados.rados.0.trial118.stdout:532: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2026-02-17T05:30:31.387 INFO:tasks.rados.rados.0.trial118.stdout:532: writing trial11845692-8 from 679049 to 1397123 tid 1 2026-02-17T05:30:31.393 INFO:tasks.rados.rados.0.trial118.stdout:532: writing trial11845692-8 from 2113302 to 2787690 tid 2 2026-02-17T05:30:31.396 INFO:tasks.rados.rados.0.trial118.stdout:532: writing trial11845692-8 from 3335030 to 3479049 tid 3 2026-02-17T05:30:31.396 INFO:tasks.rados.rados.0.trial118.stdout:533: delete oid 22 current snap is 55 2026-02-17T05:30:31.396 INFO:tasks.rados.rados.0.trial118.stdout:532: finishing write tid 1 to trial11845692-8 2026-02-17T05:30:31.396 INFO:tasks.rados.rados.0.trial118.stdout:532: finishing write tid 2 to trial11845692-8 2026-02-17T05:30:31.397 INFO:tasks.rados.rados.0.trial118.stdout:532: finishing write tid 3 to trial11845692-8 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: finishing write tid 4 to trial11845692-8 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: finishing write tid 5 to trial11845692-8 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: oid 8 updating version 0 to 269 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: oid 8 updating version 269 to 270 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: oid 8 updating version 270 to 271 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: oid 8 version 271 is already newer than 268 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 271 (ObjNum 207 snap 55 seq_num 207) dirty exists 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: left oid 8 (ObjNum 207 snap 55 seq_num 207) 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:532: done (1 left) 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:533: done (0 left) 2026-02-17T05:30:31.398 INFO:tasks.rados.rados.0.trial118.stdout:534: write oid 17 current snap is 55 2026-02-17T05:30:31.399 INFO:tasks.rados.rados.0.trial118.stdout:534: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2026-02-17T05:30:31.402 INFO:tasks.rados.rados.0.trial118.stdout:534: writing trial11845692-17 from 712663 to 1181235 tid 1 2026-02-17T05:30:31.407 INFO:tasks.rados.rados.0.trial118.stdout:534: writing trial11845692-17 from 1713913 to 2391970 tid 2 2026-02-17T05:30:31.411 INFO:tasks.rados.rados.0.trial118.stdout:534: writing trial11845692-17 from 2873523 to 3465256 tid 3 2026-02-17T05:30:31.411 INFO:tasks.rados.rados.0.trial118.stdout:535: rollback oid 38 current snap is 55 2026-02-17T05:30:31.412 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 53 2026-02-17T05:30:31.412 INFO:tasks.rados.rados.0.trial118.stdout:534: finishing write tid 1 to trial11845692-17 2026-02-17T05:30:31.412 INFO:tasks.rados.rados.0.trial118.stdout:534: finishing write tid 2 to trial11845692-17 2026-02-17T05:30:31.412 INFO:tasks.rados.rados.0.trial118.stdout:536: snap_remove snap 52 2026-02-17T05:30:32.382 INFO:tasks.rados.rados.0.trial118.stdout:536: done (2 left) 2026-02-17T05:30:32.382 INFO:tasks.rados.rados.0.trial118.stdout:537: snap_remove snap 43 2026-02-17T05:30:33.384 INFO:tasks.rados.rados.0.trial118.stdout:537: done (2 left) 2026-02-17T05:30:33.384 INFO:tasks.rados.rados.0.trial118.stdout:538: snap_remove snap 50 2026-02-17T05:30:34.389 INFO:tasks.rados.rados.0.trial118.stdout:538: done (2 left) 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:539: snap_create 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:535: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:534: finishing write tid 3 to trial11845692-17 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:535: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:534: finishing write tid 4 to trial11845692-17 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:535: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 254 (ObjNum 188 snap 52 seq_num 188) dirty exists 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:534: finishing write tid 5 to trial11845692-17 2026-02-17T05:30:34.390 INFO:tasks.rados.rados.0.trial118.stdout:534: oid 17 updating version 0 to 69 2026-02-17T05:30:34.391 INFO:tasks.rados.rados.0.trial118.stdout:534: oid 17 version 69 is already newer than 67 2026-02-17T05:30:34.391 INFO:tasks.rados.rados.0.trial118.stdout:534: oid 17 updating version 69 to 70 2026-02-17T05:30:34.391 INFO:tasks.rados.rados.0.trial118.stdout:534: oid 17 version 70 is already newer than 68 2026-02-17T05:30:34.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 70 (ObjNum 209 snap 55 seq_num 209) dirty exists 2026-02-17T05:30:34.391 INFO:tasks.rados.rados.0.trial118.stdout:534: left oid 17 (ObjNum 209 snap 55 seq_num 209) 2026-02-17T05:30:35.255 INFO:tasks.rados.rados.0.trial118.stdout:534: done (2 left) 2026-02-17T05:30:35.255 INFO:tasks.rados.rados.0.trial118.stdout:535: done (1 left) 2026-02-17T05:30:35.255 INFO:tasks.rados.rados.0.trial118.stdout:539: done (0 left) 2026-02-17T05:30:35.255 INFO:tasks.rados.rados.0.trial118.stdout:540: write oid 30 current snap is 56 2026-02-17T05:30:35.255 INFO:tasks.rados.rados.0.trial118.stdout:540: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2026-02-17T05:30:35.260 INFO:tasks.rados.rados.0.trial118.stdout:540: writing trial11845692-30 from 729470 to 1273291 tid 1 2026-02-17T05:30:35.264 INFO:tasks.rados.rados.0.trial118.stdout:540: writing trial11845692-30 from 1772395 to 2310463 tid 2 2026-02-17T05:30:35.268 INFO:tasks.rados.rados.0.trial118.stdout:540: writing trial11845692-30 from 2900946 to 3303951 tid 3 2026-02-17T05:30:35.268 INFO:tasks.rados.rados.0.trial118.stdout:541: write (excl) oid 2 current snap is 56 2026-02-17T05:30:35.268 INFO:tasks.rados.rados.0.trial118.stdout:540: finishing write tid 1 to trial11845692-30 2026-02-17T05:30:35.268 INFO:tasks.rados.rados.0.trial118.stdout:540: finishing write tid 2 to trial11845692-30 2026-02-17T05:30:35.268 INFO:tasks.rados.rados.0.trial118.stdout:541: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2026-02-17T05:30:35.273 INFO:tasks.rados.rados.0.trial118.stdout:541: writing trial11845692-2 from 746277 to 1365347 tid 1 2026-02-17T05:30:35.278 INFO:tasks.rados.rados.0.trial118.stdout:541: writing trial11845692-2 from 1830877 to 2512603 tid 2 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:541: writing trial11845692-2 from 2928369 to 3546277 tid 3 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:542: write oid 38 current snap is 56 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: finishing write tid 3 to trial11845692-30 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: finishing write tid 4 to trial11845692-30 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: finishing write tid 5 to trial11845692-30 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: oid 30 updating version 0 to 311 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: oid 30 version 311 is already newer than 309 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: oid 30 updating version 311 to 312 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: oid 30 version 312 is already newer than 310 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 312 (ObjNum 210 snap 56 seq_num 210) dirty exists 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:540: left oid 30 (ObjNum 210 snap 56 seq_num 210) 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:541: finishing write tid 1 to trial11845692-2 2026-02-17T05:30:35.282 INFO:tasks.rados.rados.0.trial118.stdout:542: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2026-02-17T05:30:35.287 INFO:tasks.rados.rados.0.trial118.stdout:542: writing trial11845692-38 from 763084 to 1457403 tid 1 2026-02-17T05:30:35.291 INFO:tasks.rados.rados.0.trial118.stdout:542: writing trial11845692-38 from 1889359 to 2431096 tid 2 2026-02-17T05:30:35.295 INFO:tasks.rados.rados.0.trial118.stdout:542: writing trial11845692-38 from 2955792 to 3497694 tid 3 2026-02-17T05:30:35.295 INFO:tasks.rados.rados.0.trial118.stdout:540: done (2 left) 2026-02-17T05:30:35.295 INFO:tasks.rados.rados.0.trial118.stdout:543: read oid 44 snap -1 2026-02-17T05:30:35.295 INFO:tasks.rados.rados.0.trial118.stdout:543: expect (ObjNum 201 snap 54 seq_num 201) 2026-02-17T05:30:35.296 INFO:tasks.rados.rados.0.trial118.stdout:544: write oid 10 current snap is 56 2026-02-17T05:30:35.296 INFO:tasks.rados.rados.0.trial118.stdout:544: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2026-02-17T05:30:35.300 INFO:tasks.rados.rados.0.trial118.stdout:544: writing trial11845692-10 from 779891 to 1265812 tid 1 2026-02-17T05:30:35.305 INFO:tasks.rados.rados.0.trial118.stdout:544: writing trial11845692-10 from 1947841 to 2633236 tid 2 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:544: writing trial11845692-10 from 3383215 to 3579891 tid 3 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:545: delete oid 46 current snap is 56 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:541: finishing write tid 2 to trial11845692-2 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:541: finishing write tid 3 to trial11845692-2 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:541: finishing write tid 4 to trial11845692-2 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:541: finishing write tid 5 to trial11845692-2 2026-02-17T05:30:35.311 INFO:tasks.rados.rados.0.trial118.stdout:541: oid 2 updating version 0 to 299 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:541: oid 2 version 299 is already newer than 298 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:541: oid 2 version 299 is already newer than 297 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:541: oid 2 updating version 299 to 300 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 300 (ObjNum 211 snap 56 seq_num 211) dirty exists 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:541: left oid 2 (ObjNum 211 snap 56 seq_num 211) 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: finishing write tid 1 to trial11845692-38 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: finishing write tid 2 to trial11845692-38 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: finishing write tid 3 to trial11845692-38 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: finishing write tid 4 to trial11845692-38 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: finishing write tid 5 to trial11845692-38 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: oid 38 updating version 0 to 277 2026-02-17T05:30:35.312 INFO:tasks.rados.rados.0.trial118.stdout:542: oid 38 version 277 is already newer than 274 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:542: oid 38 version 277 is already newer than 275 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:542: oid 38 version 277 is already newer than 276 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 277 (ObjNum 212 snap 56 seq_num 212) dirty exists 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:542: left oid 38 (ObjNum 212 snap 56 seq_num 212) 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:543: expect (ObjNum 201 snap 54 seq_num 201) 2026-02-17T05:30:35.313 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:35.384 INFO:tasks.rados.rados.0.trial118.stdout:544: finishing write tid 1 to trial11845692-10 2026-02-17T05:30:35.384 INFO:tasks.rados.rados.0.trial118.stdout:544: finishing write tid 2 to trial11845692-10 2026-02-17T05:30:35.384 INFO:tasks.rados.rados.0.trial118.stdout:541: done (4 left) 2026-02-17T05:30:35.384 INFO:tasks.rados.rados.0.trial118.stdout:542: done (3 left) 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:543: done (2 left) 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:545: done (1 left) 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:546: delete oid 7 current snap is 56 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: finishing write tid 3 to trial11845692-10 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: finishing write tid 4 to trial11845692-10 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: finishing write tid 5 to trial11845692-10 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: oid 10 updating version 0 to 175 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: oid 10 updating version 175 to 177 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: oid 10 version 177 is already newer than 176 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:544: oid 10 updating version 177 to 178 2026-02-17T05:30:35.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 178 (ObjNum 213 snap 56 seq_num 213) dirty exists 2026-02-17T05:30:35.386 INFO:tasks.rados.rados.0.trial118.stdout:544: left oid 10 (ObjNum 213 snap 56 seq_num 213) 2026-02-17T05:30:35.386 INFO:tasks.rados.rados.0.trial118.stdout:544: done (1 left) 2026-02-17T05:30:35.386 INFO:tasks.rados.rados.0.trial118.stdout:546: done (0 left) 2026-02-17T05:30:35.386 INFO:tasks.rados.rados.0.trial118.stdout:547: write oid 24 current snap is 56 2026-02-17T05:30:35.386 INFO:tasks.rados.rados.0.trial118.stdout:547: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2026-02-17T05:30:35.389 INFO:tasks.rados.rados.0.trial118.stdout:547: writing trial11845692-24 from 430312 to 1141980 tid 1 2026-02-17T05:30:35.393 INFO:tasks.rados.rados.0.trial118.stdout:547: writing trial11845692-24 from 1723287 to 2272362 tid 2 2026-02-17T05:30:35.398 INFO:tasks.rados.rados.0.trial118.stdout:547: writing trial11845692-24 from 2781837 to 3485180 tid 3 2026-02-17T05:30:35.398 INFO:tasks.rados.rados.0.trial118.stdout:548: read oid 16 snap -1 2026-02-17T05:30:35.399 INFO:tasks.rados.rados.0.trial118.stdout:548: expect deleted 2026-02-17T05:30:35.399 INFO:tasks.rados.rados.0.trial118.stdout:549: read oid 49 snap -1 2026-02-17T05:30:35.399 INFO:tasks.rados.rados.0.trial118.stdout:549: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:30:35.399 INFO:tasks.rados.rados.0.trial118.stdout:550: write oid 33 current snap is 56 2026-02-17T05:30:35.399 INFO:tasks.rados.rados.0.trial118.stdout:550: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2026-02-17T05:30:35.403 INFO:tasks.rados.rados.0.trial118.stdout:550: writing trial11845692-33 from 447119 to 1234036 tid 1 2026-02-17T05:30:35.407 INFO:tasks.rados.rados.0.trial118.stdout:550: writing trial11845692-33 from 1665416 to 2358149 tid 2 2026-02-17T05:30:35.411 INFO:tasks.rados.rados.0.trial118.stdout:550: writing trial11845692-33 from 2976554 to 3491169 tid 3 2026-02-17T05:30:35.411 INFO:tasks.rados.rados.0.trial118.stdout:551: snap_remove snap 51 2026-02-17T05:30:36.392 INFO:tasks.rados.rados.0.trial118.stdout:551: done (4 left) 2026-02-17T05:30:36.392 INFO:tasks.rados.rados.0.trial118.stdout:552: write oid 13 current snap is 56 2026-02-17T05:30:36.392 INFO:tasks.rados.rados.0.trial118.stdout:552: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2026-02-17T05:30:36.396 INFO:tasks.rados.rados.0.trial118.stdout:552: writing trial11845692-13 from 463926 to 926092 tid 1 2026-02-17T05:30:36.401 INFO:tasks.rados.rados.0.trial118.stdout:552: writing trial11845692-13 from 1723898 to 2160289 tid 2 2026-02-17T05:30:36.407 INFO:tasks.rados.rados.0.trial118.stdout:552: writing trial11845692-13 from 2603977 to 3329864 tid 3 2026-02-17T05:30:36.407 INFO:tasks.rados.rados.0.trial118.stdout:553: read oid 22 snap -1 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:553: expect deleted 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:554: copy_from oid 39 from oid 28 current snap is 56 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:547: finishing write tid 1 to trial11845692-24 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:547: finishing write tid 2 to trial11845692-24 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:547: finishing write tid 3 to trial11845692-24 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:548: done (6 left) 2026-02-17T05:30:36.408 INFO:tasks.rados.rados.0.trial118.stdout:555: snap_create 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: finishing write tid 4 to trial11845692-24 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: finishing write tid 5 to trial11845692-24 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: oid 24 updating version 0 to 61 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: oid 24 version 61 is already newer than 60 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: oid 24 version 61 is already newer than 59 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: oid 24 version 61 is already newer than 58 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 61 (ObjNum 216 snap 56 seq_num 216) dirty exists 2026-02-17T05:30:36.409 INFO:tasks.rados.rados.0.trial118.stdout:547: left oid 24 (ObjNum 216 snap 56 seq_num 216) 2026-02-17T05:30:36.410 INFO:tasks.rados.rados.0.trial118.stdout:549: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:30:36.427 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 121689 2026-02-17T05:30:36.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: finishing write tid 1 to trial11845692-33 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: finishing write tid 2 to trial11845692-33 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: finishing write tid 3 to trial11845692-33 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: finishing write tid 4 to trial11845692-33 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: finishing write tid 5 to trial11845692-33 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: oid 33 updating version 0 to 316 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: oid 33 version 316 is already newer than 315 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: oid 33 updating version 316 to 317 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: oid 33 version 317 is already newer than 314 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 317 (ObjNum 217 snap 56 seq_num 217) dirty exists 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:550: left oid 33 (ObjNum 217 snap 56 seq_num 217) 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: finishing write tid 1 to trial11845692-13 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: finishing write tid 2 to trial11845692-13 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: finishing write tid 3 to trial11845692-13 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: finishing write tid 4 to trial11845692-13 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: finishing write tid 5 to trial11845692-13 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: oid 13 updating version 0 to 175 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: oid 13 version 175 is already newer than 173 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: oid 13 version 175 is already newer than 172 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: oid 13 version 175 is already newer than 174 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 175 (ObjNum 218 snap 56 seq_num 218) dirty exists 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:552: left oid 13 (ObjNum 218 snap 56 seq_num 218) 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:554: finishing copy_from racing read to trial11845692-39 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:554: finishing copy_from to trial11845692-39 2026-02-17T05:30:36.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 31 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:547: done (6 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:549: done (5 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:550: done (4 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:552: done (3 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:553: done (2 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:554: done (1 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:555: done (0 left) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:556: read oid 15 snap -1 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:556: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:557: write oid 47 current snap is 57 2026-02-17T05:30:37.395 INFO:tasks.rados.rados.0.trial118.stdout:557: seq_num 219 ranges {480733=537415,1782380=696402,3031400=537159} 2026-02-17T05:30:37.398 INFO:tasks.rados.rados.0.trial118.stdout:557: writing trial11845692-47 from 480733 to 1018148 tid 1 2026-02-17T05:30:37.404 INFO:tasks.rados.rados.0.trial118.stdout:557: writing trial11845692-47 from 1782380 to 2478782 tid 2 2026-02-17T05:30:37.408 INFO:tasks.rados.rados.0.trial118.stdout:557: writing trial11845692-47 from 3031400 to 3568559 tid 3 2026-02-17T05:30:37.409 INFO:tasks.rados.rados.0.trial118.stdout:558: read oid 2 snap 53 2026-02-17T05:30:37.409 INFO:tasks.rados.rados.0.trial118.stdout:558: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:30:37.409 INFO:tasks.rados.rados.0.trial118.stdout:559: copy_from oid 46 from oid 34 current snap is 57 2026-02-17T05:30:37.409 INFO:tasks.rados.rados.0.trial118.stdout:556: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:37.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 784655 2026-02-17T05:30:37.465 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2002789 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:557: finishing write tid 1 to trial11845692-47 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:557: finishing write tid 2 to trial11845692-47 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:557: finishing write tid 3 to trial11845692-47 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:557: finishing write tid 4 to trial11845692-47 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:556: done (3 left) 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:560: write (excl) oid 4 current snap is 57 2026-02-17T05:30:37.472 INFO:tasks.rados.rados.0.trial118.stdout:560: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2026-02-17T05:30:37.476 INFO:tasks.rados.rados.0.trial118.stdout:560: writing trial11845692-4 from 497540 to 1110204 tid 1 2026-02-17T05:30:37.480 INFO:tasks.rados.rados.0.trial118.stdout:560: writing trial11845692-4 from 1840862 to 2280922 tid 2 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:560: writing trial11845692-4 from 3058823 to 3523607 tid 3 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:561: delete oid 9 current snap is 57 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: finishing write tid 5 to trial11845692-47 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: oid 47 updating version 0 to 287 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: oid 47 updating version 287 to 288 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: oid 47 updating version 288 to 289 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: oid 47 updating version 289 to 290 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 290 (ObjNum 219 snap 57 seq_num 219) dirty exists 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:557: left oid 47 (ObjNum 219 snap 57 seq_num 219) 2026-02-17T05:30:37.485 INFO:tasks.rados.rados.0.trial118.stdout:558: expect (ObjNum 134 snap 29 seq_num 134) 2026-02-17T05:30:37.501 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:37.527 INFO:tasks.rados.rados.0.trial118.stdout:559: finishing copy_from racing read to trial11845692-46 2026-02-17T05:30:37.527 INFO:tasks.rados.rados.0.trial118.stdout:559: finishing copy_from to trial11845692-46 2026-02-17T05:30:37.527 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 109 (ObjNum 177 snap 46 seq_num 177) dirty exists 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:560: finishing write tid 1 to trial11845692-4 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:560: finishing write tid 2 to trial11845692-4 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:557: done (4 left) 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:558: done (3 left) 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:559: done (2 left) 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:561: done (1 left) 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:562: write oid 24 current snap is 57 2026-02-17T05:30:37.528 INFO:tasks.rados.rados.0.trial118.stdout:562: seq_num 222 ranges {531154=479515,1557826=443729,2713669=487328,3679295=51859} 2026-02-17T05:30:37.530 INFO:tasks.rados.rados.0.trial118.stdout:562: writing trial11845692-24 from 531154 to 1010669 tid 1 2026-02-17T05:30:37.534 INFO:tasks.rados.rados.0.trial118.stdout:562: writing trial11845692-24 from 1557826 to 2001555 tid 2 2026-02-17T05:30:37.539 INFO:tasks.rados.rados.0.trial118.stdout:562: writing trial11845692-24 from 2713669 to 3200997 tid 3 2026-02-17T05:30:37.541 INFO:tasks.rados.rados.0.trial118.stdout:562: writing trial11845692-24 from 3679295 to 3731154 tid 4 2026-02-17T05:30:37.541 INFO:tasks.rados.rados.0.trial118.stdout:563: delete oid 13 current snap is 57 2026-02-17T05:30:37.541 INFO:tasks.rados.rados.0.trial118.stdout:560: finishing write tid 3 to trial11845692-4 2026-02-17T05:30:37.541 INFO:tasks.rados.rados.0.trial118.stdout:560: finishing write tid 4 to trial11845692-4 2026-02-17T05:30:37.541 INFO:tasks.rados.rados.0.trial118.stdout:560: finishing write tid 5 to trial11845692-4 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:560: oid 4 updating version 0 to 365 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:560: oid 4 version 365 is already newer than 364 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:560: oid 4 version 365 is already newer than 363 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:560: oid 4 version 365 is already newer than 362 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 365 (ObjNum 220 snap 57 seq_num 220) dirty exists 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:560: left oid 4 (ObjNum 220 snap 57 seq_num 220) 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 1 to trial11845692-24 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 2 to trial11845692-24 2026-02-17T05:30:37.542 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 3 to trial11845692-24 2026-02-17T05:30:37.543 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 4 to trial11845692-24 2026-02-17T05:30:37.543 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 5 to trial11845692-24 2026-02-17T05:30:37.543 INFO:tasks.rados.rados.0.trial118.stdout:562: finishing write tid 6 to trial11845692-24 2026-02-17T05:30:37.543 INFO:tasks.rados.rados.0.trial118.stdout:562: oid 24 updating version 0 to 65 2026-02-17T05:30:37.543 INFO:tasks.rados.rados.0.trial118.stdout:562: oid 24 updating version 65 to 69 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:562: oid 24 version 69 is already newer than 66 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:562: oid 24 version 69 is already newer than 68 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:562: oid 24 version 69 is already newer than 67 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 69 (ObjNum 222 snap 57 seq_num 222) dirty exists 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:562: left oid 24 (ObjNum 222 snap 57 seq_num 222) 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:560: done (2 left) 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:562: done (1 left) 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:563: done (0 left) 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:564: write (excl) oid 30 current snap is 57 2026-02-17T05:30:37.544 INFO:tasks.rados.rados.0.trial118.stdout:564: seq_num 224 ranges {564768=630013,1674790=447398,2768515=626225} 2026-02-17T05:30:37.547 INFO:tasks.rados.rados.0.trial118.stdout:564: writing trial11845692-30 from 564768 to 1194781 tid 1 2026-02-17T05:30:37.551 INFO:tasks.rados.rados.0.trial118.stdout:564: writing trial11845692-30 from 1674790 to 2122188 tid 2 2026-02-17T05:30:37.556 INFO:tasks.rados.rados.0.trial118.stdout:564: writing trial11845692-30 from 2768515 to 3394740 tid 3 2026-02-17T05:30:37.556 INFO:tasks.rados.rados.0.trial118.stdout:565: rollback oid 4 current snap is 57 2026-02-17T05:30:37.556 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 56 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:564: finishing write tid 1 to trial11845692-30 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:564: finishing write tid 2 to trial11845692-30 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:566: read oid 27 snap -1 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:566: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:567: read oid 43 snap 56 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:567: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:568: write oid 19 current snap is 57 2026-02-17T05:30:37.557 INFO:tasks.rados.rados.0.trial118.stdout:568: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-17T05:30:37.560 INFO:tasks.rados.rados.0.trial118.stdout:568: writing trial11845692-19 from 581575 to 1286837 tid 1 2026-02-17T05:30:37.565 INFO:tasks.rados.rados.0.trial118.stdout:568: writing trial11845692-19 from 1733272 to 2440681 tid 2 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:568: writing trial11845692-19 from 3195938 to 3633435 tid 3 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:569: rollback oid 2 current snap is 57 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 56 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:565: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:565: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 369 (ObjNum 129 snap 0 seq_num 11732352) dirty dne 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:565: done (5 left) 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:570: write oid 26 current snap is 57 2026-02-17T05:30:37.570 INFO:tasks.rados.rados.0.trial118.stdout:570: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2026-02-17T05:30:37.575 INFO:tasks.rados.rados.0.trial118.stdout:570: writing trial11845692-26 from 598382 to 1378893 tid 1 2026-02-17T05:30:37.579 INFO:tasks.rados.rados.0.trial118.stdout:570: writing trial11845692-26 from 2075401 to 2526468 tid 2 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:570: writing trial11845692-26 from 3107008 to 3755777 tid 3 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:571: read oid 7 snap -1 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:571: expect deleted 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:572: copy_from oid 23 from oid 29 current snap is 57 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: finishing write tid 3 to trial11845692-30 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: finishing write tid 4 to trial11845692-30 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: finishing write tid 5 to trial11845692-30 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: oid 30 updating version 0 to 324 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: oid 30 updating version 324 to 326 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: oid 30 version 326 is already newer than 325 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: oid 30 version 326 is already newer than 323 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 326 (ObjNum 224 snap 57 seq_num 224) dirty exists 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:564: left oid 30 (ObjNum 224 snap 57 seq_num 224) 2026-02-17T05:30:37.584 INFO:tasks.rados.rados.0.trial118.stdout:566: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:37.709 INFO:tasks.rados.rados.0.trial118.stdout:567: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:30:37.734 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:37.780 INFO:tasks.rados.rados.0.trial118.stdout:568: finishing write tid 1 to trial11845692-19 2026-02-17T05:30:37.781 INFO:tasks.rados.rados.0.trial118.stdout:564: done (7 left) 2026-02-17T05:30:37.781 INFO:tasks.rados.rados.0.trial118.stdout:566: done (6 left) 2026-02-17T05:30:37.781 INFO:tasks.rados.rados.0.trial118.stdout:567: done (5 left) 2026-02-17T05:30:37.781 INFO:tasks.rados.rados.0.trial118.stdout:573: write (excl) oid 20 current snap is 57 2026-02-17T05:30:37.781 INFO:tasks.rados.rados.0.trial118.stdout:573: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2026-02-17T05:30:37.785 INFO:tasks.rados.rados.0.trial118.stdout:573: writing trial11845692-20 from 615189 to 1070949 tid 1 2026-02-17T05:30:37.789 INFO:tasks.rados.rados.0.trial118.stdout:573: writing trial11845692-20 from 1733883 to 2444961 tid 2 2026-02-17T05:30:37.794 INFO:tasks.rados.rados.0.trial118.stdout:573: writing trial11845692-20 from 3134431 to 3594472 tid 3 2026-02-17T05:30:37.794 INFO:tasks.rados.rados.0.trial118.stdout:574: write oid 5 current snap is 57 2026-02-17T05:30:37.794 INFO:tasks.rados.rados.0.trial118.stdout:574: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2026-02-17T05:30:37.798 INFO:tasks.rados.rados.0.trial118.stdout:574: writing trial11845692-5 from 631996 to 1163005 tid 1 2026-02-17T05:30:37.802 INFO:tasks.rados.rados.0.trial118.stdout:574: writing trial11845692-5 from 1792365 to 2247101 tid 2 2026-02-17T05:30:37.807 INFO:tasks.rados.rados.0.trial118.stdout:574: writing trial11845692-5 from 2761854 to 3433167 tid 3 2026-02-17T05:30:37.807 INFO:tasks.rados.rados.0.trial118.stdout:575: snap_remove snap 55 2026-02-17T05:30:38.401 INFO:tasks.rados.rados.0.trial118.stdout:575: done (7 left) 2026-02-17T05:30:38.401 INFO:tasks.rados.rados.0.trial118.stdout:576: snap_create 2026-02-17T05:30:38.401 INFO:tasks.rados.rados.0.trial118.stdout:568: finishing write tid 2 to trial11845692-19 2026-02-17T05:30:38.401 INFO:tasks.rados.rados.0.trial118.stdout:568: finishing write tid 3 to trial11845692-19 2026-02-17T05:30:38.401 INFO:tasks.rados.rados.0.trial118.stdout:568: finishing write tid 4 to trial11845692-19 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: finishing write tid 5 to trial11845692-19 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: oid 19 updating version 0 to 179 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: oid 19 version 179 is already newer than 178 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: oid 19 updating version 179 to 181 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: oid 19 version 181 is already newer than 180 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 181 (ObjNum 225 snap 57 seq_num 225) dirty exists 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:568: left oid 19 (ObjNum 225 snap 57 seq_num 225) 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:569: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:569: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:30:38.402 INFO:tasks.rados.rados.0.trial118.stdout:569: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 314 (ObjNum 211 snap 56 seq_num 211) dirty exists 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: finishing write tid 1 to trial11845692-26 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: finishing write tid 2 to trial11845692-26 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: finishing write tid 3 to trial11845692-26 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: finishing write tid 4 to trial11845692-26 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: finishing write tid 5 to trial11845692-26 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: oid 26 updating version 0 to 237 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: oid 26 version 237 is already newer than 236 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: oid 26 version 237 is already newer than 234 2026-02-17T05:30:38.403 INFO:tasks.rados.rados.0.trial118.stdout:570: oid 26 version 237 is already newer than 235 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 237 (ObjNum 226 snap 57 seq_num 226) dirty exists 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:570: left oid 26 (ObjNum 226 snap 57 seq_num 226) 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:572: finishing copy_from racing read to trial11845692-23 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:572: finishing copy_from to trial11845692-23 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 274 (ObjNum 164 snap 41 seq_num 164) dirty exists 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: finishing write tid 1 to trial11845692-20 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: finishing write tid 2 to trial11845692-20 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: finishing write tid 3 to trial11845692-20 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: finishing write tid 4 to trial11845692-20 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: finishing write tid 5 to trial11845692-20 2026-02-17T05:30:38.404 INFO:tasks.rados.rados.0.trial118.stdout:573: oid 20 updating version 0 to 317 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:573: oid 20 updating version 317 to 318 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:573: oid 20 updating version 318 to 319 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:573: oid 20 version 319 is already newer than 316 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 319 (ObjNum 227 snap 57 seq_num 227) dirty exists 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:573: left oid 20 (ObjNum 227 snap 57 seq_num 227) 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: finishing write tid 1 to trial11845692-5 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: finishing write tid 2 to trial11845692-5 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: finishing write tid 3 to trial11845692-5 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: finishing write tid 4 to trial11845692-5 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: finishing write tid 5 to trial11845692-5 2026-02-17T05:30:38.405 INFO:tasks.rados.rados.0.trial118.stdout:574: oid 5 updating version 0 to 67 2026-02-17T05:30:38.406 INFO:tasks.rados.rados.0.trial118.stdout:574: oid 5 updating version 67 to 68 2026-02-17T05:30:38.406 INFO:tasks.rados.rados.0.trial118.stdout:574: oid 5 version 68 is already newer than 65 2026-02-17T05:30:38.406 INFO:tasks.rados.rados.0.trial118.stdout:574: oid 5 version 68 is already newer than 66 2026-02-17T05:30:38.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 68 (ObjNum 228 snap 57 seq_num 228) dirty exists 2026-02-17T05:30:38.406 INFO:tasks.rados.rados.0.trial118.stdout:574: left oid 5 (ObjNum 228 snap 57 seq_num 228) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:568: done (7 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:569: done (6 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:570: done (5 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:571: done (4 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:572: done (3 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:573: done (2 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:574: done (1 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:576: done (0 left) 2026-02-17T05:30:39.400 INFO:tasks.rados.rados.0.trial118.stdout:577: snap_remove snap 57 2026-02-17T05:30:40.257 INFO:tasks.rados.rados.0.trial118.stdout:577: done (0 left) 2026-02-17T05:30:40.257 INFO:tasks.rados.rados.0.trial118.stdout:578: write oid 26 current snap is 58 2026-02-17T05:30:40.257 INFO:tasks.rados.rados.0.trial118.stdout:578: seq_num 229 ranges {648803=722611,1967200=714747,3421983=426820} 2026-02-17T05:30:40.262 INFO:tasks.rados.rados.0.trial118.stdout:578: writing trial11845692-26 from 648803 to 1371414 tid 1 2026-02-17T05:30:40.267 INFO:tasks.rados.rados.0.trial118.stdout:578: writing trial11845692-26 from 1967200 to 2681947 tid 2 2026-02-17T05:30:40.272 INFO:tasks.rados.rados.0.trial118.stdout:578: writing trial11845692-26 from 3421983 to 3848803 tid 3 2026-02-17T05:30:40.272 INFO:tasks.rados.rados.0.trial118.stdout:579: delete oid 25 current snap is 58 2026-02-17T05:30:40.272 INFO:tasks.rados.rados.0.trial118.stdout:578: finishing write tid 1 to trial11845692-26 2026-02-17T05:30:40.273 INFO:tasks.rados.rados.0.trial118.stdout:578: finishing write tid 2 to trial11845692-26 2026-02-17T05:30:40.273 INFO:tasks.rados.rados.0.trial118.stdout:579: done (1 left) 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:580: read oid 1 snap -1 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:580: expect (ObjNum 182 snap 49 seq_num 182) 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:581: read oid 19 snap -1 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:581: expect (ObjNum 225 snap 57 seq_num 225) 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:582: write (excl) oid 47 current snap is 58 2026-02-17T05:30:40.274 INFO:tasks.rados.rados.0.trial118.stdout:582: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2026-02-17T05:30:40.277 INFO:tasks.rados.rados.0.trial118.stdout:582: writing trial11845692-47 from 682417 to 1155526 tid 1 2026-02-17T05:30:40.281 INFO:tasks.rados.rados.0.trial118.stdout:582: writing trial11845692-47 from 1567811 to 2169874 tid 2 2026-02-17T05:30:40.286 INFO:tasks.rados.rados.0.trial118.stdout:582: writing trial11845692-47 from 2844123 to 3465605 tid 3 2026-02-17T05:30:40.286 INFO:tasks.rados.rados.0.trial118.stdout:583: read oid 7 snap -1 2026-02-17T05:30:40.286 INFO:tasks.rados.rados.0.trial118.stdout:583: expect deleted 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:584: copy_from oid 50 from oid 49 current snap is 58 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: finishing write tid 3 to trial11845692-26 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: finishing write tid 4 to trial11845692-26 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: finishing write tid 5 to trial11845692-26 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: oid 26 updating version 0 to 239 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: oid 26 updating version 239 to 241 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: oid 26 version 241 is already newer than 240 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: oid 26 version 241 is already newer than 238 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 241 (ObjNum 229 snap 58 seq_num 229) dirty exists 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: left oid 26 (ObjNum 229 snap 58 seq_num 229) 2026-02-17T05:30:40.287 INFO:tasks.rados.rados.0.trial118.stdout:578: done (5 left) 2026-02-17T05:30:40.288 INFO:tasks.rados.rados.0.trial118.stdout:585: copy_from oid 14 from oid 12 current snap is 58 2026-02-17T05:30:40.288 INFO:tasks.rados.rados.0.trial118.stdout:580: expect (ObjNum 182 snap 49 seq_num 182) 2026-02-17T05:30:40.288 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:40.308 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 480087 2026-02-17T05:30:40.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 738932 2026-02-17T05:30:40.346 INFO:tasks.rados.rados.0.trial118.stdout:581: expect (ObjNum 225 snap 57 seq_num 225) 2026-02-17T05:30:40.346 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:40.385 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3384059 2026-02-17T05:30:40.388 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:582: finishing write tid 1 to trial11845692-47 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:582: finishing write tid 2 to trial11845692-47 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:580: done (5 left) 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:581: done (4 left) 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:586: snap_create 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:585: finishing copy_from to trial11845692-14 2026-02-17T05:30:40.415 INFO:tasks.rados.rados.0.trial118.stdout:585: got expected ENOENT (src dne) 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:585: finishing copy_from racing read to trial11845692-14 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: finishing write tid 3 to trial11845692-47 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: finishing write tid 4 to trial11845692-47 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: finishing write tid 5 to trial11845692-47 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: oid 47 updating version 0 to 298 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: oid 47 version 298 is already newer than 297 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: oid 47 updating version 298 to 299 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: oid 47 updating version 299 to 300 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 300 (ObjNum 231 snap 58 seq_num 231) dirty exists 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:582: left oid 47 (ObjNum 231 snap 58 seq_num 231) 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:584: finishing copy_from racing read to trial11845692-50 2026-02-17T05:30:40.416 INFO:tasks.rados.rados.0.trial118.stdout:584: finishing copy_from to trial11845692-50 2026-02-17T05:30:40.417 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 50 (ObjNum 176 snap 46 seq_num 176) dirty exists 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:582: done (4 left) 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:583: done (3 left) 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:584: done (2 left) 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:585: done (1 left) 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:586: done (0 left) 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:587: read oid 13 snap -1 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:587: expect deleted 2026-02-17T05:30:41.406 INFO:tasks.rados.rados.0.trial118.stdout:588: snap_create 2026-02-17T05:30:42.408 INFO:tasks.rados.rados.0.trial118.stdout:587: done (1 left) 2026-02-17T05:30:42.408 INFO:tasks.rados.rados.0.trial118.stdout:588: done (0 left) 2026-02-17T05:30:42.409 INFO:tasks.rados.rados.0.trial118.stdout:589: copy_from oid 44 from oid 12 current snap is 60 2026-02-17T05:30:42.409 INFO:tasks.rados.rados.0.trial118.stdout:590: write (excl) oid 26 current snap is 60 2026-02-17T05:30:42.409 INFO:tasks.rados.rados.0.trial118.stdout:590: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2026-02-17T05:30:42.413 INFO:tasks.rados.rados.0.trial118.stdout:590: writing trial11845692-26 from 699224 to 1247582 tid 1 2026-02-17T05:30:42.418 INFO:tasks.rados.rados.0.trial118.stdout:590: writing trial11845692-26 from 2026293 to 2488367 tid 2 2026-02-17T05:30:42.423 INFO:tasks.rados.rados.0.trial118.stdout:590: writing trial11845692-26 from 3271546 to 3704300 tid 3 2026-02-17T05:30:42.423 INFO:tasks.rados.rados.0.trial118.stdout:591: delete oid 49 current snap is 60 2026-02-17T05:30:42.423 INFO:tasks.rados.rados.0.trial118.stdout:589: finishing copy_from to trial11845692-44 2026-02-17T05:30:42.424 INFO:tasks.rados.rados.0.trial118.stdout:589: got expected ENOENT (src dne) 2026-02-17T05:30:42.424 INFO:tasks.rados.rados.0.trial118.stdout:589: finishing copy_from racing read to trial11845692-44 2026-02-17T05:30:42.424 INFO:tasks.rados.rados.0.trial118.stdout:590: finishing write tid 1 to trial11845692-26 2026-02-17T05:30:42.424 INFO:tasks.rados.rados.0.trial118.stdout:590: finishing write tid 2 to trial11845692-26 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: finishing write tid 3 to trial11845692-26 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: finishing write tid 4 to trial11845692-26 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: finishing write tid 5 to trial11845692-26 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: oid 26 updating version 0 to 242 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: oid 26 updating version 242 to 244 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: oid 26 updating version 244 to 245 2026-02-17T05:30:42.425 INFO:tasks.rados.rados.0.trial118.stdout:590: oid 26 version 245 is already newer than 243 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 245 (ObjNum 232 snap 60 seq_num 232) dirty exists 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:590: left oid 26 (ObjNum 232 snap 60 seq_num 232) 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:589: done (2 left) 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:590: done (1 left) 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:591: done (0 left) 2026-02-17T05:30:42.426 INFO:tasks.rados.rados.0.trial118.stdout:592: snap_create 2026-02-17T05:30:43.410 INFO:tasks.rados.rados.0.trial118.stdout:592: done (0 left) 2026-02-17T05:30:43.410 INFO:tasks.rados.rados.0.trial118.stdout:593: delete oid 20 current snap is 61 2026-02-17T05:30:43.414 INFO:tasks.rados.rados.0.trial118.stdout:593: done (0 left) 2026-02-17T05:30:43.414 INFO:tasks.rados.rados.0.trial118.stdout:594: write (excl) oid 35 current snap is 61 2026-02-17T05:30:43.414 INFO:tasks.rados.rados.0.trial118.stdout:594: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-17T05:30:43.420 INFO:tasks.rados.rados.0.trial118.stdout:594: writing trial11845692-35 from 749645 to 1523750 tid 1 2026-02-17T05:30:43.424 INFO:tasks.rados.rados.0.trial118.stdout:594: writing trial11845692-35 from 2085386 to 2694787 tid 2 2026-02-17T05:30:43.429 INFO:tasks.rados.rados.0.trial118.stdout:594: writing trial11845692-35 from 3237462 to 3949645 tid 3 2026-02-17T05:30:43.429 INFO:tasks.rados.rados.0.trial118.stdout:595: write (excl) oid 19 current snap is 61 2026-02-17T05:30:43.429 INFO:tasks.rados.rados.0.trial118.stdout:595: seq_num 236 ranges {766452=565707,1860221=469412,2981238=594195} 2026-02-17T05:30:43.434 INFO:tasks.rados.rados.0.trial118.stdout:595: writing trial11845692-19 from 766452 to 1332159 tid 1 2026-02-17T05:30:43.438 INFO:tasks.rados.rados.0.trial118.stdout:595: writing trial11845692-19 from 1860221 to 2329633 tid 2 2026-02-17T05:30:43.443 INFO:tasks.rados.rados.0.trial118.stdout:595: writing trial11845692-19 from 2981238 to 3575433 tid 3 2026-02-17T05:30:43.443 INFO:tasks.rados.rados.0.trial118.stdout:596: rollback oid 40 current snap is 61 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: finishing write tid 1 to trial11845692-35 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: finishing write tid 2 to trial11845692-35 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: finishing write tid 3 to trial11845692-35 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 46 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: finishing write tid 4 to trial11845692-35 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: finishing write tid 5 to trial11845692-35 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: oid 35 updating version 0 to 74 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: oid 35 version 74 is already newer than 71 2026-02-17T05:30:43.444 INFO:tasks.rados.rados.0.trial118.stdout:594: oid 35 version 74 is already newer than 72 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:594: oid 35 version 74 is already newer than 73 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 74 (ObjNum 235 snap 61 seq_num 235) dirty exists 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:594: left oid 35 (ObjNum 235 snap 61 seq_num 235) 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:595: finishing write tid 1 to trial11845692-19 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:595: finishing write tid 2 to trial11845692-19 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:594: done (2 left) 2026-02-17T05:30:43.445 INFO:tasks.rados.rados.0.trial118.stdout:597: snap_remove snap 54 2026-02-17T05:30:44.414 INFO:tasks.rados.rados.0.trial118.stdout:597: done (2 left) 2026-02-17T05:30:44.414 INFO:tasks.rados.rados.0.trial118.stdout:598: delete oid 5 current snap is 61 2026-02-17T05:30:44.414 INFO:tasks.rados.rados.0.trial118.stdout:596: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 0 (ObjNum 305 snap 0 seq_num 3160) dirty dne 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: finishing write tid 3 to trial11845692-19 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: finishing write tid 4 to trial11845692-19 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: finishing write tid 5 to trial11845692-19 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: oid 19 updating version 0 to 186 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: oid 19 version 186 is already newer than 185 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: oid 19 updating version 186 to 187 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: oid 19 updating version 187 to 188 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 188 (ObjNum 236 snap 61 seq_num 236) dirty exists 2026-02-17T05:30:44.415 INFO:tasks.rados.rados.0.trial118.stdout:595: left oid 19 (ObjNum 236 snap 61 seq_num 236) 2026-02-17T05:30:44.416 INFO:tasks.rados.rados.0.trial118.stdout:595: done (2 left) 2026-02-17T05:30:44.416 INFO:tasks.rados.rados.0.trial118.stdout:596: done (1 left) 2026-02-17T05:30:44.416 INFO:tasks.rados.rados.0.trial118.stdout:598: done (0 left) 2026-02-17T05:30:44.416 INFO:tasks.rados.rados.0.trial118.stdout:599: delete oid 38 current snap is 61 2026-02-17T05:30:44.417 INFO:tasks.rados.rados.0.trial118.stdout:599: done (0 left) 2026-02-17T05:30:44.417 INFO:tasks.rados.rados.0.trial118.stdout:600: copy_from oid 22 from oid 28 current snap is 61 2026-02-17T05:30:44.417 INFO:tasks.rados.rados.0.trial118.stdout:601: copy_from oid 2 from oid 43 current snap is 61 2026-02-17T05:30:44.417 INFO:tasks.rados.rados.0.trial118.stdout:602: delete oid 34 current snap is 61 2026-02-17T05:30:44.419 INFO:tasks.rados.rados.0.trial118.stdout:602: done (2 left) 2026-02-17T05:30:44.419 INFO:tasks.rados.rados.0.trial118.stdout:603: read oid 9 snap -1 2026-02-17T05:30:44.419 INFO:tasks.rados.rados.0.trial118.stdout:603: expect deleted 2026-02-17T05:30:44.419 INFO:tasks.rados.rados.0.trial118.stdout:604: write oid 10 current snap is 61 2026-02-17T05:30:44.419 INFO:tasks.rados.rados.0.trial118.stdout:604: seq_num 240 ranges {433680=466703,1577796=455884} 2026-02-17T05:30:44.422 INFO:tasks.rados.rados.0.trial118.stdout:604: writing trial11845692-10 from 433680 to 900383 tid 1 2026-02-17T05:30:44.426 INFO:tasks.rados.rados.0.trial118.stdout:604: writing trial11845692-10 from 1577796 to 2033680 tid 2 2026-02-17T05:30:44.427 INFO:tasks.rados.rados.0.trial118.stdout:605: read oid 40 snap 58 2026-02-17T05:30:44.427 INFO:tasks.rados.rados.0.trial118.stdout:605: expect deleted 2026-02-17T05:30:44.427 INFO:tasks.rados.rados.0.trial118.stdout:606: snap_remove snap 56 2026-02-17T05:30:45.257 INFO:tasks.rados.rados.0.trial118.stdout:606: done (5 left) 2026-02-17T05:30:45.257 INFO:tasks.rados.rados.0.trial118.stdout:607: write (excl) oid 33 current snap is 61 2026-02-17T05:30:45.257 INFO:tasks.rados.rados.0.trial118.stdout:607: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-17T05:30:45.261 INFO:tasks.rados.rados.0.trial118.stdout:607: writing trial11845692-33 from 450487 to 992439 tid 1 2026-02-17T05:30:45.265 INFO:tasks.rados.rados.0.trial118.stdout:607: writing trial11845692-33 from 1636278 to 2050487 tid 2 2026-02-17T05:30:45.265 INFO:tasks.rados.rados.0.trial118.stdout:608: rollback oid 5 current snap is 61 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 5 to 59 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:600: finishing copy_from racing read to trial11845692-22 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:600: finishing copy_from to trial11845692-22 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 31 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:601: finishing copy_from racing read to trial11845692-2 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:600: done (6 left) 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:603: done (5 left) 2026-02-17T05:30:45.266 INFO:tasks.rados.rados.0.trial118.stdout:609: snap_remove snap 60 2026-02-17T05:30:46.259 INFO:tasks.rados.rados.0.trial118.stdout:609: done (5 left) 2026-02-17T05:30:46.259 INFO:tasks.rados.rados.0.trial118.stdout:610: read oid 38 snap -1 2026-02-17T05:30:46.260 INFO:tasks.rados.rados.0.trial118.stdout:610: expect deleted 2026-02-17T05:30:46.260 INFO:tasks.rados.rados.0.trial118.stdout:611: write oid 24 current snap is 61 2026-02-17T05:30:46.260 INFO:tasks.rados.rados.0.trial118.stdout:601: finishing copy_from to trial11845692-2 2026-02-17T05:30:46.260 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 26 (ObjNum 98 snap 21 seq_num 98) dirty exists 2026-02-17T05:30:46.260 INFO:tasks.rados.rados.0.trial118.stdout:611: seq_num 242 ranges {467294=617201,1578407=488887} 2026-02-17T05:30:46.264 INFO:tasks.rados.rados.0.trial118.stdout:611: writing trial11845692-24 from 467294 to 1084495 tid 1 2026-02-17T05:30:46.268 INFO:tasks.rados.rados.0.trial118.stdout:611: writing trial11845692-24 from 1578407 to 2067294 tid 2 2026-02-17T05:30:46.268 INFO:tasks.rados.rados.0.trial118.stdout:601: done (6 left) 2026-02-17T05:30:46.268 INFO:tasks.rados.rados.0.trial118.stdout:605: done (5 left) 2026-02-17T05:30:46.268 INFO:tasks.rados.rados.0.trial118.stdout:612: write oid 20 current snap is 61 2026-02-17T05:30:46.268 INFO:tasks.rados.rados.0.trial118.stdout:612: seq_num 243 ranges {484101=692450,1636889=447212} 2026-02-17T05:30:46.273 INFO:tasks.rados.rados.0.trial118.stdout:612: writing trial11845692-20 from 484101 to 1176551 tid 1 2026-02-17T05:30:46.278 INFO:tasks.rados.rados.0.trial118.stdout:612: writing trial11845692-20 from 1636889 to 2084101 tid 2 2026-02-17T05:30:46.278 INFO:tasks.rados.rados.0.trial118.stdout:613: copy_from oid 41 from oid 30 current snap is 61 2026-02-17T05:30:46.278 INFO:tasks.rados.rados.0.trial118.stdout:604: finishing write tid 1 to trial11845692-10 2026-02-17T05:30:46.278 INFO:tasks.rados.rados.0.trial118.stdout:604: finishing write tid 2 to trial11845692-10 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: finishing write tid 3 to trial11845692-10 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: finishing write tid 4 to trial11845692-10 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: oid 10 updating version 0 to 190 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: oid 10 updating version 190 to 192 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: oid 10 version 192 is already newer than 191 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 192 (ObjNum 240 snap 61 seq_num 240) dirty exists 2026-02-17T05:30:46.279 INFO:tasks.rados.rados.0.trial118.stdout:604: left oid 10 (ObjNum 240 snap 61 seq_num 240) 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:607: finishing write tid 1 to trial11845692-33 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:604: done (6 left) 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:614: read oid 42 snap 53 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:614: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:615: copy_from oid 39 from oid 28 current snap is 61 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:608: finishing rollback tid 1 to trial11845692-5 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:608: finishing rollback tid 2 to trial11845692-5 2026-02-17T05:30:46.280 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 78 (ObjNum 228 snap 57 seq_num 228) dirty exists 2026-02-17T05:30:46.281 INFO:tasks.rados.rados.0.trial118.stdout:608: done (7 left) 2026-02-17T05:30:46.281 INFO:tasks.rados.rados.0.trial118.stdout:616: snap_remove snap 59 2026-02-17T05:30:47.261 INFO:tasks.rados.rados.0.trial118.stdout:616: done (7 left) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:617: copy_from oid 35 from oid 50 current snap is 61 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: finishing write tid 2 to trial11845692-33 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: finishing write tid 3 to trial11845692-33 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: finishing write tid 4 to trial11845692-33 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: oid 33 updating version 0 to 342 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: oid 33 version 342 is already newer than 341 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: oid 33 version 342 is already newer than 340 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 342 (ObjNum 241 snap 61 seq_num 241) dirty exists 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: left oid 33 (ObjNum 241 snap 61 seq_num 241) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: finishing write tid 1 to trial11845692-24 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: finishing write tid 2 to trial11845692-24 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: finishing write tid 3 to trial11845692-24 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: finishing write tid 4 to trial11845692-24 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: oid 24 updating version 0 to 85 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: oid 24 updating version 85 to 86 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: oid 24 version 86 is already newer than 84 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 86 (ObjNum 242 snap 61 seq_num 242) dirty exists 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: left oid 24 (ObjNum 242 snap 61 seq_num 242) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:612: finishing write tid 1 to trial11845692-20 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:607: done (7 left) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:610: done (6 left) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:611: done (5 left) 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:618: copy_from oid 12 from oid 26 current snap is 61 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:612: finishing write tid 2 to trial11845692-20 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:612: finishing write tid 3 to trial11845692-20 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:612: finishing write tid 4 to trial11845692-20 2026-02-17T05:30:47.262 INFO:tasks.rados.rados.0.trial118.stdout:612: oid 20 updating version 0 to 343 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:612: oid 20 updating version 343 to 344 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:612: oid 20 version 344 is already newer than 342 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 344 (ObjNum 243 snap 61 seq_num 243) dirty exists 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:612: left oid 20 (ObjNum 243 snap 61 seq_num 243) 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:612: done (5 left) 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:619: rollback oid 48 current snap is 61 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 53 2026-02-17T05:30:47.263 INFO:tasks.rados.rados.0.trial118.stdout:614: expect (ObjNum 88 snap 13 seq_num 88) 2026-02-17T05:30:47.310 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1514869 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:615: finishing copy_from racing read to trial11845692-39 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:615: finishing copy_from to trial11845692-39 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 31 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:613: finishing copy_from racing read to trial11845692-41 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:613: finishing copy_from to trial11845692-41 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 326 (ObjNum 224 snap 57 seq_num 224) dirty exists 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:613: done (5 left) 2026-02-17T05:30:47.393 INFO:tasks.rados.rados.0.trial118.stdout:614: done (4 left) 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:615: done (3 left) 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:620: snap_create 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:619: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:619: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:619: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 313 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:617: finishing copy_from racing read to trial11845692-35 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:617: finishing copy_from to trial11845692-35 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 50 (ObjNum 176 snap 46 seq_num 176) dirty exists 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:618: finishing copy_from racing read to trial11845692-12 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:618: finishing copy_from to trial11845692-12 2026-02-17T05:30:47.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 245 (ObjNum 232 snap 60 seq_num 232) dirty exists 2026-02-17T05:30:48.265 INFO:tasks.rados.rados.0.trial118.stdout:617: done (3 left) 2026-02-17T05:30:48.265 INFO:tasks.rados.rados.0.trial118.stdout:618: done (2 left) 2026-02-17T05:30:48.265 INFO:tasks.rados.rados.0.trial118.stdout:619: done (1 left) 2026-02-17T05:30:48.265 INFO:tasks.rados.rados.0.trial118.stdout:620: done (0 left) 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:621: read oid 28 snap 61 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:621: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:622: read oid 44 snap 53 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:622: expect deleted 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:623: write (excl) oid 33 current snap is 62 2026-02-17T05:30:48.266 INFO:tasks.rados.rados.0.trial118.stdout:623: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-17T05:30:48.269 INFO:tasks.rados.rados.0.trial118.stdout:623: writing trial11845692-33 from 500908 to 984960 tid 1 2026-02-17T05:30:48.273 INFO:tasks.rados.rados.0.trial118.stdout:623: writing trial11845692-33 from 1411724 to 2100908 tid 2 2026-02-17T05:30:48.274 INFO:tasks.rados.rados.0.trial118.stdout:624: snap_remove snap 58 2026-02-17T05:30:49.267 INFO:tasks.rados.rados.0.trial118.stdout:624: done (3 left) 2026-02-17T05:30:49.268 INFO:tasks.rados.rados.0.trial118.stdout:625: read oid 47 snap -1 2026-02-17T05:30:49.268 INFO:tasks.rados.rados.0.trial118.stdout:625: expect (ObjNum 231 snap 58 seq_num 231) 2026-02-17T05:30:49.268 INFO:tasks.rados.rados.0.trial118.stdout:626: write (excl) oid 22 current snap is 62 2026-02-17T05:30:49.268 INFO:tasks.rados.rados.0.trial118.stdout:626: seq_num 245 ranges {517715=559301,1870206=247509} 2026-02-17T05:30:49.273 INFO:tasks.rados.rados.0.trial118.stdout:626: writing trial11845692-22 from 517715 to 1077016 tid 1 2026-02-17T05:30:49.277 INFO:tasks.rados.rados.0.trial118.stdout:626: writing trial11845692-22 from 1870206 to 2117715 tid 2 2026-02-17T05:30:49.277 INFO:tasks.rados.rados.0.trial118.stdout:627: snap_create 2026-02-17T05:30:49.277 INFO:tasks.rados.rados.0.trial118.stdout:621: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:30:49.324 INFO:tasks.rados.rados.0.trial118.stdout:623: finishing write tid 1 to trial11845692-33 2026-02-17T05:30:49.324 INFO:tasks.rados.rados.0.trial118.stdout:623: finishing write tid 2 to trial11845692-33 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: finishing write tid 3 to trial11845692-33 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: finishing write tid 4 to trial11845692-33 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: oid 33 updating version 0 to 350 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: oid 33 version 350 is already newer than 348 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: oid 33 version 350 is already newer than 349 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 350 (ObjNum 244 snap 62 seq_num 244) dirty exists 2026-02-17T05:30:49.325 INFO:tasks.rados.rados.0.trial118.stdout:623: left oid 33 (ObjNum 244 snap 62 seq_num 244) 2026-02-17T05:30:49.326 INFO:tasks.rados.rados.0.trial118.stdout:626: finishing write tid 1 to trial11845692-22 2026-02-17T05:30:49.326 INFO:tasks.rados.rados.0.trial118.stdout:625: expect (ObjNum 231 snap 58 seq_num 231) 2026-02-17T05:30:49.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1677113 2026-02-17T05:30:49.371 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:49.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 250052 2026-02-17T05:30:49.475 INFO:tasks.rados.rados.0.trial118.stdout:626: finishing write tid 2 to trial11845692-22 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: finishing write tid 3 to trial11845692-22 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: finishing write tid 4 to trial11845692-22 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: oid 22 updating version 0 to 314 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: oid 22 updating version 314 to 316 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: oid 22 version 316 is already newer than 315 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 316 (ObjNum 245 snap 62 seq_num 245) dirty exists 2026-02-17T05:30:49.476 INFO:tasks.rados.rados.0.trial118.stdout:626: left oid 22 (ObjNum 245 snap 62 seq_num 245) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:621: done (5 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:622: done (4 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:623: done (3 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:625: done (2 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:626: done (1 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:627: done (0 left) 2026-02-17T05:30:50.257 INFO:tasks.rados.rados.0.trial118.stdout:628: snap_create 2026-02-17T05:30:51.259 INFO:tasks.rados.rados.0.trial118.stdout:628: done (0 left) 2026-02-17T05:30:51.259 INFO:tasks.rados.rados.0.trial118.stdout:629: read oid 15 snap 61 2026-02-17T05:30:51.259 INFO:tasks.rados.rados.0.trial118.stdout:629: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:51.259 INFO:tasks.rados.rados.0.trial118.stdout:630: snap_remove snap 62 2026-02-17T05:30:52.261 INFO:tasks.rados.rados.0.trial118.stdout:630: done (1 left) 2026-02-17T05:30:52.261 INFO:tasks.rados.rados.0.trial118.stdout:631: read oid 27 snap 53 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:631: expect (ObjNum 196 snap 53 seq_num 196) 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:632: read oid 43 snap -1 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:632: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:633: delete oid 12 current snap is 64 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:629: expect (ObjNum 167 snap 41 seq_num 167) 2026-02-17T05:30:52.262 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:52.334 INFO:tasks.rados.rados.0.trial118.stdout:632: expect (ObjNum 98 snap 21 seq_num 98) 2026-02-17T05:30:52.402 INFO:tasks.rados.rados.0.trial118.stdout:631: expect (ObjNum 196 snap 53 seq_num 196) 2026-02-17T05:30:52.464 INFO:tasks.rados.rados.0.trial118.stdout:629: done (3 left) 2026-02-17T05:30:52.465 INFO:tasks.rados.rados.0.trial118.stdout:631: done (2 left) 2026-02-17T05:30:52.465 INFO:tasks.rados.rados.0.trial118.stdout:632: done (1 left) 2026-02-17T05:30:52.465 INFO:tasks.rados.rados.0.trial118.stdout:633: done (0 left) 2026-02-17T05:30:52.465 INFO:tasks.rados.rados.0.trial118.stdout:634: snap_remove snap 46 2026-02-17T05:30:53.271 INFO:tasks.rados.rados.0.trial118.stdout:634: done (0 left) 2026-02-17T05:30:53.271 INFO:tasks.rados.rados.0.trial118.stdout:635: rollback oid 17 current snap is 64 2026-02-17T05:30:53.271 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 53 2026-02-17T05:30:53.271 INFO:tasks.rados.rados.0.trial118.stdout:636: write oid 47 current snap is 64 2026-02-17T05:30:53.271 INFO:tasks.rados.rados.0.trial118.stdout:636: seq_num 247 ranges {551329=709799,1870817=280512} 2026-02-17T05:30:53.277 INFO:tasks.rados.rados.0.trial118.stdout:636: writing trial11845692-47 from 551329 to 1261128 tid 1 2026-02-17T05:30:53.281 INFO:tasks.rados.rados.0.trial118.stdout:636: writing trial11845692-47 from 1870817 to 2151329 tid 2 2026-02-17T05:30:53.281 INFO:tasks.rados.rados.0.trial118.stdout:637: write (excl) oid 31 current snap is 64 2026-02-17T05:30:53.281 INFO:tasks.rados.rados.0.trial118.stdout:637: seq_num 248 ranges {568136=785048,1929299=238837} 2026-02-17T05:30:53.286 INFO:tasks.rados.rados.0.trial118.stdout:637: writing trial11845692-31 from 568136 to 1353184 tid 1 2026-02-17T05:30:53.289 INFO:tasks.rados.rados.0.trial118.stdout:637: writing trial11845692-31 from 1929299 to 2168136 tid 2 2026-02-17T05:30:53.289 INFO:tasks.rados.rados.0.trial118.stdout:638: write oid 33 current snap is 64 2026-02-17T05:30:53.289 INFO:tasks.rados.rados.0.trial118.stdout:638: seq_num 249 ranges {584943=460297,1587781=597162} 2026-02-17T05:30:53.293 INFO:tasks.rados.rados.0.trial118.stdout:638: writing trial11845692-33 from 584943 to 1045240 tid 1 2026-02-17T05:30:53.297 INFO:tasks.rados.rados.0.trial118.stdout:638: writing trial11845692-33 from 1587781 to 2184943 tid 2 2026-02-17T05:30:53.297 INFO:tasks.rados.rados.0.trial118.stdout:639: write (excl) oid 21 current snap is 64 2026-02-17T05:30:53.297 INFO:tasks.rados.rados.0.trial118.stdout:639: seq_num 250 ranges {601750=535546,1929910=271840} 2026-02-17T05:30:53.302 INFO:tasks.rados.rados.0.trial118.stdout:639: writing trial11845692-21 from 601750 to 1137296 tid 1 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:639: writing trial11845692-21 from 1929910 to 2201750 tid 2 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:640: write oid 46 current snap is 64 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:635: finishing rollback tid 0 to trial11845692-17 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:635: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 111 (ObjNum 353 snap 0 seq_num 12772112) dirty dne 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: finishing write tid 1 to trial11845692-47 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: finishing write tid 2 to trial11845692-47 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: finishing write tid 3 to trial11845692-47 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: finishing write tid 4 to trial11845692-47 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: oid 47 updating version 0 to 336 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: oid 47 version 336 is already newer than 335 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: oid 47 version 336 is already newer than 334 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 336 (ObjNum 247 snap 64 seq_num 247) dirty exists 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:636: left oid 47 (ObjNum 247 snap 64 seq_num 247) 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:637: finishing write tid 1 to trial11845692-31 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:637: finishing write tid 2 to trial11845692-31 2026-02-17T05:30:53.306 INFO:tasks.rados.rados.0.trial118.stdout:637: finishing write tid 3 to trial11845692-31 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:637: finishing write tid 4 to trial11845692-31 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:637: oid 31 updating version 0 to 366 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:637: oid 31 updating version 366 to 367 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:637: oid 31 updating version 367 to 368 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 368 (ObjNum 248 snap 64 seq_num 248) dirty exists 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:637: left oid 31 (ObjNum 248 snap 64 seq_num 248) 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:638: finishing write tid 1 to trial11845692-33 2026-02-17T05:30:53.307 INFO:tasks.rados.rados.0.trial118.stdout:640: seq_num 251 ranges {618557=727148,2104745=113812} 2026-02-17T05:30:53.311 INFO:tasks.rados.rados.0.trial118.stdout:640: writing trial11845692-46 from 618557 to 1345705 tid 1 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:640: writing trial11845692-46 from 2104745 to 2218557 tid 2 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:635: done (5 left) 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:636: done (4 left) 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:637: done (3 left) 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:641: delete oid 36 current snap is 64 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: finishing write tid 2 to trial11845692-33 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: finishing write tid 3 to trial11845692-33 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: finishing write tid 4 to trial11845692-33 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: oid 33 updating version 0 to 358 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: oid 33 updating version 358 to 359 2026-02-17T05:30:53.314 INFO:tasks.rados.rados.0.trial118.stdout:638: oid 33 updating version 359 to 360 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 360 (ObjNum 249 snap 64 seq_num 249) dirty exists 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:638: left oid 33 (ObjNum 249 snap 64 seq_num 249) 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: finishing write tid 1 to trial11845692-21 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: finishing write tid 2 to trial11845692-21 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: finishing write tid 3 to trial11845692-21 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: finishing write tid 4 to trial11845692-21 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: oid 21 updating version 0 to 362 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: oid 21 updating version 362 to 363 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: oid 21 updating version 363 to 364 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 364 (ObjNum 250 snap 64 seq_num 250) dirty exists 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: left oid 21 (ObjNum 250 snap 64 seq_num 250) 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:640: finishing write tid 1 to trial11845692-46 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:638: done (3 left) 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:639: done (2 left) 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:641: done (1 left) 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:642: read oid 16 snap -1 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:642: expect deleted 2026-02-17T05:30:53.315 INFO:tasks.rados.rados.0.trial118.stdout:643: snap_remove snap 61 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:643: done (2 left) 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:644: rollback oid 28 current snap is 64 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 53 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: finishing write tid 2 to trial11845692-46 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: finishing write tid 3 to trial11845692-46 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: finishing write tid 4 to trial11845692-46 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: oid 46 updating version 0 to 112 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: oid 46 updating version 112 to 113 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:640: oid 46 updating version 113 to 114 2026-02-17T05:30:54.275 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 114 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:640: left oid 46 (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:640: done (2 left) 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:642: done (1 left) 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:645: rollback oid 37 current snap is 64 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 53 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:646: read oid 39 snap -1 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:646: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:647: read oid 14 snap 63 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:647: expect (ObjNum 199 snap 53 seq_num 199) 2026-02-17T05:30:54.276 INFO:tasks.rados.rados.0.trial118.stdout:648: delete oid 3 current snap is 64 2026-02-17T05:30:54.277 INFO:tasks.rados.rados.0.trial118.stdout:644: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:30:54.277 INFO:tasks.rados.rados.0.trial118.stdout:645: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:30:54.277 INFO:tasks.rados.rados.0.trial118.stdout:645: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:30:54.277 INFO:tasks.rados.rados.0.trial118.stdout:645: finishing rollback tid 2 to trial11845692-37 2026-02-17T05:30:54.277 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 44 (ObjNum 152 snap 38 seq_num 152) dirty exists 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:644: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:644: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 137 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:644: done (4 left) 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:645: done (3 left) 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:648: done (2 left) 2026-02-17T05:30:54.278 INFO:tasks.rados.rados.0.trial118.stdout:649: delete oid 36 current snap is 64 2026-02-17T05:30:54.279 INFO:tasks.rados.rados.0.trial118.stdout:649: done (2 left) 2026-02-17T05:30:54.279 INFO:tasks.rados.rados.0.trial118.stdout:650: write (excl) oid 43 current snap is 64 2026-02-17T05:30:54.279 INFO:tasks.rados.rados.0.trial118.stdout:650: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-17T05:30:54.284 INFO:tasks.rados.rados.0.trial118.stdout:650: writing trial11845692-43 from 685785 to 1313929 tid 1 2026-02-17T05:30:54.287 INFO:tasks.rados.rados.0.trial118.stdout:650: writing trial11845692-43 from 1822320 to 2285785 tid 2 2026-02-17T05:30:54.288 INFO:tasks.rados.rados.0.trial118.stdout:651: snap_remove snap 53 2026-02-17T05:30:55.257 INFO:tasks.rados.rados.0.trial118.stdout:651: done (3 left) 2026-02-17T05:30:55.258 INFO:tasks.rados.rados.0.trial118.stdout:652: write oid 1 current snap is 64 2026-02-17T05:30:55.258 INFO:tasks.rados.rados.0.trial118.stdout:652: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-17T05:30:55.263 INFO:tasks.rados.rados.0.trial118.stdout:652: writing trial11845692-1 from 702592 to 1405985 tid 1 2026-02-17T05:30:55.267 INFO:tasks.rados.rados.0.trial118.stdout:652: writing trial11845692-1 from 1880802 to 2302592 tid 2 2026-02-17T05:30:55.267 INFO:tasks.rados.rados.0.trial118.stdout:653: write (excl) oid 12 current snap is 64 2026-02-17T05:30:55.267 INFO:tasks.rados.rados.0.trial118.stdout:653: seq_num 257 ranges {719399=778642,1939284=380115} 2026-02-17T05:30:55.272 INFO:tasks.rados.rados.0.trial118.stdout:653: writing trial11845692-12 from 719399 to 1498041 tid 1 2026-02-17T05:30:55.275 INFO:tasks.rados.rados.0.trial118.stdout:653: writing trial11845692-12 from 1939284 to 2319399 tid 2 2026-02-17T05:30:55.276 INFO:tasks.rados.rados.0.trial118.stdout:654: copy_from oid 20 from oid 28 current snap is 64 2026-02-17T05:30:55.276 INFO:tasks.rados.rados.0.trial118.stdout:646: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:30:55.309 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 952717 2026-02-17T05:30:55.320 INFO:tasks.rados.rados.0.trial118.stdout:647: expect (ObjNum 199 snap 53 seq_num 199) 2026-02-17T05:30:55.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:55.382 INFO:tasks.rados.rados.0.trial118.stdout:650: finishing write tid 1 to trial11845692-43 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: finishing write tid 2 to trial11845692-43 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: finishing write tid 3 to trial11845692-43 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: finishing write tid 4 to trial11845692-43 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: oid 43 updating version 0 to 249 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: oid 43 version 249 is already newer than 248 2026-02-17T05:30:55.383 INFO:tasks.rados.rados.0.trial118.stdout:650: oid 43 version 249 is already newer than 247 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 249 (ObjNum 255 snap 64 seq_num 255) dirty exists 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:650: left oid 43 (ObjNum 255 snap 64 seq_num 255) 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:652: finishing write tid 1 to trial11845692-1 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:652: finishing write tid 2 to trial11845692-1 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:652: finishing write tid 3 to trial11845692-1 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:652: finishing write tid 4 to trial11845692-1 2026-02-17T05:30:55.384 INFO:tasks.rados.rados.0.trial118.stdout:652: oid 1 updating version 0 to 376 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:652: oid 1 updating version 376 to 378 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:652: oid 1 version 378 is already newer than 377 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 378 (ObjNum 256 snap 64 seq_num 256) dirty exists 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:652: left oid 1 (ObjNum 256 snap 64 seq_num 256) 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:653: finishing write tid 1 to trial11845692-12 2026-02-17T05:30:55.385 INFO:tasks.rados.rados.0.trial118.stdout:653: finishing write tid 2 to trial11845692-12 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:646: done (5 left) 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:647: done (4 left) 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:650: done (3 left) 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:652: done (2 left) 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:655: delete oid 14 current snap is 64 2026-02-17T05:30:55.386 INFO:tasks.rados.rados.0.trial118.stdout:653: finishing write tid 3 to trial11845692-12 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:653: finishing write tid 4 to trial11845692-12 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:653: oid 12 updating version 0 to 252 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:653: oid 12 version 252 is already newer than 250 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:653: oid 12 version 252 is already newer than 251 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 252 (ObjNum 257 snap 64 seq_num 257) dirty exists 2026-02-17T05:30:55.387 INFO:tasks.rados.rados.0.trial118.stdout:653: left oid 12 (ObjNum 257 snap 64 seq_num 257) 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:654: finishing copy_from racing read to trial11845692-20 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:654: finishing copy_from to trial11845692-20 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 137 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:653: done (2 left) 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:654: done (1 left) 2026-02-17T05:30:55.388 INFO:tasks.rados.rados.0.trial118.stdout:655: done (0 left) 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:656: rollback oid 26 current snap is 64 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 63 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:657: copy_from oid 15 from oid 44 current snap is 64 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:658: rollback oid 20 current snap is 64 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 63 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:659: delete oid 36 current snap is 64 2026-02-17T05:30:55.389 INFO:tasks.rados.rados.0.trial118.stdout:659: done (3 left) 2026-02-17T05:30:55.390 INFO:tasks.rados.rados.0.trial118.stdout:660: write (excl) oid 30 current snap is 64 2026-02-17T05:30:55.390 INFO:tasks.rados.rados.0.trial118.stdout:660: seq_num 260 ranges {769820=720742,2114730=255090} 2026-02-17T05:30:55.393 INFO:tasks.rados.rados.0.trial118.stdout:660: writing trial11845692-30 from 769820 to 1490562 tid 1 2026-02-17T05:30:55.393 INFO:tasks.rados.rados.0.trial118.stdout:660: writing trial11845692-30 from 2114730 to 2369820 tid 2 2026-02-17T05:30:55.393 INFO:tasks.rados.rados.0.trial118.stdout:661: read oid 18 snap -1 2026-02-17T05:30:55.393 INFO:tasks.rados.rados.0.trial118.stdout:661: expect (ObjNum 183 snap 50 seq_num 183) 2026-02-17T05:30:55.393 INFO:tasks.rados.rados.0.trial118.stdout:662: read oid 8 snap 63 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:662: expect (ObjNum 207 snap 55 seq_num 207) 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:663: rollback oid 39 current snap is 64 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:658: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:658: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:658: finishing rollback tid 2 to trial11845692-20 2026-02-17T05:30:55.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 387 (ObjNum 243 snap 61 seq_num 243) dirty exists 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:656: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 63 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:656: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:656: finishing rollback tid 2 to trial11845692-26 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 248 (ObjNum 232 snap 60 seq_num 232) dirty exists 2026-02-17T05:30:55.395 INFO:tasks.rados.rados.0.trial118.stdout:657: finishing copy_from racing read to trial11845692-15 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:657: finishing copy_from to trial11845692-15 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 53 (ObjNum 201 snap 54 seq_num 201) dirty exists 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:660: finishing write tid 1 to trial11845692-30 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:656: done (6 left) 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:657: done (5 left) 2026-02-17T05:30:55.396 INFO:tasks.rados.rados.0.trial118.stdout:658: done (4 left) 2026-02-17T05:30:55.397 INFO:tasks.rados.rados.0.trial118.stdout:664: copy_from oid 32 from oid 22 current snap is 64 2026-02-17T05:30:55.397 INFO:tasks.rados.rados.0.trial118.stdout:665: write oid 35 current snap is 64 2026-02-17T05:30:55.397 INFO:tasks.rados.rados.0.trial118.stdout:665: seq_num 261 ranges {786627=795991,2173212=213415} 2026-02-17T05:30:55.398 INFO:tasks.rados.rados.0.trial118.stdout:665: writing trial11845692-35 from 786627 to 1582618 tid 1 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:665: writing trial11845692-35 from 2173212 to 2386627 tid 2 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:666: snap_create 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:660: finishing write tid 2 to trial11845692-30 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:660: finishing write tid 3 to trial11845692-30 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:660: finishing write tid 4 to trial11845692-30 2026-02-17T05:30:55.401 INFO:tasks.rados.rados.0.trial118.stdout:660: oid 30 updating version 0 to 381 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:660: oid 30 version 381 is already newer than 380 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:660: oid 30 updating version 381 to 382 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 382 (ObjNum 260 snap 64 seq_num 260) dirty exists 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:660: left oid 30 (ObjNum 260 snap 64 seq_num 260) 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:663: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:663: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:30:55.402 INFO:tasks.rados.rados.0.trial118.stdout:663: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:30:55.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 348 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:30:55.403 INFO:tasks.rados.rados.0.trial118.stdout:661: expect (ObjNum 183 snap 50 seq_num 183) 2026-02-17T05:30:55.403 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1575382 2026-02-17T05:30:55.423 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2733779 2026-02-17T05:30:55.429 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:55.451 INFO:tasks.rados.rados.0.trial118.stdout:664: finishing copy_from racing read to trial11845692-32 2026-02-17T05:30:55.452 INFO:tasks.rados.rados.0.trial118.stdout:664: finishing copy_from to trial11845692-32 2026-02-17T05:30:55.452 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 316 (ObjNum 245 snap 62 seq_num 245) dirty exists 2026-02-17T05:30:55.452 INFO:tasks.rados.rados.0.trial118.stdout:662: expect (ObjNum 207 snap 55 seq_num 207) 2026-02-17T05:30:55.460 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1681327 2026-02-17T05:30:55.479 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:55.521 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1656480 2026-02-17T05:30:55.540 INFO:tasks.rados.rados.0.trial118.stdout:665: finishing write tid 1 to trial11845692-35 2026-02-17T05:30:55.540 INFO:tasks.rados.rados.0.trial118.stdout:665: finishing write tid 2 to trial11845692-35 2026-02-17T05:30:55.540 INFO:tasks.rados.rados.0.trial118.stdout:665: finishing write tid 3 to trial11845692-35 2026-02-17T05:30:55.540 INFO:tasks.rados.rados.0.trial118.stdout:665: finishing write tid 4 to trial11845692-35 2026-02-17T05:30:55.541 INFO:tasks.rados.rados.0.trial118.stdout:665: oid 35 updating version 0 to 101 2026-02-17T05:30:55.541 INFO:tasks.rados.rados.0.trial118.stdout:665: oid 35 updating version 101 to 102 2026-02-17T05:30:55.541 INFO:tasks.rados.rados.0.trial118.stdout:665: oid 35 updating version 102 to 103 2026-02-17T05:30:55.541 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 103 (ObjNum 261 snap 64 seq_num 261) dirty exists 2026-02-17T05:30:55.541 INFO:tasks.rados.rados.0.trial118.stdout:665: left oid 35 (ObjNum 261 snap 64 seq_num 261) 2026-02-17T05:30:56.279 INFO:tasks.rados.rados.0.trial118.stdout:660: done (6 left) 2026-02-17T05:30:56.279 INFO:tasks.rados.rados.0.trial118.stdout:661: done (5 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:662: done (4 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:663: done (3 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:664: done (2 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:665: done (1 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:666: done (0 left) 2026-02-17T05:30:56.280 INFO:tasks.rados.rados.0.trial118.stdout:667: snap_remove snap 63 2026-02-17T05:30:57.279 INFO:tasks.rados.rados.0.trial118.stdout:667: done (0 left) 2026-02-17T05:30:57.280 INFO:tasks.rados.rados.0.trial118.stdout:668: write oid 36 current snap is 65 2026-02-17T05:30:57.280 INFO:tasks.rados.rados.0.trial118.stdout:668: seq_num 262 ranges {403434=471240,1315341=400756} 2026-02-17T05:30:57.284 INFO:tasks.rados.rados.0.trial118.stdout:668: writing trial11845692-36 from 403434 to 874674 tid 1 2026-02-17T05:30:57.287 INFO:tasks.rados.rados.0.trial118.stdout:668: writing trial11845692-36 from 1315341 to 1716097 tid 2 2026-02-17T05:30:57.288 INFO:tasks.rados.rados.0.trial118.stdout:669: read oid 22 snap -1 2026-02-17T05:30:57.288 INFO:tasks.rados.rados.0.trial118.stdout:669: expect (ObjNum 245 snap 62 seq_num 245) 2026-02-17T05:30:57.288 INFO:tasks.rados.rados.0.trial118.stdout:670: delete oid 19 current snap is 65 2026-02-17T05:30:57.288 INFO:tasks.rados.rados.0.trial118.stdout:668: finishing write tid 1 to trial11845692-36 2026-02-17T05:30:57.288 INFO:tasks.rados.rados.0.trial118.stdout:670: done (2 left) 2026-02-17T05:30:57.289 INFO:tasks.rados.rados.0.trial118.stdout:671: rollback oid 33 current snap is 65 2026-02-17T05:30:57.289 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 64 2026-02-17T05:30:57.289 INFO:tasks.rados.rados.0.trial118.stdout:672: delete oid 25 current snap is 65 2026-02-17T05:30:57.289 INFO:tasks.rados.rados.0.trial118.stdout:668: finishing write tid 2 to trial11845692-36 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: finishing write tid 3 to trial11845692-36 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: finishing write tid 4 to trial11845692-36 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: oid 36 updating version 0 to 319 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: oid 36 version 319 is already newer than 318 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: oid 36 version 319 is already newer than 317 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 319 (ObjNum 262 snap 65 seq_num 262) dirty exists 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:668: left oid 36 (ObjNum 262 snap 65 seq_num 262) 2026-02-17T05:30:57.290 INFO:tasks.rados.rados.0.trial118.stdout:669: expect (ObjNum 245 snap 62 seq_num 245) 2026-02-17T05:30:57.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:57.348 INFO:tasks.rados.rados.0.trial118.stdout:671: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:30:57.348 INFO:tasks.rados.rados.0.trial118.stdout:671: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:30:57.348 INFO:tasks.rados.rados.0.trial118.stdout:671: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 394 (ObjNum 249 snap 64 seq_num 249) dirty exists 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:668: done (3 left) 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:669: done (2 left) 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:671: done (1 left) 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:672: done (0 left) 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:673: write oid 26 current snap is 65 2026-02-17T05:30:57.349 INFO:tasks.rados.rados.0.trial118.stdout:673: seq_num 265 ranges {453855=696987,1890787=548083} 2026-02-17T05:30:57.352 INFO:tasks.rados.rados.0.trial118.stdout:673: writing trial11845692-26 from 453855 to 1150842 tid 1 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:673: writing trial11845692-26 from 1890787 to 2438870 tid 2 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:674: read oid 45 snap 64 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:674: expect (ObjNum 138 snap 29 seq_num 138) 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:675: write (excl) oid 2 current snap is 65 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:673: finishing write tid 1 to trial11845692-26 2026-02-17T05:30:57.358 INFO:tasks.rados.rados.0.trial118.stdout:675: seq_num 266 ranges {470662=772236,1832916=408094} 2026-02-17T05:30:57.362 INFO:tasks.rados.rados.0.trial118.stdout:675: writing trial11845692-2 from 470662 to 1242898 tid 1 2026-02-17T05:30:57.366 INFO:tasks.rados.rados.0.trial118.stdout:675: writing trial11845692-2 from 1832916 to 2241010 tid 2 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:676: copy_from oid 31 from oid 29 current snap is 65 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:673: finishing write tid 2 to trial11845692-26 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:673: finishing write tid 3 to trial11845692-26 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:673: finishing write tid 4 to trial11845692-26 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:673: oid 26 updating version 0 to 250 2026-02-17T05:30:57.367 INFO:tasks.rados.rados.0.trial118.stdout:673: oid 26 updating version 250 to 251 2026-02-17T05:30:57.368 INFO:tasks.rados.rados.0.trial118.stdout:673: oid 26 version 251 is already newer than 249 2026-02-17T05:30:57.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 251 (ObjNum 265 snap 65 seq_num 265) dirty exists 2026-02-17T05:30:57.368 INFO:tasks.rados.rados.0.trial118.stdout:673: left oid 26 (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:30:57.368 INFO:tasks.rados.rados.0.trial118.stdout:674: expect (ObjNum 138 snap 29 seq_num 138) 2026-02-17T05:30:57.392 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:30:57.418 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 30970 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: finishing write tid 1 to trial11845692-2 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: finishing write tid 2 to trial11845692-2 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: finishing write tid 3 to trial11845692-2 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: finishing write tid 4 to trial11845692-2 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: oid 2 updating version 0 to 395 2026-02-17T05:30:57.444 INFO:tasks.rados.rados.0.trial118.stdout:675: oid 2 version 395 is already newer than 393 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:675: oid 2 version 395 is already newer than 394 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 395 (ObjNum 266 snap 65 seq_num 266) dirty exists 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:675: left oid 2 (ObjNum 266 snap 65 seq_num 266) 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:676: finishing copy_from racing read to trial11845692-31 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:676: finishing copy_from to trial11845692-31 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 274 (ObjNum 164 snap 41 seq_num 164) dirty exists 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:673: done (3 left) 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:674: done (2 left) 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:675: done (1 left) 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:676: done (0 left) 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:677: rollback oid 20 current snap is 65 2026-02-17T05:30:57.445 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 64 2026-02-17T05:30:57.446 INFO:tasks.rados.rados.0.trial118.stdout:678: delete oid 5 current snap is 65 2026-02-17T05:30:57.446 INFO:tasks.rados.rados.0.trial118.stdout:678: done (1 left) 2026-02-17T05:30:57.446 INFO:tasks.rados.rados.0.trial118.stdout:679: snap_create 2026-02-17T05:30:57.447 INFO:tasks.rados.rados.0.trial118.stdout:677: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:30:57.447 INFO:tasks.rados.rados.0.trial118.stdout:677: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:30:57.447 INFO:tasks.rados.rados.0.trial118.stdout:677: finishing rollback tid 2 to trial11845692-20 2026-02-17T05:30:57.447 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 401 (ObjNum 243 snap 61 seq_num 243) dirty exists 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:677: done (1 left) 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:679: done (0 left) 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:680: read oid 6 snap 65 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:680: expect deleted 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:681: rollback oid 36 current snap is 66 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 64 2026-02-17T05:30:58.284 INFO:tasks.rados.rados.0.trial118.stdout:682: snap_create 2026-02-17T05:30:58.286 INFO:tasks.rados.rados.0.trial118.stdout:681: finishing rollback tid 0 to trial11845692-36 2026-02-17T05:30:58.287 INFO:tasks.rados.rados.0.trial118.stdout:681: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:30:58.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 321 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:30:59.284 INFO:tasks.rados.rados.0.trial118.stdout:680: done (2 left) 2026-02-17T05:30:59.284 INFO:tasks.rados.rados.0.trial118.stdout:681: done (1 left) 2026-02-17T05:30:59.284 INFO:tasks.rados.rados.0.trial118.stdout:682: done (0 left) 2026-02-17T05:30:59.284 INFO:tasks.rados.rados.0.trial118.stdout:683: write (excl) oid 40 current snap is 67 2026-02-17T05:30:59.284 INFO:tasks.rados.rados.0.trial118.stdout:683: seq_num 268 ranges {504276=639087,1666233=695410} 2026-02-17T05:30:59.289 INFO:tasks.rados.rados.0.trial118.stdout:683: writing trial11845692-40 from 504276 to 1143363 tid 1 2026-02-17T05:30:59.294 INFO:tasks.rados.rados.0.trial118.stdout:683: writing trial11845692-40 from 1666233 to 2361643 tid 2 2026-02-17T05:30:59.294 INFO:tasks.rados.rados.0.trial118.stdout:684: snap_remove snap 66 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:684: done (1 left) 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:685: read oid 33 snap -1 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:685: expect (ObjNum 249 snap 64 seq_num 249) 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:686: read oid 39 snap -1 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:686: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:687: write (excl) oid 13 current snap is 67 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: finishing write tid 1 to trial11845692-40 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: finishing write tid 2 to trial11845692-40 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: finishing write tid 3 to trial11845692-40 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: finishing write tid 4 to trial11845692-40 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: oid 40 updating version 0 to 398 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: oid 40 version 398 is already newer than 397 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: oid 40 version 398 is already newer than 396 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 398 (ObjNum 268 snap 67 seq_num 268) dirty exists 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:683: left oid 40 (ObjNum 268 snap 67 seq_num 268) 2026-02-17T05:31:00.259 INFO:tasks.rados.rados.0.trial118.stdout:687: seq_num 269 ranges {521083=714336,1724715=555421} 2026-02-17T05:31:00.264 INFO:tasks.rados.rados.0.trial118.stdout:687: writing trial11845692-13 from 521083 to 1235419 tid 1 2026-02-17T05:31:00.268 INFO:tasks.rados.rados.0.trial118.stdout:687: writing trial11845692-13 from 1724715 to 2280136 tid 2 2026-02-17T05:31:00.268 INFO:tasks.rados.rados.0.trial118.stdout:683: done (3 left) 2026-02-17T05:31:00.268 INFO:tasks.rados.rados.0.trial118.stdout:688: write (excl) oid 43 current snap is 67 2026-02-17T05:31:00.268 INFO:tasks.rados.rados.0.trial118.stdout:688: seq_num 270 ranges {537890=789585,1783197=699079} 2026-02-17T05:31:00.273 INFO:tasks.rados.rados.0.trial118.stdout:688: writing trial11845692-43 from 537890 to 1327475 tid 1 2026-02-17T05:31:00.277 INFO:tasks.rados.rados.0.trial118.stdout:688: writing trial11845692-43 from 1783197 to 2482276 tid 2 2026-02-17T05:31:00.277 INFO:tasks.rados.rados.0.trial118.stdout:689: rollback oid 48 current snap is 67 2026-02-17T05:31:00.277 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 65 2026-02-17T05:31:00.277 INFO:tasks.rados.rados.0.trial118.stdout:685: expect (ObjNum 249 snap 64 seq_num 249) 2026-02-17T05:31:00.326 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:00.354 INFO:tasks.rados.rados.0.trial118.stdout:686: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:00.354 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:00.371 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:00.396 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2206119 2026-02-17T05:31:00.398 INFO:tasks.rados.rados.0.trial118.stdout:687: finishing write tid 1 to trial11845692-13 2026-02-17T05:31:00.398 INFO:tasks.rados.rados.0.trial118.stdout:687: finishing write tid 2 to trial11845692-13 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: finishing write tid 3 to trial11845692-13 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: finishing write tid 4 to trial11845692-13 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: oid 13 updating version 0 to 213 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: oid 13 updating version 213 to 214 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: oid 13 updating version 214 to 215 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 215 (ObjNum 269 snap 67 seq_num 269) dirty exists 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:687: left oid 13 (ObjNum 269 snap 67 seq_num 269) 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:688: finishing write tid 1 to trial11845692-43 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:688: finishing write tid 2 to trial11845692-43 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:688: finishing write tid 3 to trial11845692-43 2026-02-17T05:31:00.399 INFO:tasks.rados.rados.0.trial118.stdout:688: finishing write tid 4 to trial11845692-43 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:688: oid 43 updating version 0 to 253 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:688: oid 43 updating version 253 to 254 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:688: oid 43 updating version 254 to 255 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 255 (ObjNum 270 snap 67 seq_num 270) dirty exists 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:688: left oid 43 (ObjNum 270 snap 67 seq_num 270) 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:689: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:689: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:689: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 324 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:685: done (4 left) 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:686: done (3 left) 2026-02-17T05:31:00.400 INFO:tasks.rados.rados.0.trial118.stdout:687: done (2 left) 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:688: done (1 left) 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:689: done (0 left) 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:690: read oid 4 snap -1 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:690: expect deleted 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:691: write oid 38 current snap is 67 2026-02-17T05:31:00.401 INFO:tasks.rados.rados.0.trial118.stdout:691: seq_num 271 ranges {554697=464834,1725326=559090} 2026-02-17T05:31:00.402 INFO:tasks.rados.rados.0.trial118.stdout:691: writing trial11845692-38 from 554697 to 1019531 tid 1 2026-02-17T05:31:00.407 INFO:tasks.rados.rados.0.trial118.stdout:691: writing trial11845692-38 from 1725326 to 2284416 tid 2 2026-02-17T05:31:00.407 INFO:tasks.rados.rados.0.trial118.stdout:692: write oid 48 current snap is 67 2026-02-17T05:31:00.407 INFO:tasks.rados.rados.0.trial118.stdout:692: seq_num 272 ranges {571504=540083,1783808=702748} 2026-02-17T05:31:00.411 INFO:tasks.rados.rados.0.trial118.stdout:692: writing trial11845692-48 from 571504 to 1111587 tid 1 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:692: writing trial11845692-48 from 1783808 to 2486556 tid 2 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:693: read oid 46 snap -1 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:693: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:694: delete oid 12 current snap is 67 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:691: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:691: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:691: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:00.417 INFO:tasks.rados.rados.0.trial118.stdout:691: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:691: oid 38 updating version 0 to 355 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:691: oid 38 version 355 is already newer than 353 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:691: oid 38 version 355 is already newer than 354 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 355 (ObjNum 271 snap 67 seq_num 271) dirty exists 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:691: left oid 38 (ObjNum 271 snap 67 seq_num 271) 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:692: finishing write tid 1 to trial11845692-48 2026-02-17T05:31:00.418 INFO:tasks.rados.rados.0.trial118.stdout:690: done (4 left) 2026-02-17T05:31:00.419 INFO:tasks.rados.rados.0.trial118.stdout:691: done (3 left) 2026-02-17T05:31:00.419 INFO:tasks.rados.rados.0.trial118.stdout:694: done (2 left) 2026-02-17T05:31:00.419 INFO:tasks.rados.rados.0.trial118.stdout:695: rollback oid 29 current snap is 67 2026-02-17T05:31:00.419 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 65 2026-02-17T05:31:00.419 INFO:tasks.rados.rados.0.trial118.stdout:696: snap_remove snap 64 2026-02-17T05:31:01.291 INFO:tasks.rados.rados.0.trial118.stdout:696: done (3 left) 2026-02-17T05:31:01.292 INFO:tasks.rados.rados.0.trial118.stdout:697: read oid 41 snap -1 2026-02-17T05:31:01.292 INFO:tasks.rados.rados.0.trial118.stdout:697: expect (ObjNum 224 snap 57 seq_num 224) 2026-02-17T05:31:01.292 INFO:tasks.rados.rados.0.trial118.stdout:698: write (excl) oid 36 current snap is 67 2026-02-17T05:31:01.292 INFO:tasks.rados.rados.0.trial118.stdout:698: seq_num 274 ranges {605118=406934,1617125=706417} 2026-02-17T05:31:01.296 INFO:tasks.rados.rados.0.trial118.stdout:698: writing trial11845692-36 from 605118 to 1012052 tid 1 2026-02-17T05:31:01.301 INFO:tasks.rados.rados.0.trial118.stdout:698: writing trial11845692-36 from 1617125 to 2323542 tid 2 2026-02-17T05:31:01.301 INFO:tasks.rados.rados.0.trial118.stdout:699: write (excl) oid 4 current snap is 67 2026-02-17T05:31:01.301 INFO:tasks.rados.rados.0.trial118.stdout:699: seq_num 275 ranges {621925=482183,1559254=566428} 2026-02-17T05:31:01.305 INFO:tasks.rados.rados.0.trial118.stdout:699: writing trial11845692-4 from 621925 to 1104108 tid 1 2026-02-17T05:31:01.310 INFO:tasks.rados.rados.0.trial118.stdout:699: writing trial11845692-4 from 1559254 to 2125682 tid 2 2026-02-17T05:31:01.310 INFO:tasks.rados.rados.0.trial118.stdout:700: write oid 38 current snap is 67 2026-02-17T05:31:01.310 INFO:tasks.rados.rados.0.trial118.stdout:700: seq_num 276 ranges {638732=557432,1617736=710086} 2026-02-17T05:31:01.314 INFO:tasks.rados.rados.0.trial118.stdout:700: writing trial11845692-38 from 638732 to 1196164 tid 1 2026-02-17T05:31:01.319 INFO:tasks.rados.rados.0.trial118.stdout:700: writing trial11845692-38 from 1617736 to 2327822 tid 2 2026-02-17T05:31:01.319 INFO:tasks.rados.rados.0.trial118.stdout:701: write oid 3 current snap is 67 2026-02-17T05:31:01.319 INFO:tasks.rados.rados.0.trial118.stdout:692: finishing write tid 2 to trial11845692-48 2026-02-17T05:31:01.319 INFO:tasks.rados.rados.0.trial118.stdout:692: finishing write tid 3 to trial11845692-48 2026-02-17T05:31:01.319 INFO:tasks.rados.rados.0.trial118.stdout:692: finishing write tid 4 to trial11845692-48 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:692: oid 48 updating version 0 to 326 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:692: oid 48 version 326 is already newer than 325 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:692: oid 48 updating version 326 to 327 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 327 (ObjNum 272 snap 67 seq_num 272) dirty exists 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:692: left oid 48 (ObjNum 272 snap 67 seq_num 272) 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:695: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:695: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:695: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 403 (ObjNum 164 snap 41 seq_num 164) dirty exists 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:693: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:31:01.320 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:01.430 INFO:tasks.rados.rados.0.trial118.stdout:698: finishing write tid 1 to trial11845692-36 2026-02-17T05:31:01.431 INFO:tasks.rados.rados.0.trial118.stdout:697: expect (ObjNum 224 snap 57 seq_num 224) 2026-02-17T05:31:01.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2557228 2026-02-17T05:31:01.573 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1449955 2026-02-17T05:31:01.628 INFO:tasks.rados.rados.0.trial118.stdout:698: finishing write tid 2 to trial11845692-36 2026-02-17T05:31:01.628 INFO:tasks.rados.rados.0.trial118.stdout:698: finishing write tid 3 to trial11845692-36 2026-02-17T05:31:01.628 INFO:tasks.rados.rados.0.trial118.stdout:701: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-17T05:31:01.633 INFO:tasks.rados.rados.0.trial118.stdout:701: writing trial11845692-3 from 655539 to 1288220 tid 1 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:701: writing trial11845692-3 from 2076218 to 2646315 tid 2 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:692: done (7 left) 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:693: done (6 left) 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:695: done (5 left) 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:697: done (4 left) 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:702: rollback oid 22 current snap is 67 2026-02-17T05:31:01.639 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 65 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:698: finishing write tid 4 to trial11845692-36 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:698: oid 36 updating version 0 to 329 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:698: oid 36 version 329 is already newer than 328 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:698: oid 36 updating version 329 to 330 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 330 (ObjNum 274 snap 67 seq_num 274) dirty exists 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:698: left oid 36 (ObjNum 274 snap 67 seq_num 274) 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: finishing write tid 1 to trial11845692-4 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: finishing write tid 2 to trial11845692-4 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: finishing write tid 3 to trial11845692-4 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: finishing write tid 4 to trial11845692-4 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: oid 4 updating version 0 to 408 2026-02-17T05:31:01.640 INFO:tasks.rados.rados.0.trial118.stdout:699: oid 4 version 408 is already newer than 406 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:699: oid 4 version 408 is already newer than 407 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 408 (ObjNum 275 snap 67 seq_num 275) dirty exists 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:699: left oid 4 (ObjNum 275 snap 67 seq_num 275) 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:700: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:698: done (4 left) 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:699: done (3 left) 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:703: write oid 42 current snap is 67 2026-02-17T05:31:01.641 INFO:tasks.rados.rados.0.trial118.stdout:703: seq_num 278 ranges {672346=707930,2134700=537646} 2026-02-17T05:31:01.643 INFO:tasks.rados.rados.0.trial118.stdout:703: writing trial11845692-42 from 672346 to 1380276 tid 1 2026-02-17T05:31:01.649 INFO:tasks.rados.rados.0.trial118.stdout:703: writing trial11845692-42 from 2134700 to 2672346 tid 2 2026-02-17T05:31:01.649 INFO:tasks.rados.rados.0.trial118.stdout:704: delete oid 11 current snap is 67 2026-02-17T05:31:01.649 INFO:tasks.rados.rados.0.trial118.stdout:700: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:01.649 INFO:tasks.rados.rados.0.trial118.stdout:700: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:01.649 INFO:tasks.rados.rados.0.trial118.stdout:700: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:700: oid 38 updating version 0 to 357 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:700: oid 38 version 357 is already newer than 356 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:700: oid 38 updating version 357 to 358 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 358 (ObjNum 276 snap 67 seq_num 276) dirty exists 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:700: left oid 38 (ObjNum 276 snap 67 seq_num 276) 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:701: finishing write tid 1 to trial11845692-3 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:702: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:701: finishing write tid 2 to trial11845692-3 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:702: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:701: finishing write tid 3 to trial11845692-3 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:702: finishing rollback tid 2 to trial11845692-22 2026-02-17T05:31:01.650 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 333 (ObjNum 245 snap 62 seq_num 245) dirty exists 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:701: finishing write tid 4 to trial11845692-3 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:701: oid 3 updating version 0 to 220 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:701: oid 3 version 220 is already newer than 218 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:701: oid 3 version 220 is already newer than 219 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 220 (ObjNum 277 snap 67 seq_num 277) dirty exists 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:701: left oid 3 (ObjNum 277 snap 67 seq_num 277) 2026-02-17T05:31:01.651 INFO:tasks.rados.rados.0.trial118.stdout:703: finishing write tid 1 to trial11845692-42 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:703: finishing write tid 2 to trial11845692-42 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:700: done (4 left) 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:701: done (3 left) 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:702: done (2 left) 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:704: done (1 left) 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:705: write oid 15 current snap is 67 2026-02-17T05:31:01.652 INFO:tasks.rados.rados.0.trial118.stdout:705: seq_num 280 ranges {705960=458428,1735311=717424} 2026-02-17T05:31:01.654 INFO:tasks.rados.rados.0.trial118.stdout:705: writing trial11845692-15 from 705960 to 1164388 tid 1 2026-02-17T05:31:01.659 INFO:tasks.rados.rados.0.trial118.stdout:705: writing trial11845692-15 from 1735311 to 2452735 tid 2 2026-02-17T05:31:01.659 INFO:tasks.rados.rados.0.trial118.stdout:706: read oid 1 snap -1 2026-02-17T05:31:01.659 INFO:tasks.rados.rados.0.trial118.stdout:706: expect (ObjNum 256 snap 64 seq_num 256) 2026-02-17T05:31:01.659 INFO:tasks.rados.rados.0.trial118.stdout:707: snap_remove snap 65 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:707: done (3 left) 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:708: rollback oid 11 current snap is 67 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:708: done (3 left) 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:709: rollback oid 49 current snap is 67 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:709: done (3 left) 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:710: snap_create 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:703: finishing write tid 3 to trial11845692-42 2026-02-17T05:31:02.296 INFO:tasks.rados.rados.0.trial118.stdout:703: finishing write tid 4 to trial11845692-42 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:703: oid 42 updating version 0 to 361 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:703: oid 42 updating version 361 to 362 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:703: oid 42 version 362 is already newer than 360 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 362 (ObjNum 278 snap 67 seq_num 278) dirty exists 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:703: left oid 42 (ObjNum 278 snap 67 seq_num 278) 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: finishing write tid 1 to trial11845692-15 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: finishing write tid 2 to trial11845692-15 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: finishing write tid 3 to trial11845692-15 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: finishing write tid 4 to trial11845692-15 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: oid 15 updating version 0 to 336 2026-02-17T05:31:02.297 INFO:tasks.rados.rados.0.trial118.stdout:705: oid 15 version 336 is already newer than 335 2026-02-17T05:31:02.298 INFO:tasks.rados.rados.0.trial118.stdout:705: oid 15 version 336 is already newer than 334 2026-02-17T05:31:02.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 336 (ObjNum 280 snap 67 seq_num 280) dirty exists 2026-02-17T05:31:02.298 INFO:tasks.rados.rados.0.trial118.stdout:705: left oid 15 (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:02.298 INFO:tasks.rados.rados.0.trial118.stdout:706: expect (ObjNum 256 snap 64 seq_num 256) 2026-02-17T05:31:02.303 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1460217 2026-02-17T05:31:02.326 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:03.297 INFO:tasks.rados.rados.0.trial118.stdout:703: done (3 left) 2026-02-17T05:31:03.297 INFO:tasks.rados.rados.0.trial118.stdout:705: done (2 left) 2026-02-17T05:31:03.297 INFO:tasks.rados.rados.0.trial118.stdout:706: done (1 left) 2026-02-17T05:31:03.297 INFO:tasks.rados.rados.0.trial118.stdout:710: done (0 left) 2026-02-17T05:31:03.297 INFO:tasks.rados.rados.0.trial118.stdout:711: snap_create 2026-02-17T05:31:04.297 INFO:tasks.rados.rados.0.trial118.stdout:711: done (0 left) 2026-02-17T05:31:04.298 INFO:tasks.rados.rados.0.trial118.stdout:712: snap_remove snap 68 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:712: done (0 left) 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:713: read oid 26 snap 67 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:713: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:714: read oid 31 snap -1 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:714: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:05.302 INFO:tasks.rados.rados.0.trial118.stdout:715: snap_create 2026-02-17T05:31:05.308 INFO:tasks.rados.rados.0.trial118.stdout:714: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:05.357 INFO:tasks.rados.rados.0.trial118.stdout:713: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:31:05.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:05.410 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:05.463 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 8879 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:713: done (2 left) 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:714: done (1 left) 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:715: done (0 left) 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:716: read oid 16 snap 67 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:716: expect deleted 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:717: write (excl) oid 14 current snap is 70 2026-02-17T05:31:06.303 INFO:tasks.rados.rados.0.trial118.stdout:717: seq_num 281 ranges {722767=533677,1793793=461082} 2026-02-17T05:31:06.308 INFO:tasks.rados.rados.0.trial118.stdout:717: writing trial11845692-14 from 722767 to 1256444 tid 1 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:717: writing trial11845692-14 from 1793793 to 2254875 tid 2 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:718: copy_from oid 40 from oid 44 current snap is 70 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:717: finishing write tid 1 to trial11845692-14 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:716: done (2 left) 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:719: read oid 47 snap -1 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:719: expect (ObjNum 247 snap 64 seq_num 247) 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:720: rollback oid 22 current snap is 70 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 69 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:721: read oid 5 snap 67 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:721: expect deleted 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:722: write oid 45 current snap is 70 2026-02-17T05:31:06.312 INFO:tasks.rados.rados.0.trial118.stdout:722: seq_num 282 ranges {739574=725279,1968628=721093} 2026-02-17T05:31:06.317 INFO:tasks.rados.rados.0.trial118.stdout:722: writing trial11845692-45 from 739574 to 1464853 tid 1 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:722: writing trial11845692-45 from 1968628 to 2689721 tid 2 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:723: read oid 42 snap -1 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:723: expect (ObjNum 278 snap 67 seq_num 278) 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:724: read oid 15 snap -1 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:724: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:725: write oid 21 current snap is 70 2026-02-17T05:31:06.322 INFO:tasks.rados.rados.0.trial118.stdout:725: seq_num 283 ranges {756381=400528,1910757=464751} 2026-02-17T05:31:06.326 INFO:tasks.rados.rados.0.trial118.stdout:725: writing trial11845692-21 from 756381 to 1156909 tid 1 2026-02-17T05:31:06.331 INFO:tasks.rados.rados.0.trial118.stdout:725: writing trial11845692-21 from 1910757 to 2375508 tid 2 2026-02-17T05:31:06.331 INFO:tasks.rados.rados.0.trial118.stdout:726: read oid 9 snap -1 2026-02-17T05:31:06.331 INFO:tasks.rados.rados.0.trial118.stdout:726: expect deleted 2026-02-17T05:31:06.331 INFO:tasks.rados.rados.0.trial118.stdout:727: write oid 13 current snap is 70 2026-02-17T05:31:06.331 INFO:tasks.rados.rados.0.trial118.stdout:727: seq_num 284 ranges {773188=475777,1969239=724762} 2026-02-17T05:31:06.336 INFO:tasks.rados.rados.0.trial118.stdout:727: writing trial11845692-13 from 773188 to 1248965 tid 1 2026-02-17T05:31:06.343 INFO:tasks.rados.rados.0.trial118.stdout:727: writing trial11845692-13 from 1969239 to 2694001 tid 2 2026-02-17T05:31:06.343 INFO:tasks.rados.rados.0.trial118.stdout:728: snap_create 2026-02-17T05:31:06.343 INFO:tasks.rados.rados.0.trial118.stdout:717: finishing write tid 2 to trial11845692-14 2026-02-17T05:31:06.343 INFO:tasks.rados.rados.0.trial118.stdout:717: finishing write tid 3 to trial11845692-14 2026-02-17T05:31:06.343 INFO:tasks.rados.rados.0.trial118.stdout:717: finishing write tid 4 to trial11845692-14 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:717: oid 14 updating version 0 to 99 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:717: oid 14 updating version 99 to 101 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:717: oid 14 version 101 is already newer than 100 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 101 (ObjNum 281 snap 70 seq_num 281) dirty exists 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:717: left oid 14 (ObjNum 281 snap 70 seq_num 281) 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:720: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:31:06.344 INFO:tasks.rados.rados.0.trial118.stdout:720: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:31:06.345 INFO:tasks.rados.rados.0.trial118.stdout:720: finishing rollback tid 2 to trial11845692-22 2026-02-17T05:31:06.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 339 (ObjNum 245 snap 62 seq_num 245) dirty exists 2026-02-17T05:31:06.345 INFO:tasks.rados.rados.0.trial118.stdout:719: expect (ObjNum 247 snap 64 seq_num 247) 2026-02-17T05:31:06.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1762809 2026-02-17T05:31:06.363 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1368377 2026-02-17T05:31:06.396 INFO:tasks.rados.rados.0.trial118.stdout:718: finishing copy_from racing read to trial11845692-40 2026-02-17T05:31:06.396 INFO:tasks.rados.rados.0.trial118.stdout:718: finishing copy_from to trial11845692-40 2026-02-17T05:31:06.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 53 (ObjNum 201 snap 54 seq_num 201) dirty exists 2026-02-17T05:31:06.396 INFO:tasks.rados.rados.0.trial118.stdout:722: finishing write tid 1 to trial11845692-45 2026-02-17T05:31:06.396 INFO:tasks.rados.rados.0.trial118.stdout:723: expect (ObjNum 278 snap 67 seq_num 278) 2026-02-17T05:31:06.467 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 727146 2026-02-17T05:31:06.490 INFO:tasks.rados.rados.0.trial118.stdout:722: finishing write tid 2 to trial11845692-45 2026-02-17T05:31:06.490 INFO:tasks.rados.rados.0.trial118.stdout:722: finishing write tid 3 to trial11845692-45 2026-02-17T05:31:06.490 INFO:tasks.rados.rados.0.trial118.stdout:722: finishing write tid 4 to trial11845692-45 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:722: oid 45 updating version 0 to 341 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:722: oid 45 version 341 is already newer than 340 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:722: oid 45 updating version 341 to 342 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 342 (ObjNum 282 snap 70 seq_num 282) dirty exists 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:722: left oid 45 (ObjNum 282 snap 70 seq_num 282) 2026-02-17T05:31:06.491 INFO:tasks.rados.rados.0.trial118.stdout:724: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:06.540 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: finishing write tid 1 to trial11845692-21 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: finishing write tid 2 to trial11845692-21 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: finishing write tid 3 to trial11845692-21 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: finishing write tid 4 to trial11845692-21 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: oid 21 updating version 0 to 404 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: oid 21 updating version 404 to 406 2026-02-17T05:31:06.569 INFO:tasks.rados.rados.0.trial118.stdout:725: oid 21 version 406 is already newer than 405 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 406 (ObjNum 283 snap 70 seq_num 283) dirty exists 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:725: left oid 21 (ObjNum 283 snap 70 seq_num 283) 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: finishing write tid 1 to trial11845692-13 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: finishing write tid 2 to trial11845692-13 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: finishing write tid 3 to trial11845692-13 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: finishing write tid 4 to trial11845692-13 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: oid 13 updating version 0 to 222 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: oid 13 updating version 222 to 224 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: oid 13 version 224 is already newer than 223 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 224 (ObjNum 284 snap 70 seq_num 284) dirty exists 2026-02-17T05:31:06.570 INFO:tasks.rados.rados.0.trial118.stdout:727: left oid 13 (ObjNum 284 snap 70 seq_num 284) 2026-02-17T05:31:07.309 INFO:tasks.rados.rados.0.trial118.stdout:717: done (11 left) 2026-02-17T05:31:07.309 INFO:tasks.rados.rados.0.trial118.stdout:718: done (10 left) 2026-02-17T05:31:07.309 INFO:tasks.rados.rados.0.trial118.stdout:719: done (9 left) 2026-02-17T05:31:07.309 INFO:tasks.rados.rados.0.trial118.stdout:720: done (8 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:721: done (7 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:722: done (6 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:723: done (5 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:724: done (4 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:725: done (3 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:726: done (2 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:727: done (1 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:728: done (0 left) 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:729: write (excl) oid 47 current snap is 71 2026-02-17T05:31:07.310 INFO:tasks.rados.rados.0.trial118.stdout:729: seq_num 285 ranges {789995=551026,2027721=468420} 2026-02-17T05:31:07.314 INFO:tasks.rados.rados.0.trial118.stdout:729: writing trial11845692-47 from 789995 to 1341021 tid 1 2026-02-17T05:31:07.320 INFO:tasks.rados.rados.0.trial118.stdout:729: writing trial11845692-47 from 2027721 to 2496141 tid 2 2026-02-17T05:31:07.320 INFO:tasks.rados.rados.0.trial118.stdout:730: read oid 19 snap 69 2026-02-17T05:31:07.320 INFO:tasks.rados.rados.0.trial118.stdout:730: expect deleted 2026-02-17T05:31:07.320 INFO:tasks.rados.rados.0.trial118.stdout:731: delete oid 17 current snap is 71 2026-02-17T05:31:07.320 INFO:tasks.rados.rados.0.trial118.stdout:729: finishing write tid 1 to trial11845692-47 2026-02-17T05:31:07.321 INFO:tasks.rados.rados.0.trial118.stdout:730: done (2 left) 2026-02-17T05:31:07.321 INFO:tasks.rados.rados.0.trial118.stdout:731: done (1 left) 2026-02-17T05:31:07.321 INFO:tasks.rados.rados.0.trial118.stdout:732: snap_remove snap 69 2026-02-17T05:31:08.310 INFO:tasks.rados.rados.0.trial118.stdout:732: done (1 left) 2026-02-17T05:31:08.310 INFO:tasks.rados.rados.0.trial118.stdout:733: rollback oid 6 current snap is 71 2026-02-17T05:31:08.310 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 70 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: finishing write tid 2 to trial11845692-47 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: finishing write tid 3 to trial11845692-47 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: finishing write tid 4 to trial11845692-47 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: oid 47 updating version 0 to 368 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: oid 47 version 368 is already newer than 367 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: oid 47 version 368 is already newer than 366 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 368 (ObjNum 285 snap 71 seq_num 285) dirty exists 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: left oid 47 (ObjNum 285 snap 71 seq_num 285) 2026-02-17T05:31:08.311 INFO:tasks.rados.rados.0.trial118.stdout:729: done (1 left) 2026-02-17T05:31:08.312 INFO:tasks.rados.rados.0.trial118.stdout:734: snap_create 2026-02-17T05:31:08.312 INFO:tasks.rados.rados.0.trial118.stdout:733: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:31:08.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 0 (ObjNum 81 snap 0 seq_num 12933613) dirty dne 2026-02-17T05:31:09.313 INFO:tasks.rados.rados.0.trial118.stdout:733: done (1 left) 2026-02-17T05:31:09.313 INFO:tasks.rados.rados.0.trial118.stdout:734: done (0 left) 2026-02-17T05:31:09.313 INFO:tasks.rados.rados.0.trial118.stdout:735: write oid 27 current snap is 72 2026-02-17T05:31:09.313 INFO:tasks.rados.rados.0.trial118.stdout:735: seq_num 287 ranges {423609=701524,1628332=472089,2648987=174622} 2026-02-17T05:31:09.319 INFO:tasks.rados.rados.0.trial118.stdout:735: writing trial11845692-27 from 423609 to 1125133 tid 1 2026-02-17T05:31:09.322 INFO:tasks.rados.rados.0.trial118.stdout:735: writing trial11845692-27 from 1628332 to 2100421 tid 2 2026-02-17T05:31:09.325 INFO:tasks.rados.rados.0.trial118.stdout:735: writing trial11845692-27 from 2648987 to 2823609 tid 3 2026-02-17T05:31:09.325 INFO:tasks.rados.rados.0.trial118.stdout:736: rollback oid 33 current snap is 72 2026-02-17T05:31:09.325 INFO:tasks.rados.rados.0.trial118.stdout:735: finishing write tid 1 to trial11845692-27 2026-02-17T05:31:09.325 INFO:tasks.rados.rados.0.trial118.stdout:735: finishing write tid 2 to trial11845692-27 2026-02-17T05:31:09.326 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 70 2026-02-17T05:31:09.326 INFO:tasks.rados.rados.0.trial118.stdout:737: write oid 45 current snap is 72 2026-02-17T05:31:09.326 INFO:tasks.rados.rados.0.trial118.stdout:737: seq_num 288 ranges {440416=776773,1686814=732100} 2026-02-17T05:31:09.330 INFO:tasks.rados.rados.0.trial118.stdout:737: writing trial11845692-45 from 440416 to 1217189 tid 1 2026-02-17T05:31:09.334 INFO:tasks.rados.rados.0.trial118.stdout:737: writing trial11845692-45 from 1686814 to 2418914 tid 2 2026-02-17T05:31:09.334 INFO:tasks.rados.rados.0.trial118.stdout:738: delete oid 41 current snap is 72 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: finishing write tid 3 to trial11845692-27 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: finishing write tid 4 to trial11845692-27 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: finishing write tid 5 to trial11845692-27 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: oid 27 updating version 0 to 416 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: oid 27 version 416 is already newer than 413 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: oid 27 version 416 is already newer than 415 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: oid 27 version 416 is already newer than 414 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 416 (ObjNum 287 snap 72 seq_num 287) dirty exists 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:735: left oid 27 (ObjNum 287 snap 72 seq_num 287) 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:736: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:736: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:736: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 414 (ObjNum 249 snap 64 seq_num 249) dirty exists 2026-02-17T05:31:09.335 INFO:tasks.rados.rados.0.trial118.stdout:737: finishing write tid 1 to trial11845692-45 2026-02-17T05:31:09.336 INFO:tasks.rados.rados.0.trial118.stdout:737: finishing write tid 2 to trial11845692-45 2026-02-17T05:31:09.336 INFO:tasks.rados.rados.0.trial118.stdout:737: finishing write tid 3 to trial11845692-45 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: finishing write tid 4 to trial11845692-45 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: oid 45 updating version 0 to 345 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: oid 45 version 345 is already newer than 343 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: oid 45 version 345 is already newer than 344 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 345 (ObjNum 288 snap 72 seq_num 288) dirty exists 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: left oid 45 (ObjNum 288 snap 72 seq_num 288) 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:735: done (3 left) 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:736: done (2 left) 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:737: done (1 left) 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:738: done (0 left) 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:739: write oid 7 current snap is 72 2026-02-17T05:31:09.337 INFO:tasks.rados.rados.0.trial118.stdout:739: seq_num 290 ranges {474030=643624,1520131=735769} 2026-02-17T05:31:09.341 INFO:tasks.rados.rados.0.trial118.stdout:739: writing trial11845692-7 from 474030 to 1117654 tid 1 2026-02-17T05:31:09.345 INFO:tasks.rados.rados.0.trial118.stdout:739: writing trial11845692-7 from 1520131 to 2255900 tid 2 2026-02-17T05:31:09.345 INFO:tasks.rados.rados.0.trial118.stdout:740: delete oid 47 current snap is 72 2026-02-17T05:31:09.345 INFO:tasks.rados.rados.0.trial118.stdout:739: finishing write tid 1 to trial11845692-7 2026-02-17T05:31:09.346 INFO:tasks.rados.rados.0.trial118.stdout:740: done (1 left) 2026-02-17T05:31:09.346 INFO:tasks.rados.rados.0.trial118.stdout:741: snap_remove snap 71 2026-02-17T05:31:10.260 INFO:tasks.rados.rados.0.trial118.stdout:741: done (1 left) 2026-02-17T05:31:10.260 INFO:tasks.rados.rados.0.trial118.stdout:742: delete oid 10 current snap is 72 2026-02-17T05:31:10.260 INFO:tasks.rados.rados.0.trial118.stdout:739: finishing write tid 2 to trial11845692-7 2026-02-17T05:31:10.260 INFO:tasks.rados.rados.0.trial118.stdout:739: finishing write tid 3 to trial11845692-7 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:739: finishing write tid 4 to trial11845692-7 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:739: oid 7 updating version 0 to 415 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:739: oid 7 version 415 is already newer than 414 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:739: oid 7 version 415 is already newer than 413 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 415 (ObjNum 290 snap 72 seq_num 290) dirty exists 2026-02-17T05:31:10.261 INFO:tasks.rados.rados.0.trial118.stdout:739: left oid 7 (ObjNum 290 snap 72 seq_num 290) 2026-02-17T05:31:10.263 INFO:tasks.rados.rados.0.trial118.stdout:739: done (1 left) 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:742: done (0 left) 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:743: read oid 5 snap 67 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:743: expect deleted 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:744: rollback oid 18 current snap is 72 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 70 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:745: write (excl) oid 38 current snap is 72 2026-02-17T05:31:10.264 INFO:tasks.rados.rados.0.trial118.stdout:745: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2026-02-17T05:31:10.267 INFO:tasks.rados.rados.0.trial118.stdout:745: writing trial11845692-38 from 524451 to 993822 tid 1 2026-02-17T05:31:10.271 INFO:tasks.rados.rados.0.trial118.stdout:745: writing trial11845692-38 from 1579224 to 2062320 tid 2 2026-02-17T05:31:10.274 INFO:tasks.rados.rados.0.trial118.stdout:745: writing trial11845692-38 from 2529878 to 2924451 tid 3 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:746: snap_create 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:744: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:744: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:744: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 147 (ObjNum 183 snap 50 seq_num 183) dirty exists 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:745: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:10.275 INFO:tasks.rados.rados.0.trial118.stdout:745: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:10.276 INFO:tasks.rados.rados.0.trial118.stdout:745: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:10.276 INFO:tasks.rados.rados.0.trial118.stdout:745: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:10.276 INFO:tasks.rados.rados.0.trial118.stdout:745: finishing write tid 5 to trial11845692-38 2026-02-17T05:31:10.276 INFO:tasks.rados.rados.0.trial118.stdout:745: oid 38 updating version 0 to 377 2026-02-17T05:31:10.277 INFO:tasks.rados.rados.0.trial118.stdout:745: oid 38 updating version 377 to 378 2026-02-17T05:31:10.277 INFO:tasks.rados.rados.0.trial118.stdout:745: oid 38 updating version 378 to 379 2026-02-17T05:31:10.277 INFO:tasks.rados.rados.0.trial118.stdout:745: oid 38 version 379 is already newer than 376 2026-02-17T05:31:10.277 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 379 (ObjNum 293 snap 72 seq_num 293) dirty exists 2026-02-17T05:31:10.277 INFO:tasks.rados.rados.0.trial118.stdout:745: left oid 38 (ObjNum 293 snap 72 seq_num 293) 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:743: done (3 left) 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:744: done (2 left) 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:745: done (1 left) 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:746: done (0 left) 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:747: copy_from oid 48 from oid 21 current snap is 73 2026-02-17T05:31:11.262 INFO:tasks.rados.rados.0.trial118.stdout:748: snap_create 2026-02-17T05:31:11.269 INFO:tasks.rados.rados.0.trial118.stdout:747: finishing copy_from racing read to trial11845692-48 2026-02-17T05:31:11.273 INFO:tasks.rados.rados.0.trial118.stdout:747: finishing copy_from to trial11845692-48 2026-02-17T05:31:11.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 406 (ObjNum 283 snap 70 seq_num 283) dirty exists 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:747: done (1 left) 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:748: done (0 left) 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:749: read oid 2 snap -1 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:749: expect (ObjNum 266 snap 65 seq_num 266) 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:750: rollback oid 47 current snap is 74 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 72 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:751: write (excl) oid 12 current snap is 74 2026-02-17T05:31:12.263 INFO:tasks.rados.rados.0.trial118.stdout:751: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2026-02-17T05:31:12.267 INFO:tasks.rados.rados.0.trial118.stdout:751: writing trial11845692-12 from 541258 to 1085878 tid 1 2026-02-17T05:31:12.271 INFO:tasks.rados.rados.0.trial118.stdout:751: writing trial11845692-12 from 1637706 to 2264460 tid 2 2026-02-17T05:31:12.274 INFO:tasks.rados.rados.0.trial118.stdout:751: writing trial11845692-12 from 2840948 to 2941258 tid 3 2026-02-17T05:31:12.275 INFO:tasks.rados.rados.0.trial118.stdout:752: write oid 31 current snap is 74 2026-02-17T05:31:12.275 INFO:tasks.rados.rados.0.trial118.stdout:752: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2026-02-17T05:31:12.279 INFO:tasks.rados.rados.0.trial118.stdout:752: writing trial11845692-31 from 558065 to 1177934 tid 1 2026-02-17T05:31:12.282 INFO:tasks.rados.rados.0.trial118.stdout:752: writing trial11845692-31 from 1579835 to 2066600 tid 2 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:752: writing trial11845692-31 from 2468371 to 2958065 tid 3 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:753: read oid 13 snap 70 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:753: expect (ObjNum 284 snap 70 seq_num 284) 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:754: read oid 3 snap 72 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:754: expect (ObjNum 277 snap 67 seq_num 277) 2026-02-17T05:31:12.286 INFO:tasks.rados.rados.0.trial118.stdout:755: snap_remove snap 67 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:755: done (6 left) 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:756: delete oid 44 current snap is 74 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:750: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 372 (ObjNum 33 snap 0 seq_num 12855584) dirty dne 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:749: expect (ObjNum 266 snap 65 seq_num 266) 2026-02-17T05:31:13.265 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 337596 2026-02-17T05:31:13.290 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 19518 2026-02-17T05:31:13.324 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2055144 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: finishing write tid 1 to trial11845692-12 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: finishing write tid 2 to trial11845692-12 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: finishing write tid 3 to trial11845692-12 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: finishing write tid 4 to trial11845692-12 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: finishing write tid 5 to trial11845692-12 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: oid 12 updating version 0 to 258 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: oid 12 updating version 258 to 259 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: oid 12 version 259 is already newer than 257 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:751: oid 12 updating version 259 to 260 2026-02-17T05:31:13.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 260 (ObjNum 294 snap 74 seq_num 294) dirty exists 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:751: left oid 12 (ObjNum 294 snap 74 seq_num 294) 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: finishing write tid 1 to trial11845692-31 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: finishing write tid 2 to trial11845692-31 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: finishing write tid 3 to trial11845692-31 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: finishing write tid 4 to trial11845692-31 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: finishing write tid 5 to trial11845692-31 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: oid 31 updating version 0 to 420 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: oid 31 updating version 420 to 423 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: oid 31 version 423 is already newer than 422 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:752: oid 31 version 423 is already newer than 421 2026-02-17T05:31:13.336 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 423 (ObjNum 295 snap 74 seq_num 295) dirty exists 2026-02-17T05:31:13.337 INFO:tasks.rados.rados.0.trial118.stdout:752: left oid 31 (ObjNum 295 snap 74 seq_num 295) 2026-02-17T05:31:13.337 INFO:tasks.rados.rados.0.trial118.stdout:753: expect (ObjNum 284 snap 70 seq_num 284) 2026-02-17T05:31:13.408 INFO:tasks.rados.rados.0.trial118.stdout:754: expect (ObjNum 277 snap 67 seq_num 277) 2026-02-17T05:31:13.408 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:13.435 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2116688 2026-02-17T05:31:13.457 INFO:tasks.rados.rados.0.trial118.stdout:749: done (6 left) 2026-02-17T05:31:13.457 INFO:tasks.rados.rados.0.trial118.stdout:750: done (5 left) 2026-02-17T05:31:13.457 INFO:tasks.rados.rados.0.trial118.stdout:751: done (4 left) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:752: done (3 left) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:753: done (2 left) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:754: done (1 left) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:756: done (0 left) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:757: read oid 7 snap -1 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:757: expect (ObjNum 290 snap 72 seq_num 290) 2026-02-17T05:31:13.458 INFO:tasks.rados.rados.0.trial118.stdout:758: read oid 15 snap 72 2026-02-17T05:31:13.459 INFO:tasks.rados.rados.0.trial118.stdout:758: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:13.459 INFO:tasks.rados.rados.0.trial118.stdout:759: rollback oid 47 current snap is 74 2026-02-17T05:31:13.459 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 73 2026-02-17T05:31:13.459 INFO:tasks.rados.rados.0.trial118.stdout:760: snap_remove snap 70 2026-02-17T05:31:14.267 INFO:tasks.rados.rados.0.trial118.stdout:760: done (3 left) 2026-02-17T05:31:14.268 INFO:tasks.rados.rados.0.trial118.stdout:761: write oid 2 current snap is 74 2026-02-17T05:31:14.268 INFO:tasks.rados.rados.0.trial118.stdout:761: seq_num 297 ranges {591679=486720,1813152=490434} 2026-02-17T05:31:14.272 INFO:tasks.rados.rados.0.trial118.stdout:761: writing trial11845692-2 from 591679 to 1078399 tid 1 2026-02-17T05:31:14.277 INFO:tasks.rados.rados.0.trial118.stdout:761: writing trial11845692-2 from 1813152 to 2303586 tid 2 2026-02-17T05:31:14.277 INFO:tasks.rados.rados.0.trial118.stdout:762: delete oid 19 current snap is 74 2026-02-17T05:31:14.277 INFO:tasks.rados.rados.0.trial118.stdout:759: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:31:14.277 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 372 (ObjNum 33 snap 0 seq_num 5) dirty dne 2026-02-17T05:31:14.277 INFO:tasks.rados.rados.0.trial118.stdout:758: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:14.301 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:14.357 INFO:tasks.rados.rados.0.trial118.stdout:757: expect (ObjNum 290 snap 72 seq_num 290) 2026-02-17T05:31:14.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:14.398 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: finishing write tid 1 to trial11845692-2 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: finishing write tid 2 to trial11845692-2 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: finishing write tid 3 to trial11845692-2 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: finishing write tid 4 to trial11845692-2 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: oid 2 updating version 0 to 433 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: oid 2 updating version 433 to 434 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: oid 2 updating version 434 to 435 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 435 (ObjNum 297 snap 74 seq_num 297) dirty exists 2026-02-17T05:31:14.419 INFO:tasks.rados.rados.0.trial118.stdout:761: left oid 2 (ObjNum 297 snap 74 seq_num 297) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:757: done (4 left) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:758: done (3 left) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:759: done (2 left) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:761: done (1 left) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:762: done (0 left) 2026-02-17T05:31:14.420 INFO:tasks.rados.rados.0.trial118.stdout:763: snap_create 2026-02-17T05:31:15.268 INFO:tasks.rados.rados.0.trial118.stdout:763: done (0 left) 2026-02-17T05:31:15.268 INFO:tasks.rados.rados.0.trial118.stdout:764: read oid 41 snap -1 2026-02-17T05:31:15.268 INFO:tasks.rados.rados.0.trial118.stdout:764: expect deleted 2026-02-17T05:31:15.268 INFO:tasks.rados.rados.0.trial118.stdout:765: write oid 38 current snap is 75 2026-02-17T05:31:15.269 INFO:tasks.rados.rados.0.trial118.stdout:765: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2026-02-17T05:31:15.273 INFO:tasks.rados.rados.0.trial118.stdout:765: writing trial11845692-38 from 625293 to 1262511 tid 1 2026-02-17T05:31:15.277 INFO:tasks.rados.rados.0.trial118.stdout:765: writing trial11845692-38 from 1813763 to 2307866 tid 2 2026-02-17T05:31:15.280 INFO:tasks.rados.rados.0.trial118.stdout:765: writing trial11845692-38 from 2978063 to 3025293 tid 3 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:766: rollback oid 28 current snap is 75 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 73 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:765: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:765: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:764: done (2 left) 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:767: read oid 10 snap -1 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:767: expect deleted 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:768: read oid 12 snap -1 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:768: expect (ObjNum 294 snap 74 seq_num 294) 2026-02-17T05:31:15.281 INFO:tasks.rados.rados.0.trial118.stdout:769: read oid 29 snap 74 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:769: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:770: rollback oid 24 current snap is 75 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 72 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:771: copy_from oid 17 from oid 30 current snap is 75 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:772: read oid 3 snap -1 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:772: expect (ObjNum 277 snap 67 seq_num 277) 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:773: write (excl) oid 33 current snap is 75 2026-02-17T05:31:15.282 INFO:tasks.rados.rados.0.trial118.stdout:773: seq_num 300 ranges {642100=712467,1872245=637761} 2026-02-17T05:31:15.285 INFO:tasks.rados.rados.0.trial118.stdout:773: writing trial11845692-33 from 642100 to 1354567 tid 1 2026-02-17T05:31:15.290 INFO:tasks.rados.rados.0.trial118.stdout:773: writing trial11845692-33 from 1872245 to 2510006 tid 2 2026-02-17T05:31:15.290 INFO:tasks.rados.rados.0.trial118.stdout:774: copy_from oid 25 from oid 20 current snap is 75 2026-02-17T05:31:15.290 INFO:tasks.rados.rados.0.trial118.stdout:766: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:31:15.290 INFO:tasks.rados.rados.0.trial118.stdout:770: finishing rollback tid 0 to trial11845692-24 2026-02-17T05:31:15.290 INFO:tasks.rados.rados.0.trial118.stdout:770: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:766: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:766: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 155 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:770: finishing rollback tid 2 to trial11845692-24 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 113 (ObjNum 242 snap 61 seq_num 242) dirty exists 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:765: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:766: done (9 left) 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:767: done (8 left) 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:770: done (7 left) 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:775: write oid 1 current snap is 75 2026-02-17T05:31:15.291 INFO:tasks.rados.rados.0.trial118.stdout:775: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2026-02-17T05:31:15.295 INFO:tasks.rados.rados.0.trial118.stdout:775: writing trial11845692-1 from 658907 to 1446623 tid 1 2026-02-17T05:31:15.299 INFO:tasks.rados.rados.0.trial118.stdout:775: writing trial11845692-1 from 1930727 to 2428499 tid 2 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:775: writing trial11845692-1 from 3032909 to 3058907 tid 3 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:776: rollback oid 40 current snap is 75 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 74 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:765: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:765: finishing write tid 5 to trial11845692-38 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:765: oid 38 updating version 0 to 391 2026-02-17T05:31:15.302 INFO:tasks.rados.rados.0.trial118.stdout:765: oid 38 updating version 391 to 393 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:765: oid 38 updating version 393 to 394 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:765: oid 38 version 394 is already newer than 392 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 394 (ObjNum 299 snap 75 seq_num 299) dirty exists 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:765: left oid 38 (ObjNum 299 snap 75 seq_num 299) 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:772: expect (ObjNum 277 snap 67 seq_num 277) 2026-02-17T05:31:15.303 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 443630 2026-02-17T05:31:15.319 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:15.357 INFO:tasks.rados.rados.0.trial118.stdout:769: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:15.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:15.376 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:15.413 INFO:tasks.rados.rados.0.trial118.stdout:768: expect (ObjNum 294 snap 74 seq_num 294) 2026-02-17T05:31:15.414 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:771: finishing copy_from racing read to trial11845692-17 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:771: finishing copy_from to trial11845692-17 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 382 (ObjNum 260 snap 64 seq_num 260) dirty exists 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:773: finishing write tid 1 to trial11845692-33 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:773: finishing write tid 2 to trial11845692-33 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:765: done (8 left) 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:768: done (7 left) 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:769: done (6 left) 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:771: done (5 left) 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:772: done (4 left) 2026-02-17T05:31:15.469 INFO:tasks.rados.rados.0.trial118.stdout:777: write (excl) oid 29 current snap is 75 2026-02-17T05:31:15.470 INFO:tasks.rados.rados.0.trial118.stdout:777: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2026-02-17T05:31:15.473 INFO:tasks.rados.rados.0.trial118.stdout:777: writing trial11845692-29 from 675714 to 1138679 tid 1 2026-02-17T05:31:15.477 INFO:tasks.rados.rados.0.trial118.stdout:777: writing trial11845692-29 from 1589209 to 2230639 tid 2 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:777: writing trial11845692-29 from 2943979 to 3075714 tid 3 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:778: copy_from oid 42 from oid 35 current snap is 75 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: finishing write tid 3 to trial11845692-33 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: finishing write tid 4 to trial11845692-33 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: oid 33 updating version 0 to 428 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: oid 33 version 428 is already newer than 426 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: oid 33 version 428 is already newer than 427 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 428 (ObjNum 300 snap 75 seq_num 300) dirty exists 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: left oid 33 (ObjNum 300 snap 75 seq_num 300) 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:774: finishing copy_from racing read to trial11845692-25 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:774: finishing copy_from to trial11845692-25 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 401 (ObjNum 243 snap 61 seq_num 243) dirty exists 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:775: finishing write tid 1 to trial11845692-1 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:775: finishing write tid 2 to trial11845692-1 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:775: finishing write tid 3 to trial11845692-1 2026-02-17T05:31:15.481 INFO:tasks.rados.rados.0.trial118.stdout:773: done (5 left) 2026-02-17T05:31:15.482 INFO:tasks.rados.rados.0.trial118.stdout:774: done (4 left) 2026-02-17T05:31:15.482 INFO:tasks.rados.rados.0.trial118.stdout:779: write (excl) oid 25 current snap is 75 2026-02-17T05:31:15.482 INFO:tasks.rados.rados.0.trial118.stdout:779: seq_num 303 ranges {692521=538214,1931338=785088} 2026-02-17T05:31:15.485 INFO:tasks.rados.rados.0.trial118.stdout:779: writing trial11845692-25 from 692521 to 1230735 tid 1 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:779: writing trial11845692-25 from 1931338 to 2716426 tid 2 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:780: delete oid 38 current snap is 75 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: finishing write tid 4 to trial11845692-1 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: finishing write tid 5 to trial11845692-1 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: oid 1 updating version 0 to 434 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: oid 1 version 434 is already newer than 433 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: oid 1 version 434 is already newer than 432 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: oid 1 version 434 is already newer than 431 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 434 (ObjNum 301 snap 75 seq_num 301) dirty exists 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:775: left oid 1 (ObjNum 301 snap 75 seq_num 301) 2026-02-17T05:31:15.491 INFO:tasks.rados.rados.0.trial118.stdout:776: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:776: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:776: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 438 (ObjNum 201 snap 54 seq_num 201) dirty exists 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: finishing write tid 1 to trial11845692-29 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: finishing write tid 2 to trial11845692-29 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: finishing write tid 3 to trial11845692-29 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: finishing write tid 4 to trial11845692-29 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: finishing write tid 5 to trial11845692-29 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: oid 29 updating version 0 to 426 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: oid 29 version 426 is already newer than 425 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: oid 29 version 426 is already newer than 424 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: oid 29 version 426 is already newer than 423 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 426 (ObjNum 302 snap 75 seq_num 302) dirty exists 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:777: left oid 29 (ObjNum 302 snap 75 seq_num 302) 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:779: finishing write tid 1 to trial11845692-25 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:778: finishing copy_from racing read to trial11845692-42 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:778: finishing copy_from to trial11845692-42 2026-02-17T05:31:15.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 103 (ObjNum 261 snap 64 seq_num 261) dirty exists 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:775: done (5 left) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:776: done (4 left) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:777: done (3 left) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:778: done (2 left) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:780: done (1 left) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:781: read oid 6 snap 72 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:781: expect deleted 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:782: delete oid 45 current snap is 75 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: finishing write tid 2 to trial11845692-25 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: finishing write tid 3 to trial11845692-25 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: finishing write tid 4 to trial11845692-25 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: oid 25 updating version 0 to 440 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: oid 25 version 440 is already newer than 439 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: oid 25 updating version 440 to 441 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 441 (ObjNum 303 snap 75 seq_num 303) dirty exists 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: left oid 25 (ObjNum 303 snap 75 seq_num 303) 2026-02-17T05:31:15.493 INFO:tasks.rados.rados.0.trial118.stdout:779: done (2 left) 2026-02-17T05:31:15.494 INFO:tasks.rados.rados.0.trial118.stdout:781: done (1 left) 2026-02-17T05:31:15.494 INFO:tasks.rados.rados.0.trial118.stdout:782: done (0 left) 2026-02-17T05:31:15.494 INFO:tasks.rados.rados.0.trial118.stdout:783: delete oid 37 current snap is 75 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:783: done (0 left) 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:784: rollback oid 31 current snap is 75 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 74 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:785: read oid 18 snap -1 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:785: expect (ObjNum 183 snap 50 seq_num 183) 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:786: write (excl) oid 2 current snap is 75 2026-02-17T05:31:15.495 INFO:tasks.rados.rados.0.trial118.stdout:786: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2026-02-17T05:31:15.499 INFO:tasks.rados.rados.0.trial118.stdout:786: writing trial11845692-2 from 759749 to 1315312 tid 1 2026-02-17T05:31:15.504 INFO:tasks.rados.rados.0.trial118.stdout:786: writing trial11845692-2 from 1765266 to 2557692 tid 2 2026-02-17T05:31:15.507 INFO:tasks.rados.rados.0.trial118.stdout:786: writing trial11845692-2 from 2964741 to 3159749 tid 3 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:787: copy_from oid 22 from oid 38 current snap is 75 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:784: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:784: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:784: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 439 (ObjNum 295 snap 74 seq_num 295) dirty exists 2026-02-17T05:31:15.508 INFO:tasks.rados.rados.0.trial118.stdout:785: expect (ObjNum 183 snap 50 seq_num 183) 2026-02-17T05:31:15.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1077501 2026-02-17T05:31:15.538 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:15.560 INFO:tasks.rados.rados.0.trial118.stdout:786: finishing write tid 1 to trial11845692-2 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: finishing write tid 2 to trial11845692-2 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:787: finishing copy_from to trial11845692-22 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:787: got expected ENOENT (src dne) 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:787: finishing copy_from racing read to trial11845692-22 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: finishing write tid 3 to trial11845692-2 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: finishing write tid 4 to trial11845692-2 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: finishing write tid 5 to trial11845692-2 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: oid 2 updating version 0 to 444 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: oid 2 version 444 is already newer than 442 2026-02-17T05:31:15.561 INFO:tasks.rados.rados.0.trial118.stdout:786: oid 2 version 444 is already newer than 443 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:786: oid 2 version 444 is already newer than 441 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 444 (ObjNum 307 snap 75 seq_num 307) dirty exists 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:786: left oid 2 (ObjNum 307 snap 75 seq_num 307) 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:784: done (3 left) 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:785: done (2 left) 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:786: done (1 left) 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:787: done (0 left) 2026-02-17T05:31:15.562 INFO:tasks.rados.rados.0.trial118.stdout:788: snap_create 2026-02-17T05:31:16.274 INFO:tasks.rados.rados.0.trial118.stdout:788: done (0 left) 2026-02-17T05:31:16.274 INFO:tasks.rados.rados.0.trial118.stdout:789: write (excl) oid 14 current snap is 76 2026-02-17T05:31:16.275 INFO:tasks.rados.rados.0.trial118.stdout:789: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-17T05:31:16.280 INFO:tasks.rados.rados.0.trial118.stdout:789: writing trial11845692-14 from 776556 to 1407368 tid 1 2026-02-17T05:31:16.284 INFO:tasks.rados.rados.0.trial118.stdout:789: writing trial11845692-14 from 1823748 to 2476185 tid 2 2026-02-17T05:31:16.287 INFO:tasks.rados.rados.0.trial118.stdout:789: writing trial11845692-14 from 3108517 to 3176556 tid 3 2026-02-17T05:31:16.288 INFO:tasks.rados.rados.0.trial118.stdout:790: delete oid 36 current snap is 76 2026-02-17T05:31:16.288 INFO:tasks.rados.rados.0.trial118.stdout:789: finishing write tid 1 to trial11845692-14 2026-02-17T05:31:16.288 INFO:tasks.rados.rados.0.trial118.stdout:789: finishing write tid 2 to trial11845692-14 2026-02-17T05:31:16.288 INFO:tasks.rados.rados.0.trial118.stdout:789: finishing write tid 3 to trial11845692-14 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: finishing write tid 4 to trial11845692-14 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: finishing write tid 5 to trial11845692-14 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: oid 14 updating version 0 to 104 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: oid 14 updating version 104 to 105 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: oid 14 updating version 105 to 106 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: oid 14 version 106 is already newer than 103 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 106 (ObjNum 308 snap 76 seq_num 308) dirty exists 2026-02-17T05:31:16.289 INFO:tasks.rados.rados.0.trial118.stdout:789: left oid 14 (ObjNum 308 snap 76 seq_num 308) 2026-02-17T05:31:16.290 INFO:tasks.rados.rados.0.trial118.stdout:789: done (1 left) 2026-02-17T05:31:16.290 INFO:tasks.rados.rados.0.trial118.stdout:790: done (0 left) 2026-02-17T05:31:16.290 INFO:tasks.rados.rados.0.trial118.stdout:791: delete oid 47 current snap is 76 2026-02-17T05:31:16.291 INFO:tasks.rados.rados.0.trial118.stdout:791: done (0 left) 2026-02-17T05:31:16.291 INFO:tasks.rados.rados.0.trial118.stdout:792: snap_create 2026-02-17T05:31:17.276 INFO:tasks.rados.rados.0.trial118.stdout:792: done (0 left) 2026-02-17T05:31:17.276 INFO:tasks.rados.rados.0.trial118.stdout:793: write oid 11 current snap is 77 2026-02-17T05:31:17.276 INFO:tasks.rados.rados.0.trial118.stdout:793: seq_num 311 ranges {426977=456559,1482841=799764,2958080=268897} 2026-02-17T05:31:17.279 INFO:tasks.rados.rados.0.trial118.stdout:793: writing trial11845692-11 from 426977 to 883536 tid 1 2026-02-17T05:31:17.284 INFO:tasks.rados.rados.0.trial118.stdout:793: writing trial11845692-11 from 1482841 to 2282605 tid 2 2026-02-17T05:31:17.288 INFO:tasks.rados.rados.0.trial118.stdout:793: writing trial11845692-11 from 2958080 to 3226977 tid 3 2026-02-17T05:31:17.289 INFO:tasks.rados.rados.0.trial118.stdout:794: rollback oid 46 current snap is 77 2026-02-17T05:31:17.289 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 76 2026-02-17T05:31:17.289 INFO:tasks.rados.rados.0.trial118.stdout:793: finishing write tid 1 to trial11845692-11 2026-02-17T05:31:17.289 INFO:tasks.rados.rados.0.trial118.stdout:793: finishing write tid 2 to trial11845692-11 2026-02-17T05:31:17.289 INFO:tasks.rados.rados.0.trial118.stdout:795: snap_remove snap 75 2026-02-17T05:31:18.280 INFO:tasks.rados.rados.0.trial118.stdout:795: done (2 left) 2026-02-17T05:31:18.280 INFO:tasks.rados.rados.0.trial118.stdout:796: read oid 41 snap -1 2026-02-17T05:31:18.280 INFO:tasks.rados.rados.0.trial118.stdout:796: expect deleted 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: finishing write tid 3 to trial11845692-11 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: finishing write tid 4 to trial11845692-11 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:797: read oid 23 snap -1 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:797: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:798: delete oid 35 current snap is 77 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: finishing write tid 5 to trial11845692-11 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: oid 11 updating version 0 to 447 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: oid 11 version 447 is already newer than 446 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: oid 11 version 447 is already newer than 445 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: oid 11 updating version 447 to 448 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 448 (ObjNum 311 snap 77 seq_num 311) dirty exists 2026-02-17T05:31:18.281 INFO:tasks.rados.rados.0.trial118.stdout:793: left oid 11 (ObjNum 311 snap 77 seq_num 311) 2026-02-17T05:31:18.282 INFO:tasks.rados.rados.0.trial118.stdout:794: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:31:18.282 INFO:tasks.rados.rados.0.trial118.stdout:794: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:31:18.282 INFO:tasks.rados.rados.0.trial118.stdout:794: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:31:18.282 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 385 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:793: done (4 left) 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:794: done (3 left) 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:796: done (2 left) 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:798: done (1 left) 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:799: read oid 5 snap -1 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:799: expect deleted 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:800: read oid 22 snap -1 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:800: expect (ObjNum 245 snap 62 seq_num 245) 2026-02-17T05:31:18.283 INFO:tasks.rados.rados.0.trial118.stdout:801: snap_create 2026-02-17T05:31:18.287 INFO:tasks.rados.rados.0.trial118.stdout:797: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:18.287 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 219453 2026-02-17T05:31:18.333 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2625560 2026-02-17T05:31:18.334 INFO:tasks.rados.rados.0.trial118.stdout:800: expect (ObjNum 245 snap 62 seq_num 245) 2026-02-17T05:31:18.340 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1126491 2026-02-17T05:31:19.280 INFO:tasks.rados.rados.0.trial118.stdout:797: done (3 left) 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:799: done (2 left) 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:800: done (1 left) 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:801: done (0 left) 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:802: read oid 40 snap -1 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:802: expect (ObjNum 201 snap 54 seq_num 201) 2026-02-17T05:31:19.281 INFO:tasks.rados.rados.0.trial118.stdout:803: snap_remove snap 76 2026-02-17T05:31:20.261 INFO:tasks.rados.rados.0.trial118.stdout:803: done (1 left) 2026-02-17T05:31:20.261 INFO:tasks.rados.rados.0.trial118.stdout:804: snap_remove snap 72 2026-02-17T05:31:21.264 INFO:tasks.rados.rados.0.trial118.stdout:804: done (1 left) 2026-02-17T05:31:21.264 INFO:tasks.rados.rados.0.trial118.stdout:805: write oid 49 current snap is 78 2026-02-17T05:31:21.265 INFO:tasks.rados.rados.0.trial118.stdout:805: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2026-02-17T05:31:21.269 INFO:tasks.rados.rados.0.trial118.stdout:805: writing trial11845692-49 from 460591 to 1184001 tid 1 2026-02-17T05:31:21.273 INFO:tasks.rados.rados.0.trial118.stdout:805: writing trial11845692-49 from 1716158 to 2119591 tid 2 2026-02-17T05:31:21.277 INFO:tasks.rados.rados.0.trial118.stdout:805: writing trial11845692-49 from 2729279 to 3169419 tid 3 2026-02-17T05:31:21.277 INFO:tasks.rados.rados.0.trial118.stdout:806: copy_from oid 30 from oid 10 current snap is 78 2026-02-17T05:31:21.277 INFO:tasks.rados.rados.0.trial118.stdout:802: expect (ObjNum 201 snap 54 seq_num 201) 2026-02-17T05:31:21.279 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 629379 2026-02-17T05:31:21.340 INFO:tasks.rados.rados.0.trial118.stdout:805: finishing write tid 1 to trial11845692-49 2026-02-17T05:31:21.340 INFO:tasks.rados.rados.0.trial118.stdout:802: done (2 left) 2026-02-17T05:31:21.340 INFO:tasks.rados.rados.0.trial118.stdout:807: write (excl) oid 38 current snap is 78 2026-02-17T05:31:21.341 INFO:tasks.rados.rados.0.trial118.stdout:807: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-17T05:31:21.345 INFO:tasks.rados.rados.0.trial118.stdout:807: writing trial11845692-38 from 477398 to 1276057 tid 1 2026-02-17T05:31:21.349 INFO:tasks.rados.rados.0.trial118.stdout:807: writing trial11845692-38 from 1774640 to 2438084 tid 2 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:807: writing trial11845692-38 from 2873055 to 3277398 tid 3 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:808: rollback oid 9 current snap is 78 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 73 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:805: finishing write tid 2 to trial11845692-49 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:806: finishing copy_from to trial11845692-30 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:806: got expected ENOENT (src dne) 2026-02-17T05:31:21.354 INFO:tasks.rados.rados.0.trial118.stdout:806: finishing copy_from racing read to trial11845692-30 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: finishing write tid 3 to trial11845692-49 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: finishing write tid 4 to trial11845692-49 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: finishing write tid 5 to trial11845692-49 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: oid 49 updating version 0 to 321 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: oid 49 version 321 is already newer than 320 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: oid 49 version 321 is already newer than 318 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: oid 49 version 321 is already newer than 319 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 321 (ObjNum 313 snap 78 seq_num 313) dirty exists 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: left oid 49 (ObjNum 313 snap 78 seq_num 313) 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:807: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:807: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:21.355 INFO:tasks.rados.rados.0.trial118.stdout:805: done (3 left) 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:806: done (2 left) 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:809: read oid 11 snap -1 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:809: expect (ObjNum 311 snap 77 seq_num 311) 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:810: rollback oid 45 current snap is 78 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 77 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:811: write (excl) oid 47 current snap is 78 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:811: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2026-02-17T05:31:21.356 INFO:tasks.rados.rados.0.trial118.stdout:811: writing trial11845692-47 from 494205 to 968113 tid 1 2026-02-17T05:31:21.360 INFO:tasks.rados.rados.0.trial118.stdout:811: writing trial11845692-47 from 1433122 to 1840224 tid 2 2026-02-17T05:31:21.364 INFO:tasks.rados.rados.0.trial118.stdout:811: writing trial11845692-47 from 2384125 to 2846809 tid 3 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:812: copy_from oid 27 from oid 48 current snap is 78 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:810: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 407 (ObjNum 129 snap 0 seq_num 12779216) dirty dne 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:808: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 0 (ObjNum 33 snap 0 seq_num 13238272) dirty dne 2026-02-17T05:31:21.365 INFO:tasks.rados.rados.0.trial118.stdout:807: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: finishing write tid 5 to trial11845692-38 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: oid 38 updating version 0 to 404 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: oid 38 updating version 404 to 406 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: oid 38 version 406 is already newer than 405 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:807: oid 38 version 406 is already newer than 403 2026-02-17T05:31:21.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 406 (ObjNum 314 snap 78 seq_num 314) dirty exists 2026-02-17T05:31:21.367 INFO:tasks.rados.rados.0.trial118.stdout:807: left oid 38 (ObjNum 314 snap 78 seq_num 314) 2026-02-17T05:31:21.367 INFO:tasks.rados.rados.0.trial118.stdout:809: expect (ObjNum 311 snap 77 seq_num 311) 2026-02-17T05:31:21.370 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1499863 2026-02-17T05:31:21.416 INFO:tasks.rados.rados.0.trial118.stdout:811: finishing write tid 1 to trial11845692-47 2026-02-17T05:31:21.417 INFO:tasks.rados.rados.0.trial118.stdout:811: finishing write tid 2 to trial11845692-47 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: finishing write tid 3 to trial11845692-47 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:807: done (5 left) 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:808: done (4 left) 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:809: done (3 left) 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:810: done (2 left) 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:813: delete oid 2 current snap is 78 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: finishing write tid 4 to trial11845692-47 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: finishing write tid 5 to trial11845692-47 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: oid 47 updating version 0 to 408 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: oid 47 updating version 408 to 409 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: oid 47 updating version 409 to 410 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: oid 47 version 410 is already newer than 407 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 410 (ObjNum 315 snap 78 seq_num 315) dirty exists 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:811: left oid 47 (ObjNum 315 snap 78 seq_num 315) 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:812: finishing copy_from racing read to trial11845692-27 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:812: finishing copy_from to trial11845692-27 2026-02-17T05:31:21.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 406 (ObjNum 283 snap 70 seq_num 283) dirty exists 2026-02-17T05:31:21.419 INFO:tasks.rados.rados.0.trial118.stdout:811: done (2 left) 2026-02-17T05:31:21.419 INFO:tasks.rados.rados.0.trial118.stdout:812: done (1 left) 2026-02-17T05:31:21.419 INFO:tasks.rados.rados.0.trial118.stdout:813: done (0 left) 2026-02-17T05:31:21.419 INFO:tasks.rados.rados.0.trial118.stdout:814: write oid 14 current snap is 78 2026-02-17T05:31:21.419 INFO:tasks.rados.rados.0.trial118.stdout:814: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2026-02-17T05:31:21.422 INFO:tasks.rados.rados.0.trial118.stdout:814: writing trial11845692-14 from 527819 to 1152225 tid 1 2026-02-17T05:31:21.426 INFO:tasks.rados.rados.0.trial118.stdout:814: writing trial11845692-14 from 1833733 to 2244504 tid 2 2026-02-17T05:31:21.430 INFO:tasks.rados.rados.0.trial118.stdout:814: writing trial11845692-14 from 2722618 to 3324199 tid 3 2026-02-17T05:31:21.430 INFO:tasks.rados.rados.0.trial118.stdout:815: write (excl) oid 22 current snap is 78 2026-02-17T05:31:21.430 INFO:tasks.rados.rados.0.trial118.stdout:815: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2026-02-17T05:31:21.435 INFO:tasks.rados.rados.0.trial118.stdout:815: writing trial11845692-22 from 544626 to 1244281 tid 1 2026-02-17T05:31:21.439 INFO:tasks.rados.rados.0.trial118.stdout:815: writing trial11845692-22 from 1892215 to 2446644 tid 2 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:815: writing trial11845692-22 from 3150041 to 3344626 tid 3 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:816: copy_from oid 15 from oid 16 current snap is 78 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:814: finishing write tid 1 to trial11845692-14 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:814: finishing write tid 2 to trial11845692-14 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:814: finishing write tid 3 to trial11845692-14 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:817: write oid 35 current snap is 78 2026-02-17T05:31:21.443 INFO:tasks.rados.rados.0.trial118.stdout:817: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2026-02-17T05:31:21.447 INFO:tasks.rados.rados.0.trial118.stdout:817: writing trial11845692-35 from 561433 to 1336337 tid 1 2026-02-17T05:31:21.451 INFO:tasks.rados.rados.0.trial118.stdout:817: writing trial11845692-35 from 1950697 to 2365137 tid 2 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:817: writing trial11845692-35 from 2777464 to 3361433 tid 3 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:818: read oid 28 snap -1 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:818: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:819: copy_from oid 45 from oid 25 current snap is 78 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: finishing write tid 4 to trial11845692-14 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:820: rollback oid 3 current snap is 78 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 77 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: finishing write tid 5 to trial11845692-14 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: oid 14 updating version 0 to 114 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: oid 14 updating version 114 to 115 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: oid 14 version 115 is already newer than 112 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: oid 14 version 115 is already newer than 113 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 115 (ObjNum 317 snap 78 seq_num 317) dirty exists 2026-02-17T05:31:21.456 INFO:tasks.rados.rados.0.trial118.stdout:814: left oid 14 (ObjNum 317 snap 78 seq_num 317) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: finishing write tid 1 to trial11845692-22 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: finishing write tid 2 to trial11845692-22 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: finishing write tid 3 to trial11845692-22 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: finishing write tid 4 to trial11845692-22 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: finishing write tid 5 to trial11845692-22 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: oid 22 updating version 0 to 412 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: oid 22 version 412 is already newer than 411 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: oid 22 version 412 is already newer than 410 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: oid 22 version 412 is already newer than 409 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 412 (ObjNum 318 snap 78 seq_num 318) dirty exists 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: left oid 22 (ObjNum 318 snap 78 seq_num 318) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:816: finishing copy_from to trial11845692-15 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:816: got expected ENOENT (src dne) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:816: finishing copy_from racing read to trial11845692-15 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:817: finishing write tid 1 to trial11845692-35 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:817: finishing write tid 2 to trial11845692-35 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:814: done (6 left) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:815: done (5 left) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:816: done (4 left) 2026-02-17T05:31:21.457 INFO:tasks.rados.rados.0.trial118.stdout:821: delete oid 34 current snap is 78 2026-02-17T05:31:21.458 INFO:tasks.rados.rados.0.trial118.stdout:817: finishing write tid 3 to trial11845692-35 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: finishing write tid 4 to trial11845692-35 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: finishing write tid 5 to trial11845692-35 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: oid 35 updating version 0 to 125 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: oid 35 version 125 is already newer than 124 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: oid 35 updating version 125 to 127 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: oid 35 version 127 is already newer than 126 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 127 (ObjNum 319 snap 78 seq_num 319) dirty exists 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:817: left oid 35 (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:820: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:31:21.459 INFO:tasks.rados.rados.0.trial118.stdout:820: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:31:21.460 INFO:tasks.rados.rados.0.trial118.stdout:820: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:31:21.460 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 233 (ObjNum 277 snap 67 seq_num 277) dirty exists 2026-02-17T05:31:21.460 INFO:tasks.rados.rados.0.trial118.stdout:818: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:21.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:21.479 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1433574 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:819: finishing copy_from racing read to trial11845692-45 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:817: done (4 left) 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:818: done (3 left) 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:820: done (2 left) 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:821: done (1 left) 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:822: read oid 47 snap -1 2026-02-17T05:31:21.508 INFO:tasks.rados.rados.0.trial118.stdout:822: expect (ObjNum 315 snap 78 seq_num 315) 2026-02-17T05:31:21.509 INFO:tasks.rados.rados.0.trial118.stdout:823: write oid 33 current snap is 78 2026-02-17T05:31:21.509 INFO:tasks.rados.rados.0.trial118.stdout:823: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-17T05:31:21.512 INFO:tasks.rados.rados.0.trial118.stdout:823: writing trial11845692-33 from 595047 to 1236802 tid 1 2026-02-17T05:31:21.515 INFO:tasks.rados.rados.0.trial118.stdout:823: writing trial11845692-33 from 1667661 to 2085770 tid 2 2026-02-17T05:31:21.520 INFO:tasks.rados.rados.0.trial118.stdout:823: writing trial11845692-33 from 2548663 to 3311685 tid 3 2026-02-17T05:31:21.520 INFO:tasks.rados.rados.0.trial118.stdout:824: snap_remove snap 77 2026-02-17T05:31:22.288 INFO:tasks.rados.rados.0.trial118.stdout:824: done (3 left) 2026-02-17T05:31:22.289 INFO:tasks.rados.rados.0.trial118.stdout:825: delete oid 21 current snap is 78 2026-02-17T05:31:22.289 INFO:tasks.rados.rados.0.trial118.stdout:819: finishing copy_from to trial11845692-45 2026-02-17T05:31:22.289 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 441 (ObjNum 303 snap 75 seq_num 303) dirty exists 2026-02-17T05:31:22.289 INFO:tasks.rados.rados.0.trial118.stdout:822: expect (ObjNum 315 snap 78 seq_num 315) 2026-02-17T05:31:22.347 INFO:tasks.rados.rados.0.trial118.stdout:823: finishing write tid 1 to trial11845692-33 2026-02-17T05:31:22.347 INFO:tasks.rados.rados.0.trial118.stdout:823: finishing write tid 2 to trial11845692-33 2026-02-17T05:31:22.347 INFO:tasks.rados.rados.0.trial118.stdout:823: finishing write tid 3 to trial11845692-33 2026-02-17T05:31:22.347 INFO:tasks.rados.rados.0.trial118.stdout:819: done (3 left) 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:822: done (2 left) 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:825: done (1 left) 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:826: delete oid 4 current snap is 78 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: finishing write tid 4 to trial11845692-33 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: finishing write tid 5 to trial11845692-33 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: oid 33 updating version 0 to 451 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: oid 33 version 451 is already newer than 450 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: oid 33 updating version 451 to 452 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: oid 33 version 452 is already newer than 449 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 452 (ObjNum 321 snap 78 seq_num 321) dirty exists 2026-02-17T05:31:22.348 INFO:tasks.rados.rados.0.trial118.stdout:823: left oid 33 (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:823: done (1 left) 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:826: done (0 left) 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:827: read oid 50 snap -1 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:827: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:828: write oid 32 current snap is 78 2026-02-17T05:31:22.349 INFO:tasks.rados.rados.0.trial118.stdout:828: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2026-02-17T05:31:22.353 INFO:tasks.rados.rados.0.trial118.stdout:828: writing trial11845692-32 from 645468 to 1112970 tid 1 2026-02-17T05:31:22.357 INFO:tasks.rados.rados.0.trial118.stdout:828: writing trial11845692-32 from 1726754 to 2292190 tid 2 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:828: writing trial11845692-32 from 2798226 to 3395064 tid 3 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:829: read oid 31 snap 73 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:829: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:830: copy_from oid 42 from oid 30 current snap is 78 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:827: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:31:22.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:22.424 INFO:tasks.rados.rados.0.trial118.stdout:828: finishing write tid 1 to trial11845692-32 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:827: done (3 left) 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:831: snap_create 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: finishing write tid 2 to trial11845692-32 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: finishing write tid 3 to trial11845692-32 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: finishing write tid 4 to trial11845692-32 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: finishing write tid 5 to trial11845692-32 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: oid 32 updating version 0 to 325 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: oid 32 version 325 is already newer than 324 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: oid 32 version 325 is already newer than 323 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: oid 32 version 325 is already newer than 322 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 325 (ObjNum 324 snap 78 seq_num 324) dirty exists 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:828: left oid 32 (ObjNum 324 snap 78 seq_num 324) 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:829: expect (ObjNum 164 snap 41 seq_num 164) 2026-02-17T05:31:22.425 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:22.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1466546 2026-02-17T05:31:22.476 INFO:tasks.rados.rados.0.trial118.stdout:830: finishing copy_from racing read to trial11845692-42 2026-02-17T05:31:22.476 INFO:tasks.rados.rados.0.trial118.stdout:830: finishing copy_from to trial11845692-42 2026-02-17T05:31:22.476 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 382 (ObjNum 260 snap 64 seq_num 260) dirty exists 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:828: done (3 left) 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:829: done (2 left) 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:830: done (1 left) 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:831: done (0 left) 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:832: rollback oid 3 current snap is 79 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 73 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:833: read oid 20 snap -1 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:833: expect (ObjNum 243 snap 61 seq_num 243) 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:834: read oid 2 snap -1 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:834: expect deleted 2026-02-17T05:31:23.291 INFO:tasks.rados.rados.0.trial118.stdout:835: snap_create 2026-02-17T05:31:23.294 INFO:tasks.rados.rados.0.trial118.stdout:832: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:31:23.294 INFO:tasks.rados.rados.0.trial118.stdout:832: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:31:23.294 INFO:tasks.rados.rados.0.trial118.stdout:832: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:31:23.294 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 239 (ObjNum 277 snap 67 seq_num 277) dirty exists 2026-02-17T05:31:23.295 INFO:tasks.rados.rados.0.trial118.stdout:833: expect (ObjNum 243 snap 61 seq_num 243) 2026-02-17T05:31:23.310 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:23.324 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:24.293 INFO:tasks.rados.rados.0.trial118.stdout:832: done (3 left) 2026-02-17T05:31:24.293 INFO:tasks.rados.rados.0.trial118.stdout:833: done (2 left) 2026-02-17T05:31:24.293 INFO:tasks.rados.rados.0.trial118.stdout:834: done (1 left) 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:835: done (0 left) 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:836: read oid 41 snap -1 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:836: expect deleted 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:837: read oid 39 snap -1 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:837: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:838: rollback oid 32 current snap is 80 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 79 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:839: rollback oid 2 current snap is 80 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 74 2026-02-17T05:31:24.294 INFO:tasks.rados.rados.0.trial118.stdout:840: snap_remove snap 73 2026-02-17T05:31:25.298 INFO:tasks.rados.rados.0.trial118.stdout:840: done (4 left) 2026-02-17T05:31:25.298 INFO:tasks.rados.rados.0.trial118.stdout:841: copy_from oid 5 from oid 4 current snap is 80 2026-02-17T05:31:25.298 INFO:tasks.rados.rados.0.trial118.stdout:839: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:31:25.298 INFO:tasks.rados.rados.0.trial118.stdout:839: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 462 (ObjNum 297 snap 74 seq_num 297) dirty exists 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:838: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:838: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:838: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 328 (ObjNum 324 snap 78 seq_num 324) dirty exists 2026-02-17T05:31:25.299 INFO:tasks.rados.rados.0.trial118.stdout:837: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:31:25.316 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:25.332 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 236292 2026-02-17T05:31:25.348 INFO:tasks.rados.rados.0.trial118.stdout:841: finishing copy_from to trial11845692-5 2026-02-17T05:31:25.348 INFO:tasks.rados.rados.0.trial118.stdout:841: got expected ENOENT (src dne) 2026-02-17T05:31:25.348 INFO:tasks.rados.rados.0.trial118.stdout:841: finishing copy_from racing read to trial11845692-5 2026-02-17T05:31:25.348 INFO:tasks.rados.rados.0.trial118.stdout:836: done (4 left) 2026-02-17T05:31:25.349 INFO:tasks.rados.rados.0.trial118.stdout:837: done (3 left) 2026-02-17T05:31:25.349 INFO:tasks.rados.rados.0.trial118.stdout:838: done (2 left) 2026-02-17T05:31:25.349 INFO:tasks.rados.rados.0.trial118.stdout:839: done (1 left) 2026-02-17T05:31:25.349 INFO:tasks.rados.rados.0.trial118.stdout:841: done (0 left) 2026-02-17T05:31:25.349 INFO:tasks.rados.rados.0.trial118.stdout:842: snap_remove snap 79 2026-02-17T05:31:26.300 INFO:tasks.rados.rados.0.trial118.stdout:842: done (0 left) 2026-02-17T05:31:26.300 INFO:tasks.rados.rados.0.trial118.stdout:843: write oid 49 current snap is 80 2026-02-17T05:31:26.300 INFO:tasks.rados.rados.0.trial118.stdout:843: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2026-02-17T05:31:26.304 INFO:tasks.rados.rados.0.trial118.stdout:843: writing trial11845692-49 from 662275 to 1205026 tid 1 2026-02-17T05:31:26.308 INFO:tasks.rados.rados.0.trial118.stdout:843: writing trial11845692-49 from 1785236 to 2210683 tid 2 2026-02-17T05:31:26.313 INFO:tasks.rados.rados.0.trial118.stdout:843: writing trial11845692-49 from 2942002 to 3462275 tid 3 2026-02-17T05:31:26.314 INFO:tasks.rados.rados.0.trial118.stdout:844: write oid 12 current snap is 80 2026-02-17T05:31:26.314 INFO:tasks.rados.rados.0.trial118.stdout:844: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2026-02-17T05:31:26.318 INFO:tasks.rados.rados.0.trial118.stdout:844: writing trial11845692-12 from 679082 to 1297082 tid 1 2026-02-17T05:31:26.322 INFO:tasks.rados.rados.0.trial118.stdout:844: writing trial11845692-12 from 1843718 to 2412823 tid 2 2026-02-17T05:31:26.326 INFO:tasks.rados.rados.0.trial118.stdout:844: writing trial11845692-12 from 2853072 to 3479082 tid 3 2026-02-17T05:31:26.326 INFO:tasks.rados.rados.0.trial118.stdout:845: read oid 34 snap -1 2026-02-17T05:31:26.326 INFO:tasks.rados.rados.0.trial118.stdout:845: expect deleted 2026-02-17T05:31:26.326 INFO:tasks.rados.rados.0.trial118.stdout:846: write (excl) oid 22 current snap is 80 2026-02-17T05:31:26.326 INFO:tasks.rados.rados.0.trial118.stdout:846: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2026-02-17T05:31:26.330 INFO:tasks.rados.rados.0.trial118.stdout:846: writing trial11845692-22 from 695889 to 1105491 tid 1 2026-02-17T05:31:26.334 INFO:tasks.rados.rados.0.trial118.stdout:846: writing trial11845692-22 from 1618553 to 2331316 tid 2 2026-02-17T05:31:26.341 INFO:tasks.rados.rados.0.trial118.stdout:846: writing trial11845692-22 from 2996848 to 3495889 tid 3 2026-02-17T05:31:26.341 INFO:tasks.rados.rados.0.trial118.stdout:847: rollback oid 36 current snap is 80 2026-02-17T05:31:26.341 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 74 2026-02-17T05:31:26.341 INFO:tasks.rados.rados.0.trial118.stdout:843: finishing write tid 1 to trial11845692-49 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: finishing write tid 2 to trial11845692-49 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: finishing write tid 3 to trial11845692-49 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: finishing write tid 4 to trial11845692-49 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: finishing write tid 5 to trial11845692-49 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: oid 49 updating version 0 to 329 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: oid 49 updating version 329 to 330 2026-02-17T05:31:26.342 INFO:tasks.rados.rados.0.trial118.stdout:843: oid 49 updating version 330 to 331 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:843: oid 49 updating version 331 to 332 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 332 (ObjNum 325 snap 80 seq_num 325) dirty exists 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:843: left oid 49 (ObjNum 325 snap 80 seq_num 325) 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:844: finishing write tid 1 to trial11845692-12 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:844: finishing write tid 2 to trial11845692-12 2026-02-17T05:31:26.343 INFO:tasks.rados.rados.0.trial118.stdout:844: finishing write tid 3 to trial11845692-12 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:844: finishing write tid 4 to trial11845692-12 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:843: done (4 left) 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:845: done (3 left) 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:848: read oid 14 snap -1 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:848: expect (ObjNum 317 snap 78 seq_num 317) 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:849: write (excl) oid 1 current snap is 80 2026-02-17T05:31:26.344 INFO:tasks.rados.rados.0.trial118.stdout:849: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2026-02-17T05:31:26.346 INFO:tasks.rados.rados.0.trial118.stdout:849: writing trial11845692-1 from 712696 to 1197547 tid 1 2026-02-17T05:31:26.348 INFO:tasks.rados.rados.0.trial118.stdout:849: writing trial11845692-1 from 1960682 to 2533456 tid 2 2026-02-17T05:31:26.353 INFO:tasks.rados.rados.0.trial118.stdout:849: writing trial11845692-1 from 3307918 to 3512696 tid 3 2026-02-17T05:31:26.353 INFO:tasks.rados.rados.0.trial118.stdout:850: write (excl) oid 8 current snap is 80 2026-02-17T05:31:26.353 INFO:tasks.rados.rados.0.trial118.stdout:850: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2026-02-17T05:31:26.357 INFO:tasks.rados.rados.0.trial118.stdout:850: writing trial11845692-8 from 729503 to 1289603 tid 1 2026-02-17T05:31:26.362 INFO:tasks.rados.rados.0.trial118.stdout:850: writing trial11845692-8 from 2019164 to 2735596 tid 2 2026-02-17T05:31:26.365 INFO:tasks.rados.rados.0.trial118.stdout:850: writing trial11845692-8 from 3335341 to 3529503 tid 3 2026-02-17T05:31:26.365 INFO:tasks.rados.rados.0.trial118.stdout:851: snap_remove snap 78 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:851: done (6 left) 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:852: delete oid 25 current snap is 80 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: finishing write tid 5 to trial11845692-12 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: oid 12 updating version 0 to 263 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: oid 12 updating version 263 to 264 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: oid 12 version 264 is already newer than 262 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: oid 12 version 264 is already newer than 261 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 264 (ObjNum 326 snap 80 seq_num 326) dirty exists 2026-02-17T05:31:27.303 INFO:tasks.rados.rados.0.trial118.stdout:844: left oid 12 (ObjNum 326 snap 80 seq_num 326) 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: finishing write tid 1 to trial11845692-22 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: finishing write tid 2 to trial11845692-22 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: finishing write tid 3 to trial11845692-22 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: finishing write tid 4 to trial11845692-22 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: finishing write tid 5 to trial11845692-22 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: oid 22 updating version 0 to 442 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: oid 22 updating version 442 to 443 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: oid 22 updating version 443 to 445 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: oid 22 version 445 is already newer than 444 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 445 (ObjNum 327 snap 80 seq_num 327) dirty exists 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:846: left oid 22 (ObjNum 327 snap 80 seq_num 327) 2026-02-17T05:31:27.304 INFO:tasks.rados.rados.0.trial118.stdout:847: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:31:27.305 INFO:tasks.rados.rados.0.trial118.stdout:847: finishing rollback tid 2 to trial11845692-36 2026-02-17T05:31:27.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 447 (ObjNum 274 snap 67 seq_num 274) dirty exists 2026-02-17T05:31:27.305 INFO:tasks.rados.rados.0.trial118.stdout:848: expect (ObjNum 317 snap 78 seq_num 317) 2026-02-17T05:31:27.305 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:27.371 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3171069 2026-02-17T05:31:27.376 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: finishing write tid 1 to trial11845692-1 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: finishing write tid 2 to trial11845692-1 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: finishing write tid 3 to trial11845692-1 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: finishing write tid 4 to trial11845692-1 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: finishing write tid 5 to trial11845692-1 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: oid 1 updating version 0 to 468 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: oid 1 version 468 is already newer than 466 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: oid 1 version 468 is already newer than 467 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: oid 1 updating version 468 to 469 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 469 (ObjNum 328 snap 80 seq_num 328) dirty exists 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:849: left oid 1 (ObjNum 328 snap 80 seq_num 328) 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: finishing write tid 1 to trial11845692-8 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: finishing write tid 2 to trial11845692-8 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: finishing write tid 3 to trial11845692-8 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: finishing write tid 4 to trial11845692-8 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: finishing write tid 5 to trial11845692-8 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: oid 8 updating version 0 to 472 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: oid 8 version 472 is already newer than 470 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: oid 8 version 472 is already newer than 471 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: oid 8 updating version 472 to 473 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 473 (ObjNum 329 snap 80 seq_num 329) dirty exists 2026-02-17T05:31:27.418 INFO:tasks.rados.rados.0.trial118.stdout:850: left oid 8 (ObjNum 329 snap 80 seq_num 329) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:844: done (6 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:846: done (5 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:847: done (4 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:848: done (3 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:849: done (2 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:850: done (1 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:852: done (0 left) 2026-02-17T05:31:27.419 INFO:tasks.rados.rados.0.trial118.stdout:853: snap_remove snap 74 2026-02-17T05:31:28.305 INFO:tasks.rados.rados.0.trial118.stdout:853: done (0 left) 2026-02-17T05:31:28.306 INFO:tasks.rados.rados.0.trial118.stdout:854: copy_from oid 7 from oid 11 current snap is 80 2026-02-17T05:31:28.306 INFO:tasks.rados.rados.0.trial118.stdout:855: delete oid 24 current snap is 80 2026-02-17T05:31:28.307 INFO:tasks.rados.rados.0.trial118.stdout:855: done (1 left) 2026-02-17T05:31:28.307 INFO:tasks.rados.rados.0.trial118.stdout:856: read oid 42 snap -1 2026-02-17T05:31:28.308 INFO:tasks.rados.rados.0.trial118.stdout:856: expect (ObjNum 260 snap 64 seq_num 260) 2026-02-17T05:31:28.308 INFO:tasks.rados.rados.0.trial118.stdout:857: read oid 32 snap -1 2026-02-17T05:31:28.308 INFO:tasks.rados.rados.0.trial118.stdout:857: expect (ObjNum 324 snap 78 seq_num 324) 2026-02-17T05:31:28.308 INFO:tasks.rados.rados.0.trial118.stdout:858: write (excl) oid 17 current snap is 80 2026-02-17T05:31:28.308 INFO:tasks.rados.rados.0.trial118.stdout:858: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2026-02-17T05:31:28.314 INFO:tasks.rados.rados.0.trial118.stdout:858: writing trial11845692-17 from 779924 to 1565771 tid 1 2026-02-17T05:31:28.318 INFO:tasks.rados.rados.0.trial118.stdout:858: writing trial11845692-17 from 2078257 to 2658369 tid 2 2026-02-17T05:31:28.322 INFO:tasks.rados.rados.0.trial118.stdout:858: writing trial11845692-17 from 3301257 to 3579924 tid 3 2026-02-17T05:31:28.322 INFO:tasks.rados.rados.0.trial118.stdout:859: read oid 1 snap -1 2026-02-17T05:31:28.322 INFO:tasks.rados.rados.0.trial118.stdout:859: expect (ObjNum 328 snap 80 seq_num 328) 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:860: read oid 10 snap -1 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:860: expect deleted 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:861: read oid 30 snap -1 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:861: expect (ObjNum 260 snap 64 seq_num 260) 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:862: read oid 29 snap -1 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:862: expect (ObjNum 302 snap 75 seq_num 302) 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:863: snap_create 2026-02-17T05:31:28.323 INFO:tasks.rados.rados.0.trial118.stdout:857: expect (ObjNum 324 snap 78 seq_num 324) 2026-02-17T05:31:28.395 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:28.435 INFO:tasks.rados.rados.0.trial118.stdout:856: expect (ObjNum 260 snap 64 seq_num 260) 2026-02-17T05:31:28.436 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:28.507 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:854: finishing copy_from racing read to trial11845692-7 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:854: finishing copy_from to trial11845692-7 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 448 (ObjNum 311 snap 77 seq_num 311) dirty exists 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: finishing write tid 1 to trial11845692-17 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: finishing write tid 2 to trial11845692-17 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: finishing write tid 3 to trial11845692-17 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: finishing write tid 4 to trial11845692-17 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: finishing write tid 5 to trial11845692-17 2026-02-17T05:31:28.544 INFO:tasks.rados.rados.0.trial118.stdout:858: oid 17 updating version 0 to 386 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:858: oid 17 updating version 386 to 388 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:858: oid 17 updating version 388 to 389 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:858: oid 17 version 389 is already newer than 387 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 389 (ObjNum 332 snap 80 seq_num 332) dirty exists 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:858: left oid 17 (ObjNum 332 snap 80 seq_num 332) 2026-02-17T05:31:28.545 INFO:tasks.rados.rados.0.trial118.stdout:862: expect (ObjNum 302 snap 75 seq_num 302) 2026-02-17T05:31:28.629 INFO:tasks.rados.rados.0.trial118.stdout:859: expect (ObjNum 328 snap 80 seq_num 328) 2026-02-17T05:31:28.778 INFO:tasks.rados.rados.0.trial118.stdout:861: expect (ObjNum 260 snap 64 seq_num 260) 2026-02-17T05:31:28.807 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:28.855 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1515580 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:854: done (8 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:856: done (7 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:857: done (6 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:858: done (5 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:859: done (4 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:860: done (3 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:861: done (2 left) 2026-02-17T05:31:29.309 INFO:tasks.rados.rados.0.trial118.stdout:862: done (1 left) 2026-02-17T05:31:29.310 INFO:tasks.rados.rados.0.trial118.stdout:863: done (0 left) 2026-02-17T05:31:29.310 INFO:tasks.rados.rados.0.trial118.stdout:864: write (excl) oid 43 current snap is 81 2026-02-17T05:31:29.310 INFO:tasks.rados.rados.0.trial118.stdout:864: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2026-02-17T05:31:29.313 INFO:tasks.rados.rados.0.trial118.stdout:864: writing trial11845692-43 from 796731 to 1257827 tid 1 2026-02-17T05:31:29.317 INFO:tasks.rados.rados.0.trial118.stdout:864: writing trial11845692-43 from 1736739 to 2460509 tid 2 2026-02-17T05:31:29.323 INFO:tasks.rados.rados.0.trial118.stdout:864: writing trial11845692-43 from 2928680 to 3596731 tid 3 2026-02-17T05:31:29.323 INFO:tasks.rados.rados.0.trial118.stdout:865: write (excl) oid 7 current snap is 81 2026-02-17T05:31:29.323 INFO:tasks.rados.rados.0.trial118.stdout:865: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-17T05:31:29.326 INFO:tasks.rados.rados.0.trial118.stdout:865: writing trial11845692-7 from 413538 to 949883 tid 1 2026-02-17T05:31:29.330 INFO:tasks.rados.rados.0.trial118.stdout:865: writing trial11845692-7 from 1395221 to 1979002 tid 2 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:865: writing trial11845692-7 from 2556103 to 3214720 tid 3 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:866: rollback oid 18 current snap is 81 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 80 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: finishing write tid 1 to trial11845692-43 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: finishing write tid 2 to trial11845692-43 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: finishing write tid 3 to trial11845692-43 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: finishing write tid 4 to trial11845692-43 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: finishing write tid 5 to trial11845692-43 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: oid 43 updating version 0 to 265 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: oid 43 updating version 265 to 267 2026-02-17T05:31:29.336 INFO:tasks.rados.rados.0.trial118.stdout:864: oid 43 version 267 is already newer than 266 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:864: oid 43 updating version 267 to 268 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 268 (ObjNum 333 snap 81 seq_num 333) dirty exists 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:864: left oid 43 (ObjNum 333 snap 81 seq_num 333) 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:865: finishing write tid 1 to trial11845692-7 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:865: finishing write tid 2 to trial11845692-7 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:864: done (2 left) 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:867: read oid 25 snap -1 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:867: expect deleted 2026-02-17T05:31:29.337 INFO:tasks.rados.rados.0.trial118.stdout:868: delete oid 17 current snap is 81 2026-02-17T05:31:29.339 INFO:tasks.rados.rados.0.trial118.stdout:865: finishing write tid 3 to trial11845692-7 2026-02-17T05:31:29.339 INFO:tasks.rados.rados.0.trial118.stdout:865: finishing write tid 4 to trial11845692-7 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:866: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: finishing write tid 5 to trial11845692-7 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: oid 7 updating version 0 to 450 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: oid 7 updating version 450 to 451 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: oid 7 version 451 is already newer than 449 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: oid 7 updating version 451 to 452 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 452 (ObjNum 334 snap 81 seq_num 334) dirty exists 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: left oid 7 (ObjNum 334 snap 81 seq_num 334) 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:866: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:866: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 166 (ObjNum 183 snap 50 seq_num 183) dirty exists 2026-02-17T05:31:29.340 INFO:tasks.rados.rados.0.trial118.stdout:865: done (3 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:866: done (2 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:867: done (1 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:868: done (0 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:869: read oid 16 snap -1 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:869: expect deleted 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:870: delete oid 17 current snap is 81 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:869: done (1 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:870: done (0 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:871: delete oid 47 current snap is 81 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:871: done (0 left) 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:872: read oid 5 snap 80 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:872: expect deleted 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:873: read oid 50 snap 80 2026-02-17T05:31:29.341 INFO:tasks.rados.rados.0.trial118.stdout:873: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:31:29.342 INFO:tasks.rados.rados.0.trial118.stdout:874: write oid 11 current snap is 81 2026-02-17T05:31:29.342 INFO:tasks.rados.rados.0.trial118.stdout:874: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-17T05:31:29.343 INFO:tasks.rados.rados.0.trial118.stdout:874: writing trial11845692-11 from 480766 to 1034460 tid 1 2026-02-17T05:31:29.348 INFO:tasks.rados.rados.0.trial118.stdout:874: writing trial11845692-11 from 1629149 to 2220268 tid 2 2026-02-17T05:31:29.353 INFO:tasks.rados.rados.0.trial118.stdout:874: writing trial11845692-11 from 2782148 to 3202206 tid 3 2026-02-17T05:31:29.353 INFO:tasks.rados.rados.0.trial118.stdout:875: delete oid 45 current snap is 81 2026-02-17T05:31:29.353 INFO:tasks.rados.rados.0.trial118.stdout:873: expect (ObjNum 176 snap 46 seq_num 176) 2026-02-17T05:31:29.356 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 870931 2026-02-17T05:31:29.407 INFO:tasks.rados.rados.0.trial118.stdout:874: finishing write tid 1 to trial11845692-11 2026-02-17T05:31:29.407 INFO:tasks.rados.rados.0.trial118.stdout:872: done (3 left) 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:873: done (2 left) 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:875: done (1 left) 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:876: delete oid 20 current snap is 81 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: finishing write tid 2 to trial11845692-11 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: finishing write tid 3 to trial11845692-11 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: finishing write tid 4 to trial11845692-11 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: finishing write tid 5 to trial11845692-11 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: oid 11 updating version 0 to 488 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: oid 11 version 488 is already newer than 486 2026-02-17T05:31:29.408 INFO:tasks.rados.rados.0.trial118.stdout:874: oid 11 version 488 is already newer than 487 2026-02-17T05:31:29.409 INFO:tasks.rados.rados.0.trial118.stdout:874: oid 11 version 488 is already newer than 485 2026-02-17T05:31:29.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 488 (ObjNum 338 snap 81 seq_num 338) dirty exists 2026-02-17T05:31:29.409 INFO:tasks.rados.rados.0.trial118.stdout:874: left oid 11 (ObjNum 338 snap 81 seq_num 338) 2026-02-17T05:31:29.409 INFO:tasks.rados.rados.0.trial118.stdout:874: done (1 left) 2026-02-17T05:31:29.409 INFO:tasks.rados.rados.0.trial118.stdout:876: done (0 left) 2026-02-17T05:31:29.410 INFO:tasks.rados.rados.0.trial118.stdout:877: snap_remove snap 80 2026-02-17T05:31:30.261 INFO:tasks.rados.rados.0.trial118.stdout:877: done (0 left) 2026-02-17T05:31:30.261 INFO:tasks.rados.rados.0.trial118.stdout:878: delete oid 4 current snap is 81 2026-02-17T05:31:30.264 INFO:tasks.rados.rados.0.trial118.stdout:878: done (0 left) 2026-02-17T05:31:30.264 INFO:tasks.rados.rados.0.trial118.stdout:879: read oid 15 snap -1 2026-02-17T05:31:30.264 INFO:tasks.rados.rados.0.trial118.stdout:879: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:30.264 INFO:tasks.rados.rados.0.trial118.stdout:880: write (excl) oid 50 current snap is 81 2026-02-17T05:31:30.264 INFO:tasks.rados.rados.0.trial118.stdout:880: seq_num 342 ranges {547994=454690,1746724=482104,2659134=465146,3605976=142018} 2026-02-17T05:31:30.268 INFO:tasks.rados.rados.0.trial118.stdout:880: writing trial11845692-50 from 547994 to 1002684 tid 1 2026-02-17T05:31:30.273 INFO:tasks.rados.rados.0.trial118.stdout:880: writing trial11845692-50 from 1746724 to 2228828 tid 2 2026-02-17T05:31:30.277 INFO:tasks.rados.rados.0.trial118.stdout:880: writing trial11845692-50 from 2659134 to 3124280 tid 3 2026-02-17T05:31:30.279 INFO:tasks.rados.rados.0.trial118.stdout:880: writing trial11845692-50 from 3605976 to 3747994 tid 4 2026-02-17T05:31:30.280 INFO:tasks.rados.rados.0.trial118.stdout:881: delete oid 29 current snap is 81 2026-02-17T05:31:30.280 INFO:tasks.rados.rados.0.trial118.stdout:879: expect (ObjNum 280 snap 67 seq_num 280) 2026-02-17T05:31:30.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1694875 2026-02-17T05:31:30.330 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:30.358 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 1 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 2 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 3 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 4 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 5 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: finishing write tid 6 to trial11845692-50 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: oid 50 updating version 0 to 270 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: oid 50 updating version 270 to 271 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: oid 50 updating version 271 to 272 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: oid 50 updating version 272 to 273 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: oid 50 version 273 is already newer than 269 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 273 (ObjNum 342 snap 81 seq_num 342) dirty exists 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: left oid 50 (ObjNum 342 snap 81 seq_num 342) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:879: done (2 left) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:880: done (1 left) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:881: done (0 left) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:882: rollback oid 31 current snap is 81 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:882: done (0 left) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:883: read oid 33 snap -1 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:883: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:884: rollback oid 9 current snap is 81 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:884: done (1 left) 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:885: copy_from oid 45 from oid 39 current snap is 81 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:886: write (excl) oid 8 current snap is 81 2026-02-17T05:31:30.359 INFO:tasks.rados.rados.0.trial118.stdout:886: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2026-02-17T05:31:30.364 INFO:tasks.rados.rados.0.trial118.stdout:886: writing trial11845692-8 from 581608 to 1303149 tid 1 2026-02-17T05:31:30.368 INFO:tasks.rados.rados.0.trial118.stdout:886: writing trial11845692-8 from 1863688 to 2349461 tid 2 2026-02-17T05:31:30.373 INFO:tasks.rados.rados.0.trial118.stdout:886: writing trial11845692-8 from 3113980 to 3718023 tid 3 2026-02-17T05:31:30.374 INFO:tasks.rados.rados.0.trial118.stdout:887: snap_create 2026-02-17T05:31:30.374 INFO:tasks.rados.rados.0.trial118.stdout:885: finishing copy_from racing read to trial11845692-45 2026-02-17T05:31:30.374 INFO:tasks.rados.rados.0.trial118.stdout:885: finishing copy_from to trial11845692-45 2026-02-17T05:31:30.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 348 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:31:30.374 INFO:tasks.rados.rados.0.trial118.stdout:883: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:31:30.407 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2524061 2026-02-17T05:31:30.433 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1087827 2026-02-17T05:31:30.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: finishing write tid 1 to trial11845692-8 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: finishing write tid 2 to trial11845692-8 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: finishing write tid 3 to trial11845692-8 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: finishing write tid 4 to trial11845692-8 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: finishing write tid 5 to trial11845692-8 2026-02-17T05:31:30.521 INFO:tasks.rados.rados.0.trial118.stdout:886: oid 8 updating version 0 to 498 2026-02-17T05:31:30.522 INFO:tasks.rados.rados.0.trial118.stdout:886: oid 8 version 498 is already newer than 495 2026-02-17T05:31:30.522 INFO:tasks.rados.rados.0.trial118.stdout:886: oid 8 version 498 is already newer than 497 2026-02-17T05:31:30.522 INFO:tasks.rados.rados.0.trial118.stdout:886: oid 8 version 498 is already newer than 496 2026-02-17T05:31:30.522 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 498 (ObjNum 344 snap 81 seq_num 344) dirty exists 2026-02-17T05:31:30.522 INFO:tasks.rados.rados.0.trial118.stdout:886: left oid 8 (ObjNum 344 snap 81 seq_num 344) 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:883: done (3 left) 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:885: done (2 left) 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:886: done (1 left) 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:887: done (0 left) 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:888: write (excl) oid 45 current snap is 82 2026-02-17T05:31:31.313 INFO:tasks.rados.rados.0.trial118.stdout:888: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2026-02-17T05:31:31.319 INFO:tasks.rados.rados.0.trial118.stdout:888: writing trial11845692-45 from 598415 to 1395205 tid 1 2026-02-17T05:31:31.324 INFO:tasks.rados.rados.0.trial118.stdout:888: writing trial11845692-45 from 1922170 to 2667954 tid 2 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:888: writing trial11845692-45 from 3141403 to 3556718 tid 3 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:889: read oid 4 snap -1 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:889: expect deleted 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:890: copy_from oid 13 from oid 46 current snap is 82 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:888: finishing write tid 1 to trial11845692-45 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:888: finishing write tid 2 to trial11845692-45 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:891: write (excl) oid 40 current snap is 82 2026-02-17T05:31:31.328 INFO:tasks.rados.rados.0.trial118.stdout:891: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-17T05:31:31.331 INFO:tasks.rados.rados.0.trial118.stdout:891: writing trial11845692-40 from 615222 to 1087261 tid 1 2026-02-17T05:31:31.335 INFO:tasks.rados.rados.0.trial118.stdout:891: writing trial11845692-40 from 1580652 to 2070094 tid 2 2026-02-17T05:31:31.340 INFO:tasks.rados.rados.0.trial118.stdout:891: writing trial11845692-40 from 2768826 to 3395413 tid 3 2026-02-17T05:31:31.341 INFO:tasks.rados.rados.0.trial118.stdout:892: write oid 23 current snap is 82 2026-02-17T05:31:31.341 INFO:tasks.rados.rados.0.trial118.stdout:892: seq_num 347 ranges {632029=547288,1639134=749453,2796249=437859,3653524=178505} 2026-02-17T05:31:31.344 INFO:tasks.rados.rados.0.trial118.stdout:892: writing trial11845692-23 from 632029 to 1179317 tid 1 2026-02-17T05:31:31.349 INFO:tasks.rados.rados.0.trial118.stdout:892: writing trial11845692-23 from 1639134 to 2388587 tid 2 2026-02-17T05:31:31.352 INFO:tasks.rados.rados.0.trial118.stdout:892: writing trial11845692-23 from 2796249 to 3234108 tid 3 2026-02-17T05:31:31.355 INFO:tasks.rados.rados.0.trial118.stdout:892: writing trial11845692-23 from 3653524 to 3832029 tid 4 2026-02-17T05:31:31.355 INFO:tasks.rados.rados.0.trial118.stdout:893: read oid 22 snap -1 2026-02-17T05:31:31.355 INFO:tasks.rados.rados.0.trial118.stdout:893: expect (ObjNum 327 snap 80 seq_num 327) 2026-02-17T05:31:31.355 INFO:tasks.rados.rados.0.trial118.stdout:894: write oid 14 current snap is 82 2026-02-17T05:31:31.356 INFO:tasks.rados.rados.0.trial118.stdout:894: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2026-02-17T05:31:31.359 INFO:tasks.rados.rados.0.trial118.stdout:894: writing trial11845692-14 from 648836 to 1271373 tid 1 2026-02-17T05:31:31.363 INFO:tasks.rados.rados.0.trial118.stdout:894: writing trial11845692-14 from 1981263 to 2474374 tid 2 2026-02-17T05:31:31.369 INFO:tasks.rados.rados.0.trial118.stdout:894: writing trial11845692-14 from 3107319 to 3848836 tid 3 2026-02-17T05:31:31.369 INFO:tasks.rados.rados.0.trial118.stdout:895: write oid 31 current snap is 82 2026-02-17T05:31:31.369 INFO:tasks.rados.rados.0.trial118.stdout:895: seq_num 349 ranges {665643=697786,2039745=753122,3534742=330901} 2026-02-17T05:31:31.373 INFO:tasks.rados.rados.0.trial118.stdout:895: writing trial11845692-31 from 665643 to 1363429 tid 1 2026-02-17T05:31:31.379 INFO:tasks.rados.rados.0.trial118.stdout:895: writing trial11845692-31 from 2039745 to 2792867 tid 2 2026-02-17T05:31:31.383 INFO:tasks.rados.rados.0.trial118.stdout:895: writing trial11845692-31 from 3534742 to 3865643 tid 3 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:896: delete oid 44 current snap is 82 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: finishing write tid 3 to trial11845692-45 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: finishing write tid 4 to trial11845692-45 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: finishing write tid 5 to trial11845692-45 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: oid 45 updating version 0 to 452 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: oid 45 version 452 is already newer than 450 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: oid 45 version 452 is already newer than 449 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: oid 45 version 452 is already newer than 451 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 452 (ObjNum 345 snap 82 seq_num 345) dirty exists 2026-02-17T05:31:31.384 INFO:tasks.rados.rados.0.trial118.stdout:888: left oid 45 (ObjNum 345 snap 82 seq_num 345) 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: finishing write tid 1 to trial11845692-40 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:890: finishing copy_from racing read to trial11845692-13 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:890: finishing copy_from to trial11845692-13 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 385 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: finishing write tid 2 to trial11845692-40 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: finishing write tid 3 to trial11845692-40 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: finishing write tid 4 to trial11845692-40 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: finishing write tid 5 to trial11845692-40 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: oid 40 updating version 0 to 483 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: oid 40 updating version 483 to 485 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: oid 40 version 485 is already newer than 484 2026-02-17T05:31:31.385 INFO:tasks.rados.rados.0.trial118.stdout:891: oid 40 version 485 is already newer than 482 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 485 (ObjNum 346 snap 82 seq_num 346) dirty exists 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:891: left oid 40 (ObjNum 346 snap 82 seq_num 346) 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 1 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 2 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 3 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 4 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 5 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: finishing write tid 6 to trial11845692-23 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: oid 23 updating version 0 to 279 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: oid 23 version 279 is already newer than 277 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: oid 23 version 279 is already newer than 275 2026-02-17T05:31:31.386 INFO:tasks.rados.rados.0.trial118.stdout:892: oid 23 version 279 is already newer than 278 2026-02-17T05:31:31.387 INFO:tasks.rados.rados.0.trial118.stdout:892: oid 23 version 279 is already newer than 276 2026-02-17T05:31:31.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 279 (ObjNum 347 snap 82 seq_num 347) dirty exists 2026-02-17T05:31:31.387 INFO:tasks.rados.rados.0.trial118.stdout:892: left oid 23 (ObjNum 347 snap 82 seq_num 347) 2026-02-17T05:31:31.387 INFO:tasks.rados.rados.0.trial118.stdout:893: expect (ObjNum 327 snap 80 seq_num 327) 2026-02-17T05:31:31.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 229064 2026-02-17T05:31:31.504 INFO:tasks.rados.rados.0.trial118.stdout:894: finishing write tid 1 to trial11845692-14 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:888: done (8 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:889: done (7 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:890: done (6 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:891: done (5 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:892: done (4 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:893: done (3 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:896: done (2 left) 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:897: rollback oid 45 current snap is 82 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 81 2026-02-17T05:31:31.505 INFO:tasks.rados.rados.0.trial118.stdout:894: finishing write tid 2 to trial11845692-14 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: finishing write tid 3 to trial11845692-14 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: finishing write tid 4 to trial11845692-14 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: finishing write tid 5 to trial11845692-14 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: oid 14 updating version 0 to 123 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: oid 14 updating version 123 to 124 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: oid 14 updating version 124 to 126 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: oid 14 version 126 is already newer than 125 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 126 (ObjNum 348 snap 82 seq_num 348) dirty exists 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: left oid 14 (ObjNum 348 snap 82 seq_num 348) 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:895: finishing write tid 1 to trial11845692-31 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:895: finishing write tid 2 to trial11845692-31 2026-02-17T05:31:31.506 INFO:tasks.rados.rados.0.trial118.stdout:894: done (2 left) 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:898: copy_from oid 49 from oid 15 current snap is 82 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: finishing write tid 3 to trial11845692-31 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: finishing write tid 4 to trial11845692-31 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: finishing write tid 5 to trial11845692-31 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: oid 31 updating version 0 to 501 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: oid 31 version 501 is already newer than 500 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: oid 31 updating version 501 to 503 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: oid 31 version 503 is already newer than 502 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 503 (ObjNum 349 snap 82 seq_num 349) dirty exists 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: left oid 31 (ObjNum 349 snap 82 seq_num 349) 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:895: done (2 left) 2026-02-17T05:31:31.507 INFO:tasks.rados.rados.0.trial118.stdout:899: snap_create 2026-02-17T05:31:31.508 INFO:tasks.rados.rados.0.trial118.stdout:897: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:31:31.508 INFO:tasks.rados.rados.0.trial118.stdout:897: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:31:31.508 INFO:tasks.rados.rados.0.trial118.stdout:897: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:31:31.508 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 455 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-17T05:31:31.511 INFO:tasks.rados.rados.0.trial118.stdout:898: finishing copy_from racing read to trial11845692-49 2026-02-17T05:31:31.512 INFO:tasks.rados.rados.0.trial118.stdout:898: finishing copy_from to trial11845692-49 2026-02-17T05:31:31.512 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 336 (ObjNum 280 snap 67 seq_num 280) dirty exists 2026-02-17T05:31:32.317 INFO:tasks.rados.rados.0.trial118.stdout:897: done (2 left) 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:898: done (1 left) 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:899: done (0 left) 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:900: read oid 2 snap -1 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:900: expect (ObjNum 297 snap 74 seq_num 297) 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:901: write oid 7 current snap is 83 2026-02-17T05:31:32.318 INFO:tasks.rados.rados.0.trial118.stdout:901: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2026-02-17T05:31:32.322 INFO:tasks.rados.rados.0.trial118.stdout:901: writing trial11845692-7 from 699257 to 1263894 tid 1 2026-02-17T05:31:32.327 INFO:tasks.rados.rados.0.trial118.stdout:901: writing trial11845692-7 from 1873062 to 2513500 tid 2 2026-02-17T05:31:32.332 INFO:tasks.rados.rados.0.trial118.stdout:901: writing trial11845692-7 from 3305941 to 3899257 tid 3 2026-02-17T05:31:32.332 INFO:tasks.rados.rados.0.trial118.stdout:902: write (excl) oid 48 current snap is 83 2026-02-17T05:31:32.332 INFO:tasks.rados.rados.0.trial118.stdout:902: seq_num 352 ranges {716064=639886,1815191=500449,2817011=526925} 2026-02-17T05:31:32.337 INFO:tasks.rados.rados.0.trial118.stdout:902: writing trial11845692-48 from 716064 to 1355950 tid 1 2026-02-17T05:31:32.340 INFO:tasks.rados.rados.0.trial118.stdout:902: writing trial11845692-48 from 1815191 to 2315640 tid 2 2026-02-17T05:31:32.344 INFO:tasks.rados.rados.0.trial118.stdout:902: writing trial11845692-48 from 2817011 to 3343936 tid 3 2026-02-17T05:31:32.344 INFO:tasks.rados.rados.0.trial118.stdout:903: write oid 3 current snap is 83 2026-02-17T05:31:32.345 INFO:tasks.rados.rados.0.trial118.stdout:903: seq_num 353 ranges {732871=715135,1873673=644107,3244434=688437} 2026-02-17T05:31:32.350 INFO:tasks.rados.rados.0.trial118.stdout:903: writing trial11845692-3 from 732871 to 1448006 tid 1 2026-02-17T05:31:32.354 INFO:tasks.rados.rados.0.trial118.stdout:903: writing trial11845692-3 from 1873673 to 2517780 tid 2 2026-02-17T05:31:32.359 INFO:tasks.rados.rados.0.trial118.stdout:903: writing trial11845692-3 from 3244434 to 3932871 tid 3 2026-02-17T05:31:32.359 INFO:tasks.rados.rados.0.trial118.stdout:904: read oid 1 snap 81 2026-02-17T05:31:32.359 INFO:tasks.rados.rados.0.trial118.stdout:904: expect (ObjNum 328 snap 80 seq_num 328) 2026-02-17T05:31:32.360 INFO:tasks.rados.rados.0.trial118.stdout:905: write (excl) oid 38 current snap is 83 2026-02-17T05:31:32.360 INFO:tasks.rados.rados.0.trial118.stdout:905: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-17T05:31:32.365 INFO:tasks.rados.rados.0.trial118.stdout:905: writing trial11845692-38 from 749678 to 1540062 tid 1 2026-02-17T05:31:32.369 INFO:tasks.rados.rados.0.trial118.stdout:905: writing trial11845692-38 from 2332155 to 2836273 tid 2 2026-02-17T05:31:32.373 INFO:tasks.rados.rados.0.trial118.stdout:905: writing trial11845692-38 from 3271857 to 3821326 tid 3 2026-02-17T05:31:32.373 INFO:tasks.rados.rados.0.trial118.stdout:906: snap_create 2026-02-17T05:31:32.373 INFO:tasks.rados.rados.0.trial118.stdout:900: expect (ObjNum 297 snap 74 seq_num 297) 2026-02-17T05:31:32.450 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 626010 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: finishing write tid 1 to trial11845692-7 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: finishing write tid 2 to trial11845692-7 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: finishing write tid 3 to trial11845692-7 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: finishing write tid 4 to trial11845692-7 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: finishing write tid 5 to trial11845692-7 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: oid 7 updating version 0 to 456 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: oid 7 version 456 is already newer than 455 2026-02-17T05:31:32.482 INFO:tasks.rados.rados.0.trial118.stdout:901: oid 7 version 456 is already newer than 454 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:901: oid 7 updating version 456 to 457 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 457 (ObjNum 351 snap 83 seq_num 351) dirty exists 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:901: left oid 7 (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: finishing write tid 1 to trial11845692-48 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: finishing write tid 2 to trial11845692-48 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: finishing write tid 3 to trial11845692-48 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: finishing write tid 4 to trial11845692-48 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: finishing write tid 5 to trial11845692-48 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: oid 48 updating version 0 to 459 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: oid 48 version 459 is already newer than 456 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: oid 48 version 459 is already newer than 457 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:902: oid 48 version 459 is already newer than 458 2026-02-17T05:31:32.483 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 459 (ObjNum 352 snap 83 seq_num 352) dirty exists 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:902: left oid 48 (ObjNum 352 snap 83 seq_num 352) 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: finishing write tid 1 to trial11845692-3 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: finishing write tid 2 to trial11845692-3 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: finishing write tid 3 to trial11845692-3 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: finishing write tid 4 to trial11845692-3 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: finishing write tid 5 to trial11845692-3 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: oid 3 updating version 0 to 386 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: oid 3 updating version 386 to 388 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: oid 3 version 388 is already newer than 387 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: oid 3 updating version 388 to 389 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 389 (ObjNum 353 snap 83 seq_num 353) dirty exists 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:903: left oid 3 (ObjNum 353 snap 83 seq_num 353) 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:904: expect (ObjNum 328 snap 80 seq_num 328) 2026-02-17T05:31:32.484 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:32.537 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 914378 2026-02-17T05:31:32.617 INFO:tasks.rados.rados.0.trial118.stdout:905: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: finishing write tid 5 to trial11845692-38 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: oid 38 updating version 0 to 428 2026-02-17T05:31:32.618 INFO:tasks.rados.rados.0.trial118.stdout:905: oid 38 version 428 is already newer than 425 2026-02-17T05:31:32.619 INFO:tasks.rados.rados.0.trial118.stdout:905: oid 38 version 428 is already newer than 426 2026-02-17T05:31:32.619 INFO:tasks.rados.rados.0.trial118.stdout:905: oid 38 version 428 is already newer than 427 2026-02-17T05:31:32.619 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 428 (ObjNum 354 snap 83 seq_num 354) dirty exists 2026-02-17T05:31:32.619 INFO:tasks.rados.rados.0.trial118.stdout:905: left oid 38 (ObjNum 354 snap 83 seq_num 354) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:900: done (6 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:901: done (5 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:902: done (4 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:903: done (3 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:904: done (2 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:905: done (1 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:906: done (0 left) 2026-02-17T05:31:33.320 INFO:tasks.rados.rados.0.trial118.stdout:907: snap_create 2026-02-17T05:31:34.322 INFO:tasks.rados.rados.0.trial118.stdout:907: done (0 left) 2026-02-17T05:31:34.322 INFO:tasks.rados.rados.0.trial118.stdout:908: read oid 14 snap -1 2026-02-17T05:31:34.322 INFO:tasks.rados.rados.0.trial118.stdout:908: expect (ObjNum 348 snap 82 seq_num 348) 2026-02-17T05:31:34.322 INFO:tasks.rados.rados.0.trial118.stdout:909: snap_remove snap 81 2026-02-17T05:31:35.323 INFO:tasks.rados.rados.0.trial118.stdout:909: done (1 left) 2026-02-17T05:31:35.323 INFO:tasks.rados.rados.0.trial118.stdout:910: write (excl) oid 42 current snap is 85 2026-02-17T05:31:35.323 INFO:tasks.rados.rados.0.trial118.stdout:910: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2026-02-17T05:31:35.328 INFO:tasks.rados.rados.0.trial118.stdout:910: writing trial11845692-42 from 766485 to 1232118 tid 1 2026-02-17T05:31:35.334 INFO:tasks.rados.rados.0.trial118.stdout:910: writing trial11845692-42 from 1990637 to 2638413 tid 2 2026-02-17T05:31:35.339 INFO:tasks.rados.rados.0.trial118.stdout:910: writing trial11845692-42 from 3299280 to 3966485 tid 3 2026-02-17T05:31:35.339 INFO:tasks.rados.rados.0.trial118.stdout:911: snap_remove snap 83 2026-02-17T05:31:36.328 INFO:tasks.rados.rados.0.trial118.stdout:911: done (2 left) 2026-02-17T05:31:36.328 INFO:tasks.rados.rados.0.trial118.stdout:912: snap_create 2026-02-17T05:31:36.328 INFO:tasks.rados.rados.0.trial118.stdout:908: expect (ObjNum 348 snap 82 seq_num 348) 2026-02-17T05:31:36.356 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2091946 2026-02-17T05:31:36.417 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:36.469 INFO:tasks.rados.rados.0.trial118.stdout:910: finishing write tid 1 to trial11845692-42 2026-02-17T05:31:36.469 INFO:tasks.rados.rados.0.trial118.stdout:910: finishing write tid 2 to trial11845692-42 2026-02-17T05:31:36.469 INFO:tasks.rados.rados.0.trial118.stdout:910: finishing write tid 3 to trial11845692-42 2026-02-17T05:31:36.469 INFO:tasks.rados.rados.0.trial118.stdout:910: finishing write tid 4 to trial11845692-42 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: finishing write tid 5 to trial11845692-42 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: oid 42 updating version 0 to 435 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: oid 42 version 435 is already newer than 430 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: oid 42 version 435 is already newer than 433 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: oid 42 version 435 is already newer than 434 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 435 (ObjNum 355 snap 85 seq_num 355) dirty exists 2026-02-17T05:31:36.470 INFO:tasks.rados.rados.0.trial118.stdout:910: left oid 42 (ObjNum 355 snap 85 seq_num 355) 2026-02-17T05:31:37.328 INFO:tasks.rados.rados.0.trial118.stdout:908: done (2 left) 2026-02-17T05:31:37.328 INFO:tasks.rados.rados.0.trial118.stdout:910: done (1 left) 2026-02-17T05:31:37.328 INFO:tasks.rados.rados.0.trial118.stdout:912: done (0 left) 2026-02-17T05:31:37.328 INFO:tasks.rados.rados.0.trial118.stdout:913: read oid 13 snap -1 2026-02-17T05:31:37.329 INFO:tasks.rados.rados.0.trial118.stdout:913: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:31:37.329 INFO:tasks.rados.rados.0.trial118.stdout:914: delete oid 9 current snap is 86 2026-02-17T05:31:37.330 INFO:tasks.rados.rados.0.trial118.stdout:914: done (1 left) 2026-02-17T05:31:37.330 INFO:tasks.rados.rados.0.trial118.stdout:915: read oid 9 snap -1 2026-02-17T05:31:37.330 INFO:tasks.rados.rados.0.trial118.stdout:915: expect deleted 2026-02-17T05:31:37.331 INFO:tasks.rados.rados.0.trial118.stdout:916: snap_create 2026-02-17T05:31:37.334 INFO:tasks.rados.rados.0.trial118.stdout:913: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:31:37.334 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 364563 2026-02-17T05:31:37.430 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2040949 2026-02-17T05:31:38.332 INFO:tasks.rados.rados.0.trial118.stdout:913: done (2 left) 2026-02-17T05:31:38.332 INFO:tasks.rados.rados.0.trial118.stdout:915: done (1 left) 2026-02-17T05:31:38.332 INFO:tasks.rados.rados.0.trial118.stdout:916: done (0 left) 2026-02-17T05:31:38.332 INFO:tasks.rados.rados.0.trial118.stdout:917: copy_from oid 18 from oid 50 current snap is 87 2026-02-17T05:31:38.332 INFO:tasks.rados.rados.0.trial118.stdout:918: delete oid 21 current snap is 87 2026-02-17T05:31:38.333 INFO:tasks.rados.rados.0.trial118.stdout:918: done (1 left) 2026-02-17T05:31:38.333 INFO:tasks.rados.rados.0.trial118.stdout:919: write (excl) oid 30 current snap is 87 2026-02-17T05:31:38.333 INFO:tasks.rados.rados.0.trial118.stdout:919: seq_num 358 ranges {416906=407733,1366083=511456} 2026-02-17T05:31:38.337 INFO:tasks.rados.rados.0.trial118.stdout:919: writing trial11845692-30 from 416906 to 824639 tid 1 2026-02-17T05:31:38.341 INFO:tasks.rados.rados.0.trial118.stdout:919: writing trial11845692-30 from 1366083 to 1877539 tid 2 2026-02-17T05:31:38.341 INFO:tasks.rados.rados.0.trial118.stdout:920: read oid 7 snap -1 2026-02-17T05:31:38.341 INFO:tasks.rados.rados.0.trial118.stdout:920: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:38.341 INFO:tasks.rados.rados.0.trial118.stdout:921: write oid 19 current snap is 87 2026-02-17T05:31:38.342 INFO:tasks.rados.rados.0.trial118.stdout:919: finishing write tid 1 to trial11845692-30 2026-02-17T05:31:38.342 INFO:tasks.rados.rados.0.trial118.stdout:921: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-17T05:31:38.345 INFO:tasks.rados.rados.0.trial118.stdout:921: writing trial11845692-19 from 433713 to 916695 tid 1 2026-02-17T05:31:38.349 INFO:tasks.rados.rados.0.trial118.stdout:921: writing trial11845692-19 from 1424565 to 2033713 tid 2 2026-02-17T05:31:38.349 INFO:tasks.rados.rados.0.trial118.stdout:922: delete oid 34 current snap is 87 2026-02-17T05:31:38.349 INFO:tasks.rados.rados.0.trial118.stdout:919: finishing write tid 2 to trial11845692-30 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:917: finishing copy_from racing read to trial11845692-18 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: finishing write tid 3 to trial11845692-30 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: finishing write tid 4 to trial11845692-30 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: oid 30 updating version 0 to 490 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: oid 30 updating version 490 to 491 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: oid 30 updating version 491 to 492 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 492 (ObjNum 358 snap 87 seq_num 358) dirty exists 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:919: left oid 30 (ObjNum 358 snap 87 seq_num 358) 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:917: finishing copy_from to trial11845692-18 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 273 (ObjNum 342 snap 81 seq_num 342) dirty exists 2026-02-17T05:31:38.350 INFO:tasks.rados.rados.0.trial118.stdout:920: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:38.468 INFO:tasks.rados.rados.0.trial118.stdout:921: finishing write tid 1 to trial11845692-19 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:921: finishing write tid 2 to trial11845692-19 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:921: finishing write tid 3 to trial11845692-19 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:917: done (4 left) 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:919: done (3 left) 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:920: done (2 left) 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:922: done (1 left) 2026-02-17T05:31:38.469 INFO:tasks.rados.rados.0.trial118.stdout:923: snap_remove snap 82 2026-02-17T05:31:39.338 INFO:tasks.rados.rados.0.trial118.stdout:923: done (1 left) 2026-02-17T05:31:39.338 INFO:tasks.rados.rados.0.trial118.stdout:924: write oid 30 current snap is 87 2026-02-17T05:31:39.338 INFO:tasks.rados.rados.0.trial118.stdout:924: seq_num 361 ranges {467327=633480,1825176=242151} 2026-02-17T05:31:39.343 INFO:tasks.rados.rados.0.trial118.stdout:924: writing trial11845692-30 from 467327 to 1100807 tid 1 2026-02-17T05:31:39.347 INFO:tasks.rados.rados.0.trial118.stdout:924: writing trial11845692-30 from 1825176 to 2067327 tid 2 2026-02-17T05:31:39.347 INFO:tasks.rados.rados.0.trial118.stdout:925: read oid 22 snap 85 2026-02-17T05:31:39.347 INFO:tasks.rados.rados.0.trial118.stdout:925: expect (ObjNum 327 snap 80 seq_num 327) 2026-02-17T05:31:39.347 INFO:tasks.rados.rados.0.trial118.stdout:926: delete oid 45 current snap is 87 2026-02-17T05:31:39.347 INFO:tasks.rados.rados.0.trial118.stdout:921: finishing write tid 4 to trial11845692-19 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:921: oid 19 updating version 0 to 391 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:921: oid 19 updating version 391 to 392 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:921: oid 19 version 392 is already newer than 390 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 392 (ObjNum 359 snap 87 seq_num 359) dirty exists 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:921: left oid 19 (ObjNum 359 snap 87 seq_num 359) 2026-02-17T05:31:39.348 INFO:tasks.rados.rados.0.trial118.stdout:924: finishing write tid 1 to trial11845692-30 2026-02-17T05:31:39.349 INFO:tasks.rados.rados.0.trial118.stdout:924: finishing write tid 2 to trial11845692-30 2026-02-17T05:31:39.349 INFO:tasks.rados.rados.0.trial118.stdout:924: finishing write tid 3 to trial11845692-30 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:924: finishing write tid 4 to trial11845692-30 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:924: oid 30 updating version 0 to 493 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:924: oid 30 updating version 493 to 496 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:924: oid 30 updating version 496 to 497 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 497 (ObjNum 361 snap 87 seq_num 361) dirty exists 2026-02-17T05:31:39.350 INFO:tasks.rados.rados.0.trial118.stdout:924: left oid 30 (ObjNum 361 snap 87 seq_num 361) 2026-02-17T05:31:39.351 INFO:tasks.rados.rados.0.trial118.stdout:925: expect (ObjNum 327 snap 80 seq_num 327) 2026-02-17T05:31:39.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2695347 2026-02-17T05:31:39.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3068434 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:921: done (3 left) 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:924: done (2 left) 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:925: done (1 left) 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:926: done (0 left) 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:927: write oid 38 current snap is 87 2026-02-17T05:31:39.463 INFO:tasks.rados.rados.0.trial118.stdout:927: seq_num 363 ranges {500941=783978,1942140=158801} 2026-02-17T05:31:39.468 INFO:tasks.rados.rados.0.trial118.stdout:927: writing trial11845692-38 from 500941 to 1284919 tid 1 2026-02-17T05:31:39.471 INFO:tasks.rados.rados.0.trial118.stdout:927: writing trial11845692-38 from 1942140 to 2100941 tid 2 2026-02-17T05:31:39.471 INFO:tasks.rados.rados.0.trial118.stdout:928: write oid 29 current snap is 87 2026-02-17T05:31:39.471 INFO:tasks.rados.rados.0.trial118.stdout:927: finishing write tid 1 to trial11845692-38 2026-02-17T05:31:39.472 INFO:tasks.rados.rados.0.trial118.stdout:928: seq_num 364 ranges {517748=459227,1600622=406110} 2026-02-17T05:31:39.475 INFO:tasks.rados.rados.0.trial118.stdout:928: writing trial11845692-29 from 517748 to 976975 tid 1 2026-02-17T05:31:39.479 INFO:tasks.rados.rados.0.trial118.stdout:928: writing trial11845692-29 from 1600622 to 2006732 tid 2 2026-02-17T05:31:39.479 INFO:tasks.rados.rados.0.trial118.stdout:929: write oid 15 current snap is 87 2026-02-17T05:31:39.479 INFO:tasks.rados.rados.0.trial118.stdout:929: seq_num 365 ranges {534555=650829,1659104=475451} 2026-02-17T05:31:39.484 INFO:tasks.rados.rados.0.trial118.stdout:929: writing trial11845692-15 from 534555 to 1185384 tid 1 2026-02-17T05:31:39.487 INFO:tasks.rados.rados.0.trial118.stdout:929: writing trial11845692-15 from 1659104 to 2134555 tid 2 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:930: copy_from oid 14 from oid 16 current snap is 87 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: finishing write tid 2 to trial11845692-38 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: finishing write tid 3 to trial11845692-38 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: finishing write tid 4 to trial11845692-38 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: oid 38 updating version 0 to 445 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: oid 38 version 445 is already newer than 443 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: oid 38 version 445 is already newer than 444 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 445 (ObjNum 363 snap 87 seq_num 363) dirty exists 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: left oid 38 (ObjNum 363 snap 87 seq_num 363) 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: finishing write tid 1 to trial11845692-29 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: finishing write tid 2 to trial11845692-29 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: finishing write tid 3 to trial11845692-29 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: finishing write tid 4 to trial11845692-29 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: oid 29 updating version 0 to 460 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: oid 29 updating version 460 to 461 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: oid 29 version 461 is already newer than 459 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 461 (ObjNum 364 snap 87 seq_num 364) dirty exists 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: left oid 29 (ObjNum 364 snap 87 seq_num 364) 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:929: finishing write tid 1 to trial11845692-15 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:927: done (3 left) 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:928: done (2 left) 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:931: snap_create 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:930: finishing copy_from to trial11845692-14 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:930: got expected ENOENT (src dne) 2026-02-17T05:31:39.488 INFO:tasks.rados.rados.0.trial118.stdout:930: finishing copy_from racing read to trial11845692-14 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: finishing write tid 2 to trial11845692-15 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: finishing write tid 3 to trial11845692-15 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: finishing write tid 4 to trial11845692-15 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: oid 15 updating version 0 to 462 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: oid 15 updating version 462 to 463 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: oid 15 version 463 is already newer than 461 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 463 (ObjNum 365 snap 87 seq_num 365) dirty exists 2026-02-17T05:31:39.489 INFO:tasks.rados.rados.0.trial118.stdout:929: left oid 15 (ObjNum 365 snap 87 seq_num 365) 2026-02-17T05:31:40.264 INFO:tasks.rados.rados.0.trial118.stdout:929: done (2 left) 2026-02-17T05:31:40.264 INFO:tasks.rados.rados.0.trial118.stdout:930: done (1 left) 2026-02-17T05:31:40.264 INFO:tasks.rados.rados.0.trial118.stdout:931: done (0 left) 2026-02-17T05:31:40.265 INFO:tasks.rados.rados.0.trial118.stdout:932: rollback oid 41 current snap is 88 2026-02-17T05:31:40.265 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 86 2026-02-17T05:31:40.265 INFO:tasks.rados.rados.0.trial118.stdout:933: write (excl) oid 43 current snap is 88 2026-02-17T05:31:40.265 INFO:tasks.rados.rados.0.trial118.stdout:933: seq_num 366 ranges {551362=726078,1717586=409779} 2026-02-17T05:31:40.269 INFO:tasks.rados.rados.0.trial118.stdout:933: writing trial11845692-43 from 551362 to 1277440 tid 1 2026-02-17T05:31:40.272 INFO:tasks.rados.rados.0.trial118.stdout:933: writing trial11845692-43 from 1717586 to 2127365 tid 2 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:934: rollback oid 11 current snap is 88 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 87 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:932: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 0 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:932: done (2 left) 2026-02-17T05:31:40.273 INFO:tasks.rados.rados.0.trial118.stdout:935: snap_create 2026-02-17T05:31:40.274 INFO:tasks.rados.rados.0.trial118.stdout:933: finishing write tid 1 to trial11845692-43 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: finishing write tid 2 to trial11845692-43 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:934: finishing rollback tid 0 to trial11845692-11 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: finishing write tid 3 to trial11845692-43 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: finishing write tid 4 to trial11845692-43 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: oid 43 updating version 0 to 275 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: oid 43 updating version 275 to 276 2026-02-17T05:31:40.275 INFO:tasks.rados.rados.0.trial118.stdout:933: oid 43 version 276 is already newer than 274 2026-02-17T05:31:40.276 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 276 (ObjNum 366 snap 88 seq_num 366) dirty exists 2026-02-17T05:31:40.276 INFO:tasks.rados.rados.0.trial118.stdout:933: left oid 43 (ObjNum 366 snap 88 seq_num 366) 2026-02-17T05:31:40.276 INFO:tasks.rados.rados.0.trial118.stdout:934: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:31:40.276 INFO:tasks.rados.rados.0.trial118.stdout:934: finishing rollback tid 2 to trial11845692-11 2026-02-17T05:31:40.276 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 509 (ObjNum 338 snap 81 seq_num 338) dirty exists 2026-02-17T05:31:41.266 INFO:tasks.rados.rados.0.trial118.stdout:933: done (2 left) 2026-02-17T05:31:41.266 INFO:tasks.rados.rados.0.trial118.stdout:934: done (1 left) 2026-02-17T05:31:41.266 INFO:tasks.rados.rados.0.trial118.stdout:935: done (0 left) 2026-02-17T05:31:41.266 INFO:tasks.rados.rados.0.trial118.stdout:936: write (excl) oid 2 current snap is 89 2026-02-17T05:31:41.266 INFO:tasks.rados.rados.0.trial118.stdout:936: seq_num 367 ranges {568169=401327,1376068=669790} 2026-02-17T05:31:41.270 INFO:tasks.rados.rados.0.trial118.stdout:936: writing trial11845692-2 from 568169 to 969496 tid 1 2026-02-17T05:31:41.274 INFO:tasks.rados.rados.0.trial118.stdout:936: writing trial11845692-2 from 1376068 to 2045858 tid 2 2026-02-17T05:31:41.274 INFO:tasks.rados.rados.0.trial118.stdout:937: write (excl) oid 36 current snap is 89 2026-02-17T05:31:41.274 INFO:tasks.rados.rados.0.trial118.stdout:937: seq_num 368 ranges {584976=476576,1834550=350426} 2026-02-17T05:31:41.279 INFO:tasks.rados.rados.0.trial118.stdout:937: writing trial11845692-36 from 584976 to 1061552 tid 1 2026-02-17T05:31:41.283 INFO:tasks.rados.rados.0.trial118.stdout:937: writing trial11845692-36 from 1834550 to 2184976 tid 2 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:938: delete oid 27 current snap is 89 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: finishing write tid 1 to trial11845692-2 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: finishing write tid 2 to trial11845692-2 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: finishing write tid 3 to trial11845692-2 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: finishing write tid 4 to trial11845692-2 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: oid 2 updating version 0 to 513 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: oid 2 version 513 is already newer than 511 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: oid 2 version 513 is already newer than 512 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 513 (ObjNum 367 snap 89 seq_num 367) dirty exists 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:936: left oid 2 (ObjNum 367 snap 89 seq_num 367) 2026-02-17T05:31:41.284 INFO:tasks.rados.rados.0.trial118.stdout:937: finishing write tid 1 to trial11845692-36 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:936: done (2 left) 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:938: done (1 left) 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:939: read oid 23 snap 85 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:939: expect (ObjNum 347 snap 82 seq_num 347) 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:940: copy_from oid 43 from oid 8 current snap is 89 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:941: read oid 5 snap -1 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:941: expect deleted 2026-02-17T05:31:41.285 INFO:tasks.rados.rados.0.trial118.stdout:942: delete oid 27 current snap is 89 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: finishing write tid 2 to trial11845692-36 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: finishing write tid 3 to trial11845692-36 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: finishing write tid 4 to trial11845692-36 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: oid 36 updating version 0 to 464 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: oid 36 updating version 464 to 466 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: oid 36 version 466 is already newer than 465 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 466 (ObjNum 368 snap 89 seq_num 368) dirty exists 2026-02-17T05:31:41.286 INFO:tasks.rados.rados.0.trial118.stdout:937: left oid 36 (ObjNum 368 snap 89 seq_num 368) 2026-02-17T05:31:41.288 INFO:tasks.rados.rados.0.trial118.stdout:937: done (4 left) 2026-02-17T05:31:41.288 INFO:tasks.rados.rados.0.trial118.stdout:941: done (3 left) 2026-02-17T05:31:41.288 INFO:tasks.rados.rados.0.trial118.stdout:942: done (2 left) 2026-02-17T05:31:41.289 INFO:tasks.rados.rados.0.trial118.stdout:943: copy_from oid 16 from oid 2 current snap is 89 2026-02-17T05:31:41.289 INFO:tasks.rados.rados.0.trial118.stdout:944: write oid 3 current snap is 89 2026-02-17T05:31:41.290 INFO:tasks.rados.rados.0.trial118.stdout:944: seq_num 371 ranges {635397=702323,1893643=341754} 2026-02-17T05:31:41.295 INFO:tasks.rados.rados.0.trial118.stdout:944: writing trial11845692-3 from 635397 to 1337720 tid 1 2026-02-17T05:31:41.299 INFO:tasks.rados.rados.0.trial118.stdout:944: writing trial11845692-3 from 1893643 to 2235397 tid 2 2026-02-17T05:31:41.299 INFO:tasks.rados.rados.0.trial118.stdout:945: delete oid 47 current snap is 89 2026-02-17T05:31:41.299 INFO:tasks.rados.rados.0.trial118.stdout:939: expect (ObjNum 347 snap 82 seq_num 347) 2026-02-17T05:31:41.307 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1421440 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:940: finishing copy_from racing read to trial11845692-43 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:943: finishing copy_from racing read to trial11845692-16 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:940: finishing copy_from to trial11845692-43 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 498 (ObjNum 344 snap 81 seq_num 344) dirty exists 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:943: finishing copy_from to trial11845692-16 2026-02-17T05:31:41.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 513 (ObjNum 367 snap 89 seq_num 367) dirty exists 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: finishing write tid 1 to trial11845692-3 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: finishing write tid 2 to trial11845692-3 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: finishing write tid 3 to trial11845692-3 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: finishing write tid 4 to trial11845692-3 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: oid 3 updating version 0 to 395 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: oid 3 version 395 is already newer than 393 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: oid 3 version 395 is already newer than 394 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 395 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: left oid 3 (ObjNum 371 snap 89 seq_num 371) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:939: done (4 left) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:940: done (3 left) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:943: done (2 left) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:944: done (1 left) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:945: done (0 left) 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:946: copy_from oid 43 from oid 49 current snap is 89 2026-02-17T05:31:41.404 INFO:tasks.rados.rados.0.trial118.stdout:947: snap_create 2026-02-17T05:31:41.407 INFO:tasks.rados.rados.0.trial118.stdout:946: finishing copy_from racing read to trial11845692-43 2026-02-17T05:31:41.409 INFO:tasks.rados.rados.0.trial118.stdout:946: finishing copy_from to trial11845692-43 2026-02-17T05:31:41.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 336 (ObjNum 280 snap 67 seq_num 280) dirty exists 2026-02-17T05:31:42.340 INFO:tasks.rados.rados.0.trial118.stdout:946: done (1 left) 2026-02-17T05:31:42.341 INFO:tasks.rados.rados.0.trial118.stdout:947: done (0 left) 2026-02-17T05:31:42.341 INFO:tasks.rados.rados.0.trial118.stdout:948: read oid 7 snap -1 2026-02-17T05:31:42.341 INFO:tasks.rados.rados.0.trial118.stdout:948: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:42.341 INFO:tasks.rados.rados.0.trial118.stdout:949: write oid 5 current snap is 90 2026-02-17T05:31:42.341 INFO:tasks.rados.rados.0.trial118.stdout:949: seq_num 373 ranges {669011=569174,2010607=258404} 2026-02-17T05:31:42.345 INFO:tasks.rados.rados.0.trial118.stdout:949: writing trial11845692-5 from 669011 to 1238185 tid 1 2026-02-17T05:31:42.350 INFO:tasks.rados.rados.0.trial118.stdout:949: writing trial11845692-5 from 2010607 to 2269011 tid 2 2026-02-17T05:31:42.350 INFO:tasks.rados.rados.0.trial118.stdout:950: snap_remove snap 87 2026-02-17T05:31:43.342 INFO:tasks.rados.rados.0.trial118.stdout:950: done (2 left) 2026-02-17T05:31:43.342 INFO:tasks.rados.rados.0.trial118.stdout:951: snap_remove snap 84 2026-02-17T05:31:44.346 INFO:tasks.rados.rados.0.trial118.stdout:951: done (2 left) 2026-02-17T05:31:44.347 INFO:tasks.rados.rados.0.trial118.stdout:952: snap_create 2026-02-17T05:31:44.347 INFO:tasks.rados.rados.0.trial118.stdout:948: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: finishing write tid 1 to trial11845692-5 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: finishing write tid 2 to trial11845692-5 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: finishing write tid 3 to trial11845692-5 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: finishing write tid 4 to trial11845692-5 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: oid 5 updating version 0 to 130 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: oid 5 updating version 130 to 131 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:949: oid 5 version 131 is already newer than 129 2026-02-17T05:31:44.476 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 131 (ObjNum 373 snap 90 seq_num 373) dirty exists 2026-02-17T05:31:44.477 INFO:tasks.rados.rados.0.trial118.stdout:949: left oid 5 (ObjNum 373 snap 90 seq_num 373) 2026-02-17T05:31:45.348 INFO:tasks.rados.rados.0.trial118.stdout:948: done (2 left) 2026-02-17T05:31:45.348 INFO:tasks.rados.rados.0.trial118.stdout:949: done (1 left) 2026-02-17T05:31:45.348 INFO:tasks.rados.rados.0.trial118.stdout:952: done (0 left) 2026-02-17T05:31:45.348 INFO:tasks.rados.rados.0.trial118.stdout:953: snap_remove snap 86 2026-02-17T05:31:46.351 INFO:tasks.rados.rados.0.trial118.stdout:953: done (0 left) 2026-02-17T05:31:46.351 INFO:tasks.rados.rados.0.trial118.stdout:954: write oid 47 current snap is 91 2026-02-17T05:31:46.351 INFO:tasks.rados.rados.0.trial118.stdout:954: seq_num 374 ranges {685818=644423,2069089=216729} 2026-02-17T05:31:46.356 INFO:tasks.rados.rados.0.trial118.stdout:954: writing trial11845692-47 from 685818 to 1330241 tid 1 2026-02-17T05:31:46.360 INFO:tasks.rados.rados.0.trial118.stdout:954: writing trial11845692-47 from 2069089 to 2285818 tid 2 2026-02-17T05:31:46.360 INFO:tasks.rados.rados.0.trial118.stdout:955: read oid 8 snap 85 2026-02-17T05:31:46.360 INFO:tasks.rados.rados.0.trial118.stdout:955: expect (ObjNum 344 snap 81 seq_num 344) 2026-02-17T05:31:46.360 INFO:tasks.rados.rados.0.trial118.stdout:956: snap_remove snap 88 2026-02-17T05:31:47.351 INFO:tasks.rados.rados.0.trial118.stdout:956: done (2 left) 2026-02-17T05:31:47.352 INFO:tasks.rados.rados.0.trial118.stdout:957: read oid 7 snap -1 2026-02-17T05:31:47.352 INFO:tasks.rados.rados.0.trial118.stdout:957: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:47.352 INFO:tasks.rados.rados.0.trial118.stdout:958: snap_remove snap 89 2026-02-17T05:31:48.354 INFO:tasks.rados.rados.0.trial118.stdout:958: done (3 left) 2026-02-17T05:31:48.354 INFO:tasks.rados.rados.0.trial118.stdout:959: snap_remove snap 90 2026-02-17T05:31:49.356 INFO:tasks.rados.rados.0.trial118.stdout:959: done (3 left) 2026-02-17T05:31:49.356 INFO:tasks.rados.rados.0.trial118.stdout:960: delete oid 30 current snap is 91 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: finishing write tid 1 to trial11845692-47 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: finishing write tid 2 to trial11845692-47 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: finishing write tid 3 to trial11845692-47 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: finishing write tid 4 to trial11845692-47 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: oid 47 updating version 0 to 455 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: oid 47 version 455 is already newer than 453 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: oid 47 version 455 is already newer than 454 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 455 (ObjNum 374 snap 91 seq_num 374) dirty exists 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:954: left oid 47 (ObjNum 374 snap 91 seq_num 374) 2026-02-17T05:31:49.357 INFO:tasks.rados.rados.0.trial118.stdout:955: expect (ObjNum 344 snap 81 seq_num 344) 2026-02-17T05:31:49.471 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 112751 2026-02-17T05:31:49.528 INFO:tasks.rados.rados.0.trial118.stdout:957: expect (ObjNum 351 snap 83 seq_num 351) 2026-02-17T05:31:49.541 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2058387 2026-02-17T05:31:49.569 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:954: done (3 left) 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:955: done (2 left) 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:957: done (1 left) 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:960: done (0 left) 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:961: read oid 47 snap -1 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:961: expect (ObjNum 374 snap 91 seq_num 374) 2026-02-17T05:31:49.660 INFO:tasks.rados.rados.0.trial118.stdout:962: snap_create 2026-02-17T05:31:49.665 INFO:tasks.rados.rados.0.trial118.stdout:961: expect (ObjNum 374 snap 91 seq_num 374) 2026-02-17T05:31:49.667 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1918252 2026-02-17T05:31:49.674 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:49.691 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:31:50.265 INFO:tasks.rados.rados.0.trial118.stdout:961: done (1 left) 2026-02-17T05:31:50.265 INFO:tasks.rados.rados.0.trial118.stdout:962: done (0 left) 2026-02-17T05:31:50.265 INFO:tasks.rados.rados.0.trial118.stdout:963: write (excl) oid 30 current snap is 92 2026-02-17T05:31:50.265 INFO:tasks.rados.rados.0.trial118.stdout:963: seq_num 376 ranges {719432=794921,2186053=133379} 2026-02-17T05:31:50.271 INFO:tasks.rados.rados.0.trial118.stdout:963: writing trial11845692-30 from 719432 to 1514353 tid 1 2026-02-17T05:31:50.274 INFO:tasks.rados.rados.0.trial118.stdout:963: writing trial11845692-30 from 2186053 to 2319432 tid 2 2026-02-17T05:31:50.274 INFO:tasks.rados.rados.0.trial118.stdout:964: read oid 5 snap -1 2026-02-17T05:31:50.274 INFO:tasks.rados.rados.0.trial118.stdout:964: expect (ObjNum 373 snap 90 seq_num 373) 2026-02-17T05:31:50.274 INFO:tasks.rados.rados.0.trial118.stdout:965: snap_remove snap 91 2026-02-17T05:31:51.267 INFO:tasks.rados.rados.0.trial118.stdout:965: done (2 left) 2026-02-17T05:31:51.267 INFO:tasks.rados.rados.0.trial118.stdout:966: read oid 24 snap -1 2026-02-17T05:31:51.267 INFO:tasks.rados.rados.0.trial118.stdout:966: expect deleted 2026-02-17T05:31:51.268 INFO:tasks.rados.rados.0.trial118.stdout:967: write oid 18 current snap is 92 2026-02-17T05:31:51.268 INFO:tasks.rados.rados.0.trial118.stdout:967: seq_num 377 ranges {736239=470170,1728182=571782} 2026-02-17T05:31:51.273 INFO:tasks.rados.rados.0.trial118.stdout:967: writing trial11845692-18 from 736239 to 1206409 tid 1 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:967: writing trial11845692-18 from 1728182 to 2299964 tid 2 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:968: snap_create 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: finishing write tid 1 to trial11845692-30 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: finishing write tid 2 to trial11845692-30 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: finishing write tid 3 to trial11845692-30 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: finishing write tid 4 to trial11845692-30 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: oid 30 updating version 0 to 503 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: oid 30 updating version 503 to 504 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: oid 30 updating version 504 to 505 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 505 (ObjNum 376 snap 92 seq_num 376) dirty exists 2026-02-17T05:31:51.277 INFO:tasks.rados.rados.0.trial118.stdout:963: left oid 30 (ObjNum 376 snap 92 seq_num 376) 2026-02-17T05:31:51.278 INFO:tasks.rados.rados.0.trial118.stdout:964: expect (ObjNum 373 snap 90 seq_num 373) 2026-02-17T05:31:51.280 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1433301 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: finishing write tid 1 to trial11845692-18 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: finishing write tid 2 to trial11845692-18 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: finishing write tid 3 to trial11845692-18 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: finishing write tid 4 to trial11845692-18 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: oid 18 updating version 0 to 276 2026-02-17T05:31:51.323 INFO:tasks.rados.rados.0.trial118.stdout:967: oid 18 version 276 is already newer than 275 2026-02-17T05:31:51.324 INFO:tasks.rados.rados.0.trial118.stdout:967: oid 18 version 276 is already newer than 274 2026-02-17T05:31:51.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 276 (ObjNum 377 snap 92 seq_num 377) dirty exists 2026-02-17T05:31:51.324 INFO:tasks.rados.rados.0.trial118.stdout:967: left oid 18 (ObjNum 377 snap 92 seq_num 377) 2026-02-17T05:31:52.268 INFO:tasks.rados.rados.0.trial118.stdout:963: done (4 left) 2026-02-17T05:31:52.268 INFO:tasks.rados.rados.0.trial118.stdout:964: done (3 left) 2026-02-17T05:31:52.269 INFO:tasks.rados.rados.0.trial118.stdout:966: done (2 left) 2026-02-17T05:31:52.269 INFO:tasks.rados.rados.0.trial118.stdout:967: done (1 left) 2026-02-17T05:31:52.269 INFO:tasks.rados.rados.0.trial118.stdout:968: done (0 left) 2026-02-17T05:31:52.269 INFO:tasks.rados.rados.0.trial118.stdout:969: snap_remove snap 85 2026-02-17T05:31:52.658 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:31:52.658 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:31:52.658 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T05:31:52.658 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T05:31:52.662 INFO:tasks.ceph.mon.b:Started 2026-02-17T05:31:52.662 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:31:52.662 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:31:52.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.742+0000 7fa3b4ecc640 10 monclient: get_monmap_and_config 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.742+0000 7fa3b4ecc640 10 monclient: build_initial_monmap 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.742+0000 7fa3b4ecc640 10 monclient: monmap: 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:52.743997+0000 2026-02-17T05:31:52.753 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:52.743997+0000 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.742+0000 7fa3b4ecc640 1 Processor -- start 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 1 -- start start 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient: init 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:52.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b008b060 con 0x7fa3b005dee0 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b005dc90 con 0x7fa3b0182720 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b008d6a0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient(hunting): authenticate will time out at 841.372369s 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ae575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa3b005d1b0 0x7fa3b005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59788/0 (socket says 10.20.193.106:59788) 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3add74640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa3b005dee0 0x7fa3b0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40284/0 (socket says 10.20.193.106:40284) 2026-02-17T05:31:52.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ae575640 1 -- 10.20.193.106:0/318047619 learned_addr learned my addr 10.20.193.106:0/318047619 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31842238 0 0) 0x7fa3b008d6a0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): my global_id is 4607 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3940035e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697789194 0 0) 0x7fa3b008b060 con 0x7fa3b005dee0 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient(hunting): my global_id is 64200 2026-02-17T05:31:52.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b008d6a0 con 0x7fa3b005dee0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3440220127 0 0) 0x7fa3940035e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 >> v1:10.20.193.118:6789/0 conn(0x7fa3b0182720 legacy=0x7fa3b01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 >> v1:10.20.193.106:6789/0 conn(0x7fa3b005dee0 legacy=0x7fa3b0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: _finish_hunting 0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 monclient: found mon.noname-b 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b0057960 con 0x7fa3b005d1b0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: _finish_auth 0 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: _check_auth_tickets 2026-02-17T05:31:52.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3a4002dd0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: dump: 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.758 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 5 monclient: authenticate success, global_id 4607 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3a4003010 con 0x7fa3b005d1b0 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 1 -- 10.20.193.106:0/318047619 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3a4003420 con 0x7fa3b005d1b0 2026-02-17T05:31:52.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3ad573640 10 monclient: dump: 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.760 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.743+0000 7fa3b4ecc640 4 set_mon_vals no callback set 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 10 monclient: shutdown 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/318047619 >> v1:10.20.193.106:6790/0 conn(0x7fa3b005d1b0 legacy=0x7fa3b005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/318047619 shutdown_connections 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/318047619 >> 10.20.193.106:0/318047619 conn(0x7fa3b00915f0 msgr2=0x7fa3b00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/318047619 shutdown_connections 2026-02-17T05:31:52.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/318047619 wait complete. 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 10 monclient: build_initial_monmap 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 10 monclient: monmap: 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:52.762 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 Processor -- start 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 1 -- start start 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.744+0000 7fa3b4ecc640 10 monclient: init 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b005e8e0 con 0x7fa3b005dee0 2026-02-17T05:31:52.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b005ce20 con 0x7fa3b0182720 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b008a040 con 0x7fa3b005d1b0 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient(hunting): authenticate will time out at 841.374088s 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3ae575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa3b005d1b0 0x7fa3b013cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59800/0 (socket says 10.20.193.106:59800) 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3ae575640 1 -- 10.20.193.106:0/1452368879 learned_addr learned my addr 10.20.193.106:0/1452368879 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706530796 0 0) 0x7fa3b008a040 con 0x7fa3b005d1b0 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): my global_id is 4610 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37c0035e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435443152 0 0) 0x7fa3b005e8e0 con 0x7fa3b005dee0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): my global_id is 64203 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b008a040 con 0x7fa3b005dee0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2696855483 0 0) 0x7fa37c0035e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3b005e8e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3a4002ce0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:52.765 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3283393814 0 0) 0x7fa3b008a040 con 0x7fa3b005dee0 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa37c0035e0 con 0x7fa3b005dee0 2026-02-17T05:31:52.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa39c002fe0 con 0x7fa3b005dee0 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.767 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1976097912 0 0) 0x7fa3b005e8e0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 >> v1:10.20.193.118:6789/0 conn(0x7fa3b0182720 legacy=0x7fa3b0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 >> v1:10.20.193.106:6789/0 conn(0x7fa3b005dee0 legacy=0x7fa3b013d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 monclient: found mon.c 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b010e820 con 0x7fa3b005d1b0 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: _finish_auth 0 2026-02-17T05:31:52.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 5 monclient: authenticate success, global_id 4610 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _renew_subs 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b01824f0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _renew_subs 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3b010d5a0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3a4004b50 con 0x7fa3b005d1b0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3a4004eb0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa392ffd640 10 monclient: dump: 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.770 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.745+0000 7fa3acd72640 4 set_mon_vals no callback set 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa3b4ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa3a4005010 con 0x7fa3b005d1b0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa3b4ecc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa3b4ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b0057ca0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3915+0+0 (unknown 4108592732 0 0) 0x7fa3a404fdd0 con 0x7fa3b005d1b0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.746+0000 7fa3add74640 10 monclient: get_auth_request con 0x7fa37c040be0 auth_method 0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.748+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fa3a4017570 con 0x7fa3b005d1b0 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.748+0000 7fa392ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:52.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.748+0000 7fa392ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.899+0000 7fa3b4ecc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.899+0000 7fa3b4ecc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.899+0000 7fa3b4ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.899+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa3b010d920 con 0x7fa3b005d1b0 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.900+0000 7fa392ffd640 1 -- 10.20.193.106:0/1452368879 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 641365192) 0x7fa3a4015500 con 0x7fa3b005d1b0 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.900+0000 7fa392ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:31:52.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.900+0000 7fa392ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 >> v1:10.20.193.118:6812/703720803 conn(0x7fa37c040be0 legacy=0x7fa37c061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 10 monclient: shutdown 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 >> v1:10.20.193.106:6790/0 conn(0x7fa3b005d1b0 legacy=0x7fa3b013cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 shutdown_connections 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 >> 10.20.193.106:0/1452368879 conn(0x7fa3b00915f0 msgr2=0x7fa3b008c290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:52.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 shutdown_connections 2026-02-17T05:31:52.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.901+0000 7fa3b4ecc640 1 -- 10.20.193.106:0/1452368879 wait complete. 2026-02-17T05:31:52.910 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:31:52.910 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:31:52.910 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:31:52.987 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 10 monclient: get_monmap_and_config 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 10 monclient: build_initial_monmap 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 10 monclient: monmap: 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:52.976912+0000 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:52.976912+0000 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:52.988 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 1 Processor -- start 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 1 -- start start 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.975+0000 7fd495012640 10 monclient: init 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient(hunting): picked mon.noname-c con 0x7fd49005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient(hunting): picked mon.noname-a con 0x7fd49005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient(hunting): picked mon.noname-b con 0x7fd490182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49008b060 con 0x7fd49005dee0 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49005dc90 con 0x7fd49005d1b0 2026-02-17T05:31:52.989 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49008d6a0 con 0x7fd490182720 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient(hunting): authenticate will time out at 841.605266s 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48f577640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd490182720 0x7fd4901a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59816/0 (socket says 10.20.193.106:59816) 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48f577640 1 -- 10.20.193.106:0/1216531038 learned_addr learned my addr 10.20.193.106:0/1216531038 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48e575640 1 --1- 10.20.193.106:0/1216531038 >> v1:10.20.193.106:6789/0 conn(0x7fd49005dee0 0x7fd490181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40308/0 (socket says 10.20.193.106:40308) 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056811139 0 0) 0x7fd49008b060 con 0x7fd49005dee0 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): my global_id is 64206 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c0035e0 con 0x7fd49005dee0 2026-02-17T05:31:52.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569616892 0 0) 0x7fd49008d6a0 con 0x7fd490182720 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): my global_id is 4613 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49008b060 con 0x7fd490182720 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832524005 0 0) 0x7fd49005dc90 con 0x7fd49005d1b0 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient(hunting): my global_id is 74101 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49008d6a0 con 0x7fd49005d1b0 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3553641906 0 0) 0x7fd47c0035e0 con 0x7fd49005dee0 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 >> v1:10.20.193.106:6790/0 conn(0x7fd490182720 legacy=0x7fd4901a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 >> v1:10.20.193.118:6789/0 conn(0x7fd49005d1b0 legacy=0x7fd49005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: _finish_hunting 0 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 monclient: found mon.noname-a 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd490057960 con 0x7fd49005dee0 2026-02-17T05:31:52.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: _finish_auth 0 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: _check_auth_tickets 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd478002dd0 con 0x7fd49005dee0 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 5 monclient: authenticate success, global_id 64206 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: dump: 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.993 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd478002fd0 con 0x7fd49005dee0 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd495012640 4 set_mon_vals no callback set 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 1 -- 10.20.193.106:0/1216531038 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd4780033e0 con 0x7fd49005dee0 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:52.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.976+0000 7fd48dd74640 10 monclient: dump: 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:52.995 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 10 monclient: shutdown 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- 10.20.193.106:0/1216531038 >> v1:10.20.193.106:6789/0 conn(0x7fd49005dee0 legacy=0x7fd490181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- 10.20.193.106:0/1216531038 shutdown_connections 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- 10.20.193.106:0/1216531038 >> 10.20.193.106:0/1216531038 conn(0x7fd4900915f0 msgr2=0x7fd4900919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- 10.20.193.106:0/1216531038 shutdown_connections 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- 10.20.193.106:0/1216531038 wait complete. 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 10 monclient: build_initial_monmap 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 10 monclient: monmap: 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:52.996 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 Processor -- start 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 1 -- start start 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.977+0000 7fd495012640 10 monclient: init 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:31:52.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient(hunting): picked mon.noname-a con 0x7fd49005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient(hunting): picked mon.noname-c con 0x7fd49005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient(hunting): picked mon.noname-b con 0x7fd490182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49010e1c0 con 0x7fd49005d1b0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49005e8e0 con 0x7fd490182720 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49008a000 con 0x7fd49005dee0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient(hunting): authenticate will time out at 841.607064s 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd48e575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd49005dee0 0x7fd49013d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59820/0 (socket says 10.20.193.106:59820) 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd48e575640 1 -- 10.20.193.106:0/895581366 learned_addr learned my addr 10.20.193.106:0/895581366 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353910023 0 0) 0x7fd49008a000 con 0x7fd49005dee0 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): my global_id is 4616 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd45c0035e0 con 0x7fd49005dee0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297996160 0 0) 0x7fd49010e1c0 con 0x7fd49005d1b0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): my global_id is 64209 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49008a000 con 0x7fd49005d1b0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2851763665 0 0) 0x7fd45c0035e0 con 0x7fd49005dee0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49010e1c0 con 0x7fd49005dee0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd4780032f0 con 0x7fd49005dee0 2026-02-17T05:31:52.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): dump: 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.000 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459137693 0 0) 0x7fd49005e8e0 con 0x7fd490182720 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient(hunting): my global_id is 74104 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd45c0035e0 con 0x7fd490182720 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2822038106 0 0) 0x7fd49010e1c0 con 0x7fd49005dee0 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.118:6789/0 conn(0x7fd490182720 legacy=0x7fd490181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6789/0 conn(0x7fd49005d1b0 legacy=0x7fd49013cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 monclient: found mon.c 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4901824f0 con 0x7fd49005dee0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 5 monclient: authenticate success, global_id 4616 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _renew_subs 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49010f030 con 0x7fd49005dee0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _renew_subs 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd49010d830 con 0x7fd49005dee0 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4780028f0 con 0x7fd49005dee0 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd478004d00 con 0x7fd49005dee0 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd48d573640 4 set_mon_vals no callback set 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd46f7fe640 10 monclient: dump: 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.003 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.978+0000 7fd495012640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd49012aa40 con 0x7fd49012a670 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd478011ca0 con 0x7fd49005dee0 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3915+0+0 (unknown 4108592732 0 0) 0x7fd47804fd50 con 0x7fd49005dee0 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863714571 0 0) 0x7fd49012aa40 con 0x7fd49012a670 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient(hunting): my global_id is 64212 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49010e1c0 con 0x7fd49012a670 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd48f577640 10 monclient: get_auth_request con 0x7fd45c0409a0 auth_method 0 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3308763639 0 0) 0x7fd49010e1c0 con 0x7fd49012a670 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49012aa40 con 0x7fd49012a670 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd4840036c0 con 0x7fd49012a670 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient: dump: 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.005 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4210019745 0 0) 0x7fd49012aa40 con 0x7fd49012a670 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd49013d950 con 0x7fd49012a670 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd4840059f0 con 0x7fd49012a670 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6789/0 conn(0x7fd49012a670 legacy=0x7fd490059fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.979+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6789/0 conn(0x7fd49012a670 legacy=0x7fd490059fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd490055570 con 0x7fd49004d200 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714376589 0 0) 0x7fd490055570 con 0x7fd49004d200 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient(hunting): my global_id is 64215 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49012aa40 con 0x7fd49004d200 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 253751072 0 0) 0x7fd49012aa40 con 0x7fd49004d200 2026-02-17T05:31:53.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd490055570 con 0x7fd49004d200 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd484003fe0 con 0x7fd49004d200 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient: dump: 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.008 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3597344999 0 0) 0x7fd490055570 con 0x7fd49004d200 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd49010dae0 con 0x7fd49004d200 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3659939788) 0x7fd484005500 con 0x7fd49004d200 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6789/0 conn(0x7fd49004d200 legacy=0x7fd49011b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd46f7fe640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6789/0 conn(0x7fd49004d200 legacy=0x7fd49011b5f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 110521, 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:53.010 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.011 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.012 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:53.013 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:53.014 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:53.015 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.016 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.017 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:53.018 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.019 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.020 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:53.021 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:53.022 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.118:6812/703720803 conn(0x7fd45c0409a0 legacy=0x7fd45c060e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.022 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 10 monclient: shutdown 2026-02-17T05:31:53.022 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.022 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 >> v1:10.20.193.106:6790/0 conn(0x7fd49005dee0 legacy=0x7fd49013d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.022 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd48f577640 1 -- 10.20.193.106:0/895581366 reap_dead start 2026-02-17T05:31:53.023 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd48f577640 1 -- 10.20.193.106:0/895581366 reap_dead start 2026-02-17T05:31:53.023 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 shutdown_connections 2026-02-17T05:31:53.023 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 >> 10.20.193.106:0/895581366 conn(0x7fd4900915f0 msgr2=0x7fd49008c630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.023 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 shutdown_connections 2026-02-17T05:31:53.023 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:52.983+0000 7fd495012640 1 -- 10.20.193.106:0/895581366 wait complete. 2026-02-17T05:31:53.023 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:53.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:31:53.023 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:31:53.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.086+0000 7fdeb85c2640 10 monclient: get_monmap_and_config 2026-02-17T05:31:53.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.086+0000 7fdeb85c2640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient: monmap: 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:53.088386+0000 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:53.088386+0000 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:53.099 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 1 Processor -- start 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 1 -- start start 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient: init 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-c con 0x7fdeb005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-b con 0x7fdeb005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-a con 0x7fdeb0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb008b060 con 0x7fdeb0182720 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb005dc90 con 0x7fdeb005d1b0 2026-02-17T05:31:53.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb008d6a0 con 0x7fdeb005dee0 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb85c2640 10 monclient(hunting): authenticate will time out at 841.716798s 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb5b36640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdeb005dee0 0x7fdeb0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59826/0 (socket says 10.20.193.106:59826) 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.087+0000 7fdeb5b36640 1 -- 10.20.193.106:0/1979833238 learned_addr learned my addr 10.20.193.106:0/1979833238 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101627576 0 0) 0x7fdeb008d6a0 con 0x7fdeb005dee0 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): my global_id is 4619 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde980035e0 con 0x7fdeb005dee0 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586193259 0 0) 0x7fdeb008b060 con 0x7fdeb0182720 2026-02-17T05:31:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): my global_id is 64218 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb008d6a0 con 0x7fdeb0182720 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50279895 0 0) 0x7fdeb005dc90 con 0x7fdeb005d1b0 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient(hunting): my global_id is 74107 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb008b060 con 0x7fdeb005d1b0 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1794241876 0 0) 0x7fdeb008d6a0 con 0x7fdeb0182720 2026-02-17T05:31:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 >> v1:10.20.193.106:6790/0 conn(0x7fdeb005dee0 legacy=0x7fdeb0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 >> v1:10.20.193.118:6789/0 conn(0x7fdeb005d1b0 legacy=0x7fdeb005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 monclient: found mon.noname-a 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb0057960 con 0x7fdeb0182720 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeac003eb0 con 0x7fdeb0182720 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 5 monclient: authenticate success, global_id 64218 2026-02-17T05:31:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: dump: 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.104 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdeac004080 con 0x7fdeb0182720 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 4 set_mon_vals no callback set 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 1 -- 10.20.193.106:0/1979833238 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeac004490 con 0x7fdeb0182720 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb5335640 10 monclient: dump: 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.105 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 10 monclient: shutdown 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 1 -- 10.20.193.106:0/1979833238 >> v1:10.20.193.106:6789/0 conn(0x7fdeb0182720 legacy=0x7fdeb01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 1 -- 10.20.193.106:0/1979833238 shutdown_connections 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 1 -- 10.20.193.106:0/1979833238 >> 10.20.193.106:0/1979833238 conn(0x7fdeb00915f0 msgr2=0x7fdeb00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 1 -- 10.20.193.106:0/1979833238 shutdown_connections 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.088+0000 7fdeb85c2640 1 -- 10.20.193.106:0/1979833238 wait complete. 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient: monmap: 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:53.107 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 1 Processor -- start 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 1 -- start start 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient: init 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-a con 0x7fdeb005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-b con 0x7fdeb005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient(hunting): picked mon.noname-c con 0x7fdeb0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb012b9e0 con 0x7fdeb005d1b0 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb012bf10 con 0x7fdeb005dee0 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb013f6a0 con 0x7fdeb0182720 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb85c2640 10 monclient(hunting): authenticate will time out at 841.718563s 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb6b38640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdeb0182720 0x7fdeb0181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59840/0 (socket says 10.20.193.106:59840) 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fdeb6b38640 1 -- 10.20.193.106:0/2764473758 learned_addr learned my addr 10.20.193.106:0/2764473758 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392089262 0 0) 0x7fdeb013f6a0 con 0x7fdeb0182720 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): my global_id is 4622 2026-02-17T05:31:53.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde800035e0 con 0x7fdeb0182720 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081514193 0 0) 0x7fdeb012b9e0 con 0x7fdeb005d1b0 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): my global_id is 64221 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb013f6a0 con 0x7fdeb005d1b0 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2255693795 0 0) 0x7fde800035e0 con 0x7fdeb0182720 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdeb012b9e0 con 0x7fdeb0182720 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeac0043a0 con 0x7fdeb0182720 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:53.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.089+0000 7fde96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1203567243 0 0) 0x7fdeb013f6a0 con 0x7fdeb005d1b0 2026-02-17T05:31:53.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde800035e0 con 0x7fdeb005d1b0 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdea0003040 con 0x7fdeb005d1b0 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3863072650 0 0) 0x7fdeb012b9e0 con 0x7fdeb0182720 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.118:6789/0 conn(0x7fdeb005dee0 legacy=0x7fdeb0128cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6789/0 conn(0x7fdeb005d1b0 legacy=0x7fdeb01285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 monclient: found mon.c 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb005e8e0 con 0x7fdeb0182720 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 5 monclient: authenticate success, global_id 4622 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 10 monclient: _renew_subs 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb013d7b0 con 0x7fdeb0182720 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 10 monclient: _renew_subs 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdeb012a9d0 con 0x7fdeb0182720 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdeac0049f0 con 0x7fdeb0182720 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeac003ad0 con 0x7fdeb0182720 2026-02-17T05:31:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 10 monclient: dump: 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb4b34640 4 set_mon_vals no callback set 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdeb01297d0 con 0x7fdeb0129400 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fdeac004dd0 con 0x7fdeb0182720 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.090+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3915+0+0 (unknown 4108592732 0 0) 0x7fdeac050ee0 con 0x7fdeb0182720 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994698447 0 0) 0x7fdeb01297d0 con 0x7fdeb0129400 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient(hunting): my global_id is 4625 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb012b9e0 con 0x7fdeb0129400 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fdeb5b36640 10 monclient: get_auth_request con 0x7fde80040b60 auth_method 0 2026-02-17T05:31:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1321062784 0 0) 0x7fdeb012b9e0 con 0x7fdeb0129400 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdeb01297d0 con 0x7fdeb0129400 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdea00036d0 con 0x7fdeb0129400 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient: dump: 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.117 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3475775014 0 0) 0x7fdeb01297d0 con 0x7fdeb0129400 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdeb0057ca0 con 0x7fdeb0129400 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdea0004700 con 0x7fdeb0129400 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6790/0 conn(0x7fdeb0129400 legacy=0x7fdeb0058ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.091+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6790/0 conn(0x7fdeb0129400 legacy=0x7fdeb0058ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.094+0000 7fdeb85c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.094+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdeb0055570 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181517034 0 0) 0x7fdeb0055570 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient(hunting): my global_id is 4628 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb01297d0 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1808169225 0 0) 0x7fdeb01297d0 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdeb0055570 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdea0003f50 con 0x7fdeb00593f0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient: dump: 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.119 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1232230308 0 0) 0x7fdeb0055570 con 0x7fdeb00593f0 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdeb008e3d0 con 0x7fdeb00593f0 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2673796043) 0x7fdea0004350 con 0x7fdeb00593f0 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6790/0 conn(0x7fdeb00593f0 legacy=0x7fdeb0130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fde96ffd640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6790/0 conn(0x7fdeb00593f0 legacy=0x7fdeb0130730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:53.121 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 237857, 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.122 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.123 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.124 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:53.125 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.126 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.127 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.128 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.129 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.130 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.131 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:53.132 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.118:6812/703720803 conn(0x7fde80040b60 legacy=0x7fde80061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 10 monclient: shutdown 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 >> v1:10.20.193.106:6790/0 conn(0x7fdeb0182720 legacy=0x7fdeb0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb6b38640 1 -- 10.20.193.106:0/2764473758 reap_dead start 2026-02-17T05:31:53.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb6b38640 1 -- 10.20.193.106:0/2764473758 reap_dead start 2026-02-17T05:31:53.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 shutdown_connections 2026-02-17T05:31:53.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 >> 10.20.193.106:0/2764473758 conn(0x7fdeb00915f0 msgr2=0x7fdeb008b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 shutdown_connections 2026-02-17T05:31:53.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.095+0000 7fdeb85c2640 1 -- 10.20.193.106:0/2764473758 wait complete. 2026-02-17T05:31:53.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:53.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:31:53.134 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: get_monmap_and_config 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: monmap: 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:53.201625+0000 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:53.201625+0000 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.209 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 1 Processor -- start 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 1 -- start start 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: init 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-c con 0x7f487005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-a con 0x7f487005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-b con 0x7f4870182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.200+0000 7f4874a52640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487008b060 con 0x7f487005dee0 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487005dc90 con 0x7f487005d1b0 2026-02-17T05:31:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487008d6a0 con 0x7f4870182720 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 10 monclient(hunting): authenticate will time out at 841.830033s 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486ed76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4870182720 0x7f48701a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59872/0 (socket says 10.20.193.106:59872) 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486ed76640 1 -- 10.20.193.106:0/3512668913 learned_addr learned my addr 10.20.193.106:0/3512668913 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486dd74640 1 --1- 10.20.193.106:0/3512668913 >> v1:10.20.193.106:6789/0 conn(0x7f487005dee0 0x7f4870181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40376/0 (socket says 10.20.193.106:40376) 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801581529 0 0) 0x7f487008d6a0 con 0x7f4870182720 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): my global_id is 4631 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f485c0035e0 con 0x7f4870182720 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785165844 0 0) 0x7f487008b060 con 0x7f487005dee0 2026-02-17T05:31:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): my global_id is 64224 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487008d6a0 con 0x7f487005dee0 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027965740 0 0) 0x7f487005dc90 con 0x7f487005d1b0 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient(hunting): my global_id is 74110 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487008b060 con 0x7f487005d1b0 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2203063525 0 0) 0x7f487008d6a0 con 0x7f487005dee0 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 >> v1:10.20.193.106:6790/0 conn(0x7f4870182720 legacy=0x7f48701a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 >> v1:10.20.193.118:6789/0 conn(0x7f487005d1b0 legacy=0x7f487005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 monclient: found mon.noname-a 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870057960 con 0x7f487005dee0 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4858002dd0 con 0x7f487005dee0 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: dump: 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.213 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 5 monclient: authenticate success, global_id 64224 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4858002fa0 con 0x7f487005dee0 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 1 -- 10.20.193.106:0/3512668913 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48580033b0 con 0x7f487005dee0 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f486d573640 10 monclient: dump: 2026-02-17T05:31:53.214 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 4 set_mon_vals no callback set 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 10 monclient: shutdown 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.201+0000 7f4874a52640 1 -- 10.20.193.106:0/3512668913 >> v1:10.20.193.106:6789/0 conn(0x7f487005dee0 legacy=0x7f4870181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 -- 10.20.193.106:0/3512668913 shutdown_connections 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 -- 10.20.193.106:0/3512668913 >> 10.20.193.106:0/3512668913 conn(0x7f48700915f0 msgr2=0x7f48700919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 -- 10.20.193.106:0/3512668913 shutdown_connections 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 -- 10.20.193.106:0/3512668913 wait complete. 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 10 monclient: monmap: 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:53.216 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 Processor -- start 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 1 -- start start 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.202+0000 7f4874a52640 10 monclient: init 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-b con 0x7f487005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-a con 0x7f487005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient(hunting): picked mon.noname-c con 0x7f4870182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487012e4b0 con 0x7f487005dee0 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487005e8e0 con 0x7f487005d1b0 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487010e120 con 0x7f4870182720 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient(hunting): authenticate will time out at 841.832105s 2026-02-17T05:31:53.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f486ed76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4870182720 0x7f4870181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59876/0 (socket says 10.20.193.106:59876) 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f486ed76640 1 -- 10.20.193.106:0/415253824 learned_addr learned my addr 10.20.193.106:0/415253824 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595178921 0 0) 0x7f487012e4b0 con 0x7f487005dee0 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): my global_id is 64227 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c0035e0 con 0x7f487005dee0 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61270664 0 0) 0x7f487010e120 con 0x7f4870182720 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): my global_id is 4634 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487012e4b0 con 0x7f4870182720 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2345774163 0 0) 0x7f483c0035e0 con 0x7f487005dee0 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f487010e120 con 0x7f487005dee0 2026-02-17T05:31:53.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f48580032c0 con 0x7f487005dee0 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:53.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2341266734 0 0) 0x7f487012e4b0 con 0x7f4870182720 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f483c0035e0 con 0x7f4870182720 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4860004120 con 0x7f4870182720 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): dump: 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.220 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823368116 0 0) 0x7f487005e8e0 con 0x7f487005d1b0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient(hunting): my global_id is 74113 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487012e4b0 con 0x7f487005d1b0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2202740728 0 0) 0x7f487010e120 con 0x7f487005dee0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.106:6790/0 conn(0x7f4870182720 legacy=0x7f4870181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6789/0 conn(0x7f487005d1b0 legacy=0x7f487012d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 monclient: found mon.a 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487010cc30 con 0x7f487005dee0 2026-02-17T05:31:53.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 5 monclient: authenticate success, global_id 64227 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _renew_subs 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f487010c6c0 con 0x7f487005dee0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _renew_subs 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f487010ef90 con 0x7f487005dee0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4858002970 con 0x7f487005dee0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4858004d80 con 0x7f487005dee0 2026-02-17T05:31:53.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f4856ffd640 10 monclient: dump: 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.203+0000 7f486cd72640 4 set_mon_vals no callback set 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4874a52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f487012a9f0 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4858011d20 con 0x7f487005dee0 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(207..207 src has 1..207) ==== 3915+0+0 (unknown 4108592732 0 0) 0x7f485804fec0 con 0x7f487005dee0 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f486ed76640 10 monclient: get_auth_request con 0x7f483c040d80 auth_method 0 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640487347 0 0) 0x7f487012a9f0 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient(hunting): my global_id is 74116 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487010e120 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 699183021 0 0) 0x7f487010e120 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f487012a9f0 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4864002f80 con 0x7f487012a620 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 10 monclient: dump: 2026-02-17T05:31:53.224 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1402674894 0 0) 0x7f487012a9f0 con 0x7f487012a620 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.204+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4870057ca0 con 0x7f487012a620 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.205+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4864005250 con 0x7f487012a620 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.205+0000 7f4856ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.205+0000 7f4856ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:53.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.205+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6789/0 conn(0x7f487012a620 legacy=0x7f48701076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.205+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6789/0 conn(0x7f487012a620 legacy=0x7f48701076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4874a52640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f487010db60 con 0x7f487010d790 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371787210 0 0) 0x7f487010db60 con 0x7f487010d790 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 10 monclient(hunting): my global_id is 74119 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.208+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487012a9f0 con 0x7f487010d790 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3202120329 0 0) 0x7f487012a9f0 con 0x7f487010d790 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f487010db60 con 0x7f487010d790 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4864003810 con 0x7f487010d790 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 10 monclient: dump: 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.228 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 818000258 0 0) 0x7f487010db60 con 0x7f487010d790 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f487010ea30 con 0x7f487010d790 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 1986532463) 0x7f4864004d70 con 0x7f487010d790 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6789/0 conn(0x7f487010d790 legacy=0x7f4870107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4856ffd640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6789/0 conn(0x7f487010d790 legacy=0x7f4870107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:53.229 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 488, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.230 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.231 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.232 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:53.233 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:53.234 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.235 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:53.236 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.237 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:53.238 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:53.239 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.118:6812/703720803 conn(0x7f483c040d80 legacy=0x7f483c061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 10 monclient: shutdown 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 >> v1:10.20.193.106:6789/0 conn(0x7f487005dee0 legacy=0x7f487012dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f486ed76640 1 -- 10.20.193.106:0/415253824 reap_dead start 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f486ed76640 1 -- 10.20.193.106:0/415253824 reap_dead start 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 shutdown_connections 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 >> 10.20.193.106:0/415253824 conn(0x7f48700915f0 msgr2=0x7f4870089790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 shutdown_connections 2026-02-17T05:31:53.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.209+0000 7f4874a52640 1 -- 10.20.193.106:0/415253824 wait complete. 2026-02-17T05:31:53.241 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:53.241 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:31:53.241 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:31:53.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.304+0000 7fdee6bee640 10 monclient: get_monmap_and_config 2026-02-17T05:31:53.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.304+0000 7fdee6bee640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.304+0000 7fdee6bee640 10 monclient: monmap: 2026-02-17T05:31:53.313 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.313 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:53.306044+0000 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:53.306044+0000 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 1 Processor -- start 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 1 -- start start 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient: init 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-a con 0x7fdee005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-c con 0x7fdee005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-b con 0x7fdee0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee008b060 con 0x7fdee005d1b0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005dc90 con 0x7fdee005dee0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee008d6a0 con 0x7fdee0182720 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 10 monclient(hunting): authenticate will time out at 841.934422s 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee4963640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fdee005d1b0 0x7fdee005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40396/0 (socket says 10.20.193.106:40396) 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee4963640 1 -- 10.20.193.106:0/1220778192 learned_addr learned my addr 10.20.193.106:0/1220778192 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee5164640 1 --1- 10.20.193.106:0/1220778192 >> v1:10.20.193.106:6790/0 conn(0x7fdee0182720 0x7fdee01a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59880/0 (socket says 10.20.193.106:59880) 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777308328 0 0) 0x7fdee008b060 con 0x7fdee005d1b0 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): my global_id is 64230 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdecc0035e0 con 0x7fdee005d1b0 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898964324 0 0) 0x7fdee008d6a0 con 0x7fdee0182720 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient(hunting): my global_id is 4637 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee008b060 con 0x7fdee0182720 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651461489 0 0) 0x7fdecc0035e0 con 0x7fdee005d1b0 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 >> v1:10.20.193.106:6790/0 conn(0x7fdee0182720 legacy=0x7fdee01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 >> v1:10.20.193.118:6789/0 conn(0x7fdee005dee0 legacy=0x7fdee0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 monclient: found mon.noname-a 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0057960 con 0x7fdee005d1b0 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fded0002dd0 con 0x7fdee005d1b0 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 5 monclient: authenticate success, global_id 64230 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fded77fe640 10 monclient: dump: 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.305+0000 7fdee6bee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fded0003010 con 0x7fdee005d1b0 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 1 -- 10.20.193.106:0/1220778192 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fded0003420 con 0x7fdee005d1b0 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 4 set_mon_vals no callback set 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fded77fe640 10 monclient: dump: 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.318 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 10 monclient: shutdown 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- 10.20.193.106:0/1220778192 >> v1:10.20.193.106:6789/0 conn(0x7fdee005d1b0 legacy=0x7fdee005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- 10.20.193.106:0/1220778192 shutdown_connections 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- 10.20.193.106:0/1220778192 >> 10.20.193.106:0/1220778192 conn(0x7fdee00915f0 msgr2=0x7fdee00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- 10.20.193.106:0/1220778192 shutdown_connections 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- 10.20.193.106:0/1220778192 wait complete. 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 10 monclient: build_initial_monmap 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 10 monclient: monmap: 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:53.319 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 Processor -- start 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 1 -- start start 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.306+0000 7fdee6bee640 10 monclient: init 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-a con 0x7fdee005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-c con 0x7fdee005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient(hunting): picked mon.noname-b con 0x7fdee0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:53.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee012ab80 con 0x7fdee005d1b0 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005ceb0 con 0x7fdee0182720 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005e8e0 con 0x7fdee005dee0 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient(hunting): authenticate will time out at 841.936251s 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee4963640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fdee005d1b0 0x7fdee01a33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40410/0 (socket says 10.20.193.106:40410) 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee4963640 1 -- 10.20.193.106:0/2779664685 learned_addr learned my addr 10.20.193.106:0/2779664685 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651238526 0 0) 0x7fdee005e8e0 con 0x7fdee005dee0 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): my global_id is 4640 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb00035e0 con 0x7fdee005dee0 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198359371 0 0) 0x7fdee0057960 con 0x7fdee005d1b0 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): my global_id is 64233 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee005e8e0 con 0x7fdee005d1b0 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1633492541 0 0) 0x7fdee005e8e0 con 0x7fdee005d1b0 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdee0057960 con 0x7fdee005d1b0 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fded0002ce0 con 0x7fdee005d1b0 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): dump: 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.322 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1448607295 0 0) 0x7fdeb00035e0 con 0x7fdee005dee0 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdee005e8e0 con 0x7fdee005dee0 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdec8003010 con 0x7fdee005dee0 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): dump: 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.323 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296791632 0 0) 0x7fdee005ceb0 con 0x7fdee0182720 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient(hunting): my global_id is 74125 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb00035e0 con 0x7fdee0182720 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3593751658 0 0) 0x7fdee0057960 con 0x7fdee005d1b0 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 >> v1:10.20.193.106:6790/0 conn(0x7fdee005dee0 legacy=0x7fdee01a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 >> v1:10.20.193.118:6789/0 conn(0x7fdee0182720 legacy=0x7fdee0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: _finish_hunting 0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 monclient: found mon.a 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0129f10 con 0x7fdee005d1b0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: _finish_auth 0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: _check_auth_tickets 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 5 monclient: authenticate success, global_id 64233 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _renew_subs 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdee01824f0 con 0x7fdee005d1b0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _renew_subs 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdee012c320 con 0x7fdee005d1b0 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fded0002970 con 0x7fdee005d1b0 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fded0004d00 con 0x7fdee005d1b0 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded57fa640 10 monclient: dump: 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:53.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.307+0000 7fded6ffd640 4 set_mon_vals no callback set 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fdee6bee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fdee6bee640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fdee6bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00008d0 con 0x7fdee005d1b0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fded0004e60 con 0x7fdee005d1b0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(207..207 src has 1..207) ==== 3915+0+0 (unknown 4108592732 0 0) 0x7fded004fca0 con 0x7fdee005d1b0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.308+0000 7fded7fff640 10 monclient: get_auth_request con 0x7fdeb0040d70 auth_method 0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.311+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fded0017380 con 0x7fdee005d1b0 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.311+0000 7fded57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:53.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.311+0000 7fded57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:53.365 INFO:tasks.rados.rados.0.trial118.stdout:969: done (0 left) 2026-02-17T05:31:53.365 INFO:tasks.rados.rados.0.trial118.stdout:970: delete oid 44 current snap is 93 2026-02-17T05:31:53.366 INFO:tasks.rados.rados.0.trial118.stdout:970: done (0 left) 2026-02-17T05:31:53.366 INFO:tasks.rados.rados.0.trial118.stdout:971: write oid 1 current snap is 93 2026-02-17T05:31:53.366 INFO:tasks.rados.rados.0.trial118.stdout:971: seq_num 379 ranges {769853=620668,1845146=524707} 2026-02-17T05:31:53.371 INFO:tasks.rados.rados.0.trial118.stdout:971: writing trial11845692-1 from 769853 to 1390521 tid 1 2026-02-17T05:31:53.375 INFO:tasks.rados.rados.0.trial118.stdout:971: writing trial11845692-1 from 1845146 to 2369853 tid 2 2026-02-17T05:31:53.375 INFO:tasks.rados.rados.0.trial118.stdout:972: read oid 25 snap -1 2026-02-17T05:31:53.375 INFO:tasks.rados.rados.0.trial118.stdout:972: expect deleted 2026-02-17T05:31:53.375 INFO:tasks.rados.rados.0.trial118.stdout:973: snap_create 2026-02-17T05:31:53.375 INFO:tasks.rados.rados.0.trial118.stdout:971: finishing write tid 1 to trial11845692-1 2026-02-17T05:31:53.376 INFO:tasks.rados.rados.0.trial118.stdout:971: finishing write tid 2 to trial11845692-1 2026-02-17T05:31:53.376 INFO:tasks.rados.rados.0.trial118.stdout:971: finishing write tid 3 to trial11845692-1 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:971: finishing write tid 4 to trial11845692-1 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:971: oid 1 updating version 0 to 511 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:971: oid 1 version 511 is already newer than 509 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:971: oid 1 version 511 is already newer than 510 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 511 (ObjNum 379 snap 93 seq_num 379) dirty exists 2026-02-17T05:31:53.377 INFO:tasks.rados.rados.0.trial118.stdout:971: left oid 1 (ObjNum 379 snap 93 seq_num 379) 2026-02-17T05:31:53.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.458+0000 7fdee6bee640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:31:53.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.458+0000 7fdee6bee640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:31:53.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.458+0000 7fdee6bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:53.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.458+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdee012ab80 con 0x7fdee005d1b0 2026-02-17T05:31:53.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.459+0000 7fded57fa640 1 -- 10.20.193.106:0/2779664685 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fdee012ab80 con 0x7fdee005d1b0 2026-02-17T05:31:53.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.459+0000 7fded57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:31:53.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.459+0000 7fded57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:53.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1787945159,config=1618278320,health=3992016579,kv=675723720,logm=2409684889}) 2026-02-17T05:31:53.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=600655680,config=1618278320,health=1796179531,kv=675723720,logm=960141597}) 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1787945159,config=1618278320,health=3992016579,kv=675723720,logm=2409684889}) 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=11,kv=11,logm=65} crc {auth=1564340967,config=1618278320,health=3550663312,kv=675723720,logm=1245274639}) 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1459511854}) 2026-02-17T05:31:53.467 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2987416725}) 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1459511854}) 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2629049200}) 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1969430801}) 2026-02-17T05:31:53.468 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1342731005}) 2026-02-17T05:31:53.469 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.469 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1969430801}) 2026-02-17T05:31:53.469 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3234655520}) 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 >> v1:10.20.193.118:6812/703720803 conn(0x7fdeb0040d70 legacy=0x7fdeb0061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 10 monclient: shutdown 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 >> v1:10.20.193.106:6789/0 conn(0x7fdee005d1b0 legacy=0x7fdee01a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 shutdown_connections 2026-02-17T05:31:53.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 >> 10.20.193.106:0/2779664685 conn(0x7fdee00915f0 msgr2=0x7fdee005c430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:53.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 shutdown_connections 2026-02-17T05:31:53.472 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.473 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:53.461+0000 7fdee6bee640 1 -- 10.20.193.106:0/2779664685 wait complete. 2026-02-17T05:31:53.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3905759769}) 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=892075500}) 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3905759769}) 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4284575082}) 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3898489566}) 2026-02-17T05:31:53.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125419361}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3898489566}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2103721925}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=357817938}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4155397304}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=357817938}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1891381595}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2093375868}) 2026-02-17T05:31:53.481 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2587338909}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2093375868}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=18103928}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1737546158}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=288801907}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1737546158}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=406533174}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=59,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=679456183,mdsmap=568353036,mgr=3324194213,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=406139034,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=243235807}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=61,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=3} crc {logm=1606280761,mdsmap=443047005,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1284844939,mon_config_key=3136443025,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=339427778}) 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=59,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=679456183,mdsmap=568353036,mgr=3324194213,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=406139034,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=243235807}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=2} crc {logm=2700289636,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1113462683,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2196611354}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=2,osd_pg_creating=1,osd_snap=24,osdmap=73} crc {osd_metadata=1309130086,osd_pg_creating=994516050,osd_snap=1478583006,osdmap=4036010426}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=2,osd_pg_creating=1,osd_snap=23,osdmap=74} crc {osd_metadata=1309130086,osd_pg_creating=994516050,osd_snap=3125843519,osdmap=297069262}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=2,osd_pg_creating=1,osd_snap=24,osdmap=73} crc {osd_metadata=1309130086,osd_pg_creating=994516050,osd_snap=1478583006,osdmap=4036010426}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=2,osd_snap=26,osdmap=72} crc {osd_metadata=1309130086,osd_snap=3388622600,osdmap=1373805785}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3112270673}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586067932}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3112270673}) 2026-02-17T05:31:53.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2276308269}) 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3582677547}) 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2709012270}) 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3582677547}) 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3315723264}) 2026-02-17T05:31:53.484 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.485 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=40} crc {osdmap=3073988601}) 2026-02-17T05:31:53.485 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=37} crc {osdmap=2709511110}) 2026-02-17T05:31:53.485 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:31:53.485 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=40} crc {osdmap=3073988601}) 2026-02-17T05:31:53.485 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:31:53.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=37} crc {osdmap=4017436960}) 2026-02-17T05:31:53.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:31:54.372 INFO:tasks.rados.rados.0.trial118.stdout:971: done (2 left) 2026-02-17T05:31:54.372 INFO:tasks.rados.rados.0.trial118.stdout:972: done (1 left) 2026-02-17T05:31:54.372 INFO:tasks.rados.rados.0.trial118.stdout:973: done (0 left) 2026-02-17T05:31:54.372 INFO:tasks.rados.rados.0.trial118.stdout:974: write oid 28 current snap is 94 2026-02-17T05:31:54.372 INFO:tasks.rados.rados.0.trial118.stdout:974: seq_num 380 ranges {786660=695917,1903628=435462} 2026-02-17T05:31:54.377 INFO:tasks.rados.rados.0.trial118.stdout:974: writing trial11845692-28 from 786660 to 1482577 tid 1 2026-02-17T05:31:54.381 INFO:tasks.rados.rados.0.trial118.stdout:974: writing trial11845692-28 from 1903628 to 2339090 tid 2 2026-02-17T05:31:54.381 INFO:tasks.rados.rados.0.trial118.stdout:975: write (excl) oid 27 current snap is 94 2026-02-17T05:31:54.381 INFO:tasks.rados.rados.0.trial118.stdout:975: seq_num 381 ranges {403467=487519,1562110=579120} 2026-02-17T05:31:54.384 INFO:tasks.rados.rados.0.trial118.stdout:975: writing trial11845692-27 from 403467 to 890986 tid 1 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:975: writing trial11845692-27 from 1562110 to 2141230 tid 2 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:976: snap_create 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: finishing write tid 1 to trial11845692-28 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: finishing write tid 2 to trial11845692-28 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: finishing write tid 3 to trial11845692-28 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: finishing write tid 4 to trial11845692-28 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: oid 28 updating version 0 to 277 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: oid 28 updating version 277 to 279 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: oid 28 version 279 is already newer than 278 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 279 (ObjNum 380 snap 94 seq_num 380) dirty exists 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:974: left oid 28 (ObjNum 380 snap 94 seq_num 380) 2026-02-17T05:31:54.389 INFO:tasks.rados.rados.0.trial118.stdout:975: finishing write tid 1 to trial11845692-27 2026-02-17T05:31:54.390 INFO:tasks.rados.rados.0.trial118.stdout:975: finishing write tid 2 to trial11845692-27 2026-02-17T05:31:54.390 INFO:tasks.rados.rados.0.trial118.stdout:975: finishing write tid 3 to trial11845692-27 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:975: finishing write tid 4 to trial11845692-27 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:975: oid 27 updating version 0 to 546 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:975: oid 27 updating version 546 to 547 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:975: oid 27 version 547 is already newer than 545 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 547 (ObjNum 381 snap 94 seq_num 381) dirty exists 2026-02-17T05:31:54.391 INFO:tasks.rados.rados.0.trial118.stdout:975: left oid 27 (ObjNum 381 snap 94 seq_num 381) 2026-02-17T05:31:54.486 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:31:54.486 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:31:54.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: get_monmap_and_config 2026-02-17T05:31:54.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: monmap: 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:54.549608+0000 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:54.549608+0000 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:54.550 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 1 Processor -- start 2026-02-17T05:31:54.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 1 -- start start 2026-02-17T05:31:54.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: init 2026-02-17T05:31:54.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-a con 0x7fa8f4182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f408b060 con 0x7fa8f4182720 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f405dc90 con 0x7fa8f405dee0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f408d6a0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.548+0000 7fa8fb74c640 10 monclient(hunting): authenticate will time out at 843.177963s 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8f94c1640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa8f405d1b0 0x7fa8f405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55586/0 (socket says 10.20.193.106:55586) 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8f94c1640 1 -- 10.20.193.106:0/2896365120 learned_addr learned my addr 10.20.193.106:0/2896365120 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8f9cc2640 1 --1- 10.20.193.106:0/2896365120 >> v1:10.20.193.106:6789/0 conn(0x7fa8f4182720 0x7fa8f41a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36626/0 (socket says 10.20.193.106:36626) 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532877171 0 0) 0x7fa8f408b060 con 0x7fa8f4182720 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): my global_id is 64236 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8dc0035e0 con 0x7fa8f4182720 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212667969 0 0) 0x7fa8f408d6a0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): my global_id is 4643 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f408b060 con 0x7fa8f405d1b0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207360891 0 0) 0x7fa8f405dc90 con 0x7fa8f405dee0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient(hunting): my global_id is 74128 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f408d6a0 con 0x7fa8f405dee0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 692648849 0 0) 0x7fa8f408b060 con 0x7fa8f405d1b0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 >> v1:10.20.193.118:6789/0 conn(0x7fa8f405dee0 legacy=0x7fa8f4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 >> v1:10.20.193.106:6789/0 conn(0x7fa8f4182720 legacy=0x7fa8f41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 monclient: found mon.noname-b 2026-02-17T05:31:54.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4057960 con 0x7fa8f405d1b0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8e4002d00 con 0x7fa8f405d1b0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 5 monclient: authenticate success, global_id 4643 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: dump: 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8e4002ed0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 1 -- 10.20.193.106:0/2896365120 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8e40032e0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 4 set_mon_vals no callback set 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8e3fff640 10 monclient: dump: 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.553 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 10 monclient: shutdown 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 1 -- 10.20.193.106:0/2896365120 >> v1:10.20.193.106:6790/0 conn(0x7fa8f405d1b0 legacy=0x7fa8f405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 1 -- 10.20.193.106:0/2896365120 shutdown_connections 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 1 -- 10.20.193.106:0/2896365120 >> 10.20.193.106:0/2896365120 conn(0x7fa8f40915f0 msgr2=0x7fa8f40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 1 -- 10.20.193.106:0/2896365120 shutdown_connections 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.549+0000 7fa8fb74c640 1 -- 10.20.193.106:0/2896365120 wait complete. 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient: monmap: 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 1 Processor -- start 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 1 -- start start 2026-02-17T05:31:54.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient: init 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient(hunting): picked mon.noname-a con 0x7fa8f4182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f412c120 con 0x7fa8f4182720 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f405e8e0 con 0x7fa8f405dee0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f413f620 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8fb74c640 10 monclient(hunting): authenticate will time out at 843.179711s 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8f94c1640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa8f405d1b0 0x7fa8f4194300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55596/0 (socket says 10.20.193.106:55596) 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8f94c1640 1 -- 10.20.193.106:0/3489214716 learned_addr learned my addr 10.20.193.106:0/3489214716 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383153281 0 0) 0x7fa8f413f620 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): my global_id is 4646 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c40035e0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472844581 0 0) 0x7fa8f412c120 con 0x7fa8f4182720 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 10 monclient(hunting): my global_id is 64239 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.550+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f413f620 con 0x7fa8f4182720 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3734290207 0 0) 0x7fa8c40035e0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8f412c120 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8e4002c10 con 0x7fa8f405d1b0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): dump: 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.556 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2521381614 0 0) 0x7fa8f413f620 con 0x7fa8f4182720 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c40035e0 con 0x7fa8f4182720 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8f00040a0 con 0x7fa8f4182720 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient(hunting): dump: 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2652284089 0 0) 0x7fa8f412c120 con 0x7fa8f405d1b0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 >> v1:10.20.193.118:6789/0 conn(0x7fa8f405dee0 legacy=0x7fa8f4180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 >> v1:10.20.193.106:6789/0 conn(0x7fa8f4182720 legacy=0x7fa8f4195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 monclient: found mon.c 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f413d700 con 0x7fa8f405d1b0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 5 monclient: authenticate success, global_id 4646 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _renew_subs 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f41824f0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _renew_subs 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8f412a920 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8e4004b50 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8e4004eb0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 10 monclient: dump: 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e37fe640 4 set_mon_vals no callback set 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f412ba10 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.551+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa8e4005010 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.552+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7fa8e404ff00 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.552+0000 7fa8f8cc0640 10 monclient: get_auth_request con 0x7fa8c4040b60 auth_method 0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.554+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fa8e4017640 con 0x7fa8f405d1b0 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.554+0000 7fa8e1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.554+0000 7fa8e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:54.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8fb74c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:31:54.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8fb74c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8fb74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa8f4055570 con 0x7fa8f405d1b0 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8e1ffb640 1 -- 10.20.193.106:0/3489214716 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 832048296) 0x7fa8e40155d0 con 0x7fa8f405d1b0 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8e1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.699+0000 7fa8e1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:54.702 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:31:54.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 >> v1:10.20.193.118:6812/703720803 conn(0x7fa8c4040b60 legacy=0x7fa8c4061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 10 monclient: shutdown 2026-02-17T05:31:54.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 >> v1:10.20.193.106:6790/0 conn(0x7fa8f405d1b0 legacy=0x7fa8f4194300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 shutdown_connections 2026-02-17T05:31:54.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 >> 10.20.193.106:0/3489214716 conn(0x7fa8f40915f0 msgr2=0x7fa8f405beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 shutdown_connections 2026-02-17T05:31:54.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.700+0000 7fa8fb74c640 1 -- 10.20.193.106:0/3489214716 wait complete. 2026-02-17T05:31:54.710 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:31:54.710 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:31:54.710 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:31:54.710 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:31:54.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 10 monclient: get_monmap_and_config 2026-02-17T05:31:54.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 10 monclient: monmap: 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:54.776817+0000 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:54.776817+0000 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:54.778 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 1 Processor -- start 2026-02-17T05:31:54.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 1 -- start start 2026-02-17T05:31:54.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.775+0000 7f9977d94640 10 monclient: init 2026-02-17T05:31:54.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:31:54.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-c con 0x7f997005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-a con 0x7f997005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-b con 0x7f9970182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997008b060 con 0x7f997005dee0 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997005dc90 con 0x7f997005d1b0 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997008d6a0 con 0x7f9970182720 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient(hunting): authenticate will time out at 843.405294s 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f997630a640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9970182720 0x7f99701a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55610/0 (socket says 10.20.193.106:55610) 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f997630a640 1 -- 10.20.193.106:0/3154532328 learned_addr learned my addr 10.20.193.106:0/3154532328 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642311299 0 0) 0x7f997008d6a0 con 0x7f9970182720 2026-02-17T05:31:54.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): my global_id is 4649 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99580035e0 con 0x7f9970182720 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969512263 0 0) 0x7f997008b060 con 0x7f997005dee0 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient(hunting): my global_id is 64242 2026-02-17T05:31:54.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f997008d6a0 con 0x7f997005dee0 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 695489878 0 0) 0x7f99580035e0 con 0x7f9970182720 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 >> v1:10.20.193.118:6789/0 conn(0x7f997005d1b0 legacy=0x7f997005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 >> v1:10.20.193.106:6789/0 conn(0x7f997005dee0 legacy=0x7f9970181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 monclient: found mon.noname-b 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970057960 con 0x7f9970182720 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c003eb0 con 0x7f9970182720 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: dump: 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.792 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 5 monclient: authenticate success, global_id 4649 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f996c0040f0 con 0x7f9970182720 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 1 -- 10.20.193.106:0/3154532328 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c004500 con 0x7f9970182720 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9974b07640 10 monclient: dump: 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.793 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.776+0000 7f9977d94640 4 set_mon_vals no callback set 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 10 monclient: shutdown 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- 10.20.193.106:0/3154532328 >> v1:10.20.193.106:6790/0 conn(0x7f9970182720 legacy=0x7f99701a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- 10.20.193.106:0/3154532328 shutdown_connections 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- 10.20.193.106:0/3154532328 >> 10.20.193.106:0/3154532328 conn(0x7f99700915f0 msgr2=0x7f99700919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- 10.20.193.106:0/3154532328 shutdown_connections 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- 10.20.193.106:0/3154532328 wait complete. 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 10 monclient: monmap: 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:54.795 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 Processor -- start 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 1 -- start start 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.777+0000 7f9977d94640 10 monclient: init 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-b con 0x7f997005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-a con 0x7f997005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient(hunting): picked mon.noname-c con 0x7f9970182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997012b150 con 0x7f997005dee0 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997005e8e0 con 0x7f997005d1b0 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997010e260 con 0x7f9970182720 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient(hunting): authenticate will time out at 843.407203s 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f997630a640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9970182720 0x7f9970181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55624/0 (socket says 10.20.193.106:55624) 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f997630a640 1 -- 10.20.193.106:0/3403482241 learned_addr learned my addr 10.20.193.106:0/3403482241 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9975308640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f997005dee0 0x7f997013d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36642/0 (socket says 10.20.193.106:36642) 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733548056 0 0) 0x7f997010e260 con 0x7f9970182720 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): my global_id is 4652 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99400035e0 con 0x7f9970182720 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181066665 0 0) 0x7f997012b150 con 0x7f997005dee0 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): my global_id is 64245 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f997010e260 con 0x7f997005dee0 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1060927008 0 0) 0x7f99400035e0 con 0x7f9970182720 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f997012b150 con 0x7f9970182720 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c003dc0 con 0x7f9970182720 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): dump: 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2000946198 0 0) 0x7f997010e260 con 0x7f997005dee0 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99400035e0 con 0x7f997005dee0 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9964003060 con 0x7f997005dee0 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient(hunting): dump: 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.800 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3934296665 0 0) 0x7f997012b150 con 0x7f9970182720 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.118:6789/0 conn(0x7f997005d1b0 legacy=0x7f997013cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6789/0 conn(0x7f997005dee0 legacy=0x7f997013d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 monclient: found mon.c 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970089f60 con 0x7f9970182720 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 5 monclient: authenticate success, global_id 4652 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _renew_subs 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99701824f0 con 0x7f9970182720 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _renew_subs 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f997010d8d0 con 0x7f9970182720 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f996c0039d0 con 0x7f9970182720 2026-02-17T05:31:54.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f996c005de0 con 0x7f9970182720 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995e7fc640 10 monclient: dump: 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.803 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.778+0000 7f995ffff640 4 set_mon_vals no callback set 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f9977d94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9970057ca0 con 0x7f997012a6f0 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f996c012d80 con 0x7f9970182720 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7f996c050f20 con 0x7f9970182720 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578948543 0 0) 0x7f9970057ca0 con 0x7f997012a6f0 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient(hunting): my global_id is 64248 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f997012b150 con 0x7f997012a6f0 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2014067957 0 0) 0x7f997012b150 con 0x7f997012a6f0 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9970057ca0 con 0x7f997012a6f0 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9960002e40 con 0x7f997012a6f0 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 10 monclient: dump: 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.805 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f9975308640 10 monclient: get_auth_request con 0x7f9940040ac0 auth_method 0 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2740308896 0 0) 0x7f9970057ca0 con 0x7f997012a6f0 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.779+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f997010e830 con 0x7f997012a6f0 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.780+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f99600033a0 con 0x7f997012a6f0 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.780+0000 7f995e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.780+0000 7f995e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.780+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6789/0 conn(0x7f997012a6f0 legacy=0x7f997005a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.780+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6789/0 conn(0x7f997012a6f0 legacy=0x7f997005a030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f9977d94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f997010ed50 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495209111 0 0) 0x7f997010ed50 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient(hunting): my global_id is 64251 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9970057ca0 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3912868439 0 0) 0x7f9970057ca0 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f997010ed50 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9960003b20 con 0x7f997004d200 2026-02-17T05:31:54.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 10 monclient: dump: 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2974601838 0 0) 0x7f997010ed50 con 0x7f997004d200 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.783+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f997012aac0 con 0x7f997004d200 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2045320758) 0x7f9960003e20 con 0x7f997004d200 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f995e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f995e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6789/0 conn(0x7f997004d200 legacy=0x7f997011b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f995e7fc640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6789/0 conn(0x7f997004d200 legacy=0x7f997011b6b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:54.809 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 112322, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:54.810 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.811 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.812 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:54.813 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.814 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.815 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:54.816 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.817 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.818 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:31:54.819 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.820 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:54.821 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:54.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.118:6812/703720803 conn(0x7f9940040ac0 legacy=0x7f9940060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 10 monclient: shutdown 2026-02-17T05:31:54.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 >> v1:10.20.193.106:6790/0 conn(0x7f9970182720 legacy=0x7f9970181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f997630a640 1 -- 10.20.193.106:0/3403482241 reap_dead start 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f997630a640 1 -- 10.20.193.106:0/3403482241 reap_dead start 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 shutdown_connections 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 >> 10.20.193.106:0/3403482241 conn(0x7f99700915f0 msgr2=0x7f997008c540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 shutdown_connections 2026-02-17T05:31:54.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.784+0000 7f9977d94640 1 -- 10.20.193.106:0/3403482241 wait complete. 2026-02-17T05:31:54.825 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:54.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:31:54.825 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: get_monmap_and_config 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: monmap: 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:54.889510+0000 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:54.889510+0000 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.890 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:54.891 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:54.891 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 1 Processor -- start 2026-02-17T05:31:54.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 1 -- start start 2026-02-17T05:31:54.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: init 2026-02-17T05:31:54.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:31:54.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-b con 0x7fd99805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-a con 0x7fd99805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-c con 0x7fd998182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99808b060 con 0x7fd99805dee0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99805dc90 con 0x7fd998182720 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99808d6a0 con 0x7fd99805d1b0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99f70c640 10 monclient(hunting): authenticate will time out at 843.517892s 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99d481640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd99805d1b0 0x7fd99805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55634/0 (socket says 10.20.193.106:55634) 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.888+0000 7fd99d481640 1 -- 10.20.193.106:0/411344862 learned_addr learned my addr 10.20.193.106:0/411344862 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348102477 0 0) 0x7fd99808b060 con 0x7fd99805dee0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): my global_id is 64254 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9800035e0 con 0x7fd99805dee0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043526165 0 0) 0x7fd99808d6a0 con 0x7fd99805d1b0 2026-02-17T05:31:54.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient(hunting): my global_id is 4655 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99808b060 con 0x7fd99805d1b0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2774653676 0 0) 0x7fd9800035e0 con 0x7fd99805dee0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 >> v1:10.20.193.106:6790/0 conn(0x7fd99805d1b0 legacy=0x7fd99805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 >> v1:10.20.193.118:6789/0 conn(0x7fd998182720 legacy=0x7fd9981a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 monclient: found mon.noname-a 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd998057960 con 0x7fd99805dee0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd98c002dd0 con 0x7fd99805dee0 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: dump: 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 5 monclient: authenticate success, global_id 64254 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd98c003090 con 0x7fd99805dee0 2026-02-17T05:31:54.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 1 -- 10.20.193.106:0/411344862 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd98c0034a0 con 0x7fd99805dee0 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd987fff640 10 monclient: dump: 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 4 set_mon_vals no callback set 2026-02-17T05:31:54.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 10 monclient: shutdown 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 1 -- 10.20.193.106:0/411344862 >> v1:10.20.193.106:6789/0 conn(0x7fd99805dee0 legacy=0x7fd998181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 1 -- 10.20.193.106:0/411344862 shutdown_connections 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 1 -- 10.20.193.106:0/411344862 >> 10.20.193.106:0/411344862 conn(0x7fd9980915f0 msgr2=0x7fd9980919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 1 -- 10.20.193.106:0/411344862 shutdown_connections 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.889+0000 7fd99f70c640 1 -- 10.20.193.106:0/411344862 wait complete. 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient: monmap: 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:54.902 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 1 Processor -- start 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 1 -- start start 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient: init 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-b con 0x7fd99805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-c con 0x7fd99805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient(hunting): picked mon.noname-a con 0x7fd998182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99812bec0 con 0x7fd998182720 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99812c1a0 con 0x7fd99805d1b0 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99812b5b0 con 0x7fd99805dee0 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99f70c640 10 monclient(hunting): authenticate will time out at 843.519600s 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99cc80640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd99805dee0 0x7fd998128b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55638/0 (socket says 10.20.193.106:55638) 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99cc80640 1 -- 10.20.193.106:0/3020021222 learned_addr learned my addr 10.20.193.106:0/3020021222 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd99dc82640 1 --1- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6789/0 conn(0x7fd998182720 0x7fd998129220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36656/0 (socket says 10.20.193.106:36656) 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186374613 0 0) 0x7fd99812bec0 con 0x7fd998182720 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): my global_id is 64257 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9680035e0 con 0x7fd998182720 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472282950 0 0) 0x7fd99812b5b0 con 0x7fd99805dee0 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 10 monclient(hunting): my global_id is 4658 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.890+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99812bec0 con 0x7fd99805dee0 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4033484140 0 0) 0x7fd9680035e0 con 0x7fd998182720 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd99812b5b0 con 0x7fd998182720 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd994004110 con 0x7fd998182720 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): dump: 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1630114885 0 0) 0x7fd99812bec0 con 0x7fd99805dee0 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9680035e0 con 0x7fd99805dee0 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd98c0033b0 con 0x7fd99805dee0 2026-02-17T05:31:54.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): dump: 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858153960 0 0) 0x7fd99812c1a0 con 0x7fd99805d1b0 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient(hunting): my global_id is 74140 2026-02-17T05:31:54.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99812bec0 con 0x7fd99805d1b0 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 164047708 0 0) 0x7fd99812b5b0 con 0x7fd998182720 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6790/0 conn(0x7fd99805dee0 legacy=0x7fd998128b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.118:6789/0 conn(0x7fd99805d1b0 legacy=0x7fd998128400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 monclient: found mon.a 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99812a9a0 con 0x7fd998182720 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: _finish_auth 0 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 5 monclient: authenticate success, global_id 64257 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 10 monclient: _renew_subs 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd99813d780 con 0x7fd998182720 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 10 monclient: _renew_subs 2026-02-17T05:31:54.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd998181de0 con 0x7fd998182720 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9940042e0 con 0x7fd998182720 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd9940049e0 con 0x7fd998182720 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 10 monclient: dump: 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd9877fe640 4 set_mon_vals no callback set 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd99812baa0 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.891+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd994004b40 con 0x7fd998182720 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7fd994050d90 con 0x7fd998182720 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786596190 0 0) 0x7fd99812baa0 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient(hunting): my global_id is 4661 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99812b5b0 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd99cc80640 10 monclient: get_auth_request con 0x7fd968040d80 auth_method 0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3839635961 0 0) 0x7fd99812b5b0 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd99812baa0 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd988002f20 con 0x7fd9981820e0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient: dump: 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3239277971 0 0) 0x7fd99812baa0 con 0x7fd9981820e0 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd998057cd0 con 0x7fd9981820e0 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd988003300 con 0x7fd9981820e0 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6790/0 conn(0x7fd9981820e0 legacy=0x7fd998058dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.892+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6790/0 conn(0x7fd9981820e0 legacy=0x7fd998058dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd99f70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd998055570 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766417903 0 0) 0x7fd998055570 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient(hunting): my global_id is 4664 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99812baa0 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2787609927 0 0) 0x7fd99812baa0 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd998055570 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd988003550 con 0x7fd9980594d0 2026-02-17T05:31:54.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 10 monclient: dump: 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 848178308 0 0) 0x7fd998055570 con 0x7fd9980594d0 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.896+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd99808e3d0 con 0x7fd9980594d0 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1850086751) 0x7fd988004ef0 con 0x7fd9980594d0 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd985ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:54.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd985ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6790/0 conn(0x7fd9980594d0 legacy=0x7fd998130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd985ffb640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6790/0 conn(0x7fd9980594d0 legacy=0x7fd998130700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 239658, 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:54.914 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.915 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.916 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:54.917 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:54.918 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.919 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.920 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.921 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.922 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:54.923 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:54.924 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:54.924 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:54.924 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:54.924 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.118:6812/703720803 conn(0x7fd968040d80 legacy=0x7fd968061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 10 monclient: shutdown 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 >> v1:10.20.193.106:6789/0 conn(0x7fd998182720 legacy=0x7fd998129220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99dc82640 1 -- 10.20.193.106:0/3020021222 reap_dead start 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99dc82640 1 -- 10.20.193.106:0/3020021222 reap_dead start 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 shutdown_connections 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 >> 10.20.193.106:0/3020021222 conn(0x7fd9980915f0 msgr2=0x7fd998054a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 shutdown_connections 2026-02-17T05:31:54.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.897+0000 7fd99f70c640 1 -- 10.20.193.106:0/3020021222 wait complete. 2026-02-17T05:31:54.926 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:54.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:31:54.926 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: get_monmap_and_config 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: build_initial_monmap 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: monmap: 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:54.991435+0000 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:54.991435+0000 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:54.992 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:54.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 1 Processor -- start 2026-02-17T05:31:54.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 1 -- start start 2026-02-17T05:31:54.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: init 2026-02-17T05:31:54.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-b con 0x7fcf3405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-c con 0x7fcf3405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-a con 0x7fcf34182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3408b060 con 0x7fcf34182720 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3405dc90 con 0x7fcf3405dee0 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3408d6a0 con 0x7fcf3405d1b0 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf3a5dd640 10 monclient(hunting): authenticate will time out at 843.619779s 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf33fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fcf3405d1b0 0x7fcf3405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55660/0 (socket says 10.20.193.106:55660) 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf33fff640 1 -- 10.20.193.106:0/3883472055 learned_addr learned my addr 10.20.193.106:0/3883472055 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.990+0000 7fcf38b53640 1 --1- 10.20.193.106:0/3883472055 >> v1:10.20.193.106:6789/0 conn(0x7fcf34182720 0x7fcf341a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36658/0 (socket says 10.20.193.106:36658) 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483820559 0 0) 0x7fcf3408b060 con 0x7fcf34182720 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:54.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): my global_id is 64260 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf180035e0 con 0x7fcf34182720 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260445474 0 0) 0x7fcf3408d6a0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient(hunting): my global_id is 4667 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf3408b060 con 0x7fcf3405d1b0 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 538859133 0 0) 0x7fcf180035e0 con 0x7fcf34182720 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 >> v1:10.20.193.106:6790/0 conn(0x7fcf3405d1b0 legacy=0x7fcf3405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 >> v1:10.20.193.118:6789/0 conn(0x7fcf3405dee0 legacy=0x7fcf34181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 monclient: found mon.noname-a 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:55.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34057960 con 0x7fcf34182720 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: _finish_auth 0 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 5 monclient: authenticate success, global_id 64260 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf28003eb0 con 0x7fcf34182720 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: dump: 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.001 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf28004130 con 0x7fcf34182720 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 1 -- 10.20.193.106:0/3883472055 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf28004540 con 0x7fcf34182720 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 4 set_mon_vals no callback set 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf32ffd640 10 monclient: dump: 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.002 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 10 monclient: shutdown 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/3883472055 >> v1:10.20.193.106:6789/0 conn(0x7fcf34182720 legacy=0x7fcf341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/3883472055 shutdown_connections 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/3883472055 >> 10.20.193.106:0/3883472055 conn(0x7fcf340915f0 msgr2=0x7fcf340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/3883472055 shutdown_connections 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.991+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/3883472055 wait complete. 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: build_initial_monmap 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: monmap: 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:55.003 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 Processor -- start 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 -- start start 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: init 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-c con 0x7fcf3405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-b con 0x7fcf3405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient(hunting): picked mon.noname-a con 0x7fcf34182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3405e950 con 0x7fcf34182720 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3410f030 con 0x7fcf3405dee0 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3410e1c0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient(hunting): authenticate will time out at 843.621481s 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf33fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fcf3405d1b0 0x7fcf3413cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55664/0 (socket says 10.20.193.106:55664) 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf33fff640 1 -- 10.20.193.106:0/711378674 learned_addr learned my addr 10.20.193.106:0/711378674 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:55.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014483273 0 0) 0x7fcf3410e1c0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): my global_id is 4670 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf040035e0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720630034 0 0) 0x7fcf34057960 con 0x7fcf34182720 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): my global_id is 64263 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf3410e1c0 con 0x7fcf34182720 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 471519698 0 0) 0x7fcf040035e0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf34057960 con 0x7fcf3405d1b0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf20003170 con 0x7fcf3405d1b0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): dump: 2026-02-17T05:31:55.005 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096312658 0 0) 0x7fcf3410f030 con 0x7fcf3405dee0 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): my global_id is 74146 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf040035e0 con 0x7fcf3405dee0 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2241894749 0 0) 0x7fcf3410e1c0 con 0x7fcf34182720 2026-02-17T05:31:55.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf3410f030 con 0x7fcf34182720 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf280042a0 con 0x7fcf34182720 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient(hunting): dump: 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1360515461 0 0) 0x7fcf34057960 con 0x7fcf3405d1b0 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6789/0 conn(0x7fcf3405dee0 legacy=0x7fcf3413d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.106:6789/0 conn(0x7fcf34182720 legacy=0x7fcf34181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:31:55.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 monclient: found mon.c 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3410ccd0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient: _finish_auth 0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 5 monclient: authenticate success, global_id 4670 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: _renew_subs 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.992+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcf341824f0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf3a5dd640 10 monclient: _renew_subs 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf3a5dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcf3410d830 con 0x7fcf3405d1b0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf20003480 con 0x7fcf3405d1b0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf20004d00 con 0x7fcf3405d1b0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 10 monclient: dump: 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf327fc640 4 set_mon_vals no callback set 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf3a5dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcf340008d0 con 0x7fcf3412a670 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fcf20011ca0 con 0x7fcf3405d1b0 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7fcf2004fe40 con 0x7fcf3405d1b0 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.993+0000 7fcf38b53640 10 monclient: get_auth_request con 0x7fcf04040dd0 auth_method 0 2026-02-17T05:31:55.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394115956 0 0) 0x7fcf340008d0 con 0x7fcf3412a670 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient(hunting): my global_id is 74149 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf34057960 con 0x7fcf3412a670 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3069045668 0 0) 0x7fcf34057960 con 0x7fcf3412a670 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf340008d0 con 0x7fcf3412a670 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf24002e60 con 0x7fcf3412a670 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient: dump: 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.010 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3770225159 0 0) 0x7fcf340008d0 con 0x7fcf3412a670 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf34057ca0 con 0x7fcf3412a670 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fcf24008a20 con 0x7fcf3412a670 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6789/0 conn(0x7fcf3412a670 legacy=0x7fcf341076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.994+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6789/0 conn(0x7fcf3412a670 legacy=0x7fcf341076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:55.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf3a5dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:31:55.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcf3410db30 con 0x7fcf34107de0 2026-02-17T05:31:55.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375505048 0 0) 0x7fcf3410db30 con 0x7fcf34107de0 2026-02-17T05:31:55.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient(hunting): my global_id is 74152 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf340008d0 con 0x7fcf34107de0 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 100856910 0 0) 0x7fcf340008d0 con 0x7fcf34107de0 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf3410db30 con 0x7fcf34107de0 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcf24003750 con 0x7fcf34107de0 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.998+0000 7fcf30ff9640 10 monclient: dump: 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.013 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 456976488 0 0) 0x7fcf3410db30 con 0x7fcf34107de0 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcf3412aa40 con 0x7fcf34107de0 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2680084569) 0x7fcf24004cb0 con 0x7fcf34107de0 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6789/0 conn(0x7fcf34107de0 legacy=0x7fcf3411b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf30ff9640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6789/0 conn(0x7fcf34107de0 legacy=0x7fcf3411b610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:31:55.014 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 14, 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 2278, 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:55.015 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:55.016 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:55.017 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:31:55.018 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.019 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.020 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.021 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:31:55.022 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:31:55.023 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.118:6812/703720803 conn(0x7fcf04040dd0 legacy=0x7fcf04061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 10 monclient: shutdown 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 >> v1:10.20.193.106:6790/0 conn(0x7fcf3405d1b0 legacy=0x7fcf3413cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf38b53640 1 -- 10.20.193.106:0/711378674 reap_dead start 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf38b53640 1 -- 10.20.193.106:0/711378674 reap_dead start 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 shutdown_connections 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 >> 10.20.193.106:0/711378674 conn(0x7fcf340915f0 msgr2=0x7fcf34088680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 shutdown_connections 2026-02-17T05:31:55.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:54.999+0000 7fcf3a5dd640 1 -- 10.20.193.106:0/711378674 wait complete. 2026-02-17T05:31:55.025 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:31:55.025 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T05:31:55.025 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-17T05:31:55.025 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T05:31:55.025 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b store 2026-02-17T05:31:55.025 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b sync_force --yes-i-really-mean-it 2026-02-17T05:31:55.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 10 monclient: get_monmap_and_config 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 10 monclient: build_initial_monmap 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 10 monclient: monmap: 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:31:55.090689+0000 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:31:55.090689+0000 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:31:55.091 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 1 Processor -- start 2026-02-17T05:31:55.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 1 -- start start 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.089+0000 7f2e69acc640 10 monclient: init 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-b con 0x7f2e6405d300 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-c con 0x7f2e64140420 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-a con 0x7f2e64140860 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6405dde0 con 0x7f2e64140860 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6408c2a0 con 0x7f2e64140420 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6408d5c0 con 0x7f2e6405d300 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient(hunting): authenticate will time out at 843.719101s 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e637fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2e6405d300 0x7f2e6405d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:55680/0 (socket says 10.20.193.106:55680) 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e637fe640 1 -- 10.20.193.106:0/3248014723 learned_addr learned my addr 10.20.193.106:0/3248014723 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886390337 0 0) 0x7f2e6405dde0 con 0x7f2e64140860 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): my global_id is 64266 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e480035e0 con 0x7f2e64140860 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071699012 0 0) 0x7f2e6408d5c0 con 0x7f2e6405d300 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient(hunting): my global_id is 4673 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6405dde0 con 0x7f2e6405d300 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1365429797 0 0) 0x7f2e480035e0 con 0x7f2e64140860 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 >> v1:10.20.193.106:6790/0 conn(0x7f2e6405d300 legacy=0x7f2e6405d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 >> v1:10.20.193.118:6789/0 conn(0x7f2e64140420 legacy=0x7f2e64181190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: _finish_hunting 0 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 monclient: found mon.noname-a 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64057880 con 0x7f2e64140860 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: _finish_auth 0 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: _check_auth_tickets 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:55.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e58003eb0 con 0x7f2e64140860 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: dump: 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 5 monclient: authenticate success, global_id 64266 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e58004080 con 0x7f2e64140860 2026-02-17T05:31:55.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 1 -- 10.20.193.106:0/3248014723 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e58004490 con 0x7f2e64140860 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e627fc640 10 monclient: dump: 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 10 monclient: get_monmap_and_config success 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.090+0000 7f2e69acc640 4 set_mon_vals no callback set 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 10 monclient: shutdown 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- 10.20.193.106:0/3248014723 >> v1:10.20.193.106:6789/0 conn(0x7f2e64140860 legacy=0x7f2e641a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- 10.20.193.106:0/3248014723 shutdown_connections 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- 10.20.193.106:0/3248014723 >> 10.20.193.106:0/3248014723 conn(0x7f2e64054ef0 msgr2=0x7f2e64090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- 10.20.193.106:0/3248014723 shutdown_connections 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- 10.20.193.106:0/3248014723 wait complete. 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 10 monclient: build_initial_monmap 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 10 monclient: monmap: 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 Processor -- start 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 1 -- start start 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.091+0000 7f2e69acc640 10 monclient: init 2026-02-17T05:31:55.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-b con 0x7f2e6405d300 addr v1:10.20.193.118:6789/0 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-c con 0x7f2e64140420 addr v1:10.20.193.106:6790/0 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient(hunting): picked mon.noname-a con 0x7f2e64140860 addr v1:10.20.193.106:6789/0 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e64089d40 con 0x7f2e64140860 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6412cfe0 con 0x7f2e6405d300 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6412b520 con 0x7f2e64140420 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient(hunting): authenticate will time out at 843.721078s 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e63fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2e64140860 0x7f2e64195120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:36680/0 (socket says 10.20.193.106:36680) 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e63fff640 1 -- 10.20.193.106:0/524426912 learned_addr learned my addr 10.20.193.106:0/524426912 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014943244 0 0) 0x7f2e64057880 con 0x7f2e64140860 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): my global_id is 64269 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e340035e0 con 0x7f2e64140860 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271760943 0 0) 0x7f2e6412b520 con 0x7f2e64140420 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): my global_id is 4676 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e64057880 con 0x7f2e64140420 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 825959298 0 0) 0x7f2e340035e0 con 0x7f2e64140860 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e6412b520 con 0x7f2e64140860 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e58003dc0 con 0x7f2e64140860 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): dump: 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1632636473 0 0) 0x7f2e64057880 con 0x7f2e64140420 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e340035e0 con 0x7f2e64140420 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e54003070 con 0x7f2e64140420 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): dump: 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151003145 0 0) 0x7f2e6412cfe0 con 0x7f2e6405d300 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient(hunting): my global_id is 74158 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e64057880 con 0x7f2e6405d300 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 404908249 0 0) 0x7f2e6412b520 con 0x7f2e64140860 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.106:6790/0 conn(0x7f2e64140420 legacy=0x7f2e64193a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6789/0 conn(0x7f2e6405d300 legacy=0x7f2e64139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 monclient: found mon.a 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6412d5a0 con 0x7f2e64140860 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: _finish_auth 0 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 5 monclient: authenticate success, global_id 64269 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _renew_subs 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6412d880 con 0x7f2e64140860 2026-02-17T05:31:55.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _renew_subs 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e6413a570 con 0x7f2e64140860 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e580049b0 con 0x7f2e64140860 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e58004d10 con 0x7f2e64140860 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e3ffff640 10 monclient: dump: 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.092+0000 7f2e61ffb640 4 set_mon_vals no callback set 2026-02-17T05:31:55.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e69acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e6412c480 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2e58004e70 con 0x7f2e64140860 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7f2e58050d60 con 0x7f2e64140860 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e62ffd640 10 monclient: get_auth_request con 0x7f2e34040dd0 auth_method 0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199960213 0 0) 0x7f2e6412c480 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient(hunting): my global_id is 74161 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6412b520 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 45873945 0 0) 0x7f2e6412b520 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e6412c480 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e50002f20 con 0x7f2e641526a0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.093+0000 7f2e3ffff640 10 monclient: dump: 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.108 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2795233906 0 0) 0x7f2e6412c480 con 0x7f2e641526a0 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e6408bec0 con 0x7f2e641526a0 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2e50003400 con 0x7f2e641526a0 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6789/0 conn(0x7f2e641526a0 legacy=0x7f2e6413ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.094+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6789/0 conn(0x7f2e641526a0 legacy=0x7f2e6413ba00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:55.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e69acc640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:31:55.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e64152a70 con 0x7f2e6404d200 2026-02-17T05:31:55.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541579403 0 0) 0x7f2e64152a70 con 0x7f2e6404d200 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 10 monclient(hunting): my global_id is 74164 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.098+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6412c480 con 0x7f2e6404d200 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 937175326 0 0) 0x7f2e6412c480 con 0x7f2e6404d200 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e64152a70 con 0x7f2e6404d200 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2e50004c40 con 0x7f2e6404d200 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 10 monclient: dump: 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:31:55.111 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1234530285 0 0) 0x7f2e64152a70 con 0x7f2e6404d200 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f2e640554e0 con 0x7f2e6404d200 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f2e50005060 con 0x7f2e6404d200 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6789/0 conn(0x7f2e6404d200 legacy=0x7f2e64197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e3ffff640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6789/0 conn(0x7f2e6404d200 legacy=0x7f2e64197850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stdout: "ret": 0, 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-17T05:31:55.112 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:31:55.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.118:6812/703720803 conn(0x7f2e34040dd0 legacy=0x7f2e34061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 10 monclient: shutdown 2026-02-17T05:31:55.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:31:55.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 >> v1:10.20.193.106:6789/0 conn(0x7f2e64140860 legacy=0x7f2e64195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:31:55.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e63fff640 1 -- 10.20.193.106:0/524426912 reap_dead start 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e63fff640 1 -- 10.20.193.106:0/524426912 reap_dead start 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 shutdown_connections 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 >> 10.20.193.106:0/524426912 conn(0x7f2e64054ef0 msgr2=0x7f2e640881e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 shutdown_connections 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:31:55.099+0000 7f2e69acc640 1 -- 10.20.193.106:0/524426912 wait complete. 2026-02-17T05:31:55.114 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T05:31:55.114 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T05:31:55.114 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:31:55.123 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T05:31:55.123 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-17T05:31:55.123 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T05:31:55.123 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T05:31:55.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T05:32:10.124 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-17T05:32:10.124 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T05:32:10.124 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T05:32:10.124 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:32:10.124 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 10 monclient: get_monmap_and_config 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 10 monclient: build_initial_monmap 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 10 monclient: monmap: 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:32:10.190836+0000 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:32:10.190836+0000 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:32:10.191 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 1 Processor -- start 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 1 -- start start 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.190+0000 7f71f1994640 10 monclient: init 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-c con 0x7f71ec05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-b con 0x7f71ec05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-a con 0x7f71ec182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec08b060 con 0x7f71ec182720 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec05dc90 con 0x7f71ec05d1b0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec08d6a0 con 0x7f71ec05dee0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71f1994640 10 monclient(hunting): authenticate will time out at 858.819198s 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71eaffd640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71ea7fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f71ec05dee0 0x7f71ec181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41230/0 (socket says 10.20.193.106:41230) 2026-02-17T05:32:10.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.191+0000 7f71ea7fc640 1 -- 10.20.193.106:0/1932567352 learned_addr learned my addr 10.20.193.106:0/1932567352 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:10.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.392+0000 7f71eaffd640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:10.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:10.793+0000 7f71eaffd640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:11.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:11.595+0000 7f71eaffd640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:13.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): tick 2026-02-17T05:32:13.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:32:13.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.106:6790/0 conn(0x7f71ec05dee0 legacy=0x7f71ec181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec05d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.106:6789/0 conn(0x7f71ec182720 legacy=0x7f71ec1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f71ec182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f71ec05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f71ec05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec057960 con 0x7f71ec182720 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec05dc90 con 0x7f71ec05d1b0 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 1 -- 10.20.193.106:0/1932567352 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d0069f80 con 0x7f71ec05dee0 2026-02-17T05:32:13.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71e8ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:13.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.191+0000 7f71eb7fe640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71d0066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:13.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.392+0000 7f71eb7fe640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71d0066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:13.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:13.793+0000 7f71eb7fe640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71d0066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:14.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:14.594+0000 7f71eb7fe640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71d0066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093227424 0 0) 0x7f71ec057960 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 10 monclient(hunting): my global_id is 64272 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d80035e0 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346363133 0 0) 0x7f71d80035e0 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.106:6790/0 conn(0x7f71ec05dee0 legacy=0x7f71d0044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71d0066760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.130+0000 7f71e9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 1 monclient: found mon.noname-a 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d006b1e0 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f71e0004270 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: dump: 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 5 monclient: authenticate success, global_id 64272 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e0004470 con 0x7f71ec182720 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.132 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 1 -- 10.20.193.106:0/1932567352 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f71e0004880 con 0x7f71ec182720 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 10 monclient: get_monmap_and_config success 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 4 set_mon_vals no callback set 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71e9ffb640 10 monclient: dump: 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 10 monclient: shutdown 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 1 -- 10.20.193.106:0/1932567352 >> v1:10.20.193.106:6789/0 conn(0x7f71ec182720 legacy=0x7f71d0023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 1 -- 10.20.193.106:0/1932567352 shutdown_connections 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 1 -- 10.20.193.106:0/1932567352 >> 10.20.193.106:0/1932567352 conn(0x7f71ec0915f0 msgr2=0x7f71ec0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 1 -- 10.20.193.106:0/1932567352 shutdown_connections 2026-02-17T05:32:15.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.131+0000 7f71f1994640 1 -- 10.20.193.106:0/1932567352 wait complete. 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient: build_initial_monmap 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient: monmap: 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:32:15.134 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 1 Processor -- start 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 1 -- start start 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient: init 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-a con 0x7f71ec05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-b con 0x7f71ec05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient(hunting): picked mon.noname-c con 0x7f71ec182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec13f530 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec12e2e0 con 0x7f71ec05dee0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec05e8e0 con 0x7f71ec182720 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71f1994640 10 monclient(hunting): authenticate will time out at 863.760848s 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71eaffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f71ec05d1b0 0x7f71ec1503c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:57838/0 (socket says 10.20.193.106:57838) 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71eaffd640 1 -- 10.20.193.106:0/296202980 learned_addr learned my addr 10.20.193.106:0/296202980 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.132+0000 7f71ea7fc640 1 -- 10.20.193.106:0/296202980 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05dee0 legacy=0x7f71ec171070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958489290 0 0) 0x7f71ec13f530 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): my global_id is 64275 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71bc0035e0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255267889 0 0) 0x7f71ec05e8e0 con 0x7f71ec182720 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): my global_id is 4679 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ec13f530 con 0x7f71ec182720 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1102494319 0 0) 0x7f71bc0035e0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71ec05e8e0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f71e00045e0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): dump: 2026-02-17T05:32:15.135 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1420097031 0 0) 0x7f71ec13f530 con 0x7f71ec182720 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71bc0035e0 con 0x7f71ec182720 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f71dc004090 con 0x7f71ec182720 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient(hunting): dump: 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.136 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 860234632 0 0) 0x7f71ec05e8e0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 >> v1:10.20.193.106:6790/0 conn(0x7f71ec182720 legacy=0x7f71ec172790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 >> v1:10.20.193.118:6789/0 conn(0x7f71ec05dee0 legacy=0x7f71ec171070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 monclient: found mon.a 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec13d8a0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 5 monclient: authenticate success, global_id 64275 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 10 monclient: _renew_subs 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec12bf80 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 10 monclient: _renew_subs 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.133+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f71ec12cae0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e00049f0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f71e0004dd0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 10 monclient: dump: 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71e97fa640 4 set_mon_vals no callback set 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71f1994640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71f1994640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71f1994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f71e0004fa0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec12de20 con 0x7f71ec05d1b0 2026-02-17T05:32:15.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7f71e004fde0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.134+0000 7f71ea7fc640 10 monclient: get_auth_request con 0x7f71bc040b60 auth_method 0 2026-02-17T05:32:15.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.136+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f71e0017520 con 0x7f71ec05d1b0 2026-02-17T05:32:15.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.136+0000 7f71c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.136+0000 7f71c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71f1994640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71f1994640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71f1994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f71ec055570 con 0x7f71ec05d1b0 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71c3fff640 1 -- 10.20.193.106:0/296202980 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1970304079) 0x7f71e0016cd0 con 0x7f71ec05d1b0 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.280+0000 7f71c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:32:15.281 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":16,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 >> v1:10.20.193.118:6812/703720803 conn(0x7f71bc040b60 legacy=0x7f71bc061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 10 monclient: shutdown 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 >> v1:10.20.193.106:6789/0 conn(0x7f71ec05d1b0 legacy=0x7f71ec1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 shutdown_connections 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 >> 10.20.193.106:0/296202980 conn(0x7f71ec0915f0 msgr2=0x7f71ec08b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 shutdown_connections 2026-02-17T05:32:15.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.282+0000 7f71f1994640 1 -- 10.20.193.106:0/296202980 wait complete. 2026-02-17T05:32:15.290 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:32:15.290 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T05:32:15.290 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 10 monclient: get_monmap_and_config 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 10 monclient: build_initial_monmap 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 10 monclient: monmap: 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:32:15.357825+0000 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:32:15.357825+0000 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:32:15.358 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 1 Processor -- start 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 1 -- start start 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.357+0000 7f337d007640 10 monclient: init 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient(hunting): picked mon.noname-c con 0x7f337805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient(hunting): picked mon.noname-b con 0x7f337805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient(hunting): picked mon.noname-a con 0x7f3378182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337808b060 con 0x7f3378182720 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337805dc90 con 0x7f337805d1b0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337808d6a0 con 0x7f337805dee0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 10 monclient(hunting): authenticate will time out at 863.986267s 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3376d76640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f337805d1b0 legacy=0x7f337805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3377577640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f3378182720 0x7f33781a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:57846/0 (socket says 10.20.193.106:57846) 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3376575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f337805dee0 0x7f3378181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46810/0 (socket says 10.20.193.106:46810) 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3377577640 1 -- 10.20.193.106:0/2211963104 learned_addr learned my addr 10.20.193.106:0/2211963104 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42125203 0 0) 0x7f337808d6a0 con 0x7f337805dee0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): my global_id is 4682 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33640035e0 con 0x7f337805dee0 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934266294 0 0) 0x7f337808b060 con 0x7f3378182720 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient(hunting): my global_id is 64278 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337808d6a0 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990739342 0 0) 0x7f337808d6a0 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 >> v1:10.20.193.106:6790/0 conn(0x7f337805dee0 legacy=0x7f3378181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 >> v1:10.20.193.118:6789/0 conn(0x7f337805d1b0 legacy=0x7f337805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 monclient: found mon.noname-a 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3378057960 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3368003eb0 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 5 monclient: authenticate success, global_id 64278 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: dump: 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f337d007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33680040b0 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 1 -- 10.20.193.106:0/2211963104 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f33680044c0 con 0x7f3378182720 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.358+0000 7f3375d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f3375d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f3375d74640 10 monclient: dump: 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 10 monclient: get_monmap_and_config success 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 4 set_mon_vals no callback set 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 10 monclient: shutdown 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- 10.20.193.106:0/2211963104 >> v1:10.20.193.106:6789/0 conn(0x7f3378182720 legacy=0x7f33781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- 10.20.193.106:0/2211963104 shutdown_connections 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- 10.20.193.106:0/2211963104 >> 10.20.193.106:0/2211963104 conn(0x7f33780915f0 msgr2=0x7f33780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- 10.20.193.106:0/2211963104 shutdown_connections 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- 10.20.193.106:0/2211963104 wait complete. 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 10 monclient: build_initial_monmap 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 10 monclient: monmap: 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 Processor -- start 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 1 -- start start 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.359+0000 7f337d007640 10 monclient: init 2026-02-17T05:32:15.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient(hunting): picked mon.noname-b con 0x7f337805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient(hunting): picked mon.noname-a con 0x7f337805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient(hunting): picked mon.noname-c con 0x7f3378182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337810d6e0 con 0x7f337805dee0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337812ad00 con 0x7f337805d1b0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337813f550 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient(hunting): authenticate will time out at 863.988191s 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f3376575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f337805dee0 0x7f337812a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:57850/0 (socket says 10.20.193.106:57850) 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f3376575640 1 -- 10.20.193.106:0/3371092443 learned_addr learned my addr 10.20.193.106:0/3371092443 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f3377577640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3378182720 0x7f3378181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46822/0 (socket says 10.20.193.106:46822) 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f3376d76640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f337805d1b0 legacy=0x7f3378129ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676677352 0 0) 0x7f337813f550 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): my global_id is 4685 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33440035e0 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306331145 0 0) 0x7f337810d6e0 con 0x7f337805dee0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): my global_id is 64281 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337813f550 con 0x7f337805dee0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2870382045 0 0) 0x7f33440035e0 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337810d6e0 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3368003dc0 con 0x7f3378182720 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): dump: 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.366 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1251165140 0 0) 0x7f337813f550 con 0x7f337805dee0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33440035e0 con 0x7f337805dee0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3360003170 con 0x7f337805dee0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient(hunting): dump: 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1296110039 0 0) 0x7f337810d6e0 con 0x7f3378182720 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.118:6789/0 conn(0x7f337805d1b0 legacy=0x7f3378129ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6789/0 conn(0x7f337805dee0 legacy=0x7f337812a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 monclient: found mon.c 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337805e8e0 con 0x7f3378182720 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 5 monclient: authenticate success, global_id 4685 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _renew_subs 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f337805c610 con 0x7f3378182720 2026-02-17T05:32:15.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _renew_subs 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f337810ea80 con 0x7f3378182720 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3368005c30 con 0x7f3378182720 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3368005f50 con 0x7f3378182720 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f3375573640 4 set_mon_vals no callback set 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.360+0000 7f33577fe640 10 monclient: dump: 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f337d007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f337812d7f0 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421617032 0 0) 0x7f337812d7f0 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient(hunting): my global_id is 64284 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337810d6e0 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3368012ef0 con 0x7f3378182720 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7f3368050f40 con 0x7f3378182720 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2862825105 0 0) 0x7f337810d6e0 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337812d7f0 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f336c003f40 con 0x7f337812d420 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 10 monclient: dump: 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f3376575640 10 monclient: get_auth_request con 0x7f3344040b70 auth_method 0 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3438699292 0 0) 0x7f337812d7f0 con 0x7f337812d420 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.361+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3378057ca0 con 0x7f337812d420 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.362+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f336c006270 con 0x7f337812d420 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.362+0000 7f33577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.362+0000 7f33577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.362+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6789/0 conn(0x7f337812d420 legacy=0x7f3378059df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.362+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6789/0 conn(0x7f337812d420 legacy=0x7f3378059df0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:32:15.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f337d007640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f337810edc0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098863600 0 0) 0x7f337810edc0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient(hunting): my global_id is 64287 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337812d7f0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2280545934 0 0) 0x7f337812d7f0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337810edc0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f336c004920 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient: dump: 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 721141706 0 0) 0x7f337810edc0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3378055570 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 3277016398) 0x7f336c005ec0 con 0x7f3378089830 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6789/0 conn(0x7f3378089830 legacy=0x7f337804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.365+0000 7f33577fe640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6789/0 conn(0x7f3378089830 legacy=0x7f337804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:32:15.370 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 16, 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 132902, 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.371 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.372 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.373 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.374 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.118:6812/703720803 conn(0x7f3344040b70 legacy=0x7f3344061020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 10 monclient: shutdown 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 >> v1:10.20.193.106:6790/0 conn(0x7f3378182720 legacy=0x7f3378181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f3377577640 1 -- 10.20.193.106:0/3371092443 reap_dead start 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 shutdown_connections 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 >> 10.20.193.106:0/3371092443 conn(0x7f33780915f0 msgr2=0x7f337808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 shutdown_connections 2026-02-17T05:32:15.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.366+0000 7f337d007640 1 -- 10.20.193.106:0/3371092443 wait complete. 2026-02-17T05:32:15.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:32:15.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:32:15.376 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.441+0000 7f8736ecc640 10 monclient: get_monmap_and_config 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.441+0000 7f8736ecc640 10 monclient: build_initial_monmap 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.441+0000 7f8736ecc640 10 monclient: monmap: 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:32:15.442208+0000 2026-02-17T05:32:15.442 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:32:15.442208+0000 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:32:15.443 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 1 Processor -- start 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 1 -- start start 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient: init 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f873005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f873005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f8730182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873008b060 con 0x7f8730182720 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873005dc90 con 0x7f873005d1b0 2026-02-17T05:32:15.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873008d6a0 con 0x7f873005dee0 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8736ecc640 10 monclient(hunting): authenticate will time out at 864.070653s 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8734c41640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f873005d1b0 legacy=0x7f873005d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8727fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f873005dee0 0x7f8730181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46832/0 (socket says 10.20.193.106:46832) 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8735442640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f8730182720 0x7f87301a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:57876/0 (socket says 10.20.193.106:57876) 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f8727fff640 1 -- 10.20.193.106:0/3896648612 learned_addr learned my addr 10.20.193.106:0/3896648612 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353660762 0 0) 0x7f873008d6a0 con 0x7f873005dee0 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): my global_id is 4688 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f871c0035e0 con 0x7f873005dee0 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639218249 0 0) 0x7f873008b060 con 0x7f8730182720 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 10 monclient(hunting): my global_id is 64290 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.442+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f873008d6a0 con 0x7f8730182720 2026-02-17T05:32:15.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2875735938 0 0) 0x7f871c0035e0 con 0x7f873005dee0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 >> v1:10.20.193.118:6789/0 conn(0x7f873005d1b0 legacy=0x7f873005d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 >> v1:10.20.193.106:6789/0 conn(0x7f8730182720 legacy=0x7f87301a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 monclient: found mon.noname-b 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8730057960 con 0x7f873005dee0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8718002dd0 con 0x7f873005dee0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: dump: 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.450 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 5 monclient: authenticate success, global_id 4688 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8718002fd0 con 0x7f873005dee0 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 1 -- 10.20.193.106:0/3896648612 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f87180033e0 con 0x7f873005dee0 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f87277fe640 10 monclient: dump: 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.451 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 10 monclient: get_monmap_and_config success 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 4 set_mon_vals no callback set 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 10 monclient: shutdown 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 1 -- 10.20.193.106:0/3896648612 >> v1:10.20.193.106:6790/0 conn(0x7f873005dee0 legacy=0x7f8730181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 1 -- 10.20.193.106:0/3896648612 shutdown_connections 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 1 -- 10.20.193.106:0/3896648612 >> 10.20.193.106:0/3896648612 conn(0x7f87300915f0 msgr2=0x7f87300919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 1 -- 10.20.193.106:0/3896648612 shutdown_connections 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 1 -- 10.20.193.106:0/3896648612 wait complete. 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 10 monclient: build_initial_monmap 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.443+0000 7f8736ecc640 10 monclient: monmap: 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:32:15.452 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 Processor -- start 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- start start 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: init 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f873005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f873005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f8730182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873010ec80 con 0x7f873005d1b0 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873012e1a0 con 0x7f873005dee0 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873012a730 con 0x7f8730182720 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient(hunting): authenticate will time out at 864.072328s 2026-02-17T05:32:15.453 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8734c41640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f873005d1b0 0x7f873012d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:57890/0 (socket says 10.20.193.106:57890) 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8734c41640 1 -- 10.20.193.106:0/2836319221 learned_addr learned my addr 10.20.193.106:0/2836319221 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8727fff640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.118:6789/0 conn(0x7f873005dee0 legacy=0x7f873012da90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128998367 0 0) 0x7f873012a730 con 0x7f8730182720 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): my global_id is 4691 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87000035e0 con 0x7f8730182720 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761689953 0 0) 0x7f873010ec80 con 0x7f873005d1b0 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): my global_id is 64293 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f873012a730 con 0x7f873005d1b0 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2858248712 0 0) 0x7f87000035e0 con 0x7f8730182720 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f873010ec80 con 0x7f8730182720 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f872c0042d0 con 0x7f8730182720 2026-02-17T05:32:15.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): dump: 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2081733112 0 0) 0x7f873012a730 con 0x7f873005d1b0 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87000035e0 con 0x7f873005d1b0 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8720004180 con 0x7f873005d1b0 2026-02-17T05:32:15.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient(hunting): dump: 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1873887567 0 0) 0x7f873010ec80 con 0x7f8730182720 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.118:6789/0 conn(0x7f873005dee0 legacy=0x7f873012da90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6789/0 conn(0x7f873005d1b0 legacy=0x7f873012d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: _finish_hunting 0 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 monclient: found mon.c 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:32:15.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873010de10 con 0x7f8730182720 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: _finish_auth 0 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: _check_auth_tickets 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 5 monclient: authenticate success, global_id 4691 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _renew_subs 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f873010c920 con 0x7f8730182720 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _renew_subs 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f873012a2c0 con 0x7f8730182720 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f872c005980 con 0x7f8730182720 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f872c005ca0 con 0x7f8730182720 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f87257fa640 10 monclient: dump: 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.457 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.444+0000 7f8726ffd640 4 set_mon_vals no callback set 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f8736ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f873010d850 con 0x7f873010d480 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f872c012c40 con 0x7f8730182720 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 3915+0+0 (unknown 3660632435 0 0) 0x7f872c050df0 con 0x7f8730182720 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965520725 0 0) 0x7f873010d850 con 0x7f873010d480 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient(hunting): my global_id is 4694 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f873010ec80 con 0x7f873010d480 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f8727fff640 10 monclient: get_auth_request con 0x7f8700040b10 auth_method 0 2026-02-17T05:32:15.458 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3608461772 0 0) 0x7f873010ec80 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f873010d850 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8720004780 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.445+0000 7f87257fa640 10 monclient: dump: 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 305783595 0 0) 0x7f873010d850 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87301825a0 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8720004940 con 0x7f873010d480 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:32:15.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:32:15.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6790/0 conn(0x7f873010d480 legacy=0x7f87301076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.446+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6790/0 conn(0x7f873010d480 legacy=0x7f87301076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f8736ecc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8730055570 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1447770794 0 0) 0x7f8730055570 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient(hunting): _negotiate 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient(hunting): my global_id is 4697 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f873010d850 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1904479289 0 0) 0x7f873010d850 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8730055570 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f87200050d0 con 0x7f873010be40 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.449+0000 7f87257fa640 10 monclient: dump: 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:32:15.461 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3547810038 0 0) 0x7f8730055570 con 0x7f873010be40 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8730057ca0 con 0x7f873010be40 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 3912132722) 0x7f87200054f0 con 0x7f873010be40 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6790/0 conn(0x7f873010be40 legacy=0x7f8730107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f87257fa640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6790/0 conn(0x7f873010be40 legacy=0x7f8730107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:32:15.462 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 16, 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 260211, 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.463 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.464 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:32:15.465 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.466 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:32:15.467 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.468 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.469 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:32:15.470 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:32:15.471 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.118:6812/703720803 conn(0x7f8700040b10 legacy=0x7f8700060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 10 monclient: shutdown 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 >> v1:10.20.193.106:6790/0 conn(0x7f8730182720 legacy=0x7f8730181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8735442640 1 -- 10.20.193.106:0/2836319221 reap_dead start 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8735442640 1 -- 10.20.193.106:0/2836319221 reap_dead start 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 shutdown_connections 2026-02-17T05:32:15.472 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 >> 10.20.193.106:0/2836319221 conn(0x7f87300915f0 msgr2=0x7f873005c630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:32:15.473 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 shutdown_connections 2026-02-17T05:32:15.473 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:32:15.450+0000 7f8736ecc640 1 -- 10.20.193.106:0/2836319221 wait complete. 2026-02-17T05:32:15.473 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:32:15.473 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:32:16.133 INFO:tasks.rados.rados.0.trial118.stdout:974: done (2 left) 2026-02-17T05:32:16.133 INFO:tasks.rados.rados.0.trial118.stdout:975: done (1 left) 2026-02-17T05:32:16.133 INFO:tasks.rados.rados.0.trial118.stdout:976: done (0 left) 2026-02-17T05:32:16.133 INFO:tasks.rados.rados.0.trial118.stdout:977: delete oid 3 current snap is 95 2026-02-17T05:32:16.134 INFO:tasks.rados.rados.0.trial118.stdout:977: done (0 left) 2026-02-17T05:32:16.134 INFO:tasks.rados.rados.0.trial118.stdout:978: snap_create 2026-02-17T05:32:17.137 INFO:tasks.rados.rados.0.trial118.stdout:978: done (0 left) 2026-02-17T05:32:17.138 INFO:tasks.rados.rados.0.trial118.stdout:979: copy_from oid 12 from oid 27 current snap is 96 2026-02-17T05:32:17.138 INFO:tasks.rados.rados.0.trial118.stdout:980: snap_remove snap 93 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:980: done (1 left) 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:981: read oid 6 snap -1 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:981: expect deleted 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:982: copy_from oid 1 from oid 17 current snap is 96 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:979: finishing copy_from racing read to trial11845692-12 2026-02-17T05:32:18.140 INFO:tasks.rados.rados.0.trial118.stdout:979: finishing copy_from to trial11845692-12 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 547 (ObjNum 381 snap 94 seq_num 381) dirty exists 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:979: done (2 left) 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:983: read oid 8 snap -1 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:983: expect (ObjNum 344 snap 81 seq_num 344) 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:984: snap_create 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:982: finishing copy_from to trial11845692-1 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:982: got expected ENOENT (src dne) 2026-02-17T05:32:18.141 INFO:tasks.rados.rados.0.trial118.stdout:982: finishing copy_from racing read to trial11845692-1 2026-02-17T05:32:18.143 INFO:tasks.rados.rados.0.trial118.stdout:983: expect (ObjNum 344 snap 81 seq_num 344) 2026-02-17T05:32:18.157 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1673142 2026-02-17T05:32:18.198 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:18.297 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3250540 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:981: done (3 left) 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:982: done (2 left) 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:983: done (1 left) 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:984: done (0 left) 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:985: rollback oid 3 current snap is 97 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 95 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:986: write oid 28 current snap is 97 2026-02-17T05:32:19.141 INFO:tasks.rados.rados.0.trial118.stdout:986: seq_num 383 ranges {437081=638017,1679074=582789} 2026-02-17T05:32:19.145 INFO:tasks.rados.rados.0.trial118.stdout:986: writing trial11845692-28 from 437081 to 1075098 tid 1 2026-02-17T05:32:19.150 INFO:tasks.rados.rados.0.trial118.stdout:986: writing trial11845692-28 from 1679074 to 2261863 tid 2 2026-02-17T05:32:19.150 INFO:tasks.rados.rados.0.trial118.stdout:987: write (excl) oid 23 current snap is 97 2026-02-17T05:32:19.151 INFO:tasks.rados.rados.0.trial118.stdout:987: seq_num 384 ranges {453888=713266,1737556=442800} 2026-02-17T05:32:19.155 INFO:tasks.rados.rados.0.trial118.stdout:987: writing trial11845692-23 from 453888 to 1167154 tid 1 2026-02-17T05:32:19.158 INFO:tasks.rados.rados.0.trial118.stdout:987: writing trial11845692-23 from 1737556 to 2180356 tid 2 2026-02-17T05:32:19.159 INFO:tasks.rados.rados.0.trial118.stdout:988: snap_remove snap 92 2026-02-17T05:32:20.146 INFO:tasks.rados.rados.0.trial118.stdout:988: done (3 left) 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:989: copy_from oid 47 from oid 24 current snap is 97 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:985: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 396 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: finishing write tid 1 to trial11845692-28 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: finishing write tid 2 to trial11845692-28 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: finishing write tid 3 to trial11845692-28 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: finishing write tid 4 to trial11845692-28 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: oid 28 updating version 0 to 282 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: oid 28 version 282 is already newer than 280 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:986: oid 28 version 282 is already newer than 281 2026-02-17T05:32:20.147 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 282 (ObjNum 383 snap 97 seq_num 383) dirty exists 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:986: left oid 28 (ObjNum 383 snap 97 seq_num 383) 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: finishing write tid 1 to trial11845692-23 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: finishing write tid 2 to trial11845692-23 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: finishing write tid 3 to trial11845692-23 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: finishing write tid 4 to trial11845692-23 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: oid 23 updating version 0 to 281 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: oid 23 updating version 281 to 282 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: oid 23 version 282 is already newer than 280 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 282 (ObjNum 384 snap 97 seq_num 384) dirty exists 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: left oid 23 (ObjNum 384 snap 97 seq_num 384) 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:985: done (3 left) 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:986: done (2 left) 2026-02-17T05:32:20.148 INFO:tasks.rados.rados.0.trial118.stdout:987: done (1 left) 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:990: rollback oid 4 current snap is 97 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 96 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:991: read oid 25 snap -1 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:991: expect deleted 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:992: write oid 5 current snap is 97 2026-02-17T05:32:20.149 INFO:tasks.rados.rados.0.trial118.stdout:992: seq_num 385 ranges {470695=788515,1679685=586458} 2026-02-17T05:32:20.151 INFO:tasks.rados.rados.0.trial118.stdout:992: writing trial11845692-5 from 470695 to 1259210 tid 1 2026-02-17T05:32:20.156 INFO:tasks.rados.rados.0.trial118.stdout:992: writing trial11845692-5 from 1679685 to 2266143 tid 2 2026-02-17T05:32:20.156 INFO:tasks.rados.rados.0.trial118.stdout:993: write (excl) oid 43 current snap is 97 2026-02-17T05:32:20.156 INFO:tasks.rados.rados.0.trial118.stdout:990: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:32:20.156 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 0 (ObjNum 353 snap 0 seq_num 2491395664) dirty dne 2026-02-17T05:32:20.156 INFO:tasks.rados.rados.0.trial118.stdout:993: seq_num 386 ranges {487502=463764,1738167=446469} 2026-02-17T05:32:20.159 INFO:tasks.rados.rados.0.trial118.stdout:993: writing trial11845692-43 from 487502 to 951266 tid 1 2026-02-17T05:32:20.164 INFO:tasks.rados.rados.0.trial118.stdout:993: writing trial11845692-43 from 1738167 to 2184636 tid 2 2026-02-17T05:32:20.164 INFO:tasks.rados.rados.0.trial118.stdout:990: done (4 left) 2026-02-17T05:32:20.165 INFO:tasks.rados.rados.0.trial118.stdout:994: write oid 11 current snap is 97 2026-02-17T05:32:20.165 INFO:tasks.rados.rados.0.trial118.stdout:994: seq_num 387 ranges {504309=539013,1796649=590127} 2026-02-17T05:32:20.168 INFO:tasks.rados.rados.0.trial118.stdout:994: writing trial11845692-11 from 504309 to 1043322 tid 1 2026-02-17T05:32:20.173 INFO:tasks.rados.rados.0.trial118.stdout:994: writing trial11845692-11 from 1796649 to 2386776 tid 2 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:995: write (excl) oid 45 current snap is 97 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:989: finishing copy_from to trial11845692-47 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:989: got expected ENOENT (src dne) 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:989: finishing copy_from racing read to trial11845692-47 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:992: finishing write tid 1 to trial11845692-5 2026-02-17T05:32:20.174 INFO:tasks.rados.rados.0.trial118.stdout:995: seq_num 388 ranges {521116=730615,1971484=549632} 2026-02-17T05:32:20.178 INFO:tasks.rados.rados.0.trial118.stdout:995: writing trial11845692-45 from 521116 to 1251731 tid 1 2026-02-17T05:32:20.183 INFO:tasks.rados.rados.0.trial118.stdout:995: writing trial11845692-45 from 1971484 to 2521116 tid 2 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:989: done (5 left) 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:991: done (4 left) 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:996: snap_create 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: finishing write tid 2 to trial11845692-5 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: finishing write tid 3 to trial11845692-5 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: finishing write tid 4 to trial11845692-5 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: oid 5 updating version 0 to 133 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: oid 5 updating version 133 to 134 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:992: oid 5 updating version 134 to 135 2026-02-17T05:32:20.184 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 135 (ObjNum 385 snap 97 seq_num 385) dirty exists 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:992: left oid 5 (ObjNum 385 snap 97 seq_num 385) 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: finishing write tid 1 to trial11845692-43 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: finishing write tid 2 to trial11845692-43 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: finishing write tid 3 to trial11845692-43 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: finishing write tid 4 to trial11845692-43 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: oid 43 updating version 0 to 549 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: oid 43 updating version 549 to 550 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: oid 43 version 550 is already newer than 548 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 550 (ObjNum 386 snap 97 seq_num 386) dirty exists 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:993: left oid 43 (ObjNum 386 snap 97 seq_num 386) 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:994: finishing write tid 1 to trial11845692-11 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:994: finishing write tid 2 to trial11845692-11 2026-02-17T05:32:20.185 INFO:tasks.rados.rados.0.trial118.stdout:994: finishing write tid 3 to trial11845692-11 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:994: finishing write tid 4 to trial11845692-11 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:994: oid 11 updating version 0 to 550 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:994: oid 11 version 550 is already newer than 549 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:994: oid 11 updating version 550 to 551 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 551 (ObjNum 387 snap 97 seq_num 387) dirty exists 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:994: left oid 11 (ObjNum 387 snap 97 seq_num 387) 2026-02-17T05:32:20.186 INFO:tasks.rados.rados.0.trial118.stdout:995: finishing write tid 1 to trial11845692-45 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: finishing write tid 2 to trial11845692-45 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: finishing write tid 3 to trial11845692-45 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: finishing write tid 4 to trial11845692-45 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: oid 45 updating version 0 to 468 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: oid 45 version 468 is already newer than 467 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: oid 45 updating version 468 to 469 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 469 (ObjNum 388 snap 97 seq_num 388) dirty exists 2026-02-17T05:32:20.187 INFO:tasks.rados.rados.0.trial118.stdout:995: left oid 45 (ObjNum 388 snap 97 seq_num 388) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:992: done (4 left) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:993: done (3 left) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:994: done (2 left) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:995: done (1 left) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:996: done (0 left) 2026-02-17T05:32:20.266 INFO:tasks.rados.rados.0.trial118.stdout:997: rollback oid 33 current snap is 98 2026-02-17T05:32:20.267 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 96 2026-02-17T05:32:20.267 INFO:tasks.rados.rados.0.trial118.stdout:998: rollback oid 45 current snap is 98 2026-02-17T05:32:20.267 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 97 2026-02-17T05:32:20.267 INFO:tasks.rados.rados.0.trial118.stdout:999: snap_create 2026-02-17T05:32:20.267 INFO:tasks.rados.rados.0.trial118.stdout:998: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:32:20.268 INFO:tasks.rados.rados.0.trial118.stdout:998: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:32:20.268 INFO:tasks.rados.rados.0.trial118.stdout:998: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:32:20.268 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 472 (ObjNum 388 snap 97 seq_num 388) dirty exists 2026-02-17T05:32:20.269 INFO:tasks.rados.rados.0.trial118.stdout:997: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:32:20.269 INFO:tasks.rados.rados.0.trial118.stdout:997: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:32:20.269 INFO:tasks.rados.rados.0.trial118.stdout:997: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:32:20.269 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 517 (ObjNum 321 snap 78 seq_num 321) dirty exists 2026-02-17T05:32:21.267 INFO:tasks.rados.rados.0.trial118.stdout:997: done (2 left) 2026-02-17T05:32:21.267 INFO:tasks.rados.rados.0.trial118.stdout:998: done (1 left) 2026-02-17T05:32:21.268 INFO:tasks.rados.rados.0.trial118.stdout:999: done (0 left) 2026-02-17T05:32:21.268 INFO:tasks.rados.rados.0.trial118.stdout:1000: copy_from oid 42 from oid 40 current snap is 99 2026-02-17T05:32:21.268 INFO:tasks.rados.rados.0.trial118.stdout:1001: snap_remove snap 96 2026-02-17T05:32:22.272 INFO:tasks.rados.rados.0.trial118.stdout:1001: done (1 left) 2026-02-17T05:32:22.272 INFO:tasks.rados.rados.0.trial118.stdout:1002: read oid 24 snap -1 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1002: expect deleted 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1003: copy_from oid 26 from oid 6 current snap is 99 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1000: finishing copy_from racing read to trial11845692-42 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1000: finishing copy_from to trial11845692-42 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 485 (ObjNum 346 snap 82 seq_num 346) dirty exists 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1000: done (2 left) 2026-02-17T05:32:22.273 INFO:tasks.rados.rados.0.trial118.stdout:1004: delete oid 17 current snap is 99 2026-02-17T05:32:22.274 INFO:tasks.rados.rados.0.trial118.stdout:1002: done (2 left) 2026-02-17T05:32:22.274 INFO:tasks.rados.rados.0.trial118.stdout:1004: done (1 left) 2026-02-17T05:32:22.274 INFO:tasks.rados.rados.0.trial118.stdout:1005: copy_from oid 15 from oid 13 current snap is 99 2026-02-17T05:32:22.274 INFO:tasks.rados.rados.0.trial118.stdout:1006: copy_from oid 29 from oid 25 current snap is 99 2026-02-17T05:32:22.275 INFO:tasks.rados.rados.0.trial118.stdout:1007: copy_from oid 50 from oid 20 current snap is 99 2026-02-17T05:32:22.275 INFO:tasks.rados.rados.0.trial118.stdout:1008: snap_remove snap 95 2026-02-17T05:32:23.274 INFO:tasks.rados.rados.0.trial118.stdout:1008: done (4 left) 2026-02-17T05:32:23.274 INFO:tasks.rados.rados.0.trial118.stdout:1009: write (excl) oid 44 current snap is 99 2026-02-17T05:32:23.274 INFO:tasks.rados.rados.0.trial118.stdout:1009: seq_num 390 ranges {554730=481113,1572095=737454} 2026-02-17T05:32:23.278 INFO:tasks.rados.rados.0.trial118.stdout:1009: writing trial11845692-44 from 554730 to 1035843 tid 1 2026-02-17T05:32:23.283 INFO:tasks.rados.rados.0.trial118.stdout:1009: writing trial11845692-44 from 1572095 to 2309549 tid 2 2026-02-17T05:32:23.283 INFO:tasks.rados.rados.0.trial118.stdout:1010: write oid 40 current snap is 99 2026-02-17T05:32:23.284 INFO:tasks.rados.rados.0.trial118.stdout:1010: seq_num 391 ranges {571537=556362,1630577=597465} 2026-02-17T05:32:23.287 INFO:tasks.rados.rados.0.trial118.stdout:1010: writing trial11845692-40 from 571537 to 1127899 tid 1 2026-02-17T05:32:23.292 INFO:tasks.rados.rados.0.trial118.stdout:1010: writing trial11845692-40 from 1630577 to 2228042 tid 2 2026-02-17T05:32:23.292 INFO:tasks.rados.rados.0.trial118.stdout:1011: write (excl) oid 34 current snap is 99 2026-02-17T05:32:23.292 INFO:tasks.rados.rados.0.trial118.stdout:1003: finishing copy_from to trial11845692-26 2026-02-17T05:32:23.292 INFO:tasks.rados.rados.0.trial118.stdout:1003: got expected ENOENT (src dne) 2026-02-17T05:32:23.292 INFO:tasks.rados.rados.0.trial118.stdout:1003: finishing copy_from racing read to trial11845692-26 2026-02-17T05:32:23.293 INFO:tasks.rados.rados.0.trial118.stdout:1006: finishing copy_from to trial11845692-29 2026-02-17T05:32:23.293 INFO:tasks.rados.rados.0.trial118.stdout:1006: got expected ENOENT (src dne) 2026-02-17T05:32:23.293 INFO:tasks.rados.rados.0.trial118.stdout:1006: finishing copy_from racing read to trial11845692-29 2026-02-17T05:32:23.293 INFO:tasks.rados.rados.0.trial118.stdout:1011: seq_num 392 ranges {588344=631611,1689059=741123} 2026-02-17T05:32:23.296 INFO:tasks.rados.rados.0.trial118.stdout:1011: writing trial11845692-34 from 588344 to 1219955 tid 1 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1011: writing trial11845692-34 from 1689059 to 2430182 tid 2 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1003: done (6 left) 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1006: done (5 left) 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1012: delete oid 36 current snap is 99 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1007: finishing copy_from to trial11845692-50 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1007: got expected ENOENT (src dne) 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1007: finishing copy_from racing read to trial11845692-50 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1005: finishing copy_from racing read to trial11845692-15 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:1005: finishing copy_from to trial11845692-15 2026-02-17T05:32:23.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 385 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: finishing write tid 1 to trial11845692-44 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: finishing write tid 2 to trial11845692-44 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: finishing write tid 3 to trial11845692-44 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: finishing write tid 4 to trial11845692-44 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: oid 44 updating version 0 to 141 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: oid 44 updating version 141 to 143 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: oid 44 version 143 is already newer than 142 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 143 (ObjNum 390 snap 99 seq_num 390) dirty exists 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1009: left oid 44 (ObjNum 390 snap 99 seq_num 390) 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1010: finishing write tid 1 to trial11845692-40 2026-02-17T05:32:23.303 INFO:tasks.rados.rados.0.trial118.stdout:1010: finishing write tid 2 to trial11845692-40 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: finishing write tid 3 to trial11845692-40 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: finishing write tid 4 to trial11845692-40 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: oid 40 updating version 0 to 525 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: oid 40 version 525 is already newer than 524 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: oid 40 version 525 is already newer than 523 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 525 (ObjNum 391 snap 99 seq_num 391) dirty exists 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1010: left oid 40 (ObjNum 391 snap 99 seq_num 391) 2026-02-17T05:32:23.304 INFO:tasks.rados.rados.0.trial118.stdout:1011: finishing write tid 1 to trial11845692-34 2026-02-17T05:32:23.305 INFO:tasks.rados.rados.0.trial118.stdout:1005: done (5 left) 2026-02-17T05:32:23.305 INFO:tasks.rados.rados.0.trial118.stdout:1007: done (4 left) 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1009: done (3 left) 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1010: done (2 left) 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1012: done (1 left) 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1013: copy_from oid 14 from oid 45 current snap is 99 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1014: rollback oid 50 current snap is 99 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 98 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1015: snap_create 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1011: finishing write tid 2 to trial11845692-34 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1011: finishing write tid 3 to trial11845692-34 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1011: finishing write tid 4 to trial11845692-34 2026-02-17T05:32:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1011: oid 34 updating version 0 to 283 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1011: oid 34 updating version 283 to 284 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1011: oid 34 updating version 284 to 285 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 285 (ObjNum 392 snap 99 seq_num 392) dirty exists 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1011: left oid 34 (ObjNum 392 snap 99 seq_num 392) 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1014: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1014: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:1014: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:32:23.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 553 (ObjNum 342 snap 81 seq_num 342) dirty exists 2026-02-17T05:32:23.311 INFO:tasks.rados.rados.0.trial118.stdout:1013: finishing copy_from racing read to trial11845692-14 2026-02-17T05:32:23.311 INFO:tasks.rados.rados.0.trial118.stdout:1013: finishing copy_from to trial11845692-14 2026-02-17T05:32:23.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 472 (ObjNum 388 snap 97 seq_num 388) dirty exists 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1011: done (3 left) 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1013: done (2 left) 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1014: done (1 left) 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1015: done (0 left) 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1016: read oid 20 snap -1 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1016: expect deleted 2026-02-17T05:32:24.277 INFO:tasks.rados.rados.0.trial118.stdout:1017: write oid 6 current snap is 100 2026-02-17T05:32:24.278 INFO:tasks.rados.rados.0.trial118.stdout:1017: seq_num 394 ranges {621958=782109,2089670=532288} 2026-02-17T05:32:24.283 INFO:tasks.rados.rados.0.trial118.stdout:1017: writing trial11845692-6 from 621958 to 1404067 tid 1 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1017: writing trial11845692-6 from 2089670 to 2621958 tid 2 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1018: rollback oid 16 current snap is 100 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 99 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1017: finishing write tid 1 to trial11845692-6 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1016: done (2 left) 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1019: read oid 9 snap -1 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1019: expect deleted 2026-02-17T05:32:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1020: snap_create 2026-02-17T05:32:24.289 INFO:tasks.rados.rados.0.trial118.stdout:1017: finishing write tid 2 to trial11845692-6 2026-02-17T05:32:24.289 INFO:tasks.rados.rados.0.trial118.stdout:1017: finishing write tid 3 to trial11845692-6 2026-02-17T05:32:24.289 INFO:tasks.rados.rados.0.trial118.stdout:1017: finishing write tid 4 to trial11845692-6 2026-02-17T05:32:24.289 INFO:tasks.rados.rados.0.trial118.stdout:1017: oid 6 updating version 0 to 284 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:1017: oid 6 updating version 284 to 285 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:1017: oid 6 version 285 is already newer than 283 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 285 (ObjNum 394 snap 100 seq_num 394) dirty exists 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:1017: left oid 6 (ObjNum 394 snap 100 seq_num 394) 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:1018: finishing rollback tid 0 to trial11845692-16 2026-02-17T05:32:24.290 INFO:tasks.rados.rados.0.trial118.stdout:1018: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:32:24.291 INFO:tasks.rados.rados.0.trial118.stdout:1018: finishing rollback tid 2 to trial11845692-16 2026-02-17T05:32:24.291 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 516 (ObjNum 367 snap 89 seq_num 367) dirty exists 2026-02-17T05:32:25.277 INFO:tasks.rados.rados.0.trial118.stdout:1017: done (3 left) 2026-02-17T05:32:25.277 INFO:tasks.rados.rados.0.trial118.stdout:1018: done (2 left) 2026-02-17T05:32:25.277 INFO:tasks.rados.rados.0.trial118.stdout:1019: done (1 left) 2026-02-17T05:32:25.278 INFO:tasks.rados.rados.0.trial118.stdout:1020: done (0 left) 2026-02-17T05:32:25.278 INFO:tasks.rados.rados.0.trial118.stdout:1021: write oid 44 current snap is 101 2026-02-17T05:32:25.278 INFO:tasks.rados.rados.0.trial118.stdout:1021: seq_num 395 ranges {638765=457358,1748152=604803} 2026-02-17T05:32:25.282 INFO:tasks.rados.rados.0.trial118.stdout:1021: writing trial11845692-44 from 638765 to 1096123 tid 1 2026-02-17T05:32:25.287 INFO:tasks.rados.rados.0.trial118.stdout:1021: writing trial11845692-44 from 1748152 to 2352955 tid 2 2026-02-17T05:32:25.287 INFO:tasks.rados.rados.0.trial118.stdout:1022: copy_from oid 8 from oid 26 current snap is 101 2026-02-17T05:32:25.287 INFO:tasks.rados.rados.0.trial118.stdout:1021: finishing write tid 1 to trial11845692-44 2026-02-17T05:32:25.287 INFO:tasks.rados.rados.0.trial118.stdout:1023: snap_create 2026-02-17T05:32:25.289 INFO:tasks.rados.rados.0.trial118.stdout:1021: finishing write tid 2 to trial11845692-44 2026-02-17T05:32:25.289 INFO:tasks.rados.rados.0.trial118.stdout:1021: finishing write tid 3 to trial11845692-44 2026-02-17T05:32:25.289 INFO:tasks.rados.rados.0.trial118.stdout:1021: finishing write tid 4 to trial11845692-44 2026-02-17T05:32:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1021: oid 44 updating version 0 to 146 2026-02-17T05:32:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1021: oid 44 updating version 146 to 147 2026-02-17T05:32:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1021: oid 44 version 147 is already newer than 145 2026-02-17T05:32:25.290 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 147 (ObjNum 395 snap 101 seq_num 395) dirty exists 2026-02-17T05:32:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1021: left oid 44 (ObjNum 395 snap 101 seq_num 395) 2026-02-17T05:32:25.294 INFO:tasks.rados.rados.0.trial118.stdout:1022: finishing copy_from racing read to trial11845692-8 2026-02-17T05:32:25.295 INFO:tasks.rados.rados.0.trial118.stdout:1022: finishing copy_from to trial11845692-8 2026-02-17T05:32:25.295 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 251 (ObjNum 265 snap 65 seq_num 265) dirty exists 2026-02-17T05:32:26.282 INFO:tasks.rados.rados.0.trial118.stdout:1021: done (2 left) 2026-02-17T05:32:26.282 INFO:tasks.rados.rados.0.trial118.stdout:1022: done (1 left) 2026-02-17T05:32:26.282 INFO:tasks.rados.rados.0.trial118.stdout:1023: done (0 left) 2026-02-17T05:32:26.282 INFO:tasks.rados.rados.0.trial118.stdout:1024: snap_create 2026-02-17T05:32:27.282 INFO:tasks.rados.rados.0.trial118.stdout:1024: done (0 left) 2026-02-17T05:32:27.282 INFO:tasks.rados.rados.0.trial118.stdout:1025: read oid 24 snap -1 2026-02-17T05:32:27.283 INFO:tasks.rados.rados.0.trial118.stdout:1025: expect deleted 2026-02-17T05:32:27.283 INFO:tasks.rados.rados.0.trial118.stdout:1026: snap_create 2026-02-17T05:32:28.285 INFO:tasks.rados.rados.0.trial118.stdout:1025: done (1 left) 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1026: done (0 left) 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1027: read oid 39 snap -1 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1027: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1028: read oid 24 snap -1 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1028: expect deleted 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1029: write oid 34 current snap is 104 2026-02-17T05:32:28.286 INFO:tasks.rados.rados.0.trial118.stdout:1029: seq_num 396 ranges {655572=648960,1922987=732585} 2026-02-17T05:32:28.291 INFO:tasks.rados.rados.0.trial118.stdout:1029: writing trial11845692-34 from 655572 to 1304532 tid 1 2026-02-17T05:32:28.296 INFO:tasks.rados.rados.0.trial118.stdout:1029: writing trial11845692-34 from 1922987 to 2655572 tid 2 2026-02-17T05:32:28.296 INFO:tasks.rados.rados.0.trial118.stdout:1030: delete oid 28 current snap is 104 2026-02-17T05:32:28.296 INFO:tasks.rados.rados.0.trial118.stdout:1027: expect (ObjNum 27 snap 0 seq_num 27) 2026-02-17T05:32:28.311 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:28.345 INFO:tasks.rados.rados.0.trial118.stdout:1029: finishing write tid 1 to trial11845692-34 2026-02-17T05:32:28.345 INFO:tasks.rados.rados.0.trial118.stdout:1029: finishing write tid 2 to trial11845692-34 2026-02-17T05:32:28.345 INFO:tasks.rados.rados.0.trial118.stdout:1027: done (3 left) 2026-02-17T05:32:28.345 INFO:tasks.rados.rados.0.trial118.stdout:1028: done (2 left) 2026-02-17T05:32:28.345 INFO:tasks.rados.rados.0.trial118.stdout:1030: done (1 left) 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1031: write (excl) oid 18 current snap is 104 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: finishing write tid 3 to trial11845692-34 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: finishing write tid 4 to trial11845692-34 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: oid 34 updating version 0 to 288 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: oid 34 version 288 is already newer than 287 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: oid 34 version 288 is already newer than 286 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 288 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1029: left oid 34 (ObjNum 396 snap 104 seq_num 396) 2026-02-17T05:32:28.346 INFO:tasks.rados.rados.0.trial118.stdout:1031: seq_num 398 ranges {689186=799458,1923598=752130} 2026-02-17T05:32:28.350 INFO:tasks.rados.rados.0.trial118.stdout:1031: writing trial11845692-18 from 689186 to 1488644 tid 1 2026-02-17T05:32:28.355 INFO:tasks.rados.rados.0.trial118.stdout:1031: writing trial11845692-18 from 1923598 to 2675728 tid 2 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1029: done (1 left) 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1032: read oid 36 snap -1 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1032: expect deleted 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1033: write oid 49 current snap is 104 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1031: finishing write tid 1 to trial11845692-18 2026-02-17T05:32:28.356 INFO:tasks.rados.rados.0.trial118.stdout:1033: seq_num 399 ranges {705993=474707,1582080=612141} 2026-02-17T05:32:28.359 INFO:tasks.rados.rados.0.trial118.stdout:1033: writing trial11845692-49 from 705993 to 1180700 tid 1 2026-02-17T05:32:28.363 INFO:tasks.rados.rados.0.trial118.stdout:1033: writing trial11845692-49 from 1582080 to 2194221 tid 2 2026-02-17T05:32:28.363 INFO:tasks.rados.rados.0.trial118.stdout:1034: write (excl) oid 47 current snap is 104 2026-02-17T05:32:28.364 INFO:tasks.rados.rados.0.trial118.stdout:1034: seq_num 400 ranges {722800=549956,2040562=682238} 2026-02-17T05:32:28.368 INFO:tasks.rados.rados.0.trial118.stdout:1034: writing trial11845692-47 from 722800 to 1272756 tid 1 2026-02-17T05:32:28.374 INFO:tasks.rados.rados.0.trial118.stdout:1034: writing trial11845692-47 from 2040562 to 2722800 tid 2 2026-02-17T05:32:28.374 INFO:tasks.rados.rados.0.trial118.stdout:1035: delete oid 50 current snap is 104 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: finishing write tid 2 to trial11845692-18 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: finishing write tid 3 to trial11845692-18 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: finishing write tid 4 to trial11845692-18 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: oid 18 updating version 0 to 292 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: oid 18 version 292 is already newer than 290 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: oid 18 version 292 is already newer than 291 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 292 (ObjNum 398 snap 104 seq_num 398) dirty exists 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1031: left oid 18 (ObjNum 398 snap 104 seq_num 398) 2026-02-17T05:32:28.375 INFO:tasks.rados.rados.0.trial118.stdout:1033: finishing write tid 1 to trial11845692-49 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: finishing write tid 2 to trial11845692-49 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: finishing write tid 3 to trial11845692-49 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: finishing write tid 4 to trial11845692-49 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: oid 49 updating version 0 to 338 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: oid 49 version 338 is already newer than 337 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: oid 49 updating version 338 to 339 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 339 (ObjNum 399 snap 104 seq_num 399) dirty exists 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1033: left oid 49 (ObjNum 399 snap 104 seq_num 399) 2026-02-17T05:32:28.376 INFO:tasks.rados.rados.0.trial118.stdout:1034: finishing write tid 1 to trial11845692-47 2026-02-17T05:32:28.377 INFO:tasks.rados.rados.0.trial118.stdout:1034: finishing write tid 2 to trial11845692-47 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: finishing write tid 3 to trial11845692-47 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: finishing write tid 4 to trial11845692-47 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: oid 47 updating version 0 to 487 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: oid 47 updating version 487 to 488 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: oid 47 version 488 is already newer than 486 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 488 (ObjNum 400 snap 104 seq_num 400) dirty exists 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: left oid 47 (ObjNum 400 snap 104 seq_num 400) 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1031: done (4 left) 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1032: done (3 left) 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1033: done (2 left) 2026-02-17T05:32:28.378 INFO:tasks.rados.rados.0.trial118.stdout:1034: done (1 left) 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1035: done (0 left) 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1036: delete oid 19 current snap is 104 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1036: done (0 left) 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1037: read oid 41 snap -1 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1037: expect deleted 2026-02-17T05:32:28.379 INFO:tasks.rados.rados.0.trial118.stdout:1038: snap_remove snap 103 2026-02-17T05:32:29.290 INFO:tasks.rados.rados.0.trial118.stdout:1038: done (1 left) 2026-02-17T05:32:29.290 INFO:tasks.rados.rados.0.trial118.stdout:1039: copy_from oid 30 from oid 2 current snap is 104 2026-02-17T05:32:29.290 INFO:tasks.rados.rados.0.trial118.stdout:1037: done (1 left) 2026-02-17T05:32:29.290 INFO:tasks.rados.rados.0.trial118.stdout:1040: copy_from oid 6 from oid 18 current snap is 104 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1041: read oid 16 snap -1 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1041: expect (ObjNum 367 snap 89 seq_num 367) 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1042: read oid 23 snap 98 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1042: expect (ObjNum 384 snap 97 seq_num 384) 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1043: write (excl) oid 39 current snap is 104 2026-02-17T05:32:29.291 INFO:tasks.rados.rados.0.trial118.stdout:1043: seq_num 403 ranges {773221=492056,1816008=503126} 2026-02-17T05:32:29.295 INFO:tasks.rados.rados.0.trial118.stdout:1043: writing trial11845692-39 from 773221 to 1265277 tid 1 2026-02-17T05:32:29.299 INFO:tasks.rados.rados.0.trial118.stdout:1043: writing trial11845692-39 from 1816008 to 2319134 tid 2 2026-02-17T05:32:29.299 INFO:tasks.rados.rados.0.trial118.stdout:1044: write oid 41 current snap is 104 2026-02-17T05:32:29.299 INFO:tasks.rados.rados.0.trial118.stdout:1044: seq_num 404 ranges {790028=567305,1874490=763137} 2026-02-17T05:32:29.304 INFO:tasks.rados.rados.0.trial118.stdout:1044: writing trial11845692-41 from 790028 to 1357333 tid 1 2026-02-17T05:32:29.309 INFO:tasks.rados.rados.0.trial118.stdout:1044: writing trial11845692-41 from 1874490 to 2637627 tid 2 2026-02-17T05:32:29.309 INFO:tasks.rados.rados.0.trial118.stdout:1045: read oid 9 snap 101 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1045: expect deleted 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1046: read oid 29 snap -1 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1046: expect (ObjNum 364 snap 87 seq_num 364) 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1047: rollback oid 33 current snap is 104 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 94 2026-02-17T05:32:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1042: expect (ObjNum 384 snap 97 seq_num 384) 2026-02-17T05:32:29.343 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 453745 2026-02-17T05:32:29.406 INFO:tasks.rados.rados.0.trial118.stdout:1039: finishing copy_from racing read to trial11845692-30 2026-02-17T05:32:29.406 INFO:tasks.rados.rados.0.trial118.stdout:1041: expect (ObjNum 367 snap 89 seq_num 367) 2026-02-17T05:32:29.433 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1039: finishing copy_from to trial11845692-30 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 513 (ObjNum 367 snap 89 seq_num 367) dirty exists 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1043: finishing write tid 1 to trial11845692-39 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1040: finishing copy_from racing read to trial11845692-6 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1043: finishing write tid 2 to trial11845692-39 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1043: finishing write tid 3 to trial11845692-39 2026-02-17T05:32:29.489 INFO:tasks.rados.rados.0.trial118.stdout:1043: finishing write tid 4 to trial11845692-39 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1043: oid 39 updating version 0 to 491 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1043: oid 39 version 491 is already newer than 489 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1043: oid 39 version 491 is already newer than 490 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 491 (ObjNum 403 snap 104 seq_num 403) dirty exists 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1043: left oid 39 (ObjNum 403 snap 104 seq_num 403) 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1040: finishing copy_from to trial11845692-6 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 292 (ObjNum 398 snap 104 seq_num 398) dirty exists 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1044: finishing write tid 1 to trial11845692-41 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1047: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1047: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:1047: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:32:29.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 531 (ObjNum 321 snap 78 seq_num 321) dirty exists 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: finishing write tid 2 to trial11845692-41 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: finishing write tid 3 to trial11845692-41 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: finishing write tid 4 to trial11845692-41 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: oid 41 updating version 0 to 517 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: oid 41 updating version 517 to 519 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: oid 41 version 519 is already newer than 518 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 519 (ObjNum 404 snap 104 seq_num 404) dirty exists 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1044: left oid 41 (ObjNum 404 snap 104 seq_num 404) 2026-02-17T05:32:29.491 INFO:tasks.rados.rados.0.trial118.stdout:1046: expect (ObjNum 364 snap 87 seq_num 364) 2026-02-17T05:32:29.510 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1039: done (8 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1040: done (7 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1041: done (6 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1042: done (5 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1043: done (4 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1044: done (3 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1045: done (2 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1046: done (1 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1047: done (0 left) 2026-02-17T05:32:29.526 INFO:tasks.rados.rados.0.trial118.stdout:1048: delete oid 37 current snap is 104 2026-02-17T05:32:29.527 INFO:tasks.rados.rados.0.trial118.stdout:1048: done (0 left) 2026-02-17T05:32:29.527 INFO:tasks.rados.rados.0.trial118.stdout:1049: delete oid 48 current snap is 104 2026-02-17T05:32:29.528 INFO:tasks.rados.rados.0.trial118.stdout:1049: done (0 left) 2026-02-17T05:32:29.528 INFO:tasks.rados.rados.0.trial118.stdout:1050: delete oid 20 current snap is 104 2026-02-17T05:32:29.529 INFO:tasks.rados.rados.0.trial118.stdout:1050: done (0 left) 2026-02-17T05:32:29.529 INFO:tasks.rados.rados.0.trial118.stdout:1051: write (excl) oid 4 current snap is 104 2026-02-17T05:32:29.529 INFO:tasks.rados.rados.0.trial118.stdout:1051: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2026-02-17T05:32:29.533 INFO:tasks.rados.rados.0.trial118.stdout:1051: writing trial11845692-4 from 457256 to 925557 tid 1 2026-02-17T05:32:29.538 INFO:tasks.rados.rados.0.trial118.stdout:1051: writing trial11845692-4 from 1592065 to 2362540 tid 2 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:1051: writing trial11845692-4 from 2854581 to 2857256 tid 3 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:1052: rollback oid 28 current snap is 104 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 99 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:1051: finishing write tid 1 to trial11845692-4 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:1051: finishing write tid 2 to trial11845692-4 2026-02-17T05:32:29.540 INFO:tasks.rados.rados.0.trial118.stdout:1053: snap_create 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: finishing write tid 3 to trial11845692-4 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: finishing write tid 4 to trial11845692-4 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: finishing write tid 5 to trial11845692-4 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: oid 4 updating version 0 to 521 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: oid 4 updating version 521 to 522 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: oid 4 version 522 is already newer than 520 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: oid 4 updating version 522 to 523 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 523 (ObjNum 408 snap 104 seq_num 408) dirty exists 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1051: left oid 4 (ObjNum 408 snap 104 seq_num 408) 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1052: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:1052: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:32:29.541 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 294 (ObjNum 383 snap 97 seq_num 383) dirty exists 2026-02-17T05:32:30.268 INFO:tasks.rados.rados.0.trial118.stdout:1051: done (2 left) 2026-02-17T05:32:30.268 INFO:tasks.rados.rados.0.trial118.stdout:1052: done (1 left) 2026-02-17T05:32:30.268 INFO:tasks.rados.rados.0.trial118.stdout:1053: done (0 left) 2026-02-17T05:32:30.268 INFO:tasks.rados.rados.0.trial118.stdout:1054: copy_from oid 9 from oid 38 current snap is 105 2026-02-17T05:32:30.268 INFO:tasks.rados.rados.0.trial118.stdout:1055: snap_remove snap 98 2026-02-17T05:32:31.268 INFO:tasks.rados.rados.0.trial118.stdout:1055: done (1 left) 2026-02-17T05:32:31.268 INFO:tasks.rados.rados.0.trial118.stdout:1056: read oid 37 snap 99 2026-02-17T05:32:31.269 INFO:tasks.rados.rados.0.trial118.stdout:1056: expect deleted 2026-02-17T05:32:31.269 INFO:tasks.rados.rados.0.trial118.stdout:1057: snap_remove snap 102 2026-02-17T05:32:31.269 INFO:tasks.rados.rados.0.trial118.stdout:1054: finishing copy_from racing read to trial11845692-9 2026-02-17T05:32:31.269 INFO:tasks.rados.rados.0.trial118.stdout:1054: finishing copy_from to trial11845692-9 2026-02-17T05:32:31.269 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 445 (ObjNum 363 snap 87 seq_num 363) dirty exists 2026-02-17T05:32:32.269 INFO:tasks.rados.rados.0.trial118.stdout:1054: done (2 left) 2026-02-17T05:32:32.269 INFO:tasks.rados.rados.0.trial118.stdout:1057: done (1 left) 2026-02-17T05:32:32.270 INFO:tasks.rados.rados.0.trial118.stdout:1058: rollback oid 49 current snap is 105 2026-02-17T05:32:32.270 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 94 2026-02-17T05:32:32.270 INFO:tasks.rados.rados.0.trial118.stdout:1056: done (1 left) 2026-02-17T05:32:32.270 INFO:tasks.rados.rados.0.trial118.stdout:1059: snap_create 2026-02-17T05:32:32.273 INFO:tasks.rados.rados.0.trial118.stdout:1058: finishing rollback tid 0 to trial11845692-49 2026-02-17T05:32:32.273 INFO:tasks.rados.rados.0.trial118.stdout:1058: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:32:32.273 INFO:tasks.rados.rados.0.trial118.stdout:1058: finishing rollback tid 2 to trial11845692-49 2026-02-17T05:32:32.274 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 342 (ObjNum 280 snap 67 seq_num 280) dirty exists 2026-02-17T05:32:33.269 INFO:tasks.rados.rados.0.trial118.stdout:1058: done (1 left) 2026-02-17T05:32:33.269 INFO:tasks.rados.rados.0.trial118.stdout:1059: done (0 left) 2026-02-17T05:32:33.269 INFO:tasks.rados.rados.0.trial118.stdout:1060: write oid 31 current snap is 106 2026-02-17T05:32:33.269 INFO:tasks.rados.rados.0.trial118.stdout:1060: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2026-02-17T05:32:33.273 INFO:tasks.rados.rados.0.trial118.stdout:1060: writing trial11845692-31 from 474063 to 1017613 tid 1 2026-02-17T05:32:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1060: writing trial11845692-31 from 1650547 to 2164680 tid 2 2026-02-17T05:32:33.281 INFO:tasks.rados.rados.0.trial118.stdout:1060: writing trial11845692-31 from 2765651 to 2874063 tid 3 2026-02-17T05:32:33.281 INFO:tasks.rados.rados.0.trial118.stdout:1061: delete oid 3 current snap is 106 2026-02-17T05:32:33.281 INFO:tasks.rados.rados.0.trial118.stdout:1060: finishing write tid 1 to trial11845692-31 2026-02-17T05:32:33.281 INFO:tasks.rados.rados.0.trial118.stdout:1060: finishing write tid 2 to trial11845692-31 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: finishing write tid 3 to trial11845692-31 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: finishing write tid 4 to trial11845692-31 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: finishing write tid 5 to trial11845692-31 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: oid 31 updating version 0 to 564 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: oid 31 updating version 564 to 565 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: oid 31 version 565 is already newer than 562 2026-02-17T05:32:33.282 INFO:tasks.rados.rados.0.trial118.stdout:1060: oid 31 version 565 is already newer than 563 2026-02-17T05:32:33.283 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 565 (ObjNum 409 snap 106 seq_num 409) dirty exists 2026-02-17T05:32:33.283 INFO:tasks.rados.rados.0.trial118.stdout:1060: left oid 31 (ObjNum 409 snap 106 seq_num 409) 2026-02-17T05:32:33.283 INFO:tasks.rados.rados.0.trial118.stdout:1060: done (1 left) 2026-02-17T05:32:33.283 INFO:tasks.rados.rados.0.trial118.stdout:1061: done (0 left) 2026-02-17T05:32:33.283 INFO:tasks.rados.rados.0.trial118.stdout:1062: snap_remove snap 101 2026-02-17T05:32:34.270 INFO:tasks.rados.rados.0.trial118.stdout:1062: done (0 left) 2026-02-17T05:32:34.270 INFO:tasks.rados.rados.0.trial118.stdout:1063: copy_from oid 23 from oid 42 current snap is 106 2026-02-17T05:32:34.270 INFO:tasks.rados.rados.0.trial118.stdout:1064: write (excl) oid 39 current snap is 106 2026-02-17T05:32:34.270 INFO:tasks.rados.rados.0.trial118.stdout:1064: seq_num 411 ranges {507677=410401,1367511=517802,2420497=487180} 2026-02-17T05:32:34.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: writing trial11845692-39 from 507677 to 918078 tid 1 2026-02-17T05:32:34.277 INFO:tasks.rados.rados.0.trial118.stdout:1064: writing trial11845692-39 from 1367511 to 1885313 tid 2 2026-02-17T05:32:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1064: writing trial11845692-39 from 2420497 to 2907677 tid 3 2026-02-17T05:32:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1065: snap_remove snap 104 2026-02-17T05:32:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1064: finishing write tid 1 to trial11845692-39 2026-02-17T05:32:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1064: finishing write tid 2 to trial11845692-39 2026-02-17T05:32:35.273 INFO:tasks.rados.rados.0.trial118.stdout:1065: done (2 left) 2026-02-17T05:32:35.273 INFO:tasks.rados.rados.0.trial118.stdout:1066: read oid 24 snap -1 2026-02-17T05:32:35.273 INFO:tasks.rados.rados.0.trial118.stdout:1066: expect deleted 2026-02-17T05:32:35.273 INFO:tasks.rados.rados.0.trial118.stdout:1067: delete oid 32 current snap is 106 2026-02-17T05:32:35.273 INFO:tasks.rados.rados.0.trial118.stdout:1064: finishing write tid 3 to trial11845692-39 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: finishing write tid 4 to trial11845692-39 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: finishing write tid 5 to trial11845692-39 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: oid 39 updating version 0 to 495 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: oid 39 version 495 is already newer than 493 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: oid 39 version 495 is already newer than 492 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: oid 39 version 495 is already newer than 494 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 495 (ObjNum 411 snap 106 seq_num 411) dirty exists 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1064: left oid 39 (ObjNum 411 snap 106 seq_num 411) 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1063: finishing copy_from racing read to trial11845692-23 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:1063: finishing copy_from to trial11845692-23 2026-02-17T05:32:35.274 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 485 (ObjNum 346 snap 82 seq_num 346) dirty exists 2026-02-17T05:32:35.277 INFO:tasks.rados.rados.0.trial118.stdout:1063: done (3 left) 2026-02-17T05:32:35.277 INFO:tasks.rados.rados.0.trial118.stdout:1064: done (2 left) 2026-02-17T05:32:35.277 INFO:tasks.rados.rados.0.trial118.stdout:1066: done (1 left) 2026-02-17T05:32:35.277 INFO:tasks.rados.rados.0.trial118.stdout:1067: done (0 left) 2026-02-17T05:32:35.277 INFO:tasks.rados.rados.0.trial118.stdout:1068: snap_remove snap 105 2026-02-17T05:32:36.276 INFO:tasks.rados.rados.0.trial118.stdout:1068: done (0 left) 2026-02-17T05:32:36.276 INFO:tasks.rados.rados.0.trial118.stdout:1069: rollback oid 20 current snap is 106 2026-02-17T05:32:36.276 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 100 2026-02-17T05:32:36.277 INFO:tasks.rados.rados.0.trial118.stdout:1070: read oid 37 snap -1 2026-02-17T05:32:36.277 INFO:tasks.rados.rados.0.trial118.stdout:1070: expect deleted 2026-02-17T05:32:36.277 INFO:tasks.rados.rados.0.trial118.stdout:1071: snap_create 2026-02-17T05:32:36.277 INFO:tasks.rados.rados.0.trial118.stdout:1069: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:32:36.277 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 0 (ObjNum 4113 snap 0 seq_num 12436976) dirty dne 2026-02-17T05:32:37.276 INFO:tasks.rados.rados.0.trial118.stdout:1069: done (2 left) 2026-02-17T05:32:37.277 INFO:tasks.rados.rados.0.trial118.stdout:1070: done (1 left) 2026-02-17T05:32:37.277 INFO:tasks.rados.rados.0.trial118.stdout:1071: done (0 left) 2026-02-17T05:32:37.277 INFO:tasks.rados.rados.0.trial118.stdout:1072: snap_create 2026-02-17T05:32:38.280 INFO:tasks.rados.rados.0.trial118.stdout:1072: done (0 left) 2026-02-17T05:32:38.281 INFO:tasks.rados.rados.0.trial118.stdout:1073: delete oid 27 current snap is 108 2026-02-17T05:32:38.282 INFO:tasks.rados.rados.0.trial118.stdout:1073: done (0 left) 2026-02-17T05:32:38.282 INFO:tasks.rados.rados.0.trial118.stdout:1074: snap_create 2026-02-17T05:32:39.282 INFO:tasks.rados.rados.0.trial118.stdout:1074: done (0 left) 2026-02-17T05:32:39.283 INFO:tasks.rados.rados.0.trial118.stdout:1075: read oid 5 snap 97 2026-02-17T05:32:39.283 INFO:tasks.rados.rados.0.trial118.stdout:1075: expect (ObjNum 385 snap 97 seq_num 385) 2026-02-17T05:32:39.283 INFO:tasks.rados.rados.0.trial118.stdout:1076: write oid 38 current snap is 109 2026-02-17T05:32:39.283 INFO:tasks.rados.rados.0.trial118.stdout:1076: seq_num 414 ranges {558098=636148,1826604=665129} 2026-02-17T05:32:39.288 INFO:tasks.rados.rados.0.trial118.stdout:1076: writing trial11845692-38 from 558098 to 1194246 tid 1 2026-02-17T05:32:39.293 INFO:tasks.rados.rados.0.trial118.stdout:1076: writing trial11845692-38 from 1826604 to 2491733 tid 2 2026-02-17T05:32:39.293 INFO:tasks.rados.rados.0.trial118.stdout:1077: read oid 37 snap -1 2026-02-17T05:32:39.293 INFO:tasks.rados.rados.0.trial118.stdout:1077: expect deleted 2026-02-17T05:32:39.293 INFO:tasks.rados.rados.0.trial118.stdout:1078: write (excl) oid 40 current snap is 109 2026-02-17T05:32:39.293 INFO:tasks.rados.rados.0.trial118.stdout:1078: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2026-02-17T05:32:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1078: writing trial11845692-40 from 574905 to 1286302 tid 1 2026-02-17T05:32:39.302 INFO:tasks.rados.rados.0.trial118.stdout:1078: writing trial11845692-40 from 1885086 to 2410226 tid 2 2026-02-17T05:32:39.304 INFO:tasks.rados.rados.0.trial118.stdout:1078: writing trial11845692-40 from 2930189 to 2974905 tid 3 2026-02-17T05:32:39.304 INFO:tasks.rados.rados.0.trial118.stdout:1079: read oid 12 snap -1 2026-02-17T05:32:39.305 INFO:tasks.rados.rados.0.trial118.stdout:1079: expect (ObjNum 381 snap 94 seq_num 381) 2026-02-17T05:32:39.305 INFO:tasks.rados.rados.0.trial118.stdout:1080: write oid 9 current snap is 109 2026-02-17T05:32:39.305 INFO:tasks.rados.rados.0.trial118.stdout:1080: seq_num 416 ranges {591712=786646,1943568=668798} 2026-02-17T05:32:39.309 INFO:tasks.rados.rados.0.trial118.stdout:1080: writing trial11845692-9 from 591712 to 1378358 tid 1 2026-02-17T05:32:39.315 INFO:tasks.rados.rados.0.trial118.stdout:1080: writing trial11845692-9 from 1943568 to 2612366 tid 2 2026-02-17T05:32:39.315 INFO:tasks.rados.rados.0.trial118.stdout:1081: write (excl) oid 30 current snap is 109 2026-02-17T05:32:39.315 INFO:tasks.rados.rados.0.trial118.stdout:1081: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2026-02-17T05:32:39.319 INFO:tasks.rados.rados.0.trial118.stdout:1081: writing trial11845692-30 from 608519 to 1070414 tid 1 2026-02-17T05:32:39.322 INFO:tasks.rados.rados.0.trial118.stdout:1081: writing trial11845692-30 from 1602050 to 2130859 tid 2 2026-02-17T05:32:39.326 INFO:tasks.rados.rados.0.trial118.stdout:1081: writing trial11845692-30 from 2585035 to 3008519 tid 3 2026-02-17T05:32:39.326 INFO:tasks.rados.rados.0.trial118.stdout:1082: write oid 24 current snap is 109 2026-02-17T05:32:39.326 INFO:tasks.rados.rados.0.trial118.stdout:1082: seq_num 418 ranges {625326=537144,1944179=672467} 2026-02-17T05:32:39.330 INFO:tasks.rados.rados.0.trial118.stdout:1082: writing trial11845692-24 from 625326 to 1162470 tid 1 2026-02-17T05:32:39.336 INFO:tasks.rados.rados.0.trial118.stdout:1082: writing trial11845692-24 from 1944179 to 2616646 tid 2 2026-02-17T05:32:39.337 INFO:tasks.rados.rados.0.trial118.stdout:1083: rollback oid 27 current snap is 109 2026-02-17T05:32:39.337 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 27 to 99 2026-02-17T05:32:39.337 INFO:tasks.rados.rados.0.trial118.stdout:1075: expect (ObjNum 385 snap 97 seq_num 385) 2026-02-17T05:32:39.337 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:39.385 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1365113 2026-02-17T05:32:39.404 INFO:tasks.rados.rados.0.trial118.stdout:1076: finishing write tid 1 to trial11845692-38 2026-02-17T05:32:39.404 INFO:tasks.rados.rados.0.trial118.stdout:1076: finishing write tid 2 to trial11845692-38 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1075: done (8 left) 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1077: done (7 left) 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1084: snap_create 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: finishing write tid 3 to trial11845692-38 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: finishing write tid 4 to trial11845692-38 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: oid 38 updating version 0 to 498 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: oid 38 updating version 498 to 500 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: oid 38 version 500 is already newer than 499 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 500 (ObjNum 414 snap 109 seq_num 414) dirty exists 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1076: left oid 38 (ObjNum 414 snap 109 seq_num 414) 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: finishing write tid 1 to trial11845692-40 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: finishing write tid 2 to trial11845692-40 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: finishing write tid 3 to trial11845692-40 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: finishing write tid 4 to trial11845692-40 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: finishing write tid 5 to trial11845692-40 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: oid 40 updating version 0 to 550 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: oid 40 version 550 is already newer than 549 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: oid 40 version 550 is already newer than 548 2026-02-17T05:32:39.405 INFO:tasks.rados.rados.0.trial118.stdout:1078: oid 40 version 550 is already newer than 547 2026-02-17T05:32:39.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 550 (ObjNum 415 snap 109 seq_num 415) dirty exists 2026-02-17T05:32:39.406 INFO:tasks.rados.rados.0.trial118.stdout:1078: left oid 40 (ObjNum 415 snap 109 seq_num 415) 2026-02-17T05:32:39.406 INFO:tasks.rados.rados.0.trial118.stdout:1079: expect (ObjNum 381 snap 94 seq_num 381) 2026-02-17T05:32:39.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 744392 2026-02-17T05:32:39.436 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:39.454 INFO:tasks.rados.rados.0.trial118.stdout:1080: finishing write tid 1 to trial11845692-9 2026-02-17T05:32:39.454 INFO:tasks.rados.rados.0.trial118.stdout:1080: finishing write tid 2 to trial11845692-9 2026-02-17T05:32:39.454 INFO:tasks.rados.rados.0.trial118.stdout:1080: finishing write tid 3 to trial11845692-9 2026-02-17T05:32:39.454 INFO:tasks.rados.rados.0.trial118.stdout:1080: finishing write tid 4 to trial11845692-9 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1080: oid 9 updating version 0 to 524 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1080: oid 9 updating version 524 to 525 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1080: oid 9 updating version 525 to 526 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 526 (ObjNum 416 snap 109 seq_num 416) dirty exists 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1080: left oid 9 (ObjNum 416 snap 109 seq_num 416) 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1081: finishing write tid 1 to trial11845692-30 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1081: finishing write tid 2 to trial11845692-30 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1081: finishing write tid 3 to trial11845692-30 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1081: finishing write tid 4 to trial11845692-30 2026-02-17T05:32:39.455 INFO:tasks.rados.rados.0.trial118.stdout:1081: finishing write tid 5 to trial11845692-30 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1081: oid 30 updating version 0 to 555 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1081: oid 30 version 555 is already newer than 553 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1081: oid 30 version 555 is already newer than 552 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1081: oid 30 version 555 is already newer than 554 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 555 (ObjNum 417 snap 109 seq_num 417) dirty exists 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1081: left oid 30 (ObjNum 417 snap 109 seq_num 417) 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1082: finishing write tid 1 to trial11845692-24 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1083: finishing rollback tid 1 to trial11845692-27 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:1083: finishing rollback tid 2 to trial11845692-27 2026-02-17T05:32:39.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 575 (ObjNum 381 snap 94 seq_num 381) dirty exists 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: finishing write tid 2 to trial11845692-24 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: finishing write tid 3 to trial11845692-24 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: finishing write tid 4 to trial11845692-24 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: oid 24 updating version 0 to 149 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: oid 24 version 149 is already newer than 148 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: oid 24 updating version 149 to 150 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 150 (ObjNum 418 snap 109 seq_num 418) dirty exists 2026-02-17T05:32:39.457 INFO:tasks.rados.rados.0.trial118.stdout:1082: left oid 24 (ObjNum 418 snap 109 seq_num 418) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1076: done (7 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1078: done (6 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1079: done (5 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1080: done (4 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1081: done (3 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1082: done (2 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1083: done (1 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1084: done (0 left) 2026-02-17T05:32:40.270 INFO:tasks.rados.rados.0.trial118.stdout:1085: copy_from oid 7 from oid 2 current snap is 110 2026-02-17T05:32:40.271 INFO:tasks.rados.rados.0.trial118.stdout:1086: delete oid 37 current snap is 110 2026-02-17T05:32:40.271 INFO:tasks.rados.rados.0.trial118.stdout:1086: done (1 left) 2026-02-17T05:32:40.271 INFO:tasks.rados.rados.0.trial118.stdout:1087: write (excl) oid 39 current snap is 110 2026-02-17T05:32:40.272 INFO:tasks.rados.rados.0.trial118.stdout:1087: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2026-02-17T05:32:40.275 INFO:tasks.rados.rados.0.trial118.stdout:1087: writing trial11845692-39 from 658940 to 1062935 tid 1 2026-02-17T05:32:40.280 INFO:tasks.rados.rados.0.trial118.stdout:1087: writing trial11845692-39 from 1777496 to 2453632 tid 2 2026-02-17T05:32:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1087: writing trial11845692-39 from 2950951 to 3058940 tid 3 2026-02-17T05:32:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1088: write oid 12 current snap is 110 2026-02-17T05:32:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1085: finishing copy_from racing read to trial11845692-7 2026-02-17T05:32:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1085: finishing copy_from to trial11845692-7 2026-02-17T05:32:40.284 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 513 (ObjNum 367 snap 89 seq_num 367) dirty exists 2026-02-17T05:32:40.284 INFO:tasks.rados.rados.0.trial118.stdout:1087: finishing write tid 1 to trial11845692-39 2026-02-17T05:32:40.284 INFO:tasks.rados.rados.0.trial118.stdout:1087: finishing write tid 2 to trial11845692-39 2026-02-17T05:32:40.284 INFO:tasks.rados.rados.0.trial118.stdout:1088: seq_num 421 ranges {675747=479244,1835978=536147} 2026-02-17T05:32:40.287 INFO:tasks.rados.rados.0.trial118.stdout:1088: writing trial11845692-12 from 675747 to 1154991 tid 1 2026-02-17T05:32:40.292 INFO:tasks.rados.rados.0.trial118.stdout:1088: writing trial11845692-12 from 1835978 to 2372125 tid 2 2026-02-17T05:32:40.292 INFO:tasks.rados.rados.0.trial118.stdout:1085: done (2 left) 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1089: snap_create 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: finishing write tid 3 to trial11845692-39 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: finishing write tid 4 to trial11845692-39 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: finishing write tid 5 to trial11845692-39 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: oid 39 updating version 0 to 502 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: oid 39 updating version 502 to 505 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: oid 39 version 505 is already newer than 504 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: oid 39 version 505 is already newer than 503 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 505 (ObjNum 420 snap 110 seq_num 420) dirty exists 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1087: left oid 39 (ObjNum 420 snap 110 seq_num 420) 2026-02-17T05:32:40.293 INFO:tasks.rados.rados.0.trial118.stdout:1088: finishing write tid 1 to trial11845692-12 2026-02-17T05:32:40.294 INFO:tasks.rados.rados.0.trial118.stdout:1088: finishing write tid 2 to trial11845692-12 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: finishing write tid 3 to trial11845692-12 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: finishing write tid 4 to trial11845692-12 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: oid 12 updating version 0 to 557 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: oid 12 version 557 is already newer than 556 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: oid 12 version 557 is already newer than 555 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 557 (ObjNum 421 snap 110 seq_num 421) dirty exists 2026-02-17T05:32:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1088: left oid 12 (ObjNum 421 snap 110 seq_num 421) 2026-02-17T05:32:41.287 INFO:tasks.rados.rados.0.trial118.stdout:1087: done (2 left) 2026-02-17T05:32:41.287 INFO:tasks.rados.rados.0.trial118.stdout:1088: done (1 left) 2026-02-17T05:32:41.288 INFO:tasks.rados.rados.0.trial118.stdout:1089: done (0 left) 2026-02-17T05:32:41.288 INFO:tasks.rados.rados.0.trial118.stdout:1090: write (excl) oid 1 current snap is 111 2026-02-17T05:32:41.288 INFO:tasks.rados.rados.0.trial118.stdout:1090: seq_num 422 ranges {692554=554493,1778107=679805,2889444=203110} 2026-02-17T05:32:41.292 INFO:tasks.rados.rados.0.trial118.stdout:1090: writing trial11845692-1 from 692554 to 1247047 tid 1 2026-02-17T05:32:41.297 INFO:tasks.rados.rados.0.trial118.stdout:1090: writing trial11845692-1 from 1778107 to 2457912 tid 2 2026-02-17T05:32:41.300 INFO:tasks.rados.rados.0.trial118.stdout:1090: writing trial11845692-1 from 2889444 to 3092554 tid 3 2026-02-17T05:32:41.301 INFO:tasks.rados.rados.0.trial118.stdout:1091: read oid 8 snap -1 2026-02-17T05:32:41.301 INFO:tasks.rados.rados.0.trial118.stdout:1091: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:41.301 INFO:tasks.rados.rados.0.trial118.stdout:1092: write (excl) oid 18 current snap is 111 2026-02-17T05:32:41.301 INFO:tasks.rados.rados.0.trial118.stdout:1092: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2026-02-17T05:32:41.305 INFO:tasks.rados.rados.0.trial118.stdout:1092: writing trial11845692-18 from 709361 to 1339103 tid 1 2026-02-17T05:32:41.309 INFO:tasks.rados.rados.0.trial118.stdout:1092: writing trial11845692-18 from 1836589 to 2376405 tid 2 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:1092: writing trial11845692-18 from 3033220 to 3109361 tid 3 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:1093: read oid 14 snap -1 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:1093: expect (ObjNum 388 snap 97 seq_num 388) 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:1094: rollback oid 41 current snap is 111 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 94 2026-02-17T05:32:41.313 INFO:tasks.rados.rados.0.trial118.stdout:1090: finishing write tid 1 to trial11845692-1 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: finishing write tid 2 to trial11845692-1 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: finishing write tid 3 to trial11845692-1 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: finishing write tid 4 to trial11845692-1 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: finishing write tid 5 to trial11845692-1 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: oid 1 updating version 0 to 558 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: oid 1 updating version 558 to 559 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: oid 1 updating version 559 to 560 2026-02-17T05:32:41.314 INFO:tasks.rados.rados.0.trial118.stdout:1090: oid 1 version 560 is already newer than 557 2026-02-17T05:32:41.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 560 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-17T05:32:41.315 INFO:tasks.rados.rados.0.trial118.stdout:1090: left oid 1 (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:32:41.315 INFO:tasks.rados.rados.0.trial118.stdout:1091: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:41.339 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1676530 2026-02-17T05:32:41.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1449795 2026-02-17T05:32:41.462 INFO:tasks.rados.rados.0.trial118.stdout:1092: finishing write tid 1 to trial11845692-18 2026-02-17T05:32:41.462 INFO:tasks.rados.rados.0.trial118.stdout:1090: done (4 left) 2026-02-17T05:32:41.462 INFO:tasks.rados.rados.0.trial118.stdout:1091: done (3 left) 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1095: copy_from oid 42 from oid 22 current snap is 111 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: finishing write tid 2 to trial11845692-18 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: finishing write tid 3 to trial11845692-18 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: finishing write tid 4 to trial11845692-18 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: finishing write tid 5 to trial11845692-18 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: oid 18 updating version 0 to 295 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: oid 18 updating version 295 to 296 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: oid 18 updating version 296 to 297 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:1092: oid 18 updating version 297 to 298 2026-02-17T05:32:41.463 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 298 (ObjNum 423 snap 111 seq_num 423) dirty exists 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:1092: left oid 18 (ObjNum 423 snap 111 seq_num 423) 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:1094: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:1094: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 528 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:1093: expect (ObjNum 388 snap 97 seq_num 388) 2026-02-17T05:32:41.464 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:41.507 INFO:tasks.rados.rados.0.trial118.stdout:1095: finishing copy_from racing read to trial11845692-42 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1095: finishing copy_from to trial11845692-42 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 445 (ObjNum 327 snap 80 seq_num 327) dirty exists 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1092: done (3 left) 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1093: done (2 left) 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1094: done (1 left) 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1095: done (0 left) 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1096: read oid 21 snap 97 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1096: expect deleted 2026-02-17T05:32:41.508 INFO:tasks.rados.rados.0.trial118.stdout:1097: snap_remove snap 99 2026-02-17T05:32:42.291 INFO:tasks.rados.rados.0.trial118.stdout:1097: done (1 left) 2026-02-17T05:32:42.291 INFO:tasks.rados.rados.0.trial118.stdout:1098: snap_create 2026-02-17T05:32:43.293 INFO:tasks.rados.rados.0.trial118.stdout:1096: done (1 left) 2026-02-17T05:32:43.293 INFO:tasks.rados.rados.0.trial118.stdout:1098: done (0 left) 2026-02-17T05:32:43.293 INFO:tasks.rados.rados.0.trial118.stdout:1099: delete oid 7 current snap is 112 2026-02-17T05:32:43.296 INFO:tasks.rados.rados.0.trial118.stdout:1099: done (0 left) 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:1100: read oid 34 snap 97 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:1100: expect deleted 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:1101: rollback oid 3 current snap is 112 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 94 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:1102: write oid 16 current snap is 112 2026-02-17T05:32:43.297 INFO:tasks.rados.rados.0.trial118.stdout:1102: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2026-02-17T05:32:43.302 INFO:tasks.rados.rados.0.trial118.stdout:1102: writing trial11845692-16 from 742975 to 1523215 tid 1 2026-02-17T05:32:43.305 INFO:tasks.rados.rados.0.trial118.stdout:1102: writing trial11845692-16 from 1953553 to 2380685 tid 2 2026-02-17T05:32:43.308 INFO:tasks.rados.rados.0.trial118.stdout:1102: writing trial11845692-16 from 2971713 to 3142975 tid 3 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1103: read oid 33 snap -1 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1103: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1104: snap_create 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1101: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1101: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 399 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1102: finishing write tid 1 to trial11845692-16 2026-02-17T05:32:43.309 INFO:tasks.rados.rados.0.trial118.stdout:1102: finishing write tid 2 to trial11845692-16 2026-02-17T05:32:43.310 INFO:tasks.rados.rados.0.trial118.stdout:1102: finishing write tid 3 to trial11845692-16 2026-02-17T05:32:43.310 INFO:tasks.rados.rados.0.trial118.stdout:1102: finishing write tid 4 to trial11845692-16 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: finishing write tid 5 to trial11845692-16 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: oid 16 updating version 0 to 531 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: oid 16 version 531 is already newer than 530 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: oid 16 updating version 531 to 532 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: oid 16 updating version 532 to 533 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 533 (ObjNum 425 snap 112 seq_num 425) dirty exists 2026-02-17T05:32:43.311 INFO:tasks.rados.rados.0.trial118.stdout:1102: left oid 16 (ObjNum 425 snap 112 seq_num 425) 2026-02-17T05:32:43.314 INFO:tasks.rados.rados.0.trial118.stdout:1103: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:32:43.361 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:44.295 INFO:tasks.rados.rados.0.trial118.stdout:1100: done (4 left) 2026-02-17T05:32:44.295 INFO:tasks.rados.rados.0.trial118.stdout:1101: done (3 left) 2026-02-17T05:32:44.295 INFO:tasks.rados.rados.0.trial118.stdout:1102: done (2 left) 2026-02-17T05:32:44.296 INFO:tasks.rados.rados.0.trial118.stdout:1103: done (1 left) 2026-02-17T05:32:44.296 INFO:tasks.rados.rados.0.trial118.stdout:1104: done (0 left) 2026-02-17T05:32:44.296 INFO:tasks.rados.rados.0.trial118.stdout:1105: write oid 16 current snap is 113 2026-02-17T05:32:44.296 INFO:tasks.rados.rados.0.trial118.stdout:1105: seq_num 426 ranges {759782=571842,2012035=687143} 2026-02-17T05:32:44.300 INFO:tasks.rados.rados.0.trial118.stdout:1105: writing trial11845692-16 from 759782 to 1331624 tid 1 2026-02-17T05:32:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1105: writing trial11845692-16 from 2012035 to 2699178 tid 2 2026-02-17T05:32:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1106: write (excl) oid 42 current snap is 113 2026-02-17T05:32:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1105: finishing write tid 1 to trial11845692-16 2026-02-17T05:32:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1106: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2026-02-17T05:32:44.311 INFO:tasks.rados.rados.0.trial118.stdout:1106: writing trial11845692-42 from 776589 to 1423680 tid 1 2026-02-17T05:32:44.315 INFO:tasks.rados.rados.0.trial118.stdout:1106: writing trial11845692-42 from 2070517 to 2501318 tid 2 2026-02-17T05:32:44.318 INFO:tasks.rados.rados.0.trial118.stdout:1106: writing trial11845692-42 from 3026559 to 3176589 tid 3 2026-02-17T05:32:44.318 INFO:tasks.rados.rados.0.trial118.stdout:1107: write (excl) oid 43 current snap is 113 2026-02-17T05:32:44.318 INFO:tasks.rados.rados.0.trial118.stdout:1107: seq_num 428 ranges {793396=722340,2128999=690812} 2026-02-17T05:32:44.323 INFO:tasks.rados.rados.0.trial118.stdout:1107: writing trial11845692-43 from 793396 to 1515736 tid 1 2026-02-17T05:32:44.330 INFO:tasks.rados.rados.0.trial118.stdout:1107: writing trial11845692-43 from 2128999 to 2819811 tid 2 2026-02-17T05:32:44.330 INFO:tasks.rados.rados.0.trial118.stdout:1108: copy_from oid 13 from oid 48 current snap is 113 2026-02-17T05:32:44.330 INFO:tasks.rados.rados.0.trial118.stdout:1105: finishing write tid 2 to trial11845692-16 2026-02-17T05:32:44.330 INFO:tasks.rados.rados.0.trial118.stdout:1105: finishing write tid 3 to trial11845692-16 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1105: finishing write tid 4 to trial11845692-16 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1105: oid 16 updating version 0 to 535 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1105: oid 16 updating version 535 to 536 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1105: oid 16 version 536 is already newer than 534 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 536 (ObjNum 426 snap 113 seq_num 426) dirty exists 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1105: left oid 16 (ObjNum 426 snap 113 seq_num 426) 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1106: finishing write tid 1 to trial11845692-42 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1106: finishing write tid 2 to trial11845692-42 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1106: finishing write tid 3 to trial11845692-42 2026-02-17T05:32:44.331 INFO:tasks.rados.rados.0.trial118.stdout:1106: finishing write tid 4 to trial11845692-42 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1105: done (3 left) 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1109: read oid 8 snap -1 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1109: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1110: read oid 3 snap 106 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1110: expect deleted 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1111: copy_from oid 37 from oid 5 current snap is 113 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1106: finishing write tid 5 to trial11845692-42 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1106: oid 42 updating version 0 to 517 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1106: oid 42 updating version 517 to 520 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1106: oid 42 version 520 is already newer than 518 2026-02-17T05:32:44.332 INFO:tasks.rados.rados.0.trial118.stdout:1106: oid 42 version 520 is already newer than 519 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 520 (ObjNum 427 snap 113 seq_num 427) dirty exists 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1106: left oid 42 (ObjNum 427 snap 113 seq_num 427) 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1107: finishing write tid 1 to trial11845692-43 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1106: done (5 left) 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1112: delete oid 18 current snap is 113 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1108: finishing copy_from to trial11845692-13 2026-02-17T05:32:44.333 INFO:tasks.rados.rados.0.trial118.stdout:1108: got expected ENOENT (src dne) 2026-02-17T05:32:44.334 INFO:tasks.rados.rados.0.trial118.stdout:1108: finishing copy_from racing read to trial11845692-13 2026-02-17T05:32:44.334 INFO:tasks.rados.rados.0.trial118.stdout:1109: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: finishing write tid 2 to trial11845692-43 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: finishing write tid 3 to trial11845692-43 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: finishing write tid 4 to trial11845692-43 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: oid 43 updating version 0 to 558 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: oid 43 updating version 558 to 559 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: oid 43 updating version 559 to 560 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 560 (ObjNum 428 snap 113 seq_num 428) dirty exists 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1107: left oid 43 (ObjNum 428 snap 113 seq_num 428) 2026-02-17T05:32:44.488 INFO:tasks.rados.rados.0.trial118.stdout:1111: finishing copy_from racing read to trial11845692-37 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1111: finishing copy_from to trial11845692-37 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 135 (ObjNum 385 snap 97 seq_num 385) dirty exists 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1107: done (5 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1108: done (4 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1109: done (3 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1110: done (2 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1111: done (1 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1112: done (0 left) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1113: read oid 44 snap -1 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1113: expect (ObjNum 395 snap 101 seq_num 395) 2026-02-17T05:32:44.489 INFO:tasks.rados.rados.0.trial118.stdout:1114: snap_create 2026-02-17T05:32:44.491 INFO:tasks.rados.rados.0.trial118.stdout:1113: expect (ObjNum 395 snap 101 seq_num 395) 2026-02-17T05:32:44.532 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2353897 2026-02-17T05:32:44.544 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1538823 2026-02-17T05:32:45.296 INFO:tasks.rados.rados.0.trial118.stdout:1113: done (1 left) 2026-02-17T05:32:45.296 INFO:tasks.rados.rados.0.trial118.stdout:1114: done (0 left) 2026-02-17T05:32:45.296 INFO:tasks.rados.rados.0.trial118.stdout:1115: write oid 16 current snap is 114 2026-02-17T05:32:45.296 INFO:tasks.rados.rados.0.trial118.stdout:1115: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2026-02-17T05:32:45.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: writing trial11845692-16 from 427010 to 899848 tid 1 2026-02-17T05:32:45.305 INFO:tasks.rados.rados.0.trial118.stdout:1115: writing trial11845692-16 from 1329610 to 2024091 tid 2 2026-02-17T05:32:45.309 INFO:tasks.rados.rados.0.trial118.stdout:1115: writing trial11845692-16 from 2708828 to 3227010 tid 3 2026-02-17T05:32:45.310 INFO:tasks.rados.rados.0.trial118.stdout:1116: snap_remove snap 112 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1116: done (1 left) 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1117: copy_from oid 45 from oid 26 current snap is 114 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1115: finishing write tid 1 to trial11845692-16 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1115: finishing write tid 2 to trial11845692-16 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1115: finishing write tid 3 to trial11845692-16 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1115: finishing write tid 4 to trial11845692-16 2026-02-17T05:32:46.299 INFO:tasks.rados.rados.0.trial118.stdout:1115: finishing write tid 5 to trial11845692-16 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: oid 16 updating version 0 to 538 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: oid 16 updating version 538 to 540 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: oid 16 version 540 is already newer than 539 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: oid 16 version 540 is already newer than 537 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 540 (ObjNum 430 snap 114 seq_num 430) dirty exists 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: left oid 16 (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1115: done (1 left) 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1118: copy_from oid 19 from oid 15 current snap is 114 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1119: rollback oid 47 current snap is 114 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 97 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1120: rollback oid 7 current snap is 114 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 113 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1121: rollback oid 39 current snap is 114 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 107 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1122: read oid 50 snap 113 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1122: expect deleted 2026-02-17T05:32:46.300 INFO:tasks.rados.rados.0.trial118.stdout:1123: delete oid 2 current snap is 114 2026-02-17T05:32:46.301 INFO:tasks.rados.rados.0.trial118.stdout:1120: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:32:46.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 529 (ObjNum 33 snap 0 seq_num 4556992) dirty dne 2026-02-17T05:32:46.303 INFO:tasks.rados.rados.0.trial118.stdout:1120: done (6 left) 2026-02-17T05:32:46.303 INFO:tasks.rados.rados.0.trial118.stdout:1122: done (5 left) 2026-02-17T05:32:46.303 INFO:tasks.rados.rados.0.trial118.stdout:1123: done (4 left) 2026-02-17T05:32:46.303 INFO:tasks.rados.rados.0.trial118.stdout:1124: snap_remove snap 108 2026-02-17T05:32:47.304 INFO:tasks.rados.rados.0.trial118.stdout:1124: done (4 left) 2026-02-17T05:32:47.304 INFO:tasks.rados.rados.0.trial118.stdout:1125: copy_from oid 21 from oid 28 current snap is 114 2026-02-17T05:32:47.304 INFO:tasks.rados.rados.0.trial118.stdout:1119: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:32:47.304 INFO:tasks.rados.rados.0.trial118.stdout:1119: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:32:47.304 INFO:tasks.rados.rados.0.trial118.stdout:1119: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 524 (ObjNum 374 snap 91 seq_num 374) dirty exists 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1121: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1121: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1121: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 528 (ObjNum 411 snap 106 seq_num 411) dirty exists 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1117: finishing copy_from racing read to trial11845692-45 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1118: finishing copy_from racing read to trial11845692-19 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1117: finishing copy_from to trial11845692-45 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 251 (ObjNum 265 snap 65 seq_num 265) dirty exists 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1118: finishing copy_from to trial11845692-19 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 385 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:32:47.305 INFO:tasks.rados.rados.0.trial118.stdout:1117: done (4 left) 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1118: done (3 left) 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1119: done (2 left) 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1121: done (1 left) 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1126: read oid 46 snap -1 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1126: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1127: write (excl) oid 22 current snap is 114 2026-02-17T05:32:47.306 INFO:tasks.rados.rados.0.trial118.stdout:1127: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2026-02-17T05:32:47.307 INFO:tasks.rados.rados.0.trial118.stdout:1127: writing trial11845692-22 from 460624 to 1083960 tid 1 2026-02-17T05:32:47.313 INFO:tasks.rados.rados.0.trial118.stdout:1127: writing trial11845692-22 from 1846574 to 2544724 tid 2 2026-02-17T05:32:47.316 INFO:tasks.rados.rados.0.trial118.stdout:1127: writing trial11845692-22 from 3163674 to 3260624 tid 3 2026-02-17T05:32:47.316 INFO:tasks.rados.rados.0.trial118.stdout:1128: snap_remove snap 113 2026-02-17T05:32:48.306 INFO:tasks.rados.rados.0.trial118.stdout:1128: done (3 left) 2026-02-17T05:32:48.306 INFO:tasks.rados.rados.0.trial118.stdout:1129: snap_create 2026-02-17T05:32:48.307 INFO:tasks.rados.rados.0.trial118.stdout:1126: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:32:48.307 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:48.360 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1658178 2026-02-17T05:32:48.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 360618 2026-02-17T05:32:48.413 INFO:tasks.rados.rados.0.trial118.stdout:1125: finishing copy_from racing read to trial11845692-21 2026-02-17T05:32:48.413 INFO:tasks.rados.rados.0.trial118.stdout:1125: finishing copy_from to trial11845692-21 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 294 (ObjNum 383 snap 97 seq_num 383) dirty exists 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: finishing write tid 1 to trial11845692-22 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: finishing write tid 2 to trial11845692-22 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: finishing write tid 3 to trial11845692-22 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: finishing write tid 4 to trial11845692-22 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: finishing write tid 5 to trial11845692-22 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: oid 22 updating version 0 to 478 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: oid 22 version 478 is already newer than 475 2026-02-17T05:32:48.414 INFO:tasks.rados.rados.0.trial118.stdout:1127: oid 22 version 478 is already newer than 477 2026-02-17T05:32:48.415 INFO:tasks.rados.rados.0.trial118.stdout:1127: oid 22 version 478 is already newer than 476 2026-02-17T05:32:48.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 478 (ObjNum 432 snap 114 seq_num 432) dirty exists 2026-02-17T05:32:48.415 INFO:tasks.rados.rados.0.trial118.stdout:1127: left oid 22 (ObjNum 432 snap 114 seq_num 432) 2026-02-17T05:32:49.307 INFO:tasks.rados.rados.0.trial118.stdout:1125: done (3 left) 2026-02-17T05:32:49.307 INFO:tasks.rados.rados.0.trial118.stdout:1126: done (2 left) 2026-02-17T05:32:49.307 INFO:tasks.rados.rados.0.trial118.stdout:1127: done (1 left) 2026-02-17T05:32:49.307 INFO:tasks.rados.rados.0.trial118.stdout:1129: done (0 left) 2026-02-17T05:32:49.307 INFO:tasks.rados.rados.0.trial118.stdout:1130: write (excl) oid 42 current snap is 115 2026-02-17T05:32:49.308 INFO:tasks.rados.rados.0.trial118.stdout:1130: seq_num 433 ranges {477431=698585,1905056=441808,3074744=202687} 2026-02-17T05:32:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1130: writing trial11845692-42 from 477431 to 1176016 tid 1 2026-02-17T05:32:49.316 INFO:tasks.rados.rados.0.trial118.stdout:1130: writing trial11845692-42 from 1905056 to 2346864 tid 2 2026-02-17T05:32:49.320 INFO:tasks.rados.rados.0.trial118.stdout:1130: writing trial11845692-42 from 3074744 to 3277431 tid 3 2026-02-17T05:32:49.320 INFO:tasks.rados.rados.0.trial118.stdout:1131: snap_remove snap 109 2026-02-17T05:32:50.271 INFO:tasks.rados.rados.0.trial118.stdout:1131: done (1 left) 2026-02-17T05:32:50.271 INFO:tasks.rados.rados.0.trial118.stdout:1132: write (excl) oid 48 current snap is 115 2026-02-17T05:32:50.271 INFO:tasks.rados.rados.0.trial118.stdout:1132: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2026-02-17T05:32:50.275 INFO:tasks.rados.rados.0.trial118.stdout:1132: writing trial11845692-48 from 494238 to 984425 tid 1 2026-02-17T05:32:50.281 INFO:tasks.rados.rados.0.trial118.stdout:1132: writing trial11845692-48 from 1563538 to 2265357 tid 2 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1132: writing trial11845692-48 from 2818520 to 3294238 tid 3 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1133: delete oid 50 current snap is 115 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: finishing write tid 1 to trial11845692-42 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: finishing write tid 2 to trial11845692-42 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: finishing write tid 3 to trial11845692-42 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: finishing write tid 4 to trial11845692-42 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: finishing write tid 5 to trial11845692-42 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: oid 42 updating version 0 to 546 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: oid 42 version 546 is already newer than 544 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: oid 42 updating version 546 to 547 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: oid 42 version 547 is already newer than 545 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 547 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1130: left oid 42 (ObjNum 433 snap 115 seq_num 433) 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1132: finishing write tid 1 to trial11845692-48 2026-02-17T05:32:50.285 INFO:tasks.rados.rados.0.trial118.stdout:1132: finishing write tid 2 to trial11845692-48 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: finishing write tid 3 to trial11845692-48 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: finishing write tid 4 to trial11845692-48 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: finishing write tid 5 to trial11845692-48 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: oid 48 updating version 0 to 480 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: oid 48 version 480 is already newer than 479 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: oid 48 updating version 480 to 481 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: oid 48 updating version 481 to 482 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 482 (ObjNum 434 snap 115 seq_num 434) dirty exists 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: left oid 48 (ObjNum 434 snap 115 seq_num 434) 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1130: done (2 left) 2026-02-17T05:32:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1132: done (1 left) 2026-02-17T05:32:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1133: done (0 left) 2026-02-17T05:32:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1134: rollback oid 34 current snap is 115 2026-02-17T05:32:50.287 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 107 2026-02-17T05:32:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1135: write (excl) oid 30 current snap is 115 2026-02-17T05:32:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1135: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2026-02-17T05:32:50.290 INFO:tasks.rados.rados.0.trial118.stdout:1135: writing trial11845692-30 from 527852 to 1168537 tid 1 2026-02-17T05:32:50.295 INFO:tasks.rados.rados.0.trial118.stdout:1135: writing trial11845692-30 from 1680502 to 2269637 tid 2 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1135: writing trial11845692-30 from 2757013 to 3327852 tid 3 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1136: read oid 8 snap -1 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1136: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1137: write oid 11 current snap is 115 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1134: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1134: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1134: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 302 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1135: finishing write tid 1 to trial11845692-30 2026-02-17T05:32:50.299 INFO:tasks.rados.rados.0.trial118.stdout:1137: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2026-02-17T05:32:50.304 INFO:tasks.rados.rados.0.trial118.stdout:1137: writing trial11845692-11 from 544659 to 1260593 tid 1 2026-02-17T05:32:50.308 INFO:tasks.rados.rados.0.trial118.stdout:1137: writing trial11845692-11 from 1738984 to 2188130 tid 2 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1137: writing trial11845692-11 from 2784436 to 3344659 tid 3 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1134: done (3 left) 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1138: read oid 41 snap -1 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1138: expect deleted 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1139: delete oid 18 current snap is 115 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1135: finishing write tid 2 to trial11845692-30 2026-02-17T05:32:50.313 INFO:tasks.rados.rados.0.trial118.stdout:1135: finishing write tid 3 to trial11845692-30 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: finishing write tid 4 to trial11845692-30 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: finishing write tid 5 to trial11845692-30 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: oid 30 updating version 0 to 582 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: oid 30 version 582 is already newer than 579 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: oid 30 version 582 is already newer than 581 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: oid 30 version 582 is already newer than 580 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 582 (ObjNum 436 snap 115 seq_num 436) dirty exists 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1135: left oid 30 (ObjNum 436 snap 115 seq_num 436) 2026-02-17T05:32:50.314 INFO:tasks.rados.rados.0.trial118.stdout:1136: expect (ObjNum 265 snap 65 seq_num 265) 2026-02-17T05:32:50.364 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:50.470 INFO:tasks.rados.rados.0.trial118.stdout:1137: finishing write tid 1 to trial11845692-11 2026-02-17T05:32:50.470 INFO:tasks.rados.rados.0.trial118.stdout:1137: finishing write tid 2 to trial11845692-11 2026-02-17T05:32:50.471 INFO:tasks.rados.rados.0.trial118.stdout:1135: done (4 left) 2026-02-17T05:32:50.471 INFO:tasks.rados.rados.0.trial118.stdout:1136: done (3 left) 2026-02-17T05:32:50.471 INFO:tasks.rados.rados.0.trial118.stdout:1139: done (2 left) 2026-02-17T05:32:50.471 INFO:tasks.rados.rados.0.trial118.stdout:1140: write oid 15 current snap is 115 2026-02-17T05:32:50.471 INFO:tasks.rados.rados.0.trial118.stdout:1140: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2026-02-17T05:32:50.474 INFO:tasks.rados.rados.0.trial118.stdout:1140: writing trial11845692-15 from 578273 to 1044705 tid 1 2026-02-17T05:32:50.478 INFO:tasks.rados.rados.0.trial118.stdout:1140: writing trial11845692-15 from 1739595 to 2192410 tid 2 2026-02-17T05:32:50.482 INFO:tasks.rados.rados.0.trial118.stdout:1140: writing trial11845692-15 from 2722929 to 3378273 tid 3 2026-02-17T05:32:50.482 INFO:tasks.rados.rados.0.trial118.stdout:1141: snap_remove snap 107 2026-02-17T05:32:51.312 INFO:tasks.rados.rados.0.trial118.stdout:1141: done (3 left) 2026-02-17T05:32:51.312 INFO:tasks.rados.rados.0.trial118.stdout:1142: write oid 22 current snap is 115 2026-02-17T05:32:51.312 INFO:tasks.rados.rados.0.trial118.stdout:1142: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2026-02-17T05:32:51.317 INFO:tasks.rados.rados.0.trial118.stdout:1142: writing trial11845692-22 from 595080 to 1136761 tid 1 2026-02-17T05:32:51.321 INFO:tasks.rados.rados.0.trial118.stdout:1142: writing trial11845692-22 from 1798077 to 2394550 tid 2 2026-02-17T05:32:51.325 INFO:tasks.rados.rados.0.trial118.stdout:1142: writing trial11845692-22 from 3150352 to 3395080 tid 3 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1143: delete oid 4 current snap is 115 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: finishing write tid 3 to trial11845692-11 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: finishing write tid 4 to trial11845692-11 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: finishing write tid 5 to trial11845692-11 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: oid 11 updating version 0 to 594 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: oid 11 version 594 is already newer than 592 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: oid 11 version 594 is already newer than 593 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: oid 11 version 594 is already newer than 591 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 594 (ObjNum 437 snap 115 seq_num 437) dirty exists 2026-02-17T05:32:51.326 INFO:tasks.rados.rados.0.trial118.stdout:1137: left oid 11 (ObjNum 437 snap 115 seq_num 437) 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: finishing write tid 1 to trial11845692-15 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: finishing write tid 2 to trial11845692-15 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: finishing write tid 3 to trial11845692-15 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: finishing write tid 4 to trial11845692-15 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: finishing write tid 5 to trial11845692-15 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: oid 15 updating version 0 to 485 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: oid 15 updating version 485 to 486 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: oid 15 version 486 is already newer than 483 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: oid 15 version 486 is already newer than 484 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 486 (ObjNum 439 snap 115 seq_num 439) dirty exists 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1140: left oid 15 (ObjNum 439 snap 115 seq_num 439) 2026-02-17T05:32:51.327 INFO:tasks.rados.rados.0.trial118.stdout:1142: finishing write tid 1 to trial11845692-22 2026-02-17T05:32:51.328 INFO:tasks.rados.rados.0.trial118.stdout:1142: finishing write tid 2 to trial11845692-22 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: finishing write tid 3 to trial11845692-22 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: finishing write tid 4 to trial11845692-22 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: finishing write tid 5 to trial11845692-22 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: oid 22 updating version 0 to 487 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: oid 22 updating version 487 to 488 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: oid 22 updating version 488 to 490 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: oid 22 version 490 is already newer than 489 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 490 (ObjNum 440 snap 115 seq_num 440) dirty exists 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1142: left oid 22 (ObjNum 440 snap 115 seq_num 440) 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1137: done (4 left) 2026-02-17T05:32:51.329 INFO:tasks.rados.rados.0.trial118.stdout:1138: done (3 left) 2026-02-17T05:32:51.330 INFO:tasks.rados.rados.0.trial118.stdout:1140: done (2 left) 2026-02-17T05:32:51.330 INFO:tasks.rados.rados.0.trial118.stdout:1142: done (1 left) 2026-02-17T05:32:51.330 INFO:tasks.rados.rados.0.trial118.stdout:1143: done (0 left) 2026-02-17T05:32:51.330 INFO:tasks.rados.rados.0.trial118.stdout:1144: write (excl) oid 23 current snap is 115 2026-02-17T05:32:51.330 INFO:tasks.rados.rados.0.trial118.stdout:1144: seq_num 442 ranges {628694=408532,1515041=600142,2805198=552112} 2026-02-17T05:32:51.332 INFO:tasks.rados.rados.0.trial118.stdout:1144: writing trial11845692-23 from 628694 to 1037226 tid 1 2026-02-17T05:32:51.336 INFO:tasks.rados.rados.0.trial118.stdout:1144: writing trial11845692-23 from 1515041 to 2115183 tid 2 2026-02-17T05:32:51.341 INFO:tasks.rados.rados.0.trial118.stdout:1144: writing trial11845692-23 from 2805198 to 3357310 tid 3 2026-02-17T05:32:51.341 INFO:tasks.rados.rados.0.trial118.stdout:1145: copy_from oid 29 from oid 42 current snap is 115 2026-02-17T05:32:51.341 INFO:tasks.rados.rados.0.trial118.stdout:1144: finishing write tid 1 to trial11845692-23 2026-02-17T05:32:51.341 INFO:tasks.rados.rados.0.trial118.stdout:1144: finishing write tid 2 to trial11845692-23 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1146: read oid 44 snap -1 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1146: expect (ObjNum 395 snap 101 seq_num 395) 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1147: read oid 47 snap -1 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1147: expect (ObjNum 374 snap 91 seq_num 374) 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1148: copy_from oid 4 from oid 38 current snap is 115 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1149: write (excl) oid 24 current snap is 115 2026-02-17T05:32:51.342 INFO:tasks.rados.rados.0.trial118.stdout:1149: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2026-02-17T05:32:51.345 INFO:tasks.rados.rados.0.trial118.stdout:1149: writing trial11845692-24 from 645501 to 1129282 tid 1 2026-02-17T05:32:51.348 INFO:tasks.rados.rados.0.trial118.stdout:1149: writing trial11845692-24 from 1573523 to 2033676 tid 2 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1149: writing trial11845692-24 from 2548974 to 3312358 tid 3 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1150: delete oid 26 current snap is 115 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1144: finishing write tid 3 to trial11845692-23 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1144: finishing write tid 4 to trial11845692-23 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1144: finishing write tid 5 to trial11845692-23 2026-02-17T05:32:51.354 INFO:tasks.rados.rados.0.trial118.stdout:1144: oid 23 updating version 0 to 487 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:1144: oid 23 version 487 is already newer than 486 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:1144: oid 23 updating version 487 to 489 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:1144: oid 23 version 489 is already newer than 488 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 489 (ObjNum 442 snap 115 seq_num 442) dirty exists 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:1144: left oid 23 (ObjNum 442 snap 115 seq_num 442) 2026-02-17T05:32:51.355 INFO:tasks.rados.rados.0.trial118.stdout:1146: expect (ObjNum 395 snap 101 seq_num 395) 2026-02-17T05:32:51.434 INFO:tasks.rados.rados.0.trial118.stdout:1147: expect (ObjNum 374 snap 91 seq_num 374) 2026-02-17T05:32:51.442 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2233496 2026-02-17T05:32:51.477 INFO:tasks.rados.rados.0.trial118.stdout:1149: finishing write tid 1 to trial11845692-24 2026-02-17T05:32:51.477 INFO:tasks.rados.rados.0.trial118.stdout:1144: done (6 left) 2026-02-17T05:32:51.477 INFO:tasks.rados.rados.0.trial118.stdout:1146: done (5 left) 2026-02-17T05:32:51.477 INFO:tasks.rados.rados.0.trial118.stdout:1147: done (4 left) 2026-02-17T05:32:51.477 INFO:tasks.rados.rados.0.trial118.stdout:1150: done (3 left) 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1151: rollback oid 3 current snap is 115 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 94 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1149: finishing write tid 2 to trial11845692-24 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1148: finishing copy_from racing read to trial11845692-4 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1145: finishing copy_from to trial11845692-29 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 547 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1145: finishing copy_from racing read to trial11845692-29 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1148: finishing copy_from to trial11845692-4 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 500 (ObjNum 414 snap 109 seq_num 414) dirty exists 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1149: finishing write tid 3 to trial11845692-24 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1145: done (3 left) 2026-02-17T05:32:51.478 INFO:tasks.rados.rados.0.trial118.stdout:1148: done (2 left) 2026-02-17T05:32:51.479 INFO:tasks.rados.rados.0.trial118.stdout:1152: snap_remove snap 97 2026-02-17T05:32:52.318 INFO:tasks.rados.rados.0.trial118.stdout:1152: done (2 left) 2026-02-17T05:32:52.318 INFO:tasks.rados.rados.0.trial118.stdout:1153: read oid 21 snap -1 2026-02-17T05:32:52.318 INFO:tasks.rados.rados.0.trial118.stdout:1153: expect (ObjNum 383 snap 97 seq_num 383) 2026-02-17T05:32:52.318 INFO:tasks.rados.rados.0.trial118.stdout:1154: write (excl) oid 15 current snap is 115 2026-02-17T05:32:52.318 INFO:tasks.rados.rados.0.trial118.stdout:1154: seq_num 445 ranges {679115=634279,2090487=463822,3003820=475295} 2026-02-17T05:32:52.322 INFO:tasks.rados.rados.0.trial118.stdout:1154: writing trial11845692-15 from 679115 to 1313394 tid 1 2026-02-17T05:32:52.327 INFO:tasks.rados.rados.0.trial118.stdout:1154: writing trial11845692-15 from 2090487 to 2554309 tid 2 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:1154: writing trial11845692-15 from 3003820 to 3479115 tid 3 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:1155: rollback oid 30 current snap is 115 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 30 to 110 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:1149: finishing write tid 4 to trial11845692-24 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:1149: finishing write tid 5 to trial11845692-24 2026-02-17T05:32:52.331 INFO:tasks.rados.rados.0.trial118.stdout:1149: oid 24 updating version 0 to 154 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1149: oid 24 updating version 154 to 156 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1149: oid 24 updating version 156 to 157 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1149: oid 24 version 157 is already newer than 155 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 157 (ObjNum 443 snap 115 seq_num 443) dirty exists 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1149: left oid 24 (ObjNum 443 snap 115 seq_num 443) 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1151: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1151: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1151: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 402 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:32:52.332 INFO:tasks.rados.rados.0.trial118.stdout:1153: expect (ObjNum 383 snap 97 seq_num 383) 2026-02-17T05:32:52.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1206671 2026-02-17T05:32:52.391 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: finishing write tid 1 to trial11845692-15 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: finishing write tid 2 to trial11845692-15 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: finishing write tid 3 to trial11845692-15 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1155: finishing rollback tid 0 to trial11845692-30 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: finishing write tid 4 to trial11845692-15 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: finishing write tid 5 to trial11845692-15 2026-02-17T05:32:52.425 INFO:tasks.rados.rados.0.trial118.stdout:1154: oid 15 updating version 0 to 491 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1154: oid 15 updating version 491 to 494 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1154: oid 15 version 494 is already newer than 493 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1154: oid 15 version 494 is already newer than 492 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 494 (ObjNum 445 snap 115 seq_num 445) dirty exists 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1154: left oid 15 (ObjNum 445 snap 115 seq_num 445) 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1155: finishing rollback tid 1 to trial11845692-30 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1155: finishing rollback tid 2 to trial11845692-30 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 599 (ObjNum 417 snap 109 seq_num 417) dirty exists 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1149: done (4 left) 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1151: done (3 left) 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1153: done (2 left) 2026-02-17T05:32:52.426 INFO:tasks.rados.rados.0.trial118.stdout:1154: done (1 left) 2026-02-17T05:32:52.427 INFO:tasks.rados.rados.0.trial118.stdout:1155: done (0 left) 2026-02-17T05:32:52.427 INFO:tasks.rados.rados.0.trial118.stdout:1156: delete oid 18 current snap is 115 2026-02-17T05:32:52.427 INFO:tasks.rados.rados.0.trial118.stdout:1156: done (0 left) 2026-02-17T05:32:52.427 INFO:tasks.rados.rados.0.trial118.stdout:1157: snap_remove snap 110 2026-02-17T05:32:53.319 INFO:tasks.rados.rados.0.trial118.stdout:1157: done (0 left) 2026-02-17T05:32:53.319 INFO:tasks.rados.rados.0.trial118.stdout:1158: delete oid 4 current snap is 115 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1158: done (0 left) 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1159: copy_from oid 14 from oid 40 current snap is 115 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1160: read oid 2 snap 114 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1160: expect deleted 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1161: read oid 36 snap -1 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1161: expect deleted 2026-02-17T05:32:53.321 INFO:tasks.rados.rados.0.trial118.stdout:1162: snap_remove snap 94 2026-02-17T05:32:54.321 INFO:tasks.rados.rados.0.trial118.stdout:1162: done (3 left) 2026-02-17T05:32:54.321 INFO:tasks.rados.rados.0.trial118.stdout:1163: snap_create 2026-02-17T05:32:54.321 INFO:tasks.rados.rados.0.trial118.stdout:1159: finishing copy_from racing read to trial11845692-14 2026-02-17T05:32:54.321 INFO:tasks.rados.rados.0.trial118.stdout:1159: finishing copy_from to trial11845692-14 2026-02-17T05:32:54.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 550 (ObjNum 415 snap 109 seq_num 415) dirty exists 2026-02-17T05:32:55.322 INFO:tasks.rados.rados.0.trial118.stdout:1159: done (3 left) 2026-02-17T05:32:55.323 INFO:tasks.rados.rados.0.trial118.stdout:1160: done (2 left) 2026-02-17T05:32:55.323 INFO:tasks.rados.rados.0.trial118.stdout:1161: done (1 left) 2026-02-17T05:32:55.323 INFO:tasks.rados.rados.0.trial118.stdout:1163: done (0 left) 2026-02-17T05:32:55.323 INFO:tasks.rados.rados.0.trial118.stdout:1164: snap_create 2026-02-17T05:32:56.325 INFO:tasks.rados.rados.0.trial118.stdout:1164: done (0 left) 2026-02-17T05:32:56.326 INFO:tasks.rados.rados.0.trial118.stdout:1165: write (excl) oid 4 current snap is 117 2026-02-17T05:32:56.326 INFO:tasks.rados.rados.0.trial118.stdout:1165: seq_num 448 ranges {729536=460026,1749580=611149,2853383=452450} 2026-02-17T05:32:56.330 INFO:tasks.rados.rados.0.trial118.stdout:1165: writing trial11845692-4 from 729536 to 1189562 tid 1 2026-02-17T05:32:56.334 INFO:tasks.rados.rados.0.trial118.stdout:1165: writing trial11845692-4 from 1749580 to 2360729 tid 2 2026-02-17T05:32:56.338 INFO:tasks.rados.rados.0.trial118.stdout:1165: writing trial11845692-4 from 2853383 to 3305833 tid 3 2026-02-17T05:32:56.338 INFO:tasks.rados.rados.0.trial118.stdout:1166: snap_create 2026-02-17T05:32:56.338 INFO:tasks.rados.rados.0.trial118.stdout:1165: finishing write tid 1 to trial11845692-4 2026-02-17T05:32:56.338 INFO:tasks.rados.rados.0.trial118.stdout:1165: finishing write tid 2 to trial11845692-4 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: finishing write tid 3 to trial11845692-4 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: finishing write tid 4 to trial11845692-4 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: finishing write tid 5 to trial11845692-4 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: oid 4 updating version 0 to 564 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: oid 4 version 564 is already newer than 563 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: oid 4 version 564 is already newer than 561 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: oid 4 version 564 is already newer than 562 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 564 (ObjNum 448 snap 117 seq_num 448) dirty exists 2026-02-17T05:32:56.340 INFO:tasks.rados.rados.0.trial118.stdout:1165: left oid 4 (ObjNum 448 snap 117 seq_num 448) 2026-02-17T05:32:57.327 INFO:tasks.rados.rados.0.trial118.stdout:1165: done (1 left) 2026-02-17T05:32:57.327 INFO:tasks.rados.rados.0.trial118.stdout:1166: done (0 left) 2026-02-17T05:32:57.328 INFO:tasks.rados.rados.0.trial118.stdout:1167: snap_remove snap 100 2026-02-17T05:32:58.330 INFO:tasks.rados.rados.0.trial118.stdout:1167: done (0 left) 2026-02-17T05:32:58.330 INFO:tasks.rados.rados.0.trial118.stdout:1168: snap_remove snap 116 2026-02-17T05:32:59.330 INFO:tasks.rados.rados.0.trial118.stdout:1168: done (0 left) 2026-02-17T05:32:59.331 INFO:tasks.rados.rados.0.trial118.stdout:1169: read oid 25 snap 111 2026-02-17T05:32:59.331 INFO:tasks.rados.rados.0.trial118.stdout:1169: expect deleted 2026-02-17T05:32:59.331 INFO:tasks.rados.rados.0.trial118.stdout:1170: write oid 39 current snap is 118 2026-02-17T05:32:59.331 INFO:tasks.rados.rados.0.trial118.stdout:1170: seq_num 449 ranges {746343=651628,1924415=754807,3397159=149184} 2026-02-17T05:32:59.336 INFO:tasks.rados.rados.0.trial118.stdout:1170: writing trial11845692-39 from 746343 to 1397971 tid 1 2026-02-17T05:32:59.341 INFO:tasks.rados.rados.0.trial118.stdout:1170: writing trial11845692-39 from 1924415 to 2679222 tid 2 2026-02-17T05:32:59.345 INFO:tasks.rados.rados.0.trial118.stdout:1170: writing trial11845692-39 from 3397159 to 3546343 tid 3 2026-02-17T05:32:59.345 INFO:tasks.rados.rados.0.trial118.stdout:1171: write oid 12 current snap is 118 2026-02-17T05:32:59.345 INFO:tasks.rados.rados.0.trial118.stdout:1171: seq_num 450 ranges {763150=726877,1982897=614818,3024582=474994} 2026-02-17T05:32:59.350 INFO:tasks.rados.rados.0.trial118.stdout:1171: writing trial11845692-12 from 763150 to 1490027 tid 1 2026-02-17T05:32:59.354 INFO:tasks.rados.rados.0.trial118.stdout:1171: writing trial11845692-12 from 1982897 to 2597715 tid 2 2026-02-17T05:32:59.359 INFO:tasks.rados.rados.0.trial118.stdout:1171: writing trial11845692-12 from 3024582 to 3499576 tid 3 2026-02-17T05:32:59.359 INFO:tasks.rados.rados.0.trial118.stdout:1172: write oid 43 current snap is 118 2026-02-17T05:32:59.359 INFO:tasks.rados.rados.0.trial118.stdout:1172: seq_num 451 ranges {779957=402126,1925026=758476,3335652=244305} 2026-02-17T05:32:59.362 INFO:tasks.rados.rados.0.trial118.stdout:1172: writing trial11845692-43 from 779957 to 1182083 tid 1 2026-02-17T05:32:59.368 INFO:tasks.rados.rados.0.trial118.stdout:1172: writing trial11845692-43 from 1925026 to 2683502 tid 2 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1172: writing trial11845692-43 from 3335652 to 3579957 tid 3 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1173: copy_from oid 14 from oid 27 current snap is 118 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: finishing write tid 1 to trial11845692-39 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: finishing write tid 2 to trial11845692-39 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: finishing write tid 3 to trial11845692-39 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: finishing write tid 4 to trial11845692-39 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1169: done (4 left) 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1174: rollback oid 15 current snap is 118 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 111 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: finishing write tid 5 to trial11845692-39 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: oid 39 updating version 0 to 596 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: oid 39 version 596 is already newer than 595 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: oid 39 version 596 is already newer than 593 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: oid 39 version 596 is already newer than 594 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 596 (ObjNum 449 snap 118 seq_num 449) dirty exists 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: left oid 39 (ObjNum 449 snap 118 seq_num 449) 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: finishing write tid 1 to trial11845692-12 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: finishing write tid 2 to trial11845692-12 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: finishing write tid 3 to trial11845692-12 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: finishing write tid 4 to trial11845692-12 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: finishing write tid 5 to trial11845692-12 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: oid 12 updating version 0 to 562 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: oid 12 version 562 is already newer than 561 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: oid 12 updating version 562 to 563 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: oid 12 updating version 563 to 564 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 564 (ObjNum 450 snap 118 seq_num 450) dirty exists 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: left oid 12 (ObjNum 450 snap 118 seq_num 450) 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1172: finishing write tid 1 to trial11845692-43 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1170: done (4 left) 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1171: done (3 left) 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1175: rollback oid 6 current snap is 118 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1172: finishing write tid 2 to trial11845692-43 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 106 2026-02-17T05:32:59.372 INFO:tasks.rados.rados.0.trial118.stdout:1176: snap_remove snap 114 2026-02-17T05:33:00.273 INFO:tasks.rados.rados.0.trial118.stdout:1176: done (4 left) 2026-02-17T05:33:00.273 INFO:tasks.rados.rados.0.trial118.stdout:1177: snap_remove snap 117 2026-02-17T05:33:01.272 INFO:tasks.rados.rados.0.trial118.stdout:1177: done (4 left) 2026-02-17T05:33:01.272 INFO:tasks.rados.rados.0.trial118.stdout:1178: snap_remove snap 115 2026-02-17T05:33:02.272 INFO:tasks.rados.rados.0.trial118.stdout:1178: done (4 left) 2026-02-17T05:33:02.272 INFO:tasks.rados.rados.0.trial118.stdout:1179: read oid 33 snap 111 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1179: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1180: read oid 25 snap 106 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1180: expect deleted 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: finishing write tid 3 to trial11845692-43 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: finishing write tid 4 to trial11845692-43 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: finishing write tid 5 to trial11845692-43 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: oid 43 updating version 0 to 565 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: oid 43 updating version 565 to 568 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: oid 43 version 568 is already newer than 566 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: oid 43 version 568 is already newer than 567 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 568 (ObjNum 451 snap 118 seq_num 451) dirty exists 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: left oid 43 (ObjNum 451 snap 118 seq_num 451) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1174: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1172: done (5 left) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1181: copy_from oid 49 from oid 32 current snap is 118 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1174: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1174: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 514 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1175: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1175: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1175: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 492 (ObjNum 398 snap 104 seq_num 398) dirty exists 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1173: finishing copy_from racing read to trial11845692-14 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1173: finishing copy_from to trial11845692-14 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 575 (ObjNum 381 snap 94 seq_num 381) dirty exists 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1173: done (5 left) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1174: done (4 left) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1175: done (3 left) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1182: read oid 39 snap -1 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1182: expect (ObjNum 449 snap 118 seq_num 449) 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1183: write (excl) oid 36 current snap is 118 2026-02-17T05:33:02.273 INFO:tasks.rados.rados.0.trial118.stdout:1183: seq_num 452 ranges {796764=477375,1983508=618487,3363075=233689} 2026-02-17T05:33:02.278 INFO:tasks.rados.rados.0.trial118.stdout:1183: writing trial11845692-36 from 796764 to 1274139 tid 1 2026-02-17T05:33:02.283 INFO:tasks.rados.rados.0.trial118.stdout:1183: writing trial11845692-36 from 1983508 to 2601995 tid 2 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1183: writing trial11845692-36 from 3363075 to 3596764 tid 3 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1184: write (excl) oid 46 current snap is 118 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1181: finishing copy_from to trial11845692-49 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1181: got expected ENOENT (src dne) 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1181: finishing copy_from racing read to trial11845692-49 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1179: expect (ObjNum 321 snap 78 seq_num 321) 2026-02-17T05:33:02.288 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:02.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1746571 2026-02-17T05:33:02.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3295122 2026-02-17T05:33:02.433 INFO:tasks.rados.rados.0.trial118.stdout:1183: finishing write tid 1 to trial11845692-36 2026-02-17T05:33:02.433 INFO:tasks.rados.rados.0.trial118.stdout:1182: expect (ObjNum 449 snap 118 seq_num 449) 2026-02-17T05:33:02.526 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 838010 2026-02-17T05:33:02.559 INFO:tasks.rados.rados.0.trial118.stdout:1183: finishing write tid 2 to trial11845692-36 2026-02-17T05:33:02.559 INFO:tasks.rados.rados.0.trial118.stdout:1183: finishing write tid 3 to trial11845692-36 2026-02-17T05:33:02.559 INFO:tasks.rados.rados.0.trial118.stdout:1183: finishing write tid 4 to trial11845692-36 2026-02-17T05:33:02.559 INFO:tasks.rados.rados.0.trial118.stdout:1184: seq_num 453 ranges {413571=552624,1641990=762145,2990498=425163} 2026-02-17T05:33:02.562 INFO:tasks.rados.rados.0.trial118.stdout:1184: writing trial11845692-46 from 413571 to 966195 tid 1 2026-02-17T05:33:02.568 INFO:tasks.rados.rados.0.trial118.stdout:1184: writing trial11845692-46 from 1641990 to 2404135 tid 2 2026-02-17T05:33:02.572 INFO:tasks.rados.rados.0.trial118.stdout:1184: writing trial11845692-46 from 2990498 to 3415661 tid 3 2026-02-17T05:33:02.572 INFO:tasks.rados.rados.0.trial118.stdout:1179: done (5 left) 2026-02-17T05:33:02.572 INFO:tasks.rados.rados.0.trial118.stdout:1180: done (4 left) 2026-02-17T05:33:02.572 INFO:tasks.rados.rados.0.trial118.stdout:1181: done (3 left) 2026-02-17T05:33:02.573 INFO:tasks.rados.rados.0.trial118.stdout:1182: done (2 left) 2026-02-17T05:33:02.573 INFO:tasks.rados.rados.0.trial118.stdout:1185: read oid 34 snap 111 2026-02-17T05:33:02.573 INFO:tasks.rados.rados.0.trial118.stdout:1185: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-17T05:33:02.573 INFO:tasks.rados.rados.0.trial118.stdout:1186: write (excl) oid 25 current snap is 118 2026-02-17T05:33:02.573 INFO:tasks.rados.rados.0.trial118.stdout:1186: seq_num 454 ranges {430378=627873,1700472=622156,3017921=612457} 2026-02-17T05:33:02.576 INFO:tasks.rados.rados.0.trial118.stdout:1186: writing trial11845692-25 from 430378 to 1058251 tid 1 2026-02-17T05:33:02.580 INFO:tasks.rados.rados.0.trial118.stdout:1186: writing trial11845692-25 from 1700472 to 2322628 tid 2 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1186: writing trial11845692-25 from 3017921 to 3630378 tid 3 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1187: snap_create 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1183: finishing write tid 5 to trial11845692-36 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1183: oid 36 updating version 0 to 523 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1183: oid 36 updating version 523 to 524 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1183: oid 36 updating version 524 to 525 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:1183: oid 36 updating version 525 to 526 2026-02-17T05:33:02.586 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 526 (ObjNum 452 snap 118 seq_num 452) dirty exists 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1183: left oid 36 (ObjNum 452 snap 118 seq_num 452) 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: finishing write tid 1 to trial11845692-46 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: finishing write tid 2 to trial11845692-46 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: finishing write tid 3 to trial11845692-46 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: finishing write tid 4 to trial11845692-46 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: finishing write tid 5 to trial11845692-46 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: oid 46 updating version 0 to 393 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: oid 46 version 393 is already newer than 392 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: oid 46 updating version 393 to 394 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: oid 46 version 394 is already newer than 391 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 394 (ObjNum 453 snap 118 seq_num 453) dirty exists 2026-02-17T05:33:02.587 INFO:tasks.rados.rados.0.trial118.stdout:1184: left oid 46 (ObjNum 453 snap 118 seq_num 453) 2026-02-17T05:33:02.588 INFO:tasks.rados.rados.0.trial118.stdout:1186: finishing write tid 1 to trial11845692-25 2026-02-17T05:33:02.588 INFO:tasks.rados.rados.0.trial118.stdout:1185: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-17T05:33:02.588 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:02.610 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:02.634 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:02.658 INFO:tasks.rados.rados.0.trial118.stdout:1186: finishing write tid 2 to trial11845692-25 2026-02-17T05:33:02.658 INFO:tasks.rados.rados.0.trial118.stdout:1186: finishing write tid 3 to trial11845692-25 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: finishing write tid 4 to trial11845692-25 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: finishing write tid 5 to trial11845692-25 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: oid 25 updating version 0 to 624 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: oid 25 version 624 is already newer than 622 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: oid 25 version 624 is already newer than 623 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: oid 25 updating version 624 to 625 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 625 (ObjNum 454 snap 118 seq_num 454) dirty exists 2026-02-17T05:33:02.659 INFO:tasks.rados.rados.0.trial118.stdout:1186: left oid 25 (ObjNum 454 snap 118 seq_num 454) 2026-02-17T05:33:03.335 INFO:tasks.rados.rados.0.trial118.stdout:1183: done (4 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1184: done (3 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1185: done (2 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1186: done (1 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1187: done (0 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1188: delete oid 50 current snap is 119 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1188: done (0 left) 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1189: write oid 15 current snap is 119 2026-02-17T05:33:03.336 INFO:tasks.rados.rados.0.trial118.stdout:1189: seq_num 456 ranges {463992=778371,1701083=625825,2956414=658979} 2026-02-17T05:33:03.341 INFO:tasks.rados.rados.0.trial118.stdout:1189: writing trial11845692-15 from 463992 to 1242363 tid 1 2026-02-17T05:33:03.345 INFO:tasks.rados.rados.0.trial118.stdout:1189: writing trial11845692-15 from 1701083 to 2326908 tid 2 2026-02-17T05:33:03.349 INFO:tasks.rados.rados.0.trial118.stdout:1189: writing trial11845692-15 from 2956414 to 3615393 tid 3 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1190: read oid 35 snap -1 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1190: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1191: rollback oid 37 current snap is 119 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 111 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1189: finishing write tid 1 to trial11845692-15 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1189: finishing write tid 2 to trial11845692-15 2026-02-17T05:33:03.350 INFO:tasks.rados.rados.0.trial118.stdout:1192: snap_remove snap 106 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1192: done (3 left) 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1193: copy_from oid 33 from oid 3 current snap is 119 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: finishing write tid 3 to trial11845692-15 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: finishing write tid 4 to trial11845692-15 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: finishing write tid 5 to trial11845692-15 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: oid 15 updating version 0 to 528 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: oid 15 updating version 528 to 531 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: oid 15 version 531 is already newer than 530 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:1189: oid 15 version 531 is already newer than 529 2026-02-17T05:33:04.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 531 (ObjNum 456 snap 119 seq_num 456) dirty exists 2026-02-17T05:33:04.339 INFO:tasks.rados.rados.0.trial118.stdout:1189: left oid 15 (ObjNum 456 snap 119 seq_num 456) 2026-02-17T05:33:04.339 INFO:tasks.rados.rados.0.trial118.stdout:1191: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:33:04.339 INFO:tasks.rados.rados.0.trial118.stdout:1191: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:33:04.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 137 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:33:04.339 INFO:tasks.rados.rados.0.trial118.stdout:1190: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:04.398 INFO:tasks.rados.rados.0.trial118.stdout:1193: finishing copy_from racing read to trial11845692-33 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1193: finishing copy_from to trial11845692-33 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 402 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1189: done (3 left) 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1190: done (2 left) 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1191: done (1 left) 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1193: done (0 left) 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1194: read oid 35 snap -1 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1194: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:04.399 INFO:tasks.rados.rados.0.trial118.stdout:1195: delete oid 43 current snap is 119 2026-02-17T05:33:04.400 INFO:tasks.rados.rados.0.trial118.stdout:1195: done (1 left) 2026-02-17T05:33:04.400 INFO:tasks.rados.rados.0.trial118.stdout:1196: copy_from oid 22 from oid 17 current snap is 119 2026-02-17T05:33:04.400 INFO:tasks.rados.rados.0.trial118.stdout:1197: write oid 36 current snap is 119 2026-02-17T05:33:04.401 INFO:tasks.rados.rados.0.trial118.stdout:1197: seq_num 458 ranges {497606=645222,1934400=629494,3243966=453640} 2026-02-17T05:33:04.404 INFO:tasks.rados.rados.0.trial118.stdout:1197: writing trial11845692-36 from 497606 to 1142828 tid 1 2026-02-17T05:33:04.409 INFO:tasks.rados.rados.0.trial118.stdout:1197: writing trial11845692-36 from 1934400 to 2563894 tid 2 2026-02-17T05:33:04.414 INFO:tasks.rados.rados.0.trial118.stdout:1197: writing trial11845692-36 from 3243966 to 3697606 tid 3 2026-02-17T05:33:04.414 INFO:tasks.rados.rados.0.trial118.stdout:1198: read oid 19 snap -1 2026-02-17T05:33:04.414 INFO:tasks.rados.rados.0.trial118.stdout:1198: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:04.414 INFO:tasks.rados.rados.0.trial118.stdout:1199: write oid 30 current snap is 119 2026-02-17T05:33:04.414 INFO:tasks.rados.rados.0.trial118.stdout:1199: seq_num 459 ranges {514413=720471,1876529=773152,3438683=275730} 2026-02-17T05:33:04.418 INFO:tasks.rados.rados.0.trial118.stdout:1199: writing trial11845692-30 from 514413 to 1234884 tid 1 2026-02-17T05:33:04.423 INFO:tasks.rados.rados.0.trial118.stdout:1199: writing trial11845692-30 from 1876529 to 2649681 tid 2 2026-02-17T05:33:04.427 INFO:tasks.rados.rados.0.trial118.stdout:1199: writing trial11845692-30 from 3438683 to 3714413 tid 3 2026-02-17T05:33:04.428 INFO:tasks.rados.rados.0.trial118.stdout:1200: write (excl) oid 15 current snap is 119 2026-02-17T05:33:04.428 INFO:tasks.rados.rados.0.trial118.stdout:1200: seq_num 460 ranges {531220=795720,1935011=516810,3066106=420420} 2026-02-17T05:33:04.432 INFO:tasks.rados.rados.0.trial118.stdout:1200: writing trial11845692-15 from 531220 to 1326940 tid 1 2026-02-17T05:33:04.436 INFO:tasks.rados.rados.0.trial118.stdout:1200: writing trial11845692-15 from 1935011 to 2451821 tid 2 2026-02-17T05:33:04.441 INFO:tasks.rados.rados.0.trial118.stdout:1200: writing trial11845692-15 from 3066106 to 3486526 tid 3 2026-02-17T05:33:04.441 INFO:tasks.rados.rados.0.trial118.stdout:1201: read oid 39 snap -1 2026-02-17T05:33:04.441 INFO:tasks.rados.rados.0.trial118.stdout:1201: expect (ObjNum 449 snap 118 seq_num 449) 2026-02-17T05:33:04.441 INFO:tasks.rados.rados.0.trial118.stdout:1202: delete oid 8 current snap is 119 2026-02-17T05:33:04.441 INFO:tasks.rados.rados.0.trial118.stdout:1194: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:04.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2207982 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1196: finishing copy_from to trial11845692-22 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1196: got expected ENOENT (src dne) 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1196: finishing copy_from racing read to trial11845692-22 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1197: finishing write tid 1 to trial11845692-36 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1194: done (7 left) 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1196: done (6 left) 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1202: done (5 left) 2026-02-17T05:33:04.495 INFO:tasks.rados.rados.0.trial118.stdout:1203: snap_remove snap 111 2026-02-17T05:33:05.341 INFO:tasks.rados.rados.0.trial118.stdout:1203: done (5 left) 2026-02-17T05:33:05.341 INFO:tasks.rados.rados.0.trial118.stdout:1204: write (excl) oid 47 current snap is 119 2026-02-17T05:33:05.341 INFO:tasks.rados.rados.0.trial118.stdout:1204: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2026-02-17T05:33:05.345 INFO:tasks.rados.rados.0.trial118.stdout:1204: writing trial11845692-47 from 564834 to 1111052 tid 1 2026-02-17T05:33:05.349 INFO:tasks.rados.rados.0.trial118.stdout:1204: writing trial11845692-47 from 1651975 to 2172454 tid 2 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1204: writing trial11845692-47 from 2720952 to 3280269 tid 3 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1205: copy_from oid 44 from oid 20 current snap is 119 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: finishing write tid 2 to trial11845692-36 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: finishing write tid 3 to trial11845692-36 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: finishing write tid 4 to trial11845692-36 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: finishing write tid 5 to trial11845692-36 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: oid 36 updating version 0 to 541 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: oid 36 version 541 is already newer than 540 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: oid 36 updating version 541 to 542 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: oid 36 version 542 is already newer than 539 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 542 (ObjNum 458 snap 119 seq_num 458) dirty exists 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1197: left oid 36 (ObjNum 458 snap 119 seq_num 458) 2026-02-17T05:33:05.353 INFO:tasks.rados.rados.0.trial118.stdout:1198: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:05.391 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:05.429 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 111377 2026-02-17T05:33:05.466 INFO:tasks.rados.rados.0.trial118.stdout:1199: finishing write tid 1 to trial11845692-30 2026-02-17T05:33:05.466 INFO:tasks.rados.rados.0.trial118.stdout:1197: done (6 left) 2026-02-17T05:33:05.467 INFO:tasks.rados.rados.0.trial118.stdout:1198: done (5 left) 2026-02-17T05:33:05.467 INFO:tasks.rados.rados.0.trial118.stdout:1206: write oid 3 current snap is 119 2026-02-17T05:33:05.467 INFO:tasks.rados.rados.0.trial118.stdout:1206: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2026-02-17T05:33:05.471 INFO:tasks.rados.rados.0.trial118.stdout:1206: writing trial11845692-3 from 581641 to 1203108 tid 1 2026-02-17T05:33:05.477 INFO:tasks.rados.rados.0.trial118.stdout:1206: writing trial11845692-3 from 1994104 to 2774594 tid 2 2026-02-17T05:33:05.481 INFO:tasks.rados.rados.0.trial118.stdout:1206: writing trial11845692-3 from 3432022 to 3781641 tid 3 2026-02-17T05:33:05.481 INFO:tasks.rados.rados.0.trial118.stdout:1207: write oid 36 current snap is 119 2026-02-17T05:33:05.481 INFO:tasks.rados.rados.0.trial118.stdout:1207: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2026-02-17T05:33:05.485 INFO:tasks.rados.rados.0.trial118.stdout:1207: writing trial11845692-36 from 598448 to 1011517 tid 1 2026-02-17T05:33:05.489 INFO:tasks.rados.rados.0.trial118.stdout:1207: writing trial11845692-36 from 1768939 to 2293087 tid 2 2026-02-17T05:33:05.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: writing trial11845692-36 from 2775798 to 3357659 tid 3 2026-02-17T05:33:05.495 INFO:tasks.rados.rados.0.trial118.stdout:1207: writing trial11845692-36 from 3781488 to 3798448 tid 4 2026-02-17T05:33:05.495 INFO:tasks.rados.rados.0.trial118.stdout:1208: read oid 12 snap -1 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1208: expect (ObjNum 450 snap 118 seq_num 450) 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1209: copy_from oid 2 from oid 32 current snap is 119 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: finishing write tid 2 to trial11845692-30 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: finishing write tid 3 to trial11845692-30 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: finishing write tid 4 to trial11845692-30 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: finishing write tid 5 to trial11845692-30 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: oid 30 updating version 0 to 638 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: oid 30 version 638 is already newer than 636 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: oid 30 version 638 is already newer than 637 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: oid 30 version 638 is already newer than 635 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 638 (ObjNum 459 snap 119 seq_num 459) dirty exists 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: left oid 30 (ObjNum 459 snap 119 seq_num 459) 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1200: finishing write tid 1 to trial11845692-15 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1200: finishing write tid 2 to trial11845692-15 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1200: finishing write tid 3 to trial11845692-15 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1200: finishing write tid 4 to trial11845692-15 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1199: done (8 left) 2026-02-17T05:33:05.496 INFO:tasks.rados.rados.0.trial118.stdout:1210: snap_remove snap 118 2026-02-17T05:33:06.344 INFO:tasks.rados.rados.0.trial118.stdout:1210: done (8 left) 2026-02-17T05:33:06.344 INFO:tasks.rados.rados.0.trial118.stdout:1211: delete oid 5 current snap is 119 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: finishing write tid 5 to trial11845692-15 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: oid 15 updating version 0 to 545 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: oid 15 version 545 is already newer than 543 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: oid 15 updating version 545 to 546 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: oid 15 version 546 is already newer than 544 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 546 (ObjNum 460 snap 119 seq_num 460) dirty exists 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1200: left oid 15 (ObjNum 460 snap 119 seq_num 460) 2026-02-17T05:33:06.345 INFO:tasks.rados.rados.0.trial118.stdout:1201: expect (ObjNum 449 snap 118 seq_num 449) 2026-02-17T05:33:06.387 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:06.456 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3377955 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1204: finishing write tid 1 to trial11845692-47 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1204: finishing write tid 2 to trial11845692-47 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1205: finishing copy_from to trial11845692-44 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1205: got expected ENOENT (src dne) 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1200: done (8 left) 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1201: done (7 left) 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1211: done (6 left) 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1212: read oid 41 snap -1 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1212: expect deleted 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1213: write (excl) oid 28 current snap is 119 2026-02-17T05:33:06.463 INFO:tasks.rados.rados.0.trial118.stdout:1213: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2026-02-17T05:33:06.468 INFO:tasks.rados.rados.0.trial118.stdout:1213: writing trial11845692-28 from 632062 to 1195629 tid 1 2026-02-17T05:33:06.472 INFO:tasks.rados.rados.0.trial118.stdout:1213: writing trial11845692-28 from 1885903 to 2413720 tid 2 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1213: writing trial11845692-28 from 2830644 to 3551402 tid 3 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1214: read oid 48 snap -1 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1214: expect (ObjNum 434 snap 115 seq_num 434) 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1215: copy_from oid 27 from oid 8 current snap is 119 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1205: finishing copy_from racing read to trial11845692-44 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1204: finishing write tid 3 to trial11845692-47 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1204: finishing write tid 4 to trial11845692-47 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1204: finishing write tid 5 to trial11845692-47 2026-02-17T05:33:06.477 INFO:tasks.rados.rados.0.trial118.stdout:1204: oid 47 updating version 0 to 623 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1204: oid 47 version 623 is already newer than 622 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1204: oid 47 version 623 is already newer than 621 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1204: oid 47 version 623 is already newer than 620 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 623 (ObjNum 462 snap 119 seq_num 462) dirty exists 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1204: left oid 47 (ObjNum 462 snap 119 seq_num 462) 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1206: finishing write tid 1 to trial11845692-3 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1204: done (9 left) 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1205: done (8 left) 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1216: write (excl) oid 20 current snap is 119 2026-02-17T05:33:06.478 INFO:tasks.rados.rados.0.trial118.stdout:1216: seq_num 467 ranges {648869=638816,1828032=787828,3141714=532030} 2026-02-17T05:33:06.482 INFO:tasks.rados.rados.0.trial118.stdout:1216: writing trial11845692-20 from 648869 to 1287685 tid 1 2026-02-17T05:33:06.487 INFO:tasks.rados.rados.0.trial118.stdout:1216: writing trial11845692-20 from 1828032 to 2615860 tid 2 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1216: writing trial11845692-20 from 3141714 to 3673744 tid 3 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1217: snap_create 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: finishing write tid 2 to trial11845692-3 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: finishing write tid 3 to trial11845692-3 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: finishing write tid 4 to trial11845692-3 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: finishing write tid 5 to trial11845692-3 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: oid 3 updating version 0 to 406 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: oid 3 version 406 is already newer than 405 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: oid 3 version 406 is already newer than 404 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: oid 3 version 406 is already newer than 403 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 406 (ObjNum 463 snap 119 seq_num 463) dirty exists 2026-02-17T05:33:06.492 INFO:tasks.rados.rados.0.trial118.stdout:1206: left oid 3 (ObjNum 463 snap 119 seq_num 463) 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 1 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 2 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1209: finishing copy_from to trial11845692-2 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1209: got expected ENOENT (src dne) 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1209: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 3 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 4 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 5 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: finishing write tid 6 to trial11845692-36 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: oid 36 updating version 0 to 554 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: oid 36 updating version 554 to 557 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: oid 36 version 557 is already newer than 553 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: oid 36 version 557 is already newer than 555 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: oid 36 version 557 is already newer than 556 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 557 (ObjNum 464 snap 119 seq_num 464) dirty exists 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1207: left oid 36 (ObjNum 464 snap 119 seq_num 464) 2026-02-17T05:33:06.493 INFO:tasks.rados.rados.0.trial118.stdout:1208: expect (ObjNum 450 snap 118 seq_num 450) 2026-02-17T05:33:06.627 INFO:tasks.rados.rados.0.trial118.stdout:1213: finishing write tid 1 to trial11845692-28 2026-02-17T05:33:06.627 INFO:tasks.rados.rados.0.trial118.stdout:1213: finishing write tid 2 to trial11845692-28 2026-02-17T05:33:06.627 INFO:tasks.rados.rados.0.trial118.stdout:1215: finishing copy_from to trial11845692-27 2026-02-17T05:33:06.627 INFO:tasks.rados.rados.0.trial118.stdout:1215: got expected ENOENT (src dne) 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1215: finishing copy_from racing read to trial11845692-27 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: finishing write tid 3 to trial11845692-28 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: finishing write tid 4 to trial11845692-28 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: finishing write tid 5 to trial11845692-28 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: oid 28 updating version 0 to 306 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: oid 28 version 306 is already newer than 305 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: oid 28 version 306 is already newer than 304 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: oid 28 version 306 is already newer than 303 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 306 (ObjNum 466 snap 119 seq_num 466) dirty exists 2026-02-17T05:33:06.628 INFO:tasks.rados.rados.0.trial118.stdout:1213: left oid 28 (ObjNum 466 snap 119 seq_num 466) 2026-02-17T05:33:06.629 INFO:tasks.rados.rados.0.trial118.stdout:1214: expect (ObjNum 434 snap 115 seq_num 434) 2026-02-17T05:33:06.629 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:06.655 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1619350 2026-02-17T05:33:06.689 INFO:tasks.rados.rados.0.trial118.stdout:1216: finishing write tid 1 to trial11845692-20 2026-02-17T05:33:06.689 INFO:tasks.rados.rados.0.trial118.stdout:1216: finishing write tid 2 to trial11845692-20 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: finishing write tid 3 to trial11845692-20 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: finishing write tid 4 to trial11845692-20 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: finishing write tid 5 to trial11845692-20 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: oid 20 updating version 0 to 654 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: oid 20 updating version 654 to 655 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: oid 20 updating version 655 to 656 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: oid 20 version 656 is already newer than 653 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 656 (ObjNum 467 snap 119 seq_num 467) dirty exists 2026-02-17T05:33:06.690 INFO:tasks.rados.rados.0.trial118.stdout:1216: left oid 20 (ObjNum 467 snap 119 seq_num 467) 2026-02-17T05:33:07.346 INFO:tasks.rados.rados.0.trial118.stdout:1206: done (9 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1207: done (8 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1208: done (7 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1209: done (6 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1212: done (5 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1213: done (4 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1214: done (3 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1215: done (2 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1216: done (1 left) 2026-02-17T05:33:07.347 INFO:tasks.rados.rados.0.trial118.stdout:1217: done (0 left) 2026-02-17T05:33:07.348 INFO:tasks.rados.rados.0.trial118.stdout:1218: write (excl) oid 18 current snap is 120 2026-02-17T05:33:07.348 INFO:tasks.rados.rados.0.trial118.stdout:1218: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2026-02-17T05:33:07.351 INFO:tasks.rados.rados.0.trial118.stdout:1218: writing trial11845692-18 from 665676 to 1379741 tid 1 2026-02-17T05:33:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1218: writing trial11845692-18 from 1886514 to 2418000 tid 2 2026-02-17T05:33:07.361 INFO:tasks.rados.rados.0.trial118.stdout:1218: writing trial11845692-18 from 3169137 to 3865676 tid 3 2026-02-17T05:33:07.361 INFO:tasks.rados.rados.0.trial118.stdout:1219: delete oid 28 current snap is 120 2026-02-17T05:33:07.361 INFO:tasks.rados.rados.0.trial118.stdout:1218: finishing write tid 1 to trial11845692-18 2026-02-17T05:33:07.362 INFO:tasks.rados.rados.0.trial118.stdout:1218: finishing write tid 2 to trial11845692-18 2026-02-17T05:33:07.364 INFO:tasks.rados.rados.0.trial118.stdout:1218: finishing write tid 3 to trial11845692-18 2026-02-17T05:33:07.364 INFO:tasks.rados.rados.0.trial118.stdout:1218: finishing write tid 4 to trial11845692-18 2026-02-17T05:33:07.364 INFO:tasks.rados.rados.0.trial118.stdout:1218: finishing write tid 5 to trial11845692-18 2026-02-17T05:33:07.364 INFO:tasks.rados.rados.0.trial118.stdout:1218: oid 18 updating version 0 to 309 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1218: oid 18 version 309 is already newer than 308 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1218: oid 18 version 309 is already newer than 307 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1218: oid 18 updating version 309 to 310 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 310 (ObjNum 468 snap 120 seq_num 468) dirty exists 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1218: left oid 18 (ObjNum 468 snap 120 seq_num 468) 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1218: done (1 left) 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1219: done (0 left) 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1220: read oid 32 snap -1 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1220: expect deleted 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1221: read oid 11 snap 119 2026-02-17T05:33:07.365 INFO:tasks.rados.rados.0.trial118.stdout:1221: expect (ObjNum 437 snap 115 seq_num 437) 2026-02-17T05:33:07.366 INFO:tasks.rados.rados.0.trial118.stdout:1222: delete oid 15 current snap is 120 2026-02-17T05:33:07.366 INFO:tasks.rados.rados.0.trial118.stdout:1220: done (2 left) 2026-02-17T05:33:07.366 INFO:tasks.rados.rados.0.trial118.stdout:1222: done (1 left) 2026-02-17T05:33:07.366 INFO:tasks.rados.rados.0.trial118.stdout:1223: snap_create 2026-02-17T05:33:07.368 INFO:tasks.rados.rados.0.trial118.stdout:1221: expect (ObjNum 437 snap 115 seq_num 437) 2026-02-17T05:33:07.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:08.348 INFO:tasks.rados.rados.0.trial118.stdout:1221: done (1 left) 2026-02-17T05:33:08.349 INFO:tasks.rados.rados.0.trial118.stdout:1223: done (0 left) 2026-02-17T05:33:08.349 INFO:tasks.rados.rados.0.trial118.stdout:1224: delete oid 48 current snap is 121 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1224: done (0 left) 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1225: read oid 15 snap -1 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1225: expect deleted 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1226: rollback oid 12 current snap is 121 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 119 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1227: rollback oid 46 current snap is 121 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 119 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1228: write oid 5 current snap is 121 2026-02-17T05:33:08.351 INFO:tasks.rados.rados.0.trial118.stdout:1228: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2026-02-17T05:33:08.356 INFO:tasks.rados.rados.0.trial118.stdout:1228: writing trial11845692-5 from 732904 to 1464318 tid 1 2026-02-17T05:33:08.361 INFO:tasks.rados.rados.0.trial118.stdout:1228: writing trial11845692-5 from 2120442 to 2659266 tid 2 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1228: writing trial11845692-5 from 3278829 to 3783572 tid 3 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1229: read oid 16 snap -1 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1229: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1230: read oid 23 snap -1 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1230: expect (ObjNum 442 snap 115 seq_num 442) 2026-02-17T05:33:08.366 INFO:tasks.rados.rados.0.trial118.stdout:1231: snap_remove snap 120 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:1231: done (6 left) 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:1232: copy_from oid 41 from oid 35 current snap is 121 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:1227: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:1227: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:1227: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:33:09.352 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 397 (ObjNum 453 snap 118 seq_num 453) dirty exists 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1226: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1226: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1226: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 572 (ObjNum 450 snap 118 seq_num 450) dirty exists 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1228: finishing write tid 1 to trial11845692-5 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1228: finishing write tid 2 to trial11845692-5 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1228: finishing write tid 3 to trial11845692-5 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1225: done (6 left) 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1226: done (5 left) 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1227: done (4 left) 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1233: snap_create 2026-02-17T05:33:09.353 INFO:tasks.rados.rados.0.trial118.stdout:1228: finishing write tid 4 to trial11845692-5 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: finishing write tid 5 to trial11845692-5 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: oid 5 updating version 0 to 577 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: oid 5 updating version 577 to 580 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: oid 5 version 580 is already newer than 578 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: oid 5 version 580 is already newer than 579 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 580 (ObjNum 472 snap 121 seq_num 472) dirty exists 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1228: left oid 5 (ObjNum 472 snap 121 seq_num 472) 2026-02-17T05:33:09.354 INFO:tasks.rados.rados.0.trial118.stdout:1229: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:09.462 INFO:tasks.rados.rados.0.trial118.stdout:1230: expect (ObjNum 442 snap 115 seq_num 442) 2026-02-17T05:33:09.588 INFO:tasks.rados.rados.0.trial118.stdout:1232: finishing copy_from racing read to trial11845692-41 2026-02-17T05:33:09.588 INFO:tasks.rados.rados.0.trial118.stdout:1232: finishing copy_from to trial11845692-41 2026-02-17T05:33:09.588 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 127 (ObjNum 319 snap 78 seq_num 319) dirty exists 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1228: done (4 left) 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1229: done (3 left) 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1230: done (2 left) 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1232: done (1 left) 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1233: done (0 left) 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1234: write (excl) oid 26 current snap is 122 2026-02-17T05:33:10.273 INFO:tasks.rados.rados.0.trial118.stdout:1234: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2026-02-17T05:33:10.277 INFO:tasks.rados.rados.0.trial118.stdout:1234: writing trial11845692-26 from 749711 to 1156374 tid 1 2026-02-17T05:33:10.282 INFO:tasks.rados.rados.0.trial118.stdout:1234: writing trial11845692-26 from 1778924 to 2461406 tid 2 2026-02-17T05:33:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1234: writing trial11845692-26 from 3189899 to 3905914 tid 3 2026-02-17T05:33:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1235: snap_create 2026-02-17T05:33:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1234: finishing write tid 1 to trial11845692-26 2026-02-17T05:33:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1234: finishing write tid 2 to trial11845692-26 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: finishing write tid 3 to trial11845692-26 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: finishing write tid 4 to trial11845692-26 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: finishing write tid 5 to trial11845692-26 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: oid 26 updating version 0 to 253 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: oid 26 updating version 253 to 255 2026-02-17T05:33:10.290 INFO:tasks.rados.rados.0.trial118.stdout:1234: oid 26 updating version 255 to 256 2026-02-17T05:33:10.291 INFO:tasks.rados.rados.0.trial118.stdout:1234: oid 26 version 256 is already newer than 254 2026-02-17T05:33:10.291 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 256 (ObjNum 473 snap 122 seq_num 473) dirty exists 2026-02-17T05:33:10.291 INFO:tasks.rados.rados.0.trial118.stdout:1234: left oid 26 (ObjNum 473 snap 122 seq_num 473) 2026-02-17T05:33:11.273 INFO:tasks.rados.rados.0.trial118.stdout:1234: done (1 left) 2026-02-17T05:33:11.273 INFO:tasks.rados.rados.0.trial118.stdout:1235: done (0 left) 2026-02-17T05:33:11.273 INFO:tasks.rados.rados.0.trial118.stdout:1236: snap_create 2026-02-17T05:33:12.274 INFO:tasks.rados.rados.0.trial118.stdout:1236: done (0 left) 2026-02-17T05:33:12.275 INFO:tasks.rados.rados.0.trial118.stdout:1237: read oid 7 snap -1 2026-02-17T05:33:12.275 INFO:tasks.rados.rados.0.trial118.stdout:1237: expect deleted 2026-02-17T05:33:12.275 INFO:tasks.rados.rados.0.trial118.stdout:1238: read oid 23 snap 123 2026-02-17T05:33:12.275 INFO:tasks.rados.rados.0.trial118.stdout:1238: expect (ObjNum 442 snap 115 seq_num 442) 2026-02-17T05:33:12.275 INFO:tasks.rados.rados.0.trial118.stdout:1239: delete oid 22 current snap is 124 2026-02-17T05:33:12.276 INFO:tasks.rados.rados.0.trial118.stdout:1238: expect (ObjNum 442 snap 115 seq_num 442) 2026-02-17T05:33:12.276 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:12.364 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 613178 2026-02-17T05:33:12.406 INFO:tasks.rados.rados.0.trial118.stdout:1237: done (2 left) 2026-02-17T05:33:12.407 INFO:tasks.rados.rados.0.trial118.stdout:1238: done (1 left) 2026-02-17T05:33:12.407 INFO:tasks.rados.rados.0.trial118.stdout:1239: done (0 left) 2026-02-17T05:33:12.407 INFO:tasks.rados.rados.0.trial118.stdout:1240: write oid 15 current snap is 124 2026-02-17T05:33:12.407 INFO:tasks.rados.rados.0.trial118.stdout:1240: seq_num 475 ranges {783325=557161,1779535=686151,3244745=454912} 2026-02-17T05:33:12.413 INFO:tasks.rados.rados.0.trial118.stdout:1240: writing trial11845692-15 from 783325 to 1340486 tid 1 2026-02-17T05:33:12.417 INFO:tasks.rados.rados.0.trial118.stdout:1240: writing trial11845692-15 from 1779535 to 2465686 tid 2 2026-02-17T05:33:12.422 INFO:tasks.rados.rados.0.trial118.stdout:1240: writing trial11845692-15 from 3244745 to 3699657 tid 3 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1241: read oid 18 snap -1 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1241: expect (ObjNum 468 snap 120 seq_num 468) 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1242: copy_from oid 2 from oid 1 current snap is 124 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1240: finishing write tid 1 to trial11845692-15 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1240: finishing write tid 2 to trial11845692-15 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1243: write (excl) oid 40 current snap is 124 2026-02-17T05:33:12.423 INFO:tasks.rados.rados.0.trial118.stdout:1243: seq_num 476 ranges {400132=632410,1438017=546162} 2026-02-17T05:33:12.426 INFO:tasks.rados.rados.0.trial118.stdout:1243: writing trial11845692-40 from 400132 to 1032542 tid 1 2026-02-17T05:33:12.430 INFO:tasks.rados.rados.0.trial118.stdout:1243: writing trial11845692-40 from 1438017 to 1984179 tid 2 2026-02-17T05:33:12.430 INFO:tasks.rados.rados.0.trial118.stdout:1244: read oid 17 snap -1 2026-02-17T05:33:12.430 INFO:tasks.rados.rados.0.trial118.stdout:1244: expect deleted 2026-02-17T05:33:12.430 INFO:tasks.rados.rados.0.trial118.stdout:1245: write oid 5 current snap is 124 2026-02-17T05:33:12.430 INFO:tasks.rados.rados.0.trial118.stdout:1245: seq_num 477 ranges {416939=707659,1896499=120440} 2026-02-17T05:33:12.434 INFO:tasks.rados.rados.0.trial118.stdout:1245: writing trial11845692-5 from 416939 to 1124598 tid 1 2026-02-17T05:33:12.437 INFO:tasks.rados.rados.0.trial118.stdout:1245: writing trial11845692-5 from 1896499 to 2016939 tid 2 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1246: delete oid 3 current snap is 124 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: finishing write tid 3 to trial11845692-15 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: finishing write tid 4 to trial11845692-15 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: finishing write tid 5 to trial11845692-15 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: oid 15 updating version 0 to 570 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: oid 15 updating version 570 to 573 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: oid 15 version 573 is already newer than 571 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: oid 15 version 573 is already newer than 572 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 573 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-17T05:33:12.438 INFO:tasks.rados.rados.0.trial118.stdout:1240: left oid 15 (ObjNum 475 snap 124 seq_num 475) 2026-02-17T05:33:12.439 INFO:tasks.rados.rados.0.trial118.stdout:1241: expect (ObjNum 468 snap 120 seq_num 468) 2026-02-17T05:33:12.472 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2154556 2026-02-17T05:33:12.512 INFO:tasks.rados.rados.0.trial118.stdout:1243: finishing write tid 1 to trial11845692-40 2026-02-17T05:33:12.512 INFO:tasks.rados.rados.0.trial118.stdout:1240: done (6 left) 2026-02-17T05:33:12.512 INFO:tasks.rados.rados.0.trial118.stdout:1241: done (5 left) 2026-02-17T05:33:12.512 INFO:tasks.rados.rados.0.trial118.stdout:1246: done (4 left) 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1247: snap_create 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: finishing write tid 2 to trial11845692-40 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: finishing write tid 3 to trial11845692-40 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: finishing write tid 4 to trial11845692-40 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: oid 40 updating version 0 to 648 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: oid 40 updating version 648 to 649 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: oid 40 updating version 649 to 650 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 650 (ObjNum 476 snap 124 seq_num 476) dirty exists 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1243: left oid 40 (ObjNum 476 snap 124 seq_num 476) 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1242: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:12.513 INFO:tasks.rados.rados.0.trial118.stdout:1242: finishing copy_from to trial11845692-2 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 560 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: finishing write tid 1 to trial11845692-5 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: finishing write tid 2 to trial11845692-5 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: finishing write tid 3 to trial11845692-5 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: finishing write tid 4 to trial11845692-5 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: oid 5 updating version 0 to 582 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: oid 5 version 582 is already newer than 581 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: oid 5 updating version 582 to 583 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 583 (ObjNum 477 snap 124 seq_num 477) dirty exists 2026-02-17T05:33:12.514 INFO:tasks.rados.rados.0.trial118.stdout:1245: left oid 5 (ObjNum 477 snap 124 seq_num 477) 2026-02-17T05:33:13.355 INFO:tasks.rados.rados.0.trial118.stdout:1242: done (4 left) 2026-02-17T05:33:13.355 INFO:tasks.rados.rados.0.trial118.stdout:1243: done (3 left) 2026-02-17T05:33:13.355 INFO:tasks.rados.rados.0.trial118.stdout:1244: done (2 left) 2026-02-17T05:33:13.356 INFO:tasks.rados.rados.0.trial118.stdout:1245: done (1 left) 2026-02-17T05:33:13.356 INFO:tasks.rados.rados.0.trial118.stdout:1247: done (0 left) 2026-02-17T05:33:13.356 INFO:tasks.rados.rados.0.trial118.stdout:1248: write (excl) oid 7 current snap is 125 2026-02-17T05:33:13.356 INFO:tasks.rados.rados.0.trial118.stdout:1248: seq_num 479 ranges {450553=574510,1613463=437090} 2026-02-17T05:33:13.359 INFO:tasks.rados.rados.0.trial118.stdout:1248: writing trial11845692-7 from 450553 to 1025063 tid 1 2026-02-17T05:33:13.363 INFO:tasks.rados.rados.0.trial118.stdout:1248: writing trial11845692-7 from 1613463 to 2050553 tid 2 2026-02-17T05:33:13.364 INFO:tasks.rados.rados.0.trial118.stdout:1249: snap_remove snap 123 2026-02-17T05:33:14.357 INFO:tasks.rados.rados.0.trial118.stdout:1249: done (1 left) 2026-02-17T05:33:14.357 INFO:tasks.rados.rados.0.trial118.stdout:1250: write (excl) oid 6 current snap is 125 2026-02-17T05:33:14.357 INFO:tasks.rados.rados.0.trial118.stdout:1250: seq_num 480 ranges {467360=649759,1671945=395415} 2026-02-17T05:33:14.361 INFO:tasks.rados.rados.0.trial118.stdout:1250: writing trial11845692-6 from 467360 to 1117119 tid 1 2026-02-17T05:33:14.364 INFO:tasks.rados.rados.0.trial118.stdout:1250: writing trial11845692-6 from 1671945 to 2067360 tid 2 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1251: read oid 20 snap -1 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1251: expect (ObjNum 467 snap 119 seq_num 467) 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1252: snap_create 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: finishing write tid 1 to trial11845692-7 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: finishing write tid 2 to trial11845692-7 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: finishing write tid 3 to trial11845692-7 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: finishing write tid 4 to trial11845692-7 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: oid 7 updating version 0 to 598 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: oid 7 version 598 is already newer than 596 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: oid 7 version 598 is already newer than 597 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 598 (ObjNum 479 snap 125 seq_num 479) dirty exists 2026-02-17T05:33:14.365 INFO:tasks.rados.rados.0.trial118.stdout:1248: left oid 7 (ObjNum 479 snap 125 seq_num 479) 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: finishing write tid 1 to trial11845692-6 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: finishing write tid 2 to trial11845692-6 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: finishing write tid 3 to trial11845692-6 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: finishing write tid 4 to trial11845692-6 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: oid 6 updating version 0 to 493 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: oid 6 updating version 493 to 494 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: oid 6 updating version 494 to 495 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 495 (ObjNum 480 snap 125 seq_num 480) dirty exists 2026-02-17T05:33:14.366 INFO:tasks.rados.rados.0.trial118.stdout:1250: left oid 6 (ObjNum 480 snap 125 seq_num 480) 2026-02-17T05:33:14.367 INFO:tasks.rados.rados.0.trial118.stdout:1251: expect (ObjNum 467 snap 119 seq_num 467) 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1248: done (3 left) 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1250: done (2 left) 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1251: done (1 left) 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1252: done (0 left) 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1253: copy_from oid 2 from oid 28 current snap is 126 2026-02-17T05:33:15.358 INFO:tasks.rados.rados.0.trial118.stdout:1254: write oid 44 current snap is 126 2026-02-17T05:33:15.359 INFO:tasks.rados.rados.0.trial118.stdout:1254: seq_num 481 ranges {484167=725008,1730427=353740} 2026-02-17T05:33:15.363 INFO:tasks.rados.rados.0.trial118.stdout:1254: writing trial11845692-44 from 484167 to 1209175 tid 1 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1254: writing trial11845692-44 from 1730427 to 2084167 tid 2 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1255: read oid 43 snap -1 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1255: expect deleted 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1256: rollback oid 17 current snap is 126 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 119 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1253: finishing copy_from to trial11845692-2 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1253: got expected ENOENT (src dne) 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1253: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1254: finishing write tid 1 to trial11845692-44 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1253: done (3 left) 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1257: read oid 15 snap -1 2026-02-17T05:33:15.367 INFO:tasks.rados.rados.0.trial118.stdout:1257: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1258: read oid 5 snap -1 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1258: expect (ObjNum 477 snap 124 seq_num 477) 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1259: read oid 1 snap -1 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1259: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1260: delete oid 41 current snap is 126 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:1256: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:33:15.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 0 (ObjNum 33 snap 0 seq_num 3) dirty dne 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: finishing write tid 2 to trial11845692-44 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: finishing write tid 3 to trial11845692-44 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1255: done (6 left) 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1256: done (5 left) 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1260: done (4 left) 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1261: delete oid 2 current snap is 126 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: finishing write tid 4 to trial11845692-44 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: oid 44 updating version 0 to 167 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: oid 44 updating version 167 to 168 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: oid 44 updating version 168 to 169 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 169 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1254: left oid 44 (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:33:15.369 INFO:tasks.rados.rados.0.trial118.stdout:1259: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:15.483 INFO:tasks.rados.rados.0.trial118.stdout:1258: expect (ObjNum 477 snap 124 seq_num 477) 2026-02-17T05:33:15.483 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:15.502 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:15.521 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:15.540 INFO:tasks.rados.rados.0.trial118.stdout:1257: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-17T05:33:15.569 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:15.601 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1665111 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1254: done (4 left) 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1257: done (3 left) 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1258: done (2 left) 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1259: done (1 left) 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1261: done (0 left) 2026-02-17T05:33:15.621 INFO:tasks.rados.rados.0.trial118.stdout:1262: rollback oid 43 current snap is 126 2026-02-17T05:33:15.622 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 124 2026-02-17T05:33:15.622 INFO:tasks.rados.rados.0.trial118.stdout:1263: snap_create 2026-02-17T05:33:15.622 INFO:tasks.rados.rados.0.trial118.stdout:1262: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:33:15.622 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 0 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-17T05:33:16.361 INFO:tasks.rados.rados.0.trial118.stdout:1262: done (1 left) 2026-02-17T05:33:16.361 INFO:tasks.rados.rados.0.trial118.stdout:1263: done (0 left) 2026-02-17T05:33:16.361 INFO:tasks.rados.rados.0.trial118.stdout:1264: copy_from oid 2 from oid 1 current snap is 127 2026-02-17T05:33:16.361 INFO:tasks.rados.rados.0.trial118.stdout:1265: snap_create 2026-02-17T05:33:16.368 INFO:tasks.rados.rados.0.trial118.stdout:1264: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:16.369 INFO:tasks.rados.rados.0.trial118.stdout:1264: finishing copy_from to trial11845692-2 2026-02-17T05:33:16.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 560 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1264: done (1 left) 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1265: done (0 left) 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1266: read oid 18 snap -1 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1266: expect (ObjNum 468 snap 120 seq_num 468) 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1267: write (excl) oid 47 current snap is 128 2026-02-17T05:33:17.362 INFO:tasks.rados.rados.0.trial118.stdout:1267: seq_num 484 ranges {534588=550755,1789520=345068} 2026-02-17T05:33:17.366 INFO:tasks.rados.rados.0.trial118.stdout:1267: writing trial11845692-47 from 534588 to 1085343 tid 1 2026-02-17T05:33:17.370 INFO:tasks.rados.rados.0.trial118.stdout:1267: writing trial11845692-47 from 1789520 to 2134588 tid 2 2026-02-17T05:33:17.371 INFO:tasks.rados.rados.0.trial118.stdout:1268: copy_from oid 38 from oid 8 current snap is 128 2026-02-17T05:33:17.371 INFO:tasks.rados.rados.0.trial118.stdout:1266: expect (ObjNum 468 snap 120 seq_num 468) 2026-02-17T05:33:17.415 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: finishing write tid 1 to trial11845692-47 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1266: done (2 left) 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1269: snap_create 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: finishing write tid 2 to trial11845692-47 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: finishing write tid 3 to trial11845692-47 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: finishing write tid 4 to trial11845692-47 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: oid 47 updating version 0 to 629 2026-02-17T05:33:17.443 INFO:tasks.rados.rados.0.trial118.stdout:1267: oid 47 version 629 is already newer than 627 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:1267: oid 47 version 629 is already newer than 628 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 629 (ObjNum 484 snap 128 seq_num 484) dirty exists 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:1267: left oid 47 (ObjNum 484 snap 128 seq_num 484) 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:1268: finishing copy_from to trial11845692-38 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:1268: got expected ENOENT (src dne) 2026-02-17T05:33:17.444 INFO:tasks.rados.rados.0.trial118.stdout:1268: finishing copy_from racing read to trial11845692-38 2026-02-17T05:33:18.366 INFO:tasks.rados.rados.0.trial118.stdout:1267: done (2 left) 2026-02-17T05:33:18.366 INFO:tasks.rados.rados.0.trial118.stdout:1268: done (1 left) 2026-02-17T05:33:18.366 INFO:tasks.rados.rados.0.trial118.stdout:1269: done (0 left) 2026-02-17T05:33:18.367 INFO:tasks.rados.rados.0.trial118.stdout:1270: read oid 32 snap -1 2026-02-17T05:33:18.367 INFO:tasks.rados.rados.0.trial118.stdout:1270: expect deleted 2026-02-17T05:33:18.367 INFO:tasks.rados.rados.0.trial118.stdout:1271: read oid 1 snap -1 2026-02-17T05:33:18.367 INFO:tasks.rados.rados.0.trial118.stdout:1271: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:18.367 INFO:tasks.rados.rados.0.trial118.stdout:1272: snap_remove snap 119 2026-02-17T05:33:19.367 INFO:tasks.rados.rados.0.trial118.stdout:1272: done (2 left) 2026-02-17T05:33:19.368 INFO:tasks.rados.rados.0.trial118.stdout:1273: snap_remove snap 121 2026-02-17T05:33:20.273 INFO:tasks.rados.rados.0.trial118.stdout:1273: done (2 left) 2026-02-17T05:33:20.273 INFO:tasks.rados.rados.0.trial118.stdout:1274: read oid 16 snap -1 2026-02-17T05:33:20.273 INFO:tasks.rados.rados.0.trial118.stdout:1274: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:20.273 INFO:tasks.rados.rados.0.trial118.stdout:1275: snap_remove snap 124 2026-02-17T05:33:21.274 INFO:tasks.rados.rados.0.trial118.stdout:1275: done (3 left) 2026-02-17T05:33:21.274 INFO:tasks.rados.rados.0.trial118.stdout:1276: delete oid 38 current snap is 129 2026-02-17T05:33:21.274 INFO:tasks.rados.rados.0.trial118.stdout:1271: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:21.275 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:21.385 INFO:tasks.rados.rados.0.trial118.stdout:1274: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:21.413 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3094151 2026-02-17T05:33:21.414 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:21.479 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2713288 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1270: done (3 left) 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1271: done (2 left) 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1274: done (1 left) 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1276: done (0 left) 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1277: copy_from oid 38 from oid 35 current snap is 129 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1278: rollback oid 43 current snap is 129 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 127 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1279: rollback oid 31 current snap is 129 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 128 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1280: read oid 28 snap 126 2026-02-17T05:33:21.483 INFO:tasks.rados.rados.0.trial118.stdout:1280: expect deleted 2026-02-17T05:33:21.484 INFO:tasks.rados.rados.0.trial118.stdout:1281: write (excl) oid 17 current snap is 129 2026-02-17T05:33:21.484 INFO:tasks.rados.rados.0.trial118.stdout:1281: seq_num 486 ranges {568202=701253,1906484=261718} 2026-02-17T05:33:21.488 INFO:tasks.rados.rados.0.trial118.stdout:1281: writing trial11845692-17 from 568202 to 1269455 tid 1 2026-02-17T05:33:21.491 INFO:tasks.rados.rados.0.trial118.stdout:1281: writing trial11845692-17 from 1906484 to 2168202 tid 2 2026-02-17T05:33:21.491 INFO:tasks.rados.rados.0.trial118.stdout:1282: snap_create 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1278: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 0 (ObjNum 305 snap 0 seq_num 1) dirty dne 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1279: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1279: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1279: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 664 (ObjNum 409 snap 106 seq_num 409) dirty exists 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1277: finishing copy_from racing read to trial11845692-38 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1281: finishing write tid 1 to trial11845692-17 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:1277: finishing copy_from to trial11845692-38 2026-02-17T05:33:21.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 127 (ObjNum 319 snap 78 seq_num 319) dirty exists 2026-02-17T05:33:21.493 INFO:tasks.rados.rados.0.trial118.stdout:1281: finishing write tid 2 to trial11845692-17 2026-02-17T05:33:21.493 INFO:tasks.rados.rados.0.trial118.stdout:1281: finishing write tid 3 to trial11845692-17 2026-02-17T05:33:21.493 INFO:tasks.rados.rados.0.trial118.stdout:1281: finishing write tid 4 to trial11845692-17 2026-02-17T05:33:21.493 INFO:tasks.rados.rados.0.trial118.stdout:1281: oid 17 updating version 0 to 400 2026-02-17T05:33:21.494 INFO:tasks.rados.rados.0.trial118.stdout:1281: oid 17 version 400 is already newer than 398 2026-02-17T05:33:21.494 INFO:tasks.rados.rados.0.trial118.stdout:1281: oid 17 version 400 is already newer than 399 2026-02-17T05:33:21.494 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 400 (ObjNum 486 snap 129 seq_num 486) dirty exists 2026-02-17T05:33:21.494 INFO:tasks.rados.rados.0.trial118.stdout:1281: left oid 17 (ObjNum 486 snap 129 seq_num 486) 2026-02-17T05:33:22.372 INFO:tasks.rados.rados.0.trial118.stdout:1277: done (5 left) 2026-02-17T05:33:22.372 INFO:tasks.rados.rados.0.trial118.stdout:1278: done (4 left) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1279: done (3 left) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1280: done (2 left) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1281: done (1 left) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1282: done (0 left) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1283: read oid 5 snap 128 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1283: expect (ObjNum 477 snap 124 seq_num 477) 2026-02-17T05:33:22.373 INFO:tasks.rados.rados.0.trial118.stdout:1284: snap_create 2026-02-17T05:33:22.375 INFO:tasks.rados.rados.0.trial118.stdout:1283: expect (ObjNum 477 snap 124 seq_num 477) 2026-02-17T05:33:22.394 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:23.374 INFO:tasks.rados.rados.0.trial118.stdout:1283: done (1 left) 2026-02-17T05:33:23.374 INFO:tasks.rados.rados.0.trial118.stdout:1284: done (0 left) 2026-02-17T05:33:23.374 INFO:tasks.rados.rados.0.trial118.stdout:1285: copy_from oid 23 from oid 30 current snap is 131 2026-02-17T05:33:23.375 INFO:tasks.rados.rados.0.trial118.stdout:1286: snap_create 2026-02-17T05:33:23.388 INFO:tasks.rados.rados.0.trial118.stdout:1285: finishing copy_from racing read to trial11845692-23 2026-02-17T05:33:23.389 INFO:tasks.rados.rados.0.trial118.stdout:1285: finishing copy_from to trial11845692-23 2026-02-17T05:33:23.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 638 (ObjNum 459 snap 119 seq_num 459) dirty exists 2026-02-17T05:33:24.377 INFO:tasks.rados.rados.0.trial118.stdout:1285: done (1 left) 2026-02-17T05:33:24.377 INFO:tasks.rados.rados.0.trial118.stdout:1286: done (0 left) 2026-02-17T05:33:24.377 INFO:tasks.rados.rados.0.trial118.stdout:1287: write (excl) oid 46 current snap is 132 2026-02-17T05:33:24.377 INFO:tasks.rados.rados.0.trial118.stdout:1287: seq_num 487 ranges {585009=492855,1564966=620043} 2026-02-17T05:33:24.382 INFO:tasks.rados.rados.0.trial118.stdout:1287: writing trial11845692-46 from 585009 to 1077864 tid 1 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1287: writing trial11845692-46 from 1564966 to 2185009 tid 2 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1288: rollback oid 18 current snap is 132 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 129 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1287: finishing write tid 1 to trial11845692-46 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1289: read oid 29 snap 131 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1289: expect (ObjNum 433 snap 115 seq_num 433) 2026-02-17T05:33:24.386 INFO:tasks.rados.rados.0.trial118.stdout:1290: snap_create 2026-02-17T05:33:24.388 INFO:tasks.rados.rados.0.trial118.stdout:1287: finishing write tid 2 to trial11845692-46 2026-02-17T05:33:24.388 INFO:tasks.rados.rados.0.trial118.stdout:1287: finishing write tid 3 to trial11845692-46 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1287: finishing write tid 4 to trial11845692-46 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1287: oid 46 updating version 0 to 402 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1287: oid 46 version 402 is already newer than 401 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1287: oid 46 updating version 402 to 403 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 403 (ObjNum 487 snap 132 seq_num 487) dirty exists 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1287: left oid 46 (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1288: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1288: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:1288: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:33:24.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 314 (ObjNum 468 snap 120 seq_num 468) dirty exists 2026-02-17T05:33:24.390 INFO:tasks.rados.rados.0.trial118.stdout:1289: expect (ObjNum 433 snap 115 seq_num 433) 2026-02-17T05:33:24.442 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:24.497 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:25.380 INFO:tasks.rados.rados.0.trial118.stdout:1287: done (3 left) 2026-02-17T05:33:25.380 INFO:tasks.rados.rados.0.trial118.stdout:1288: done (2 left) 2026-02-17T05:33:25.380 INFO:tasks.rados.rados.0.trial118.stdout:1289: done (1 left) 2026-02-17T05:33:25.381 INFO:tasks.rados.rados.0.trial118.stdout:1290: done (0 left) 2026-02-17T05:33:25.381 INFO:tasks.rados.rados.0.trial118.stdout:1291: write oid 18 current snap is 133 2026-02-17T05:33:25.381 INFO:tasks.rados.rados.0.trial118.stdout:1291: seq_num 488 ranges {601816=568104,1623448=451823} 2026-02-17T05:33:25.385 INFO:tasks.rados.rados.0.trial118.stdout:1291: writing trial11845692-18 from 601816 to 1169920 tid 1 2026-02-17T05:33:25.389 INFO:tasks.rados.rados.0.trial118.stdout:1291: writing trial11845692-18 from 1623448 to 2075271 tid 2 2026-02-17T05:33:25.389 INFO:tasks.rados.rados.0.trial118.stdout:1292: rollback oid 9 current snap is 133 2026-02-17T05:33:25.389 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 131 2026-02-17T05:33:25.389 INFO:tasks.rados.rados.0.trial118.stdout:1291: finishing write tid 1 to trial11845692-18 2026-02-17T05:33:25.389 INFO:tasks.rados.rados.0.trial118.stdout:1293: delete oid 10 current snap is 133 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: finishing write tid 2 to trial11845692-18 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: finishing write tid 3 to trial11845692-18 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: finishing write tid 4 to trial11845692-18 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: oid 18 updating version 0 to 316 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: oid 18 updating version 316 to 317 2026-02-17T05:33:25.391 INFO:tasks.rados.rados.0.trial118.stdout:1291: oid 18 version 317 is already newer than 315 2026-02-17T05:33:25.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 317 (ObjNum 488 snap 133 seq_num 488) dirty exists 2026-02-17T05:33:25.392 INFO:tasks.rados.rados.0.trial118.stdout:1291: left oid 18 (ObjNum 488 snap 133 seq_num 488) 2026-02-17T05:33:25.392 INFO:tasks.rados.rados.0.trial118.stdout:1291: done (2 left) 2026-02-17T05:33:25.392 INFO:tasks.rados.rados.0.trial118.stdout:1293: done (1 left) 2026-02-17T05:33:25.392 INFO:tasks.rados.rados.0.trial118.stdout:1294: delete oid 40 current snap is 133 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1292: finishing rollback tid 0 to trial11845692-9 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1292: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1292: finishing rollback tid 2 to trial11845692-9 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 608 (ObjNum 416 snap 109 seq_num 416) dirty exists 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1292: done (1 left) 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1294: done (0 left) 2026-02-17T05:33:25.393 INFO:tasks.rados.rados.0.trial118.stdout:1295: rollback oid 40 current snap is 133 2026-02-17T05:33:25.394 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 131 2026-02-17T05:33:25.394 INFO:tasks.rados.rados.0.trial118.stdout:1296: snap_create 2026-02-17T05:33:25.394 INFO:tasks.rados.rados.0.trial118.stdout:1295: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:33:25.394 INFO:tasks.rados.rados.0.trial118.stdout:1295: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:33:25.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 660 (ObjNum 476 snap 124 seq_num 476) dirty exists 2026-02-17T05:33:26.382 INFO:tasks.rados.rados.0.trial118.stdout:1295: done (1 left) 2026-02-17T05:33:26.382 INFO:tasks.rados.rados.0.trial118.stdout:1296: done (0 left) 2026-02-17T05:33:26.382 INFO:tasks.rados.rados.0.trial118.stdout:1297: write oid 11 current snap is 134 2026-02-17T05:33:26.382 INFO:tasks.rados.rados.0.trial118.stdout:1297: seq_num 491 ranges {652237=793851,2198894=53343} 2026-02-17T05:33:26.388 INFO:tasks.rados.rados.0.trial118.stdout:1297: writing trial11845692-11 from 652237 to 1446088 tid 1 2026-02-17T05:33:26.392 INFO:tasks.rados.rados.0.trial118.stdout:1297: writing trial11845692-11 from 2198894 to 2252237 tid 2 2026-02-17T05:33:26.392 INFO:tasks.rados.rados.0.trial118.stdout:1298: delete oid 34 current snap is 134 2026-02-17T05:33:26.392 INFO:tasks.rados.rados.0.trial118.stdout:1297: finishing write tid 1 to trial11845692-11 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: finishing write tid 2 to trial11845692-11 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: finishing write tid 3 to trial11845692-11 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: finishing write tid 4 to trial11845692-11 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: oid 11 updating version 0 to 670 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: oid 11 version 670 is already newer than 669 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: oid 11 version 670 is already newer than 668 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 670 (ObjNum 491 snap 134 seq_num 491) dirty exists 2026-02-17T05:33:26.393 INFO:tasks.rados.rados.0.trial118.stdout:1297: left oid 11 (ObjNum 491 snap 134 seq_num 491) 2026-02-17T05:33:26.395 INFO:tasks.rados.rados.0.trial118.stdout:1297: done (1 left) 2026-02-17T05:33:26.395 INFO:tasks.rados.rados.0.trial118.stdout:1298: done (0 left) 2026-02-17T05:33:26.395 INFO:tasks.rados.rados.0.trial118.stdout:1299: write (excl) oid 35 current snap is 134 2026-02-17T05:33:26.395 INFO:tasks.rados.rados.0.trial118.stdout:1299: seq_num 493 ranges {685851=544349,1799505=486346} 2026-02-17T05:33:26.400 INFO:tasks.rados.rados.0.trial118.stdout:1299: writing trial11845692-35 from 685851 to 1230200 tid 1 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1299: writing trial11845692-35 from 1799505 to 2285851 tid 2 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1300: read oid 9 snap -1 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1300: expect (ObjNum 416 snap 109 seq_num 416) 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1301: read oid 43 snap -1 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1301: expect deleted 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1302: rollback oid 3 current snap is 134 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 127 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1299: finishing write tid 1 to trial11845692-35 2026-02-17T05:33:26.405 INFO:tasks.rados.rados.0.trial118.stdout:1303: read oid 48 snap 130 2026-02-17T05:33:26.406 INFO:tasks.rados.rados.0.trial118.stdout:1303: expect deleted 2026-02-17T05:33:26.406 INFO:tasks.rados.rados.0.trial118.stdout:1304: write oid 50 current snap is 134 2026-02-17T05:33:26.406 INFO:tasks.rados.rados.0.trial118.stdout:1304: seq_num 494 ranges {702658=619598,1857987=444671} 2026-02-17T05:33:26.410 INFO:tasks.rados.rados.0.trial118.stdout:1304: writing trial11845692-50 from 702658 to 1322256 tid 1 2026-02-17T05:33:26.414 INFO:tasks.rados.rados.0.trial118.stdout:1304: writing trial11845692-50 from 1857987 to 2302658 tid 2 2026-02-17T05:33:26.414 INFO:tasks.rados.rados.0.trial118.stdout:1305: write (excl) oid 27 current snap is 134 2026-02-17T05:33:26.414 INFO:tasks.rados.rados.0.trial118.stdout:1305: seq_num 495 ranges {719465=411200,1632822=686643} 2026-02-17T05:33:26.418 INFO:tasks.rados.rados.0.trial118.stdout:1305: writing trial11845692-27 from 719465 to 1130665 tid 1 2026-02-17T05:33:26.424 INFO:tasks.rados.rados.0.trial118.stdout:1305: writing trial11845692-27 from 1632822 to 2319465 tid 2 2026-02-17T05:33:26.424 INFO:tasks.rados.rados.0.trial118.stdout:1306: copy_from oid 2 from oid 23 current snap is 134 2026-02-17T05:33:26.424 INFO:tasks.rados.rados.0.trial118.stdout:1302: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 407 (ObjNum 33 snap 0 seq_num 13173968) dirty dne 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: finishing write tid 2 to trial11845692-35 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1301: done (7 left) 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1302: done (6 left) 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1303: done (5 left) 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1307: rollback oid 20 current snap is 134 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 131 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: finishing write tid 3 to trial11845692-35 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: finishing write tid 4 to trial11845692-35 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: oid 35 updating version 0 to 177 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: oid 35 updating version 177 to 178 2026-02-17T05:33:26.425 INFO:tasks.rados.rados.0.trial118.stdout:1299: oid 35 updating version 178 to 179 2026-02-17T05:33:26.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 179 (ObjNum 493 snap 134 seq_num 493) dirty exists 2026-02-17T05:33:26.426 INFO:tasks.rados.rados.0.trial118.stdout:1299: left oid 35 (ObjNum 493 snap 134 seq_num 493) 2026-02-17T05:33:26.426 INFO:tasks.rados.rados.0.trial118.stdout:1300: expect (ObjNum 416 snap 109 seq_num 416) 2026-02-17T05:33:26.473 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 758855 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1304: finishing write tid 1 to trial11845692-50 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1304: finishing write tid 2 to trial11845692-50 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1299: done (5 left) 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1300: done (4 left) 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1308: write (excl) oid 22 current snap is 134 2026-02-17T05:33:26.544 INFO:tasks.rados.rados.0.trial118.stdout:1308: seq_num 496 ranges {736272=486449,1974951=361321} 2026-02-17T05:33:26.548 INFO:tasks.rados.rados.0.trial118.stdout:1308: writing trial11845692-22 from 736272 to 1222721 tid 1 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1308: writing trial11845692-22 from 1974951 to 2336272 tid 2 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1309: delete oid 5 current snap is 134 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: finishing write tid 3 to trial11845692-50 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: finishing write tid 4 to trial11845692-50 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: oid 50 updating version 0 to 574 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: oid 50 updating version 574 to 575 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: oid 50 version 575 is already newer than 573 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 575 (ObjNum 494 snap 134 seq_num 494) dirty exists 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1304: left oid 50 (ObjNum 494 snap 134 seq_num 494) 2026-02-17T05:33:26.553 INFO:tasks.rados.rados.0.trial118.stdout:1305: finishing write tid 1 to trial11845692-27 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: finishing write tid 2 to trial11845692-27 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: finishing write tid 3 to trial11845692-27 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: finishing write tid 4 to trial11845692-27 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: oid 27 updating version 0 to 673 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: oid 27 updating version 673 to 674 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: oid 27 version 674 is already newer than 672 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 674 (ObjNum 495 snap 134 seq_num 495) dirty exists 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1305: left oid 27 (ObjNum 495 snap 134 seq_num 495) 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1307: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1307: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:1307: finishing rollback tid 2 to trial11845692-20 2026-02-17T05:33:26.554 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 678 (ObjNum 467 snap 119 seq_num 467) dirty exists 2026-02-17T05:33:26.555 INFO:tasks.rados.rados.0.trial118.stdout:1306: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:26.555 INFO:tasks.rados.rados.0.trial118.stdout:1306: finishing copy_from to trial11845692-2 2026-02-17T05:33:26.555 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 638 (ObjNum 459 snap 119 seq_num 459) dirty exists 2026-02-17T05:33:26.555 INFO:tasks.rados.rados.0.trial118.stdout:1308: finishing write tid 1 to trial11845692-22 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: finishing write tid 2 to trial11845692-22 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: finishing write tid 3 to trial11845692-22 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: finishing write tid 4 to trial11845692-22 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: oid 22 updating version 0 to 585 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: oid 22 version 585 is already newer than 584 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: oid 22 updating version 585 to 586 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 586 (ObjNum 496 snap 134 seq_num 496) dirty exists 2026-02-17T05:33:26.556 INFO:tasks.rados.rados.0.trial118.stdout:1308: left oid 22 (ObjNum 496 snap 134 seq_num 496) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1304: done (5 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1305: done (4 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1306: done (3 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1307: done (2 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1308: done (1 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1309: done (0 left) 2026-02-17T05:33:26.557 INFO:tasks.rados.rados.0.trial118.stdout:1310: snap_remove snap 132 2026-02-17T05:33:27.383 INFO:tasks.rados.rados.0.trial118.stdout:1310: done (0 left) 2026-02-17T05:33:27.383 INFO:tasks.rados.rados.0.trial118.stdout:1311: write (excl) oid 42 current snap is 134 2026-02-17T05:33:27.383 INFO:tasks.rados.rados.0.trial118.stdout:1311: seq_num 498 ranges {769886=636947,2091915=277971} 2026-02-17T05:33:27.389 INFO:tasks.rados.rados.0.trial118.stdout:1311: writing trial11845692-42 from 769886 to 1406833 tid 1 2026-02-17T05:33:27.393 INFO:tasks.rados.rados.0.trial118.stdout:1311: writing trial11845692-42 from 2091915 to 2369886 tid 2 2026-02-17T05:33:27.393 INFO:tasks.rados.rados.0.trial118.stdout:1312: snap_create 2026-02-17T05:33:27.393 INFO:tasks.rados.rados.0.trial118.stdout:1311: finishing write tid 1 to trial11845692-42 2026-02-17T05:33:27.394 INFO:tasks.rados.rados.0.trial118.stdout:1311: finishing write tid 2 to trial11845692-42 2026-02-17T05:33:27.394 INFO:tasks.rados.rados.0.trial118.stdout:1311: finishing write tid 3 to trial11845692-42 2026-02-17T05:33:27.394 INFO:tasks.rados.rados.0.trial118.stdout:1311: finishing write tid 4 to trial11845692-42 2026-02-17T05:33:27.395 INFO:tasks.rados.rados.0.trial118.stdout:1311: oid 42 updating version 0 to 642 2026-02-17T05:33:27.395 INFO:tasks.rados.rados.0.trial118.stdout:1311: oid 42 version 642 is already newer than 641 2026-02-17T05:33:27.395 INFO:tasks.rados.rados.0.trial118.stdout:1311: oid 42 version 642 is already newer than 640 2026-02-17T05:33:27.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 642 (ObjNum 498 snap 134 seq_num 498) dirty exists 2026-02-17T05:33:27.395 INFO:tasks.rados.rados.0.trial118.stdout:1311: left oid 42 (ObjNum 498 snap 134 seq_num 498) 2026-02-17T05:33:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1311: done (1 left) 2026-02-17T05:33:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1312: done (0 left) 2026-02-17T05:33:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1313: write oid 50 current snap is 135 2026-02-17T05:33:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1313: seq_num 499 ranges {786693=712196,2150397=236296} 2026-02-17T05:33:28.394 INFO:tasks.rados.rados.0.trial118.stdout:1313: writing trial11845692-50 from 786693 to 1498889 tid 1 2026-02-17T05:33:28.397 INFO:tasks.rados.rados.0.trial118.stdout:1313: writing trial11845692-50 from 2150397 to 2386693 tid 2 2026-02-17T05:33:28.397 INFO:tasks.rados.rados.0.trial118.stdout:1314: snap_remove snap 122 2026-02-17T05:33:29.389 INFO:tasks.rados.rados.0.trial118.stdout:1314: done (1 left) 2026-02-17T05:33:29.389 INFO:tasks.rados.rados.0.trial118.stdout:1315: write oid 40 current snap is 135 2026-02-17T05:33:29.389 INFO:tasks.rados.rados.0.trial118.stdout:1315: seq_num 500 ranges {403500=787445,1692526=473837} 2026-02-17T05:33:29.393 INFO:tasks.rados.rados.0.trial118.stdout:1315: writing trial11845692-40 from 403500 to 1190945 tid 1 2026-02-17T05:33:29.398 INFO:tasks.rados.rados.0.trial118.stdout:1315: writing trial11845692-40 from 1692526 to 2166363 tid 2 2026-02-17T05:33:29.398 INFO:tasks.rados.rados.0.trial118.stdout:1316: delete oid 42 current snap is 135 2026-02-17T05:33:29.398 INFO:tasks.rados.rados.0.trial118.stdout:1313: finishing write tid 1 to trial11845692-50 2026-02-17T05:33:29.398 INFO:tasks.rados.rados.0.trial118.stdout:1313: finishing write tid 2 to trial11845692-50 2026-02-17T05:33:29.398 INFO:tasks.rados.rados.0.trial118.stdout:1313: finishing write tid 3 to trial11845692-50 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1313: finishing write tid 4 to trial11845692-50 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1313: oid 50 updating version 0 to 578 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1313: oid 50 version 578 is already newer than 577 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1313: oid 50 version 578 is already newer than 576 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 578 (ObjNum 499 snap 135 seq_num 499) dirty exists 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1313: left oid 50 (ObjNum 499 snap 135 seq_num 499) 2026-02-17T05:33:29.399 INFO:tasks.rados.rados.0.trial118.stdout:1315: finishing write tid 1 to trial11845692-40 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1315: finishing write tid 2 to trial11845692-40 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1315: finishing write tid 3 to trial11845692-40 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1313: done (2 left) 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1316: done (1 left) 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1317: read oid 16 snap -1 2026-02-17T05:33:29.402 INFO:tasks.rados.rados.0.trial118.stdout:1317: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:29.403 INFO:tasks.rados.rados.0.trial118.stdout:1318: rollback oid 8 current snap is 135 2026-02-17T05:33:29.403 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 125 2026-02-17T05:33:29.403 INFO:tasks.rados.rados.0.trial118.stdout:1319: write oid 6 current snap is 135 2026-02-17T05:33:29.403 INFO:tasks.rados.rados.0.trial118.stdout:1319: seq_num 502 ranges {437114=654296,1525843=477506} 2026-02-17T05:33:29.404 INFO:tasks.rados.rados.0.trial118.stdout:1319: writing trial11845692-6 from 437114 to 1091410 tid 1 2026-02-17T05:33:29.408 INFO:tasks.rados.rados.0.trial118.stdout:1319: writing trial11845692-6 from 1525843 to 2003349 tid 2 2026-02-17T05:33:29.408 INFO:tasks.rados.rados.0.trial118.stdout:1320: read oid 46 snap -1 2026-02-17T05:33:29.408 INFO:tasks.rados.rados.0.trial118.stdout:1320: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1321: read oid 19 snap -1 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1321: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1322: snap_create 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1315: finishing write tid 4 to trial11845692-40 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1315: oid 40 updating version 0 to 667 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1315: oid 40 version 667 is already newer than 666 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1315: oid 40 updating version 667 to 668 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 668 (ObjNum 500 snap 135 seq_num 500) dirty exists 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1315: left oid 40 (ObjNum 500 snap 135 seq_num 500) 2026-02-17T05:33:29.409 INFO:tasks.rados.rados.0.trial118.stdout:1318: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:33:29.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:33:29.410 INFO:tasks.rados.rados.0.trial118.stdout:1317: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:33:29.452 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1184106 2026-02-17T05:33:29.519 INFO:tasks.rados.rados.0.trial118.stdout:1319: finishing write tid 1 to trial11845692-6 2026-02-17T05:33:29.519 INFO:tasks.rados.rados.0.trial118.stdout:1319: finishing write tid 2 to trial11845692-6 2026-02-17T05:33:29.519 INFO:tasks.rados.rados.0.trial118.stdout:1319: finishing write tid 3 to trial11845692-6 2026-02-17T05:33:29.519 INFO:tasks.rados.rados.0.trial118.stdout:1319: finishing write tid 4 to trial11845692-6 2026-02-17T05:33:29.519 INFO:tasks.rados.rados.0.trial118.stdout:1319: oid 6 updating version 0 to 640 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:1319: oid 6 updating version 640 to 641 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:1319: oid 6 version 641 is already newer than 639 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 641 (ObjNum 502 snap 135 seq_num 502) dirty exists 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:1319: left oid 6 (ObjNum 502 snap 135 seq_num 502) 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:1321: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:29.520 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 513949 2026-02-17T05:33:29.570 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1640794 2026-02-17T05:33:29.625 INFO:tasks.rados.rados.0.trial118.stdout:1320: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:33:29.625 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:29.650 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1315: done (6 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1317: done (5 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1318: done (4 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1319: done (3 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1320: done (2 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1321: done (1 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1322: done (0 left) 2026-02-17T05:33:30.276 INFO:tasks.rados.rados.0.trial118.stdout:1323: snap_remove snap 133 2026-02-17T05:33:31.276 INFO:tasks.rados.rados.0.trial118.stdout:1323: done (0 left) 2026-02-17T05:33:31.276 INFO:tasks.rados.rados.0.trial118.stdout:1324: write oid 46 current snap is 136 2026-02-17T05:33:31.276 INFO:tasks.rados.rados.0.trial118.stdout:1324: seq_num 503 ranges {453921=729545,1584325=621164} 2026-02-17T05:33:31.281 INFO:tasks.rados.rados.0.trial118.stdout:1324: writing trial11845692-46 from 453921 to 1183466 tid 1 2026-02-17T05:33:31.285 INFO:tasks.rados.rados.0.trial118.stdout:1324: writing trial11845692-46 from 1584325 to 2205489 tid 2 2026-02-17T05:33:31.285 INFO:tasks.rados.rados.0.trial118.stdout:1325: copy_from oid 43 from oid 21 current snap is 136 2026-02-17T05:33:31.285 INFO:tasks.rados.rados.0.trial118.stdout:1324: finishing write tid 1 to trial11845692-46 2026-02-17T05:33:31.285 INFO:tasks.rados.rados.0.trial118.stdout:1326: snap_create 2026-02-17T05:33:31.286 INFO:tasks.rados.rados.0.trial118.stdout:1324: finishing write tid 2 to trial11845692-46 2026-02-17T05:33:31.286 INFO:tasks.rados.rados.0.trial118.stdout:1324: finishing write tid 3 to trial11845692-46 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:1324: finishing write tid 4 to trial11845692-46 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:1324: oid 46 updating version 0 to 406 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:1324: oid 46 version 406 is already newer than 405 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:1324: oid 46 version 406 is already newer than 404 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 406 (ObjNum 503 snap 136 seq_num 503) dirty exists 2026-02-17T05:33:31.287 INFO:tasks.rados.rados.0.trial118.stdout:1324: left oid 46 (ObjNum 503 snap 136 seq_num 503) 2026-02-17T05:33:31.291 INFO:tasks.rados.rados.0.trial118.stdout:1325: finishing copy_from racing read to trial11845692-43 2026-02-17T05:33:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1325: finishing copy_from to trial11845692-43 2026-02-17T05:33:31.292 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 294 (ObjNum 383 snap 97 seq_num 383) dirty exists 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:1324: done (2 left) 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:1325: done (1 left) 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:1326: done (0 left) 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:1327: copy_from oid 3 from oid 47 current snap is 137 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:1328: rollback oid 46 current snap is 137 2026-02-17T05:33:32.276 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 135 2026-02-17T05:33:32.277 INFO:tasks.rados.rados.0.trial118.stdout:1329: delete oid 43 current snap is 137 2026-02-17T05:33:32.280 INFO:tasks.rados.rados.0.trial118.stdout:1329: done (2 left) 2026-02-17T05:33:32.280 INFO:tasks.rados.rados.0.trial118.stdout:1330: snap_remove snap 125 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1330: done (2 left) 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1331: read oid 38 snap -1 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1331: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1332: delete oid 41 current snap is 137 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1328: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1328: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1328: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 409 (ObjNum 487 snap 132 seq_num 487) dirty exists 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1327: finishing copy_from racing read to trial11845692-3 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:1327: finishing copy_from to trial11845692-3 2026-02-17T05:33:33.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 629 (ObjNum 484 snap 128 seq_num 484) dirty exists 2026-02-17T05:33:33.280 INFO:tasks.rados.rados.0.trial118.stdout:1327: done (3 left) 2026-02-17T05:33:33.280 INFO:tasks.rados.rados.0.trial118.stdout:1328: done (2 left) 2026-02-17T05:33:33.280 INFO:tasks.rados.rados.0.trial118.stdout:1332: done (1 left) 2026-02-17T05:33:33.280 INFO:tasks.rados.rados.0.trial118.stdout:1333: write oid 31 current snap is 137 2026-02-17T05:33:33.280 INFO:tasks.rados.rados.0.trial118.stdout:1333: seq_num 506 ranges {504342=555292,1643418=484844} 2026-02-17T05:33:33.284 INFO:tasks.rados.rados.0.trial118.stdout:1333: writing trial11845692-31 from 504342 to 1059634 tid 1 2026-02-17T05:33:33.289 INFO:tasks.rados.rados.0.trial118.stdout:1333: writing trial11845692-31 from 1643418 to 2128262 tid 2 2026-02-17T05:33:33.289 INFO:tasks.rados.rados.0.trial118.stdout:1334: write (excl) oid 30 current snap is 137 2026-02-17T05:33:33.289 INFO:tasks.rados.rados.0.trial118.stdout:1334: seq_num 507 ranges {521149=630541,1701900=628502} 2026-02-17T05:33:33.294 INFO:tasks.rados.rados.0.trial118.stdout:1334: writing trial11845692-30 from 521149 to 1151690 tid 1 2026-02-17T05:33:33.298 INFO:tasks.rados.rados.0.trial118.stdout:1334: writing trial11845692-30 from 1701900 to 2330402 tid 2 2026-02-17T05:33:33.299 INFO:tasks.rados.rados.0.trial118.stdout:1335: read oid 44 snap -1 2026-02-17T05:33:33.299 INFO:tasks.rados.rados.0.trial118.stdout:1335: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:33:33.299 INFO:tasks.rados.rados.0.trial118.stdout:1336: write (excl) oid 9 current snap is 137 2026-02-17T05:33:33.299 INFO:tasks.rados.rados.0.trial118.stdout:1331: expect (ObjNum 319 snap 78 seq_num 319) 2026-02-17T05:33:33.337 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1824665 2026-02-17T05:33:33.352 INFO:tasks.rados.rados.0.trial118.stdout:1333: finishing write tid 1 to trial11845692-31 2026-02-17T05:33:33.352 INFO:tasks.rados.rados.0.trial118.stdout:1333: finishing write tid 2 to trial11845692-31 2026-02-17T05:33:33.352 INFO:tasks.rados.rados.0.trial118.stdout:1333: finishing write tid 3 to trial11845692-31 2026-02-17T05:33:33.352 INFO:tasks.rados.rados.0.trial118.stdout:1333: finishing write tid 4 to trial11845692-31 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1333: oid 31 updating version 0 to 718 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1333: oid 31 version 718 is already newer than 717 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1333: oid 31 version 718 is already newer than 716 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 718 (ObjNum 506 snap 137 seq_num 506) dirty exists 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1333: left oid 31 (ObjNum 506 snap 137 seq_num 506) 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: finishing write tid 1 to trial11845692-30 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: finishing write tid 2 to trial11845692-30 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: finishing write tid 3 to trial11845692-30 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: finishing write tid 4 to trial11845692-30 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: oid 30 updating version 0 to 674 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: oid 30 updating version 674 to 676 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: oid 30 version 676 is already newer than 675 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 676 (ObjNum 507 snap 137 seq_num 507) dirty exists 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1334: left oid 30 (ObjNum 507 snap 137 seq_num 507) 2026-02-17T05:33:33.353 INFO:tasks.rados.rados.0.trial118.stdout:1335: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:33:33.354 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1533900 2026-02-17T05:33:33.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:33.408 INFO:tasks.rados.rados.0.trial118.stdout:1336: seq_num 508 ranges {537956=705790,1644029=772160} 2026-02-17T05:33:33.413 INFO:tasks.rados.rados.0.trial118.stdout:1336: writing trial11845692-9 from 537956 to 1243746 tid 1 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1336: writing trial11845692-9 from 1644029 to 2416189 tid 2 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1331: done (4 left) 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1333: done (3 left) 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1334: done (2 left) 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1335: done (1 left) 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1337: write (excl) oid 8 current snap is 137 2026-02-17T05:33:33.418 INFO:tasks.rados.rados.0.trial118.stdout:1337: seq_num 509 ranges {554763=781039,2102511=452252} 2026-02-17T05:33:33.423 INFO:tasks.rados.rados.0.trial118.stdout:1337: writing trial11845692-8 from 554763 to 1335802 tid 1 2026-02-17T05:33:33.428 INFO:tasks.rados.rados.0.trial118.stdout:1337: writing trial11845692-8 from 2102511 to 2554763 tid 2 2026-02-17T05:33:33.428 INFO:tasks.rados.rados.0.trial118.stdout:1338: snap_remove snap 129 2026-02-17T05:33:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1338: done (2 left) 2026-02-17T05:33:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1339: delete oid 28 current snap is 137 2026-02-17T05:33:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1336: finishing write tid 1 to trial11845692-9 2026-02-17T05:33:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1336: finishing write tid 2 to trial11845692-9 2026-02-17T05:33:34.282 INFO:tasks.rados.rados.0.trial118.stdout:1336: finishing write tid 3 to trial11845692-9 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1336: finishing write tid 4 to trial11845692-9 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1336: oid 9 updating version 0 to 621 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1336: oid 9 updating version 621 to 622 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1336: oid 9 updating version 622 to 623 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 623 (ObjNum 508 snap 137 seq_num 508) dirty exists 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1336: left oid 9 (ObjNum 508 snap 137 seq_num 508) 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: finishing write tid 1 to trial11845692-8 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: finishing write tid 2 to trial11845692-8 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: finishing write tid 3 to trial11845692-8 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: finishing write tid 4 to trial11845692-8 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: oid 8 updating version 0 to 721 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: oid 8 version 721 is already newer than 720 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: oid 8 version 721 is already newer than 719 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 721 (ObjNum 509 snap 137 seq_num 509) dirty exists 2026-02-17T05:33:34.283 INFO:tasks.rados.rados.0.trial118.stdout:1337: left oid 8 (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:34.284 INFO:tasks.rados.rados.0.trial118.stdout:1336: done (2 left) 2026-02-17T05:33:34.284 INFO:tasks.rados.rados.0.trial118.stdout:1337: done (1 left) 2026-02-17T05:33:34.284 INFO:tasks.rados.rados.0.trial118.stdout:1339: done (0 left) 2026-02-17T05:33:34.284 INFO:tasks.rados.rados.0.trial118.stdout:1340: snap_create 2026-02-17T05:33:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1340: done (0 left) 2026-02-17T05:33:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1341: snap_create 2026-02-17T05:33:36.286 INFO:tasks.rados.rados.0.trial118.stdout:1341: done (0 left) 2026-02-17T05:33:36.286 INFO:tasks.rados.rados.0.trial118.stdout:1342: snap_create 2026-02-17T05:33:37.289 INFO:tasks.rados.rados.0.trial118.stdout:1342: done (0 left) 2026-02-17T05:33:37.290 INFO:tasks.rados.rados.0.trial118.stdout:1343: rollback oid 32 current snap is 140 2026-02-17T05:33:37.290 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 131 2026-02-17T05:33:37.290 INFO:tasks.rados.rados.0.trial118.stdout:1344: write oid 35 current snap is 140 2026-02-17T05:33:37.290 INFO:tasks.rados.rados.0.trial118.stdout:1344: seq_num 511 ranges {588377=647890,1935828=635840} 2026-02-17T05:33:37.294 INFO:tasks.rados.rados.0.trial118.stdout:1344: writing trial11845692-35 from 588377 to 1236267 tid 1 2026-02-17T05:33:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1344: writing trial11845692-35 from 1935828 to 2571668 tid 2 2026-02-17T05:33:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1345: read oid 41 snap -1 2026-02-17T05:33:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1345: expect deleted 2026-02-17T05:33:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1346: copy_from oid 1 from oid 13 current snap is 140 2026-02-17T05:33:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1343: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:33:37.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 0 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-17T05:33:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1344: finishing write tid 1 to trial11845692-35 2026-02-17T05:33:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1343: done (3 left) 2026-02-17T05:33:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1347: snap_create 2026-02-17T05:33:37.302 INFO:tasks.rados.rados.0.trial118.stdout:1344: finishing write tid 2 to trial11845692-35 2026-02-17T05:33:37.302 INFO:tasks.rados.rados.0.trial118.stdout:1344: finishing write tid 3 to trial11845692-35 2026-02-17T05:33:37.302 INFO:tasks.rados.rados.0.trial118.stdout:1344: finishing write tid 4 to trial11845692-35 2026-02-17T05:33:37.303 INFO:tasks.rados.rados.0.trial118.stdout:1344: oid 35 updating version 0 to 195 2026-02-17T05:33:37.303 INFO:tasks.rados.rados.0.trial118.stdout:1344: oid 35 updating version 195 to 196 2026-02-17T05:33:37.303 INFO:tasks.rados.rados.0.trial118.stdout:1344: oid 35 updating version 196 to 197 2026-02-17T05:33:37.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 197 (ObjNum 511 snap 140 seq_num 511) dirty exists 2026-02-17T05:33:37.303 INFO:tasks.rados.rados.0.trial118.stdout:1344: left oid 35 (ObjNum 511 snap 140 seq_num 511) 2026-02-17T05:33:37.304 INFO:tasks.rados.rados.0.trial118.stdout:1346: finishing copy_from racing read to trial11845692-1 2026-02-17T05:33:37.304 INFO:tasks.rados.rados.0.trial118.stdout:1346: finishing copy_from to trial11845692-1 2026-02-17T05:33:37.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 385 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1344: done (3 left) 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1345: done (2 left) 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1346: done (1 left) 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1347: done (0 left) 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1348: rollback oid 13 current snap is 141 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 134 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1349: write oid 12 current snap is 141 2026-02-17T05:33:38.295 INFO:tasks.rados.rados.0.trial118.stdout:1349: seq_num 512 ranges {605184=723139,1877957=727227} 2026-02-17T05:33:38.301 INFO:tasks.rados.rados.0.trial118.stdout:1349: writing trial11845692-12 from 605184 to 1328323 tid 1 2026-02-17T05:33:38.305 INFO:tasks.rados.rados.0.trial118.stdout:1349: writing trial11845692-12 from 1877957 to 2605184 tid 2 2026-02-17T05:33:38.306 INFO:tasks.rados.rados.0.trial118.stdout:1350: write oid 17 current snap is 141 2026-02-17T05:33:38.306 INFO:tasks.rados.rados.0.trial118.stdout:1350: seq_num 513 ranges {621991=798388,1936439=639509} 2026-02-17T05:33:38.310 INFO:tasks.rados.rados.0.trial118.stdout:1350: writing trial11845692-17 from 621991 to 1420379 tid 1 2026-02-17T05:33:38.315 INFO:tasks.rados.rados.0.trial118.stdout:1350: writing trial11845692-17 from 1936439 to 2575948 tid 2 2026-02-17T05:33:38.315 INFO:tasks.rados.rados.0.trial118.stdout:1351: snap_remove snap 135 2026-02-17T05:33:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1351: done (3 left) 2026-02-17T05:33:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1352: write (excl) oid 28 current snap is 141 2026-02-17T05:33:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1352: seq_num 514 ranges {638798=473637,1594921=783167} 2026-02-17T05:33:39.300 INFO:tasks.rados.rados.0.trial118.stdout:1352: writing trial11845692-28 from 638798 to 1112435 tid 1 2026-02-17T05:33:39.305 INFO:tasks.rados.rados.0.trial118.stdout:1352: writing trial11845692-28 from 1594921 to 2378088 tid 2 2026-02-17T05:33:39.305 INFO:tasks.rados.rados.0.trial118.stdout:1353: snap_remove snap 127 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1353: done (4 left) 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1354: read oid 44 snap -1 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1354: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1355: delete oid 47 current snap is 141 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1348: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1348: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:33:40.277 INFO:tasks.rados.rados.0.trial118.stdout:1348: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 632 (ObjNum 251 snap 64 seq_num 251) dirty exists 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: finishing write tid 1 to trial11845692-12 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: finishing write tid 2 to trial11845692-12 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: finishing write tid 3 to trial11845692-12 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: finishing write tid 4 to trial11845692-12 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: oid 12 updating version 0 to 582 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: oid 12 version 582 is already newer than 581 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: oid 12 version 582 is already newer than 580 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 582 (ObjNum 512 snap 141 seq_num 512) dirty exists 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1349: left oid 12 (ObjNum 512 snap 141 seq_num 512) 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1350: finishing write tid 1 to trial11845692-17 2026-02-17T05:33:40.278 INFO:tasks.rados.rados.0.trial118.stdout:1350: finishing write tid 2 to trial11845692-17 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: finishing write tid 3 to trial11845692-17 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: finishing write tid 4 to trial11845692-17 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: oid 17 updating version 0 to 412 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: oid 17 version 412 is already newer than 410 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: oid 17 version 412 is already newer than 411 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 412 (ObjNum 513 snap 141 seq_num 513) dirty exists 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1350: left oid 17 (ObjNum 513 snap 141 seq_num 513) 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: finishing write tid 1 to trial11845692-28 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: finishing write tid 2 to trial11845692-28 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: finishing write tid 3 to trial11845692-28 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: finishing write tid 4 to trial11845692-28 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: oid 28 updating version 0 to 334 2026-02-17T05:33:40.279 INFO:tasks.rados.rados.0.trial118.stdout:1352: oid 28 updating version 334 to 335 2026-02-17T05:33:40.280 INFO:tasks.rados.rados.0.trial118.stdout:1352: oid 28 updating version 335 to 336 2026-02-17T05:33:40.280 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 336 (ObjNum 514 snap 141 seq_num 514) dirty exists 2026-02-17T05:33:40.280 INFO:tasks.rados.rados.0.trial118.stdout:1352: left oid 28 (ObjNum 514 snap 141 seq_num 514) 2026-02-17T05:33:40.280 INFO:tasks.rados.rados.0.trial118.stdout:1354: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:33:40.317 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1038339 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1348: done (5 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1349: done (4 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1350: done (3 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1352: done (2 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1354: done (1 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1355: done (0 left) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1356: read oid 33 snap -1 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1356: expect (ObjNum 371 snap 89 seq_num 371) 2026-02-17T05:33:40.331 INFO:tasks.rados.rados.0.trial118.stdout:1357: snap_remove snap 136 2026-02-17T05:33:41.300 INFO:tasks.rados.rados.0.trial118.stdout:1357: done (1 left) 2026-02-17T05:33:41.300 INFO:tasks.rados.rados.0.trial118.stdout:1358: write oid 35 current snap is 141 2026-02-17T05:33:41.300 INFO:tasks.rados.rados.0.trial118.stdout:1358: seq_num 516 ranges {672412=624135,1995532=676880} 2026-02-17T05:33:41.305 INFO:tasks.rados.rados.0.trial118.stdout:1358: writing trial11845692-35 from 672412 to 1296547 tid 1 2026-02-17T05:33:41.311 INFO:tasks.rados.rados.0.trial118.stdout:1358: writing trial11845692-35 from 1995532 to 2672412 tid 2 2026-02-17T05:33:41.311 INFO:tasks.rados.rados.0.trial118.stdout:1359: read oid 1 snap 137 2026-02-17T05:33:41.311 INFO:tasks.rados.rados.0.trial118.stdout:1359: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:41.311 INFO:tasks.rados.rados.0.trial118.stdout:1360: write (excl) oid 20 current snap is 141 2026-02-17T05:33:41.311 INFO:tasks.rados.rados.0.trial118.stdout:1360: seq_num 517 ranges {689219=415737,1770367=646847} 2026-02-17T05:33:41.315 INFO:tasks.rados.rados.0.trial118.stdout:1360: writing trial11845692-20 from 689219 to 1104956 tid 1 2026-02-17T05:33:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1360: writing trial11845692-20 from 1770367 to 2417214 tid 2 2026-02-17T05:33:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1361: snap_remove snap 139 2026-02-17T05:33:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1361: done (4 left) 2026-02-17T05:33:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1362: write (excl) oid 4 current snap is 141 2026-02-17T05:33:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1362: seq_num 518 ranges {706026=490986,1828849=790505} 2026-02-17T05:33:42.307 INFO:tasks.rados.rados.0.trial118.stdout:1362: writing trial11845692-4 from 706026 to 1197012 tid 1 2026-02-17T05:33:42.313 INFO:tasks.rados.rados.0.trial118.stdout:1362: writing trial11845692-4 from 1828849 to 2619354 tid 2 2026-02-17T05:33:42.313 INFO:tasks.rados.rados.0.trial118.stdout:1363: copy_from oid 50 from oid 8 current snap is 141 2026-02-17T05:33:42.313 INFO:tasks.rados.rados.0.trial118.stdout:1356: expect (ObjNum 371 snap 89 seq_num 371) 2026-02-17T05:33:42.321 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1712181 2026-02-17T05:33:42.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:42.375 INFO:tasks.rados.rados.0.trial118.stdout:1358: finishing write tid 1 to trial11845692-35 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1358: finishing write tid 2 to trial11845692-35 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1356: done (5 left) 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1364: read oid 6 snap -1 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1364: expect (ObjNum 502 snap 135 seq_num 502) 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1365: snap_create 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1358: finishing write tid 3 to trial11845692-35 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1358: finishing write tid 4 to trial11845692-35 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1358: oid 35 updating version 0 to 205 2026-02-17T05:33:42.376 INFO:tasks.rados.rados.0.trial118.stdout:1358: oid 35 updating version 205 to 207 2026-02-17T05:33:42.377 INFO:tasks.rados.rados.0.trial118.stdout:1358: oid 35 version 207 is already newer than 206 2026-02-17T05:33:42.377 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 207 (ObjNum 516 snap 141 seq_num 516) dirty exists 2026-02-17T05:33:42.377 INFO:tasks.rados.rados.0.trial118.stdout:1358: left oid 35 (ObjNum 516 snap 141 seq_num 516) 2026-02-17T05:33:42.377 INFO:tasks.rados.rados.0.trial118.stdout:1359: expect (ObjNum 422 snap 111 seq_num 422) 2026-02-17T05:33:42.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:42.453 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 403251 2026-02-17T05:33:42.489 INFO:tasks.rados.rados.0.trial118.stdout:1360: finishing write tid 1 to trial11845692-20 2026-02-17T05:33:42.489 INFO:tasks.rados.rados.0.trial118.stdout:1360: finishing write tid 2 to trial11845692-20 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: finishing write tid 3 to trial11845692-20 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: finishing write tid 4 to trial11845692-20 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: oid 20 updating version 0 to 749 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: oid 20 version 749 is already newer than 747 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: oid 20 version 749 is already newer than 748 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 749 (ObjNum 517 snap 141 seq_num 517) dirty exists 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1360: left oid 20 (ObjNum 517 snap 141 seq_num 517) 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1362: finishing write tid 1 to trial11845692-4 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1362: finishing write tid 2 to trial11845692-4 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1362: finishing write tid 3 to trial11845692-4 2026-02-17T05:33:42.490 INFO:tasks.rados.rados.0.trial118.stdout:1362: finishing write tid 4 to trial11845692-4 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1362: oid 4 updating version 0 to 635 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1362: oid 4 version 635 is already newer than 633 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1362: oid 4 version 635 is already newer than 634 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 635 (ObjNum 518 snap 141 seq_num 518) dirty exists 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1362: left oid 4 (ObjNum 518 snap 141 seq_num 518) 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1363: finishing copy_from racing read to trial11845692-50 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1363: finishing copy_from to trial11845692-50 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 721 (ObjNum 509 snap 137 seq_num 509) dirty exists 2026-02-17T05:33:42.491 INFO:tasks.rados.rados.0.trial118.stdout:1364: expect (ObjNum 502 snap 135 seq_num 502) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1358: done (6 left) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1359: done (5 left) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1360: done (4 left) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1362: done (3 left) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1363: done (2 left) 2026-02-17T05:33:43.303 INFO:tasks.rados.rados.0.trial118.stdout:1364: done (1 left) 2026-02-17T05:33:43.304 INFO:tasks.rados.rados.0.trial118.stdout:1365: done (0 left) 2026-02-17T05:33:43.304 INFO:tasks.rados.rados.0.trial118.stdout:1366: copy_from oid 41 from oid 37 current snap is 142 2026-02-17T05:33:43.304 INFO:tasks.rados.rados.0.trial118.stdout:1367: delete oid 49 current snap is 142 2026-02-17T05:33:43.305 INFO:tasks.rados.rados.0.trial118.stdout:1366: finishing copy_from to trial11845692-41 2026-02-17T05:33:43.305 INFO:tasks.rados.rados.0.trial118.stdout:1366: got expected ENOENT (src dne) 2026-02-17T05:33:43.305 INFO:tasks.rados.rados.0.trial118.stdout:1366: finishing copy_from racing read to trial11845692-41 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1366: done (1 left) 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1367: done (0 left) 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1368: read oid 11 snap -1 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1368: expect (ObjNum 491 snap 134 seq_num 491) 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1369: read oid 35 snap 138 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1369: expect (ObjNum 493 snap 134 seq_num 493) 2026-02-17T05:33:43.307 INFO:tasks.rados.rados.0.trial118.stdout:1370: snap_remove snap 140 2026-02-17T05:33:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1370: done (2 left) 2026-02-17T05:33:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1371: rollback oid 41 current snap is 142 2026-02-17T05:33:44.306 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 131 2026-02-17T05:33:44.306 INFO:tasks.rados.rados.0.trial118.stdout:1368: expect (ObjNum 491 snap 134 seq_num 491) 2026-02-17T05:33:44.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 617329 2026-02-17T05:33:44.421 INFO:tasks.rados.rados.0.trial118.stdout:1369: expect (ObjNum 493 snap 134 seq_num 493) 2026-02-17T05:33:44.475 INFO:tasks.rados.rados.0.trial118.stdout:1371: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:33:44.475 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 0 (ObjNum 273 snap 0 seq_num 11722880) dirty dne 2026-02-17T05:33:44.475 INFO:tasks.rados.rados.0.trial118.stdout:1368: done (2 left) 2026-02-17T05:33:44.475 INFO:tasks.rados.rados.0.trial118.stdout:1369: done (1 left) 2026-02-17T05:33:44.476 INFO:tasks.rados.rados.0.trial118.stdout:1371: done (0 left) 2026-02-17T05:33:44.476 INFO:tasks.rados.rados.0.trial118.stdout:1372: snap_create 2026-02-17T05:33:45.308 INFO:tasks.rados.rados.0.trial118.stdout:1372: done (0 left) 2026-02-17T05:33:45.309 INFO:tasks.rados.rados.0.trial118.stdout:1373: snap_remove snap 126 2026-02-17T05:33:45.473 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:33:45.473 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:33:45.473 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T05:33:45.473 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T05:33:45.476 INFO:tasks.ceph.mon.b:Started 2026-02-17T05:33:45.476 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-17T05:33:45.476 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T05:33:45.476 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T05:33:45.476 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T05:33:45.537 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:33:45.535+0000 7f20f1416c00 -1 mon.b@-1(???).log v0 log_external_backlog rewinding external_log_to from 185 -> 0 (sync_force? mon rebuild?) 2026-02-17T05:33:50.630 INFO:tasks.rados.rados.0.trial118.stdout:1373: done (0 left) 2026-02-17T05:33:50.630 INFO:tasks.rados.rados.0.trial118.stdout:1374: write oid 24 current snap is 143 2026-02-17T05:33:50.630 INFO:tasks.rados.rados.0.trial118.stdout:1374: seq_num 520 ranges {739640=641484,1829460=794174} 2026-02-17T05:33:50.636 INFO:tasks.rados.rados.0.trial118.stdout:1374: writing trial11845692-24 from 739640 to 1381124 tid 1 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1374: writing trial11845692-24 from 1829460 to 2623634 tid 2 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1375: rollback oid 39 current snap is 143 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 134 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1374: finishing write tid 1 to trial11845692-24 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1376: read oid 33 snap 141 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1376: expect (ObjNum 371 snap 89 seq_num 371) 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1377: copy_from oid 42 from oid 29 current snap is 143 2026-02-17T05:33:50.641 INFO:tasks.rados.rados.0.trial118.stdout:1378: snap_remove snap 130 2026-02-17T05:33:51.634 INFO:tasks.rados.rados.0.trial118.stdout:1378: done (4 left) 2026-02-17T05:33:51.635 INFO:tasks.rados.rados.0.trial118.stdout:1379: snap_remove snap 131 2026-02-17T05:33:52.637 INFO:tasks.rados.rados.0.trial118.stdout:1379: done (4 left) 2026-02-17T05:33:52.637 INFO:tasks.rados.rados.0.trial118.stdout:1380: read oid 50 snap 137 2026-02-17T05:33:52.637 INFO:tasks.rados.rados.0.trial118.stdout:1380: expect (ObjNum 499 snap 135 seq_num 499) 2026-02-17T05:33:52.637 INFO:tasks.rados.rados.0.trial118.stdout:1381: write oid 7 current snap is 143 2026-02-17T05:33:52.637 INFO:tasks.rados.rados.0.trial118.stdout:1374: finishing write tid 2 to trial11845692-24 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: finishing write tid 3 to trial11845692-24 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: finishing write tid 4 to trial11845692-24 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: oid 24 updating version 0 to 217 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: oid 24 version 217 is already newer than 216 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: oid 24 version 217 is already newer than 215 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 217 (ObjNum 520 snap 143 seq_num 520) dirty exists 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1374: left oid 24 (ObjNum 520 snap 143 seq_num 520) 2026-02-17T05:33:52.638 INFO:tasks.rados.rados.0.trial118.stdout:1376: expect (ObjNum 371 snap 89 seq_num 371) 2026-02-17T05:33:52.676 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:52.698 INFO:tasks.rados.rados.0.trial118.stdout:1375: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:33:52.698 INFO:tasks.rados.rados.0.trial118.stdout:1375: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:33:52.698 INFO:tasks.rados.rados.0.trial118.stdout:1381: seq_num 521 ranges {756447=716733,1887942=537832} 2026-02-17T05:33:52.703 INFO:tasks.rados.rados.0.trial118.stdout:1381: writing trial11845692-7 from 756447 to 1473180 tid 1 2026-02-17T05:33:52.707 INFO:tasks.rados.rados.0.trial118.stdout:1381: writing trial11845692-7 from 1887942 to 2425774 tid 2 2026-02-17T05:33:52.708 INFO:tasks.rados.rados.0.trial118.stdout:1374: done (5 left) 2026-02-17T05:33:52.708 INFO:tasks.rados.rados.0.trial118.stdout:1376: done (4 left) 2026-02-17T05:33:52.708 INFO:tasks.rados.rados.0.trial118.stdout:1382: write (excl) oid 19 current snap is 143 2026-02-17T05:33:52.708 INFO:tasks.rados.rados.0.trial118.stdout:1382: seq_num 522 ranges {773254=791982,2346424=426830} 2026-02-17T05:33:52.713 INFO:tasks.rados.rados.0.trial118.stdout:1382: writing trial11845692-19 from 773254 to 1565236 tid 1 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:1382: writing trial11845692-19 from 2346424 to 2773254 tid 2 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:1383: snap_create 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:1375: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 684 (ObjNum 449 snap 118 seq_num 449) dirty exists 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:1377: finishing copy_from racing read to trial11845692-42 2026-02-17T05:33:52.718 INFO:tasks.rados.rados.0.trial118.stdout:1377: finishing copy_from to trial11845692-42 2026-02-17T05:33:52.719 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 547 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:33:52.719 INFO:tasks.rados.rados.0.trial118.stdout:1380: expect (ObjNum 499 snap 135 seq_num 499) 2026-02-17T05:33:52.762 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 260542 2026-02-17T05:33:52.784 INFO:tasks.rados.rados.0.trial118.stdout:1381: finishing write tid 1 to trial11845692-7 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: finishing write tid 2 to trial11845692-7 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: finishing write tid 3 to trial11845692-7 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: finishing write tid 4 to trial11845692-7 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: oid 7 updating version 0 to 653 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: oid 7 version 653 is already newer than 652 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: oid 7 version 653 is already newer than 651 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 653 (ObjNum 521 snap 143 seq_num 521) dirty exists 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1381: left oid 7 (ObjNum 521 snap 143 seq_num 521) 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: finishing write tid 1 to trial11845692-19 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: finishing write tid 2 to trial11845692-19 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: finishing write tid 3 to trial11845692-19 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: finishing write tid 4 to trial11845692-19 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: oid 19 updating version 0 to 635 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: oid 19 version 635 is already newer than 634 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: oid 19 version 635 is already newer than 633 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 635 (ObjNum 522 snap 143 seq_num 522) dirty exists 2026-02-17T05:33:52.785 INFO:tasks.rados.rados.0.trial118.stdout:1382: left oid 19 (ObjNum 522 snap 143 seq_num 522) 2026-02-17T05:33:53.640 INFO:tasks.rados.rados.0.trial118.stdout:1375: done (5 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1377: done (4 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1380: done (3 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1381: done (2 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1382: done (1 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1383: done (0 left) 2026-02-17T05:33:53.641 INFO:tasks.rados.rados.0.trial118.stdout:1384: snap_remove snap 134 2026-02-17T05:33:54.642 INFO:tasks.rados.rados.0.trial118.stdout:1384: done (0 left) 2026-02-17T05:33:54.643 INFO:tasks.rados.rados.0.trial118.stdout:1385: write (excl) oid 39 current snap is 144 2026-02-17T05:33:54.643 INFO:tasks.rados.rados.0.trial118.stdout:1385: seq_num 523 ranges {790061=467231,2004906=541501} 2026-02-17T05:33:54.647 INFO:tasks.rados.rados.0.trial118.stdout:1385: writing trial11845692-39 from 790061 to 1257292 tid 1 2026-02-17T05:33:54.652 INFO:tasks.rados.rados.0.trial118.stdout:1385: writing trial11845692-39 from 2004906 to 2546407 tid 2 2026-02-17T05:33:54.652 INFO:tasks.rados.rados.0.trial118.stdout:1386: snap_remove snap 138 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1386: done (1 left) 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1387: rollback oid 29 current snap is 144 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 143 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1385: finishing write tid 1 to trial11845692-39 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1385: finishing write tid 2 to trial11845692-39 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1385: finishing write tid 3 to trial11845692-39 2026-02-17T05:33:55.278 INFO:tasks.rados.rados.0.trial118.stdout:1385: finishing write tid 4 to trial11845692-39 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1385: oid 39 updating version 0 to 706 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1385: oid 39 version 706 is already newer than 699 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1385: oid 39 updating version 706 to 707 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 707 (ObjNum 523 snap 144 seq_num 523) dirty exists 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1385: left oid 39 (ObjNum 523 snap 144 seq_num 523) 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1385: done (1 left) 2026-02-17T05:33:55.279 INFO:tasks.rados.rados.0.trial118.stdout:1388: snap_remove snap 141 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1388: done (1 left) 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1389: read oid 50 snap -1 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1389: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1390: delete oid 11 current snap is 144 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1387: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1387: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:1387: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:33:56.278 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 663 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:33:56.283 INFO:tasks.rados.rados.0.trial118.stdout:1387: done (2 left) 2026-02-17T05:33:56.283 INFO:tasks.rados.rados.0.trial118.stdout:1390: done (1 left) 2026-02-17T05:33:56.283 INFO:tasks.rados.rados.0.trial118.stdout:1391: write oid 40 current snap is 144 2026-02-17T05:33:56.284 INFO:tasks.rados.rados.0.trial118.stdout:1391: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2026-02-17T05:33:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1391: writing trial11845692-40 from 423675 to 1157757 tid 1 2026-02-17T05:33:56.292 INFO:tasks.rados.rados.0.trial118.stdout:1391: writing trial11845692-40 from 1721870 to 2267040 tid 2 2026-02-17T05:33:56.294 INFO:tasks.rados.rados.0.trial118.stdout:1391: writing trial11845692-40 from 2717777 to 2823675 tid 3 2026-02-17T05:33:56.294 INFO:tasks.rados.rados.0.trial118.stdout:1392: write oid 10 current snap is 144 2026-02-17T05:33:56.294 INFO:tasks.rados.rados.0.trial118.stdout:1392: seq_num 526 ranges {440482=409331,1380352=405181,2461553=378929} 2026-02-17T05:33:56.297 INFO:tasks.rados.rados.0.trial118.stdout:1392: writing trial11845692-10 from 440482 to 849813 tid 1 2026-02-17T05:33:56.301 INFO:tasks.rados.rados.0.trial118.stdout:1392: writing trial11845692-10 from 1380352 to 1785533 tid 2 2026-02-17T05:33:56.305 INFO:tasks.rados.rados.0.trial118.stdout:1392: writing trial11845692-10 from 2461553 to 2840482 tid 3 2026-02-17T05:33:56.305 INFO:tasks.rados.rados.0.trial118.stdout:1393: snap_create 2026-02-17T05:33:56.305 INFO:tasks.rados.rados.0.trial118.stdout:1389: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:56.326 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 878824 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: finishing write tid 1 to trial11845692-40 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: finishing write tid 2 to trial11845692-40 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: finishing write tid 3 to trial11845692-40 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: finishing write tid 4 to trial11845692-40 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: finishing write tid 5 to trial11845692-40 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: oid 40 updating version 0 to 727 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: oid 40 version 727 is already newer than 726 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: oid 40 updating version 727 to 729 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: oid 40 version 729 is already newer than 728 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 729 (ObjNum 525 snap 144 seq_num 525) dirty exists 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1391: left oid 40 (ObjNum 525 snap 144 seq_num 525) 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: finishing write tid 1 to trial11845692-10 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: finishing write tid 2 to trial11845692-10 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: finishing write tid 3 to trial11845692-10 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: finishing write tid 4 to trial11845692-10 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: finishing write tid 5 to trial11845692-10 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: oid 10 updating version 0 to 348 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: oid 10 version 348 is already newer than 346 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: oid 10 version 348 is already newer than 347 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:1392: oid 10 version 348 is already newer than 345 2026-02-17T05:33:56.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 348 (ObjNum 526 snap 144 seq_num 526) dirty exists 2026-02-17T05:33:56.357 INFO:tasks.rados.rados.0.trial118.stdout:1392: left oid 10 (ObjNum 526 snap 144 seq_num 526) 2026-02-17T05:33:57.281 INFO:tasks.rados.rados.0.trial118.stdout:1389: done (3 left) 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1391: done (2 left) 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1392: done (1 left) 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1393: done (0 left) 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1394: read oid 1 snap -1 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1394: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1395: read oid 48 snap -1 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1395: expect deleted 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1396: copy_from oid 30 from oid 2 current snap is 145 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1397: copy_from oid 43 from oid 29 current snap is 145 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1398: write oid 14 current snap is 145 2026-02-17T05:33:57.282 INFO:tasks.rados.rados.0.trial118.stdout:1398: seq_num 527 ranges {457289=484580,1438834=548839,2772623=84666} 2026-02-17T05:33:57.285 INFO:tasks.rados.rados.0.trial118.stdout:1398: writing trial11845692-14 from 457289 to 941869 tid 1 2026-02-17T05:33:57.289 INFO:tasks.rados.rados.0.trial118.stdout:1398: writing trial11845692-14 from 1438834 to 1987673 tid 2 2026-02-17T05:33:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1398: writing trial11845692-14 from 2772623 to 2857289 tid 3 2026-02-17T05:33:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1399: read oid 8 snap -1 2026-02-17T05:33:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1399: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1400: rollback oid 7 current snap is 145 2026-02-17T05:33:57.293 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 142 2026-02-17T05:33:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1394: expect (ObjNum 251 snap 64 seq_num 251) 2026-02-17T05:33:57.401 INFO:tasks.rados.rados.0.trial118.stdout:1398: finishing write tid 1 to trial11845692-14 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1397: finishing copy_from racing read to trial11845692-43 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1397: finishing copy_from to trial11845692-43 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 663 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: finishing write tid 2 to trial11845692-14 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: finishing write tid 3 to trial11845692-14 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: finishing write tid 4 to trial11845692-14 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: finishing write tid 5 to trial11845692-14 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: oid 14 updating version 0 to 587 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: oid 14 updating version 587 to 588 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: oid 14 version 588 is already newer than 585 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: oid 14 version 588 is already newer than 586 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 588 (ObjNum 527 snap 145 seq_num 527) dirty exists 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1398: left oid 14 (ObjNum 527 snap 145 seq_num 527) 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1400: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:33:57.402 INFO:tasks.rados.rados.0.trial118.stdout:1400: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:33:57.403 INFO:tasks.rados.rados.0.trial118.stdout:1400: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:33:57.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 675 (ObjNum 479 snap 125 seq_num 479) dirty exists 2026-02-17T05:33:57.403 INFO:tasks.rados.rados.0.trial118.stdout:1399: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:57.419 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:57.437 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 513043 2026-02-17T05:33:57.453 INFO:tasks.rados.rados.0.trial118.stdout:1396: finishing copy_from racing read to trial11845692-30 2026-02-17T05:33:57.453 INFO:tasks.rados.rados.0.trial118.stdout:1396: finishing copy_from to trial11845692-30 2026-02-17T05:33:57.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 638 (ObjNum 459 snap 119 seq_num 459) dirty exists 2026-02-17T05:33:57.453 INFO:tasks.rados.rados.0.trial118.stdout:1394: done (6 left) 2026-02-17T05:33:57.453 INFO:tasks.rados.rados.0.trial118.stdout:1395: done (5 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1396: done (4 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1397: done (3 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1398: done (2 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1399: done (1 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1400: done (0 left) 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1401: copy_from oid 2 from oid 24 current snap is 145 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1402: write oid 43 current snap is 145 2026-02-17T05:33:57.454 INFO:tasks.rados.rados.0.trial118.stdout:1402: seq_num 528 ranges {474096=559829,1780963=408850,2800046=74050} 2026-02-17T05:33:57.456 INFO:tasks.rados.rados.0.trial118.stdout:1402: writing trial11845692-43 from 474096 to 1033925 tid 1 2026-02-17T05:33:57.460 INFO:tasks.rados.rados.0.trial118.stdout:1402: writing trial11845692-43 from 1780963 to 2189813 tid 2 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1402: writing trial11845692-43 from 2800046 to 2874096 tid 3 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1402: finishing write tid 1 to trial11845692-43 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1401: finishing copy_from racing read to trial11845692-2 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1402: finishing write tid 2 to trial11845692-43 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1401: finishing copy_from to trial11845692-2 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 217 (ObjNum 520 snap 143 seq_num 520) dirty exists 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1401: done (1 left) 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1403: write (excl) oid 14 current snap is 145 2026-02-17T05:33:57.464 INFO:tasks.rados.rados.0.trial118.stdout:1403: seq_num 529 ranges {490903=635078,1839445=552508} 2026-02-17T05:33:57.467 INFO:tasks.rados.rados.0.trial118.stdout:1403: writing trial11845692-14 from 490903 to 1125981 tid 1 2026-02-17T05:33:57.473 INFO:tasks.rados.rados.0.trial118.stdout:1403: writing trial11845692-14 from 1839445 to 2391953 tid 2 2026-02-17T05:33:57.473 INFO:tasks.rados.rados.0.trial118.stdout:1404: read oid 17 snap 137 2026-02-17T05:33:57.473 INFO:tasks.rados.rados.0.trial118.stdout:1404: expect (ObjNum 486 snap 129 seq_num 486) 2026-02-17T05:33:57.473 INFO:tasks.rados.rados.0.trial118.stdout:1405: read oid 8 snap -1 2026-02-17T05:33:57.473 INFO:tasks.rados.rados.0.trial118.stdout:1405: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1406: write (excl) oid 47 current snap is 145 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: finishing write tid 3 to trial11845692-43 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: finishing write tid 4 to trial11845692-43 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: finishing write tid 5 to trial11845692-43 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: oid 43 updating version 0 to 723 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: oid 43 updating version 723 to 724 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: oid 43 updating version 724 to 725 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: oid 43 version 725 is already newer than 722 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 725 (ObjNum 528 snap 145 seq_num 528) dirty exists 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1402: left oid 43 (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1403: finishing write tid 1 to trial11845692-14 2026-02-17T05:33:57.474 INFO:tasks.rados.rados.0.trial118.stdout:1406: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2026-02-17T05:33:57.477 INFO:tasks.rados.rados.0.trial118.stdout:1406: writing trial11845692-47 from 507710 to 1218037 tid 1 2026-02-17T05:33:57.481 INFO:tasks.rados.rados.0.trial118.stdout:1406: writing trial11845692-47 from 1897927 to 2310446 tid 2 2026-02-17T05:33:57.483 INFO:tasks.rados.rados.0.trial118.stdout:1406: writing trial11845692-47 from 2854892 to 2907710 tid 3 2026-02-17T05:33:57.484 INFO:tasks.rados.rados.0.trial118.stdout:1402: done (4 left) 2026-02-17T05:33:57.484 INFO:tasks.rados.rados.0.trial118.stdout:1407: copy_from oid 28 from oid 37 current snap is 145 2026-02-17T05:33:57.484 INFO:tasks.rados.rados.0.trial118.stdout:1405: expect (ObjNum 509 snap 137 seq_num 509) 2026-02-17T05:33:57.486 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1790255 2026-02-17T05:33:57.497 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1473601 2026-02-17T05:33:57.523 INFO:tasks.rados.rados.0.trial118.stdout:1403: finishing write tid 2 to trial11845692-14 2026-02-17T05:33:57.523 INFO:tasks.rados.rados.0.trial118.stdout:1403: finishing write tid 3 to trial11845692-14 2026-02-17T05:33:57.523 INFO:tasks.rados.rados.0.trial118.stdout:1403: finishing write tid 4 to trial11845692-14 2026-02-17T05:33:57.523 INFO:tasks.rados.rados.0.trial118.stdout:1403: oid 14 updating version 0 to 589 2026-02-17T05:33:57.523 INFO:tasks.rados.rados.0.trial118.stdout:1403: oid 14 updating version 589 to 590 2026-02-17T05:33:57.524 INFO:tasks.rados.rados.0.trial118.stdout:1403: oid 14 updating version 590 to 591 2026-02-17T05:33:57.524 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 591 (ObjNum 529 snap 145 seq_num 529) dirty exists 2026-02-17T05:33:57.524 INFO:tasks.rados.rados.0.trial118.stdout:1403: left oid 14 (ObjNum 529 snap 145 seq_num 529) 2026-02-17T05:33:57.524 INFO:tasks.rados.rados.0.trial118.stdout:1404: expect (ObjNum 486 snap 129 seq_num 486) 2026-02-17T05:33:57.534 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 206866 2026-02-17T05:33:57.549 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:33:57.564 INFO:tasks.rados.rados.0.trial118.stdout:1406: finishing write tid 1 to trial11845692-47 2026-02-17T05:33:57.564 INFO:tasks.rados.rados.0.trial118.stdout:1406: finishing write tid 2 to trial11845692-47 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1407: finishing copy_from to trial11845692-28 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1407: got expected ENOENT (src dne) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1407: finishing copy_from racing read to trial11845692-28 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1403: done (4 left) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1404: done (3 left) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1405: done (2 left) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1407: done (1 left) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1408: copy_from oid 13 from oid 44 current snap is 145 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: finishing write tid 3 to trial11845692-47 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: finishing write tid 4 to trial11845692-47 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: finishing write tid 5 to trial11845692-47 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: oid 47 updating version 0 to 715 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: oid 47 updating version 715 to 716 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: oid 47 updating version 716 to 717 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: oid 47 version 717 is already newer than 714 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 717 (ObjNum 530 snap 145 seq_num 530) dirty exists 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: left oid 47 (ObjNum 530 snap 145 seq_num 530) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1406: done (1 left) 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1409: write (excl) oid 50 current snap is 145 2026-02-17T05:33:57.565 INFO:tasks.rados.rados.0.trial118.stdout:1409: seq_num 531 ranges {524517=785576,1956409=556177} 2026-02-17T05:33:57.569 INFO:tasks.rados.rados.0.trial118.stdout:1409: writing trial11845692-50 from 524517 to 1310093 tid 1 2026-02-17T05:33:57.574 INFO:tasks.rados.rados.0.trial118.stdout:1409: writing trial11845692-50 from 1956409 to 2512586 tid 2 2026-02-17T05:33:57.574 INFO:tasks.rados.rados.0.trial118.stdout:1410: snap_remove snap 128 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1410: done (2 left) 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1411: read oid 47 snap 144 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1411: expect deleted 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1412: copy_from oid 21 from oid 42 current snap is 145 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1408: finishing copy_from racing read to trial11845692-13 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1408: finishing copy_from to trial11845692-13 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 169 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1409: finishing write tid 1 to trial11845692-50 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1409: finishing write tid 2 to trial11845692-50 2026-02-17T05:33:58.286 INFO:tasks.rados.rados.0.trial118.stdout:1409: finishing write tid 3 to trial11845692-50 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: finishing write tid 4 to trial11845692-50 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: oid 50 updating version 0 to 728 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: oid 50 version 728 is already newer than 727 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: oid 50 version 728 is already newer than 726 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 728 (ObjNum 531 snap 145 seq_num 531) dirty exists 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: left oid 50 (ObjNum 531 snap 145 seq_num 531) 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1408: done (3 left) 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1409: done (2 left) 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1413: write (excl) oid 31 current snap is 145 2026-02-17T05:33:58.287 INFO:tasks.rados.rados.0.trial118.stdout:1413: seq_num 532 ranges {541324=460825,1498538=416188,2393385=547939} 2026-02-17T05:33:58.289 INFO:tasks.rados.rados.0.trial118.stdout:1413: writing trial11845692-31 from 541324 to 1002149 tid 1 2026-02-17T05:33:58.293 INFO:tasks.rados.rados.0.trial118.stdout:1413: writing trial11845692-31 from 1498538 to 1914726 tid 2 2026-02-17T05:33:58.297 INFO:tasks.rados.rados.0.trial118.stdout:1413: writing trial11845692-31 from 2393385 to 2941324 tid 3 2026-02-17T05:33:58.297 INFO:tasks.rados.rados.0.trial118.stdout:1414: snap_create 2026-02-17T05:33:58.297 INFO:tasks.rados.rados.0.trial118.stdout:1413: finishing write tid 1 to trial11845692-31 2026-02-17T05:33:58.297 INFO:tasks.rados.rados.0.trial118.stdout:1413: finishing write tid 2 to trial11845692-31 2026-02-17T05:33:58.297 INFO:tasks.rados.rados.0.trial118.stdout:1412: finishing copy_from racing read to trial11845692-21 2026-02-17T05:33:58.298 INFO:tasks.rados.rados.0.trial118.stdout:1412: finishing copy_from to trial11845692-21 2026-02-17T05:33:58.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 547 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:33:58.298 INFO:tasks.rados.rados.0.trial118.stdout:1413: finishing write tid 3 to trial11845692-31 2026-02-17T05:33:58.298 INFO:tasks.rados.rados.0.trial118.stdout:1413: finishing write tid 4 to trial11845692-31 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: finishing write tid 5 to trial11845692-31 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: oid 31 updating version 0 to 797 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: oid 31 updating version 797 to 802 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: oid 31 updating version 802 to 806 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: oid 31 version 806 is already newer than 805 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 806 (ObjNum 532 snap 145 seq_num 532) dirty exists 2026-02-17T05:33:58.299 INFO:tasks.rados.rados.0.trial118.stdout:1413: left oid 31 (ObjNum 532 snap 145 seq_num 532) 2026-02-17T05:33:59.290 INFO:tasks.rados.rados.0.trial118.stdout:1411: done (3 left) 2026-02-17T05:33:59.290 INFO:tasks.rados.rados.0.trial118.stdout:1412: done (2 left) 2026-02-17T05:33:59.290 INFO:tasks.rados.rados.0.trial118.stdout:1413: done (1 left) 2026-02-17T05:33:59.290 INFO:tasks.rados.rados.0.trial118.stdout:1414: done (0 left) 2026-02-17T05:33:59.290 INFO:tasks.rados.rados.0.trial118.stdout:1415: copy_from oid 48 from oid 7 current snap is 146 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1416: copy_from oid 38 from oid 22 current snap is 146 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1417: copy_from oid 8 from oid 10 current snap is 146 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1418: rollback oid 32 current snap is 146 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 144 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1419: read oid 43 snap -1 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1419: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:33:59.291 INFO:tasks.rados.rados.0.trial118.stdout:1420: snap_remove snap 142 2026-02-17T05:34:00.279 INFO:tasks.rados.rados.0.trial118.stdout:1420: done (5 left) 2026-02-17T05:34:00.280 INFO:tasks.rados.rados.0.trial118.stdout:1421: write oid 28 current snap is 146 2026-02-17T05:34:00.280 INFO:tasks.rados.rados.0.trial118.stdout:1421: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2026-02-17T05:34:00.284 INFO:tasks.rados.rados.0.trial118.stdout:1421: writing trial11845692-28 from 558131 to 1210558 tid 1 2026-02-17T05:34:00.288 INFO:tasks.rados.rados.0.trial118.stdout:1421: writing trial11845692-28 from 1673373 to 2233219 tid 2 2026-02-17T05:34:00.291 INFO:tasks.rados.rados.0.trial118.stdout:1421: writing trial11845692-28 from 2820808 to 2958131 tid 3 2026-02-17T05:34:00.291 INFO:tasks.rados.rados.0.trial118.stdout:1422: write (excl) oid 42 current snap is 146 2026-02-17T05:34:00.291 INFO:tasks.rados.rados.0.trial118.stdout:1422: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2026-02-17T05:34:00.296 INFO:tasks.rados.rados.0.trial118.stdout:1422: writing trial11845692-42 from 574938 to 1302614 tid 1 2026-02-17T05:34:00.300 INFO:tasks.rados.rados.0.trial118.stdout:1422: writing trial11845692-42 from 1731855 to 2435359 tid 2 2026-02-17T05:34:00.302 INFO:tasks.rados.rados.0.trial118.stdout:1422: writing trial11845692-42 from 2848231 to 2974938 tid 3 2026-02-17T05:34:00.302 INFO:tasks.rados.rados.0.trial118.stdout:1423: read oid 24 snap 145 2026-02-17T05:34:00.303 INFO:tasks.rados.rados.0.trial118.stdout:1423: expect (ObjNum 520 snap 143 seq_num 520) 2026-02-17T05:34:00.303 INFO:tasks.rados.rados.0.trial118.stdout:1424: read oid 15 snap -1 2026-02-17T05:34:00.303 INFO:tasks.rados.rados.0.trial118.stdout:1424: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-17T05:34:00.303 INFO:tasks.rados.rados.0.trial118.stdout:1425: snap_remove snap 137 2026-02-17T05:34:00.477 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-17T05:34:00.477 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T05:34:00.478 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T05:34:00.478 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:34:00.478 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:34:00.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: get_monmap_and_config 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: monmap: 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:00.545648+0000 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:00.545648+0000 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.554 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 1 Processor -- start 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 1 -- start start 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: init 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-a con 0x7fb8a005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.544+0000 7fb8a890c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a008b060 con 0x7fb8a005dee0 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a005dc90 con 0x7fb8a0182720 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a008d6a0 con 0x7fb8a005d1b0 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 10 monclient(hunting): authenticate will time out at 969.174017s 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a6681640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb8a005d1b0 0x7fb8a005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40800/0 (socket says 10.20.193.106:40800) 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a6681640 1 -- 10.20.193.106:0/1202404963 learned_addr learned my addr 10.20.193.106:0/1202404963 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620976406 0 0) 0x7fb8a008d6a0 con 0x7fb8a005d1b0 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): my global_id is 4700 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8900035e0 con 0x7fb8a005d1b0 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804071593 0 0) 0x7fb8a008b060 con 0x7fb8a005dee0 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient(hunting): my global_id is 64296 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a008d6a0 con 0x7fb8a005dee0 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 448326072 0 0) 0x7fb8a008d6a0 con 0x7fb8a005dee0 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 >> v1:10.20.193.106:6790/0 conn(0x7fb8a005d1b0 legacy=0x7fb8a005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 >> v1:10.20.193.118:6789/0 conn(0x7fb8a0182720 legacy=0x7fb8a01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 monclient: found mon.noname-a 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0057960 con 0x7fb8a005dee0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb88c002dd0 con 0x7fb8a005dee0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: dump: 2026-02-17T05:34:00.558 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 5 monclient: authenticate success, global_id 64296 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb88c003050 con 0x7fb8a005dee0 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 1 -- 10.20.193.106:0/1202404963 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb88c003420 con 0x7fb8a005dee0 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 4 set_mon_vals no callback set 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a567f640 10 monclient: dump: 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.560 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 10 monclient: shutdown 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- 10.20.193.106:0/1202404963 >> v1:10.20.193.106:6789/0 conn(0x7fb8a005dee0 legacy=0x7fb8a0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- 10.20.193.106:0/1202404963 shutdown_connections 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- 10.20.193.106:0/1202404963 >> 10.20.193.106:0/1202404963 conn(0x7fb8a00915f0 msgr2=0x7fb8a00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- 10.20.193.106:0/1202404963 shutdown_connections 2026-02-17T05:34:00.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.545+0000 7fb8a890c640 1 -- 10.20.193.106:0/1202404963 wait complete. 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient: monmap: 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 1 Processor -- start 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 1 -- start start 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient: init 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient(hunting): picked mon.noname-a con 0x7fb8a0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a010bda0 con 0x7fb8a0182720 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a010c370 con 0x7fb8a005d1b0 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a005e8e0 con 0x7fb8a005dee0 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a890c640 10 monclient(hunting): authenticate will time out at 969.175811s 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a5e80640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb8a005dee0 0x7fb8a0180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40816/0 (socket says 10.20.193.106:40816) 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb8a5e80640 1 -- 10.20.193.106:0/3599341743 learned_addr learned my addr 10.20.193.106:0/3599341743 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956559112 0 0) 0x7fb8a005e8e0 con 0x7fb8a005dee0 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb88affd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb88affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb88affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.546+0000 7fb88affd640 10 monclient(hunting): my global_id is 4703 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8700035e0 con 0x7fb8a005dee0 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909802009 0 0) 0x7fb8a010bda0 con 0x7fb8a0182720 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): my global_id is 64299 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a005e8e0 con 0x7fb8a0182720 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4186077401 0 0) 0x7fb8700035e0 con 0x7fb8a005dee0 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8a010bda0 con 0x7fb8a005dee0 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb88c002d90 con 0x7fb8a005dee0 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): dump: 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.565 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1118641472 0 0) 0x7fb8a005e8e0 con 0x7fb8a0182720 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8700035e0 con 0x7fb8a0182720 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb894004050 con 0x7fb8a0182720 2026-02-17T05:34:00.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): dump: 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.567 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686091213 0 0) 0x7fb8a010c370 con 0x7fb8a005d1b0 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient(hunting): my global_id is 84103 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a005e8e0 con 0x7fb8a005d1b0 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3972400453 0 0) 0x7fb8a010bda0 con 0x7fb8a005dee0 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 >> v1:10.20.193.118:6789/0 conn(0x7fb8a005d1b0 legacy=0x7fb8a0128610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 >> v1:10.20.193.106:6789/0 conn(0x7fb8a0182720 legacy=0x7fb8a01141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 monclient: found mon.c 2026-02-17T05:34:00.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a010a8b0 con 0x7fb8a005dee0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 5 monclient: authenticate success, global_id 4703 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _renew_subs 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a01824f0 con 0x7fb8a005dee0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _renew_subs 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8a0128270 con 0x7fb8a005dee0 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb88c003940 con 0x7fb8a005dee0 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb88c0029d0 con 0x7fb8a005dee0 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a4e7e640 4 set_mon_vals no callback set 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 10 monclient: dump: 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.570 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb88c003ca0 con 0x7fb8a005dee0 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.547+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a00008d0 con 0x7fb8a005dee0 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.548+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(311..311 src has 1..311) ==== 4019+0+0 (unknown 1295348385 0 0) 0x7fb88c04fe70 con 0x7fb8a005dee0 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.548+0000 7fb8a6681640 10 monclient: get_auth_request con 0x7fb870040dd0 auth_method 0 2026-02-17T05:34:00.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.550+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb88c0175a0 con 0x7fb8a005dee0 2026-02-17T05:34:00.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.550+0000 7fb88affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.550+0000 7fb88affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:00.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb8a890c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:34:00.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb8a890c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb8a890c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb8a008e3d0 con 0x7fb8a005dee0 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb88affd640 1 -- 10.20.193.106:0/3599341743 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1456104798) 0x7fb88c016d50 con 0x7fb8a005dee0 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb88affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.699+0000 7fb88affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:00.702 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:34:00.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 >> v1:10.20.193.118:6812/703720803 conn(0x7fb870040dd0 legacy=0x7fb870061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 10 monclient: shutdown 2026-02-17T05:34:00.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 >> v1:10.20.193.106:6790/0 conn(0x7fb8a005dee0 legacy=0x7fb8a0180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 shutdown_connections 2026-02-17T05:34:00.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 >> 10.20.193.106:0/3599341743 conn(0x7fb8a00915f0 msgr2=0x7fb8a01a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 shutdown_connections 2026-02-17T05:34:00.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.700+0000 7fb8a890c640 1 -- 10.20.193.106:0/3599341743 wait complete. 2026-02-17T05:34:00.709 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:34:00.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:34:00.710 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:34:00.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 10 monclient: get_monmap_and_config 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 10 monclient: monmap: 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:00.773851+0000 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:00.773851+0000 2026-02-17T05:34:00.785 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 1 Processor -- start 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 1 -- start start 2026-02-17T05:34:00.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.772+0000 7f307eb0c640 10 monclient: init 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f307805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f307805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3078182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307808b060 con 0x7f307805dee0 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307805dc90 con 0x7f307805d1b0 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307808d6a0 con 0x7f3078182720 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient(hunting): authenticate will time out at 969.402199s 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306ffff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f307805dee0 0x7f3078181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58268/0 (socket says 10.20.193.106:58268) 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306ffff640 1 -- 10.20.193.106:0/2965327321 learned_addr learned my addr 10.20.193.106:0/2965327321 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307d082640 1 --1- 10.20.193.106:0/2965327321 >> v1:10.20.193.106:6790/0 conn(0x7f3078182720 0x7f30781a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40818/0 (socket says 10.20.193.106:40818) 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339875163 0 0) 0x7f307808b060 con 0x7f307805dee0 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): my global_id is 64302 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30640035e0 con 0x7f307805dee0 2026-02-17T05:34:00.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490065531 0 0) 0x7f307808d6a0 con 0x7f3078182720 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): my global_id is 4706 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307808b060 con 0x7f3078182720 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878613183 0 0) 0x7f307805dc90 con 0x7f307805d1b0 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient(hunting): my global_id is 84106 2026-02-17T05:34:00.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307808d6a0 con 0x7f307805d1b0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2564303687 0 0) 0x7f30640035e0 con 0x7f307805dee0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 >> v1:10.20.193.106:6790/0 conn(0x7f3078182720 legacy=0x7f30781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 >> v1:10.20.193.118:6789/0 conn(0x7f307805d1b0 legacy=0x7f307805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 monclient: found mon.noname-a 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3078057960 con 0x7f307805dee0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3060002dd0 con 0x7f307805dee0 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 5 monclient: authenticate success, global_id 64302 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: dump: 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.791 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3060003050 con 0x7f307805dee0 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 1 -- 10.20.193.106:0/2965327321 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3060003460 con 0x7f307805dee0 2026-02-17T05:34:00.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 4 set_mon_vals no callback set 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f306f7fe640 10 monclient: dump: 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.793 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 10 monclient: shutdown 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.773+0000 7f307eb0c640 1 -- 10.20.193.106:0/2965327321 >> v1:10.20.193.106:6789/0 conn(0x7f307805dee0 legacy=0x7f3078181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 -- 10.20.193.106:0/2965327321 shutdown_connections 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 -- 10.20.193.106:0/2965327321 >> 10.20.193.106:0/2965327321 conn(0x7f30780915f0 msgr2=0x7f30780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 -- 10.20.193.106:0/2965327321 shutdown_connections 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 -- 10.20.193.106:0/2965327321 wait complete. 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 10 monclient: monmap: 2026-02-17T05:34:00.794 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 Processor -- start 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 1 -- start start 2026-02-17T05:34:00.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 10 monclient: init 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.774+0000 7f307eb0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f307805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f307805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3078182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307812c250 con 0x7f307805d1b0 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307805e8e0 con 0x7f3078182720 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3078128730 con 0x7f307805dee0 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient(hunting): authenticate will time out at 969.404032s 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306ffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f307805dee0 0x7f307812bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40820/0 (socket says 10.20.193.106:40820) 2026-02-17T05:34:00.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306ffff640 1 -- 10.20.193.106:0/2666930948 learned_addr learned my addr 10.20.193.106:0/2666930948 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307c881640 1 --1- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307805d1b0 0x7f307812b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58282/0 (socket says 10.20.193.106:58282) 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681499285 0 0) 0x7f3078128730 con 0x7f307805dee0 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): my global_id is 4709 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30480035e0 con 0x7f307805dee0 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624123280 0 0) 0x7f307812c250 con 0x7f307805d1b0 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): my global_id is 64305 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3078128730 con 0x7f307805d1b0 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2998706754 0 0) 0x7f30480035e0 con 0x7f307805dee0 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f307812c250 con 0x7f307805dee0 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3060003370 con 0x7f307805dee0 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.798 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2188173763 0 0) 0x7f3078128730 con 0x7f307805d1b0 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30480035e0 con 0x7f307805d1b0 2026-02-17T05:34:00.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3068003090 con 0x7f307805d1b0 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.800 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2936716539 0 0) 0x7f307812c250 con 0x7f307805dee0 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.118:6789/0 conn(0x7f3078182720 legacy=0x7f3078181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307805d1b0 legacy=0x7f307812b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 monclient: found mon.c 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307810bec0 con 0x7f307805dee0 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 5 monclient: authenticate success, global_id 4709 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient: _renew_subs 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f307810a9d0 con 0x7f307805dee0 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient: _renew_subs 2026-02-17T05:34:00.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f307810cd30 con 0x7f307805dee0 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3060002950 con 0x7f307805dee0 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3060004e60 con 0x7f307805dee0 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306effd640 4 set_mon_vals no callback set 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f306d7fa640 10 monclient: dump: 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.803 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.775+0000 7f307eb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f307810c9b0 con 0x7f307810a150 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379464083 0 0) 0x7f307810c9b0 con 0x7f307810a150 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient(hunting): my global_id is 64308 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307812c250 con 0x7f307810a150 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3060011e00 con 0x7f307805dee0 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(311..311 src has 1..311) ==== 4019+0+0 (unknown 1295348385 0 0) 0x7f306004ff30 con 0x7f307805dee0 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2952521359 0 0) 0x7f307812c250 con 0x7f307810a150 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f307810c9b0 con 0x7f307810a150 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3068003660 con 0x7f307810a150 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient: dump: 2026-02-17T05:34:00.805 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f307d082640 10 monclient: get_auth_request con 0x7f3048040b90 auth_method 0 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1648998189 0 0) 0x7f307810c9b0 con 0x7f307810a150 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3078057ca0 con 0x7f307810a150 2026-02-17T05:34:00.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3068005880 con 0x7f307810a150 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307810a150 legacy=0x7f3078059f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.776+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307810a150 legacy=0x7f3078059f40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f307eb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f307810b900 con 0x7f307810b530 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611715097 0 0) 0x7f307810b900 con 0x7f307810b530 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient(hunting): my global_id is 64311 2026-02-17T05:34:00.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307810c9b0 con 0x7f307810b530 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2665580889 0 0) 0x7f307810c9b0 con 0x7f307810b530 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f307810b900 con 0x7f307810b530 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3068004070 con 0x7f307810b530 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient: dump: 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.808 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1582620995 0 0) 0x7f307810b900 con 0x7f307810b530 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f307804d910 con 0x7f307810b530 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3436884673) 0x7f3068004410 con 0x7f307810b530 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307810b530 legacy=0x7f307804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.780+0000 7f306d7fa640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6789/0 conn(0x7f307810b530 legacy=0x7f307804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:00.810 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 238318, 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.811 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.812 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.813 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:00.814 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.815 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.816 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.817 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:00.818 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.819 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.820 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.821 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:00.822 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:00.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.118:6812/703720803 conn(0x7f3048040b90 legacy=0x7f3048061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 10 monclient: shutdown 2026-02-17T05:34:00.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 >> v1:10.20.193.106:6790/0 conn(0x7f307805dee0 legacy=0x7f307812bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307d082640 1 -- 10.20.193.106:0/2666930948 reap_dead start 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307d082640 1 -- 10.20.193.106:0/2666930948 reap_dead start 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 shutdown_connections 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 >> 10.20.193.106:0/2666930948 conn(0x7f30780915f0 msgr2=0x7f307813f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 shutdown_connections 2026-02-17T05:34:00.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.781+0000 7f307eb0c640 1 -- 10.20.193.106:0/2666930948 wait complete. 2026-02-17T05:34:00.824 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:00.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:34:00.824 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 10 monclient: get_monmap_and_config 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 10 monclient: monmap: 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:00.889778+0000 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:00.889778+0000 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:00.890 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 1 Processor -- start 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 1 -- start start 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.888+0000 7ff0f7007640 10 monclient: init 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-a con 0x7ff0f005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-b con 0x7ff0f005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-c con 0x7ff0f0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f008b060 con 0x7ff0f005d1b0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f005dc90 con 0x7ff0f0182720 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f008d6a0 con 0x7ff0f005dee0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient(hunting): authenticate will time out at 969.518180s 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f4d7c640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff0f005d1b0 0x7ff0f005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58318/0 (socket says 10.20.193.106:58318) 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f4d7c640 1 -- 10.20.193.106:0/433824878 learned_addr learned my addr 10.20.193.106:0/433824878 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902495527 0 0) 0x7ff0f008b060 con 0x7ff0f005d1b0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): my global_id is 64314 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0dc0035e0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379730839 0 0) 0x7ff0f008d6a0 con 0x7ff0f005dee0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): my global_id is 4712 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f008b060 con 0x7ff0f005dee0 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970922526 0 0) 0x7ff0f005dc90 con 0x7ff0f0182720 2026-02-17T05:34:00.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient(hunting): my global_id is 84112 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f008d6a0 con 0x7ff0f0182720 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1813400440 0 0) 0x7ff0dc0035e0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 >> v1:10.20.193.106:6790/0 conn(0x7ff0f005dee0 legacy=0x7ff0f0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 >> v1:10.20.193.118:6789/0 conn(0x7ff0f0182720 legacy=0x7ff0f01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 monclient: found mon.noname-a 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0057960 con 0x7ff0f005d1b0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 5 monclient: authenticate success, global_id 64314 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0e0002dd0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: dump: 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.897 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0e0003050 con 0x7ff0f005d1b0 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 1 -- 10.20.193.106:0/433824878 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0e0003460 con 0x7ff0f005d1b0 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0e77fe640 10 monclient: dump: 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.898 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 4 set_mon_vals no callback set 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 10 monclient: shutdown 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.889+0000 7ff0f7007640 1 -- 10.20.193.106:0/433824878 >> v1:10.20.193.106:6789/0 conn(0x7ff0f005d1b0 legacy=0x7ff0f005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- 10.20.193.106:0/433824878 shutdown_connections 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- 10.20.193.106:0/433824878 >> 10.20.193.106:0/433824878 conn(0x7ff0f00915f0 msgr2=0x7ff0f00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- 10.20.193.106:0/433824878 shutdown_connections 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- 10.20.193.106:0/433824878 wait complete. 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient: monmap: 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:00.899 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 Processor -- start 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- start start 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient: init 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-c con 0x7ff0f005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-a con 0x7ff0f005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient(hunting): picked mon.noname-b con 0x7ff0f0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f010e000 con 0x7ff0f005dee0 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f0089fa0 con 0x7ff0f0182720 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f01824f0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0f7007640 10 monclient(hunting): authenticate will time out at 969.519881s 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0e7fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff0f005dee0 0x7ff0f0180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58320/0 (socket says 10.20.193.106:58320) 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.890+0000 7ff0e7fff640 1 -- 10.20.193.106:0/2744969985 learned_addr learned my addr 10.20.193.106:0/2744969985 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265618234 0 0) 0x7ff0f010e000 con 0x7ff0f005dee0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): my global_id is 64317 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0c00035e0 con 0x7ff0f005dee0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050188208 0 0) 0x7ff0f01824f0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): my global_id is 4715 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f010e000 con 0x7ff0f005d1b0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 708676786 0 0) 0x7ff0c00035e0 con 0x7ff0f005dee0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0f01824f0 con 0x7ff0f005dee0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0d8003090 con 0x7ff0f005dee0 2026-02-17T05:34:00.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2197436262 0 0) 0x7ff0f010e000 con 0x7ff0f005d1b0 2026-02-17T05:34:00.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0c00035e0 con 0x7ff0f005d1b0 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0e0003370 con 0x7ff0f005d1b0 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2283961622 0 0) 0x7ff0f01824f0 con 0x7ff0f005dee0 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6790/0 conn(0x7ff0f005d1b0 legacy=0x7ff0f012a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.118:6789/0 conn(0x7ff0f0182720 legacy=0x7ff0f0118420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 monclient: found mon.a 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f010ee70 con 0x7ff0f005dee0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 5 monclient: authenticate success, global_id 64317 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 10 monclient: _renew_subs 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f010e5d0 con 0x7ff0f005dee0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 10 monclient: _renew_subs 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0f010da40 con 0x7ff0f005dee0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0d80036d0 con 0x7ff0f005dee0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0d8003ab0 con 0x7ff0f005dee0 2026-02-17T05:34:00.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 10 monclient: dump: 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e6ffd640 4 set_mon_vals no callback set 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0f00008d0 con 0x7ff0f012ace0 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.891+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff0d8003c10 con 0x7ff0f005dee0 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(311..311 src has 1..311) ==== 4019+0+0 (unknown 1295348385 0 0) 0x7ff0d804fd20 con 0x7ff0f005dee0 2026-02-17T05:34:00.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773033349 0 0) 0x7ff0f00008d0 con 0x7ff0f012ace0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient(hunting): my global_id is 4718 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f01824f0 con 0x7ff0f012ace0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0f557d640 10 monclient: get_auth_request con 0x7ff0c0040c10 auth_method 0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1944925541 0 0) 0x7ff0f01824f0 con 0x7ff0f012ace0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0f00008d0 con 0x7ff0f012ace0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0e0004a00 con 0x7ff0f012ace0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient: dump: 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.906 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 355111675 0 0) 0x7ff0f00008d0 con 0x7ff0f012ace0 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0f0057ca0 con 0x7ff0f012ace0 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff0e0004e40 con 0x7ff0f012ace0 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6790/0 conn(0x7ff0f012ace0 legacy=0x7ff0f0059fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.892+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6790/0 conn(0x7ff0f012ace0 legacy=0x7ff0f0059fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0f7007640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:00.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0f010ea50 con 0x7ff0f004d200 2026-02-17T05:34:00.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724950589 0 0) 0x7ff0f010ea50 con 0x7ff0f004d200 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient(hunting): my global_id is 4721 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f00008d0 con 0x7ff0f004d200 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 303121223 0 0) 0x7ff0f00008d0 con 0x7ff0f004d200 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0f010ea50 con 0x7ff0f004d200 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff0e0005580 con 0x7ff0f004d200 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 10 monclient: dump: 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.909 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2999402817 0 0) 0x7ff0f010ea50 con 0x7ff0f004d200 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.896+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0f008e3d0 con 0x7ff0f004d200 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 677605726) 0x7ff0e0006ac0 con 0x7ff0f004d200 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0e57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0e57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6790/0 conn(0x7ff0f004d200 legacy=0x7ff0f011ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0e57fa640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6790/0 conn(0x7ff0f004d200 legacy=0x7ff0f011ab50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:00.910 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 365657, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.911 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.912 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:00.913 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:00.914 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.915 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.916 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:00.917 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.918 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.919 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:00.920 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.118:6812/703720803 conn(0x7ff0c0040c10 legacy=0x7ff0c00610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 10 monclient: shutdown 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 >> v1:10.20.193.106:6789/0 conn(0x7ff0f005dee0 legacy=0x7ff0f0180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f557d640 1 -- 10.20.193.106:0/2744969985 reap_dead start 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f557d640 1 -- 10.20.193.106:0/2744969985 reap_dead start 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 shutdown_connections 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 >> 10.20.193.106:0/2744969985 conn(0x7ff0f00915f0 msgr2=0x7ff0f008c300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 shutdown_connections 2026-02-17T05:34:00.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.897+0000 7ff0f7007640 1 -- 10.20.193.106:0/2744969985 wait complete. 2026-02-17T05:34:00.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:00.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:34:00.922 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.986+0000 7f227f10c640 10 monclient: get_monmap_and_config 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.986+0000 7f227f10c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient: monmap: 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:00.988390+0000 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:00.988390+0000 2026-02-17T05:34:00.988 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.989 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.989 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.989 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:00.989 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:00.989 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 1 Processor -- start 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 1 -- start start 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient: init 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-a con 0x7f227805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-b con 0x7f227805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-c con 0x7f2278182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227808b060 con 0x7f227805d1b0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227805dc90 con 0x7f2278182720 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227808d6a0 con 0x7f227805dee0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227f10c640 10 monclient(hunting): authenticate will time out at 969.616764s 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227ce81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f227805d1b0 0x7f227805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58326/0 (socket says 10.20.193.106:58326) 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.987+0000 7f227ce81640 1 -- 10.20.193.106:0/3967448492 learned_addr learned my addr 10.20.193.106:0/3967448492 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818226875 0 0) 0x7f227808d6a0 con 0x7f227805dee0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): my global_id is 4724 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22640035e0 con 0x7f227805dee0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977671211 0 0) 0x7f227808b060 con 0x7f227805d1b0 2026-02-17T05:34:00.990 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient(hunting): my global_id is 64320 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f227808d6a0 con 0x7f227805d1b0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4248500409 0 0) 0x7f22640035e0 con 0x7f227805dee0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 >> v1:10.20.193.118:6789/0 conn(0x7f2278182720 legacy=0x7f22781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 >> v1:10.20.193.106:6789/0 conn(0x7f227805d1b0 legacy=0x7f227805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 monclient: found mon.noname-b 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278057960 con 0x7f227805dee0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2260002dd0 con 0x7f227805dee0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: dump: 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 5 monclient: authenticate success, global_id 4724 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2260003010 con 0x7f227805dee0 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.991 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 4 set_mon_vals no callback set 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 1 -- 10.20.193.106:0/3967448492 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2260003420 con 0x7f227805dee0 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f226f7fe640 10 monclient: dump: 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 10 monclient: shutdown 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 1 -- 10.20.193.106:0/3967448492 >> v1:10.20.193.106:6790/0 conn(0x7f227805dee0 legacy=0x7f2278181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 1 -- 10.20.193.106:0/3967448492 shutdown_connections 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 1 -- 10.20.193.106:0/3967448492 >> 10.20.193.106:0/3967448492 conn(0x7f22780915f0 msgr2=0x7f22780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 1 -- 10.20.193.106:0/3967448492 shutdown_connections 2026-02-17T05:34:00.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.988+0000 7f227f10c640 1 -- 10.20.193.106:0/3967448492 wait complete. 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: build_initial_monmap 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: monmap: 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 Processor -- start 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 -- start start 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: init 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-b con 0x7f227805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-c con 0x7f227805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient(hunting): picked mon.noname-a con 0x7f2278182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227805e8e0 con 0x7f2278182720 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227810f0e0 con 0x7f227805d1b0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227813f390 con 0x7f227805dee0 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient(hunting): authenticate will time out at 969.618497s 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226ffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f227805dee0 0x7f227813d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40872/0 (socket says 10.20.193.106:40872) 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227d682640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2278182720 0x7f2278181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58332/0 (socket says 10.20.193.106:58332) 2026-02-17T05:34:00.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226ffff640 1 -- 10.20.193.106:0/2244155051 learned_addr learned my addr 10.20.193.106:0/2244155051 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858866876 0 0) 0x7f227805e8e0 con 0x7f2278182720 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): my global_id is 64323 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22480035e0 con 0x7f2278182720 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501093611 0 0) 0x7f227813f390 con 0x7f227805dee0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): my global_id is 4727 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f227805e8e0 con 0x7f227805dee0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1171147084 0 0) 0x7f22480035e0 con 0x7f2278182720 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f227813f390 con 0x7f2278182720 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2274004110 con 0x7f2278182720 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 663710038 0 0) 0x7f227805e8e0 con 0x7f227805dee0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22480035e0 con 0x7f227805dee0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2260003330 con 0x7f227805dee0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient(hunting): dump: 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.995 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3731312371 0 0) 0x7f227813f390 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.106:6790/0 conn(0x7f227805dee0 legacy=0x7f227813d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6789/0 conn(0x7f227805d1b0 legacy=0x7f227813cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient: _finish_hunting 0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 monclient: found mon.a 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227805ce90 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient: _finish_auth 0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 10 monclient: _check_auth_tickets 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f226d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 5 monclient: authenticate success, global_id 64323 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: _renew_subs 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.989+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22781824f0 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f227f10c640 10 monclient: _renew_subs 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f227f10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2278089a00 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22740047b0 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2274004b50 con 0x7f2278182720 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 10 monclient: dump: 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.996 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226effd640 4 set_mon_vals no callback set 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f227f10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f227808a010 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2274004cb0 con 0x7f2278182720 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(311..311 src has 1..311) ==== 4019+0+0 (unknown 1295348385 0 0) 0x7f2274050e70 con 0x7f2278182720 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.990+0000 7f226ffff640 10 monclient: get_auth_request con 0x7f2248040c40 auth_method 0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337195349 0 0) 0x7f227808a010 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient(hunting): my global_id is 84124 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f227813f390 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2743230438 0 0) 0x7f227813f390 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f227808a010 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2268002f00 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient: dump: 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1475475460 0 0) 0x7f227808a010 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2278057cd0 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2268003380 con 0x7f227812d7c0 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:00.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6789/0 conn(0x7f227812d7c0 legacy=0x7f227805a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.991+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6789/0 conn(0x7f227812d7c0 legacy=0x7f227805a010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f227f10c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f227812db90 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936930918 0 0) 0x7f227812db90 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 10 monclient(hunting): my global_id is 84127 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.995+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f227808a010 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 855439957 0 0) 0x7f227808a010 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f227812db90 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2268004cf0 con 0x7f227804d200 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 10 monclient: dump: 2026-02-17T05:34:00.998 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2495079234 0 0) 0x7f227812db90 con 0x7f227804d200 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2278055570 con 0x7f227804d200 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 324717896) 0x7f2268005990 con 0x7f227804d200 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6789/0 conn(0x7f227804d200 legacy=0x7f227811b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f226d7fa640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6789/0 conn(0x7f227804d200 legacy=0x7f227811b6a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 15463, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:00.999 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:01.000 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:01.001 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:01.002 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:01.003 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.118:6812/703720803 conn(0x7f2248040c40 legacy=0x7f22480610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 10 monclient: shutdown 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 >> v1:10.20.193.106:6789/0 conn(0x7f2278182720 legacy=0x7f2278181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227d682640 1 -- 10.20.193.106:0/2244155051 reap_dead start 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227d682640 1 -- 10.20.193.106:0/2244155051 reap_dead start 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 shutdown_connections 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 >> 10.20.193.106:0/2244155051 conn(0x7f22780915f0 msgr2=0x7f2278054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 shutdown_connections 2026-02-17T05:34:01.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:00.996+0000 7f227f10c640 1 -- 10.20.193.106:0/2244155051 wait complete. 2026-02-17T05:34:01.004 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:01.004 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:34:01.005 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.067+0000 7fb22afc2640 10 monclient: get_monmap_and_config 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.067+0000 7fb22afc2640 10 monclient: build_initial_monmap 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.067+0000 7fb22afc2640 10 monclient: monmap: 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:01.069017+0000 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:01.069017+0000 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:01.069 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 1 Processor -- start 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 1 -- start start 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient: init 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-a con 0x7fb22413bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-c con 0x7fb22408d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-b con 0x7fb2241849f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22405cca0 con 0x7fb22413bb70 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22413c650 con 0x7fb22408d4f0 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22405e010 con 0x7fb2241849f0 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 10 monclient(hunting): authenticate will time out at 969.697425s 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb229538640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb2241849f0 0x7fb2241a4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40886/0 (socket says 10.20.193.106:40886) 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb229538640 1 -- 10.20.193.106:0/130047015 learned_addr learned my addr 10.20.193.106:0/130047015 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:01.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb228d37640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb22413bb70 0x7fb22413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58348/0 (socket says 10.20.193.106:58348) 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996736593 0 0) 0x7fb22405cca0 con 0x7fb22413bb70 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): my global_id is 64326 2026-02-17T05:34:01.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2100035e0 con 0x7fb22413bb70 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283036544 0 0) 0x7fb22405e010 con 0x7fb2241849f0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): my global_id is 4730 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22405cca0 con 0x7fb2241849f0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806629344 0 0) 0x7fb22413c650 con 0x7fb22408d4f0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient(hunting): my global_id is 84130 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22405e010 con 0x7fb22408d4f0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570451138 0 0) 0x7fb2100035e0 con 0x7fb22413bb70 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 >> v1:10.20.193.106:6790/0 conn(0x7fb2241849f0 legacy=0x7fb2241a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 >> v1:10.20.193.118:6789/0 conn(0x7fb22408d4f0 legacy=0x7fb2241832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 monclient: found mon.noname-a 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22408d950 con 0x7fb22413bb70 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: _finish_auth 0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb214002d00 con 0x7fb22413bb70 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb21b7fe640 10 monclient: dump: 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:01.073 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 5 monclient: authenticate success, global_id 64326 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.068+0000 7fb22afc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb214002f10 con 0x7fb22413bb70 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 1 -- 10.20.193.106:0/130047015 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb214003320 con 0x7fb22413bb70 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb21b7fe640 10 monclient: dump: 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 4 set_mon_vals no callback set 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 10 monclient: shutdown 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- 10.20.193.106:0/130047015 >> v1:10.20.193.106:6789/0 conn(0x7fb22413bb70 legacy=0x7fb22413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- 10.20.193.106:0/130047015 shutdown_connections 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- 10.20.193.106:0/130047015 >> 10.20.193.106:0/130047015 conn(0x7fb2240915f0 msgr2=0x7fb2240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- 10.20.193.106:0/130047015 shutdown_connections 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- 10.20.193.106:0/130047015 wait complete. 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 10 monclient: build_initial_monmap 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 10 monclient: monmap: 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:01.074 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 Processor -- start 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 1 -- start start 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.069+0000 7fb22afc2640 10 monclient: init 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-b con 0x7fb22408d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-c con 0x7fb22413bb70 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient(hunting): picked mon.noname-a con 0x7fb2241849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22408a110 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22413b250 con 0x7fb22408d4f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22412a2a0 con 0x7fb22413bb70 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient(hunting): authenticate will time out at 969.699097s 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb21bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb22413bb70 0x7fb224127df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40892/0 (socket says 10.20.193.106:40892) 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb229538640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb2241849f0 0x7fb224180b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58360/0 (socket says 10.20.193.106:58360) 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb21bfff640 1 -- 10.20.193.106:0/1854287501 learned_addr learned my addr 10.20.193.106:0/1854287501 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130016488 0 0) 0x7fb22408a110 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): my global_id is 64329 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f40035e0 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195447532 0 0) 0x7fb22412a2a0 con 0x7fb22413bb70 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _negotiate 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): my global_id is 4733 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22408a110 con 0x7fb22413bb70 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1675188133 0 0) 0x7fb1f40035e0 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb22412a2a0 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb220004070 con 0x7fb2241849f0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): dump: 2026-02-17T05:34:01.075 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2043716758 0 0) 0x7fb22408a110 con 0x7fb22413bb70 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f40035e0 con 0x7fb22413bb70 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb20c003170 con 0x7fb22413bb70 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient(hunting): dump: 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 565163333 0 0) 0x7fb22412a2a0 con 0x7fb2241849f0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 >> v1:10.20.193.106:6790/0 conn(0x7fb22413bb70 legacy=0x7fb224127df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 >> v1:10.20.193.118:6789/0 conn(0x7fb22408d4f0 legacy=0x7fb2241276e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: _finish_hunting 0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 monclient: found mon.a 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224128500 con 0x7fb2241849f0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: _finish_auth 0 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: _check_auth_tickets 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:01.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 5 monclient: authenticate success, global_id 64329 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _renew_subs 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb22405e8e0 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _renew_subs 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2241a5ac0 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2200041d0 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb220005b30 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb2197fa640 10 monclient: dump: 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.070+0000 7fb21affd640 4 set_mon_vals no callback set 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb22afc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb22afc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb22afc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22412a080 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb220012ad0 con 0x7fb2241849f0 2026-02-17T05:34:01.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(311..311 src has 1..311) ==== 4019+0+0 (unknown 1295348385 0 0) 0x7fb220050ce0 con 0x7fb2241849f0 2026-02-17T05:34:01.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.071+0000 7fb228d37640 10 monclient: get_auth_request con 0x7fb1f4040bf0 auth_method 0 2026-02-17T05:34:01.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.073+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb220018350 con 0x7fb2241849f0 2026-02-17T05:34:01.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.074+0000 7fb2197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:01.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.074+0000 7fb2197fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:01.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.221+0000 7fb22afc2640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:34:01.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.221+0000 7fb22afc2640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:34:01.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.221+0000 7fb22afc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:01.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.221+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb224055570 con 0x7fb2241849f0 2026-02-17T05:34:01.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.222+0000 7fb2197fa640 1 -- 10.20.193.106:0/1854287501 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fb220017b00 con 0x7fb2241849f0 2026-02-17T05:34:01.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.222+0000 7fb2197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:34:01.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.222+0000 7fb2197fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:01.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=2851992889,config=1618278320,health=3525617350,kv=675723720,logm=3730738735}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=1267923693,config=1618278320,health=3525617350,kv=675723720,logm=2689625061}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=2851992889,config=1618278320,health=3525617350,kv=675723720,logm=3730738735}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1123749272,config=1618278320,health=3334215241,kv=675723720,logm=3593997230}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=135906523}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726581408}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=135906523}) 2026-02-17T05:34:01.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4127607839}) 2026-02-17T05:34:01.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 >> v1:10.20.193.118:6812/703720803 conn(0x7fb1f4040bf0 legacy=0x7fb1f40610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 10 monclient: shutdown 2026-02-17T05:34:01.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:01.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 >> v1:10.20.193.106:6789/0 conn(0x7fb2241849f0 legacy=0x7fb224180b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:01.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 shutdown_connections 2026-02-17T05:34:01.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 >> 10.20.193.106:0/1854287501 conn(0x7fb2240915f0 msgr2=0x7fb224054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:01.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3390911906}) 2026-02-17T05:34:01.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021542417}) 2026-02-17T05:34:01.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 shutdown_connections 2026-02-17T05:34:01.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3390911906}) 2026-02-17T05:34:01.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:01.223+0000 7fb22afc2640 1 -- 10.20.193.106:0/1854287501 wait complete. 2026-02-17T05:34:01.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=740366245}) 2026-02-17T05:34:01.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3854537180}) 2026-02-17T05:34:01.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=194805873}) 2026-02-17T05:34:01.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3854537180}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1096175510}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3337100900}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=765654045}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3337100900}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=736554042}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560328295}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=770447555}) 2026-02-17T05:34:01.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560328295}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4178967270}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3428609718}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597941309}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3428609718}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2824528686}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1655891889}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1188018791}) 2026-02-17T05:34:01.238 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1655891889}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2539150727}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2847846880}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033326341}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2847846880}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899169407}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316423888}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=755131428}) 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.239 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316423888}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1227849505}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316057721}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=876290082}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316057721}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1619330560}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2983693699}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304498261}) 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.240 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2983693699}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1665393107}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=25} crc {logm=1343659233,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=479665737,mon_config_key=3856452920,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=3983023349,osd_pg_creating=2282455559,osd_snap=3865643215}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=24} crc {logm=2559517425,mdsmap=568353036,mgr=2383830119,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=3650146887,mon_config_key=597233681,monmap=3140514009,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=2282455559,osd_snap=2796935571}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=25} crc {logm=1343659233,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=479665737,mon_config_key=3856452920,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=3983023349,osd_pg_creating=2282455559,osd_snap=3865643215}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=33,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=25} crc {logm=3582651143,mdsmap=568353036,mgr=3324194213,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=479665737,mon_config_key=1256237312,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=2282455559,osd_snap=990670274}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=14,osdmap=86} crc {osd_snap=1764649697,osdmap=1090717491}) 2026-02-17T05:34:01.241 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=14,osdmap=86} crc {osd_snap=2589077519,osdmap=2850939358}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=14,osdmap=86} crc {osd_snap=1764649697,osdmap=1090717491}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=13,osdmap=87} crc {osd_snap=3865515826,osdmap=838842532}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3548973406}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2121351895}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3548973406}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3734345049}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3236275361}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2680125754}) 2026-02-17T05:34:01.242 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3236275361}) 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2785101722}) 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1956570988}) 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2026485739}) 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1956570988}) 2026-02-17T05:34:01.243 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=677640410}) 2026-02-17T05:34:01.244 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:34:01.245 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.245 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=75} crc {osdmap=2529727680}) 2026-02-17T05:34:01.245 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=75} crc {osdmap=1167442042}) 2026-02-17T05:34:01.245 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:34:01.245 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=75} crc {osdmap=2529727680}) 2026-02-17T05:34:01.246 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:34:01.233+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=75} crc {osdmap=3409359995}) 2026-02-17T05:34:01.297 INFO:tasks.rados.rados.0.trial118.stdout:1425: done (9 left) 2026-02-17T05:34:01.297 INFO:tasks.rados.rados.0.trial118.stdout:1426: copy_from oid 23 from oid 33 current snap is 146 2026-02-17T05:34:01.298 INFO:tasks.rados.rados.0.trial118.stdout:1418: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:34:01.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:34:01.298 INFO:tasks.rados.rados.0.trial118.stdout:1419: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:34:01.315 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1766222 2026-02-17T05:34:01.369 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1945165 2026-02-17T05:34:01.448 INFO:tasks.rados.rados.0.trial118.stdout:1415: finishing copy_from racing read to trial11845692-48 2026-02-17T05:34:01.448 INFO:tasks.rados.rados.0.trial118.stdout:1418: done (9 left) 2026-02-17T05:34:01.448 INFO:tasks.rados.rados.0.trial118.stdout:1419: done (8 left) 2026-02-17T05:34:01.448 INFO:tasks.rados.rados.0.trial118.stdout:1427: write (excl) oid 45 current snap is 146 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1415: finishing copy_from to trial11845692-48 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 675 (ObjNum 479 snap 125 seq_num 479) dirty exists 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1416: finishing copy_from racing read to trial11845692-38 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1416: finishing copy_from to trial11845692-38 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 586 (ObjNum 496 snap 134 seq_num 496) dirty exists 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1417: finishing copy_from racing read to trial11845692-8 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1417: finishing copy_from to trial11845692-8 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 348 (ObjNum 526 snap 144 seq_num 526) dirty exists 2026-02-17T05:34:01.449 INFO:tasks.rados.rados.0.trial118.stdout:1427: seq_num 535 ranges {591745=402925,1790337=563515} 2026-02-17T05:34:01.451 INFO:tasks.rados.rados.0.trial118.stdout:1427: writing trial11845692-45 from 591745 to 994670 tid 1 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1427: writing trial11845692-45 from 1790337 to 2353852 tid 2 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1415: done (8 left) 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1416: done (7 left) 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1417: done (6 left) 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1428: snap_create 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: finishing write tid 1 to trial11845692-28 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: finishing write tid 2 to trial11845692-28 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: finishing write tid 3 to trial11845692-28 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: finishing write tid 4 to trial11845692-28 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: finishing write tid 5 to trial11845692-28 2026-02-17T05:34:01.457 INFO:tasks.rados.rados.0.trial118.stdout:1421: oid 28 updating version 0 to 358 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1421: oid 28 updating version 358 to 360 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1421: oid 28 version 360 is already newer than 359 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1421: oid 28 updating version 360 to 361 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 361 (ObjNum 533 snap 146 seq_num 533) dirty exists 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1421: left oid 28 (ObjNum 533 snap 146 seq_num 533) 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1422: finishing write tid 1 to trial11845692-42 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1422: finishing write tid 2 to trial11845692-42 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1422: finishing write tid 3 to trial11845692-42 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1422: finishing write tid 4 to trial11845692-42 2026-02-17T05:34:01.458 INFO:tasks.rados.rados.0.trial118.stdout:1424: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-17T05:34:01.514 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2876240 2026-02-17T05:34:01.526 INFO:tasks.rados.rados.0.trial118.stdout:1422: finishing write tid 5 to trial11845692-42 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1422: oid 42 updating version 0 to 733 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1422: oid 42 updating version 733 to 734 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1422: oid 42 updating version 734 to 735 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1422: oid 42 updating version 735 to 736 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 736 (ObjNum 534 snap 146 seq_num 534) dirty exists 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1422: left oid 42 (ObjNum 534 snap 146 seq_num 534) 2026-02-17T05:34:01.527 INFO:tasks.rados.rados.0.trial118.stdout:1423: expect (ObjNum 520 snap 143 seq_num 520) 2026-02-17T05:34:01.550 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:01.580 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:01.610 INFO:tasks.rados.rados.0.trial118.stdout:1426: finishing copy_from racing read to trial11845692-23 2026-02-17T05:34:01.610 INFO:tasks.rados.rados.0.trial118.stdout:1426: finishing copy_from to trial11845692-23 2026-02-17T05:34:01.610 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 402 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:34:01.610 INFO:tasks.rados.rados.0.trial118.stdout:1427: finishing write tid 1 to trial11845692-45 2026-02-17T05:34:01.610 INFO:tasks.rados.rados.0.trial118.stdout:1427: finishing write tid 2 to trial11845692-45 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: finishing write tid 3 to trial11845692-45 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: finishing write tid 4 to trial11845692-45 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: oid 45 updating version 0 to 677 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: oid 45 version 677 is already newer than 676 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: oid 45 updating version 677 to 678 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 678 (ObjNum 535 snap 146 seq_num 535) dirty exists 2026-02-17T05:34:01.611 INFO:tasks.rados.rados.0.trial118.stdout:1427: left oid 45 (ObjNum 535 snap 146 seq_num 535) 2026-02-17T05:34:02.245 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:34:02.246 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:34:02.301 INFO:tasks.rados.rados.0.trial118.stdout:1421: done (6 left) 2026-02-17T05:34:02.301 INFO:tasks.rados.rados.0.trial118.stdout:1422: done (5 left) 2026-02-17T05:34:02.301 INFO:tasks.rados.rados.0.trial118.stdout:1423: done (4 left) 2026-02-17T05:34:02.301 INFO:tasks.rados.rados.0.trial118.stdout:1424: done (3 left) 2026-02-17T05:34:02.301 INFO:tasks.rados.rados.0.trial118.stdout:1426: done (2 left) 2026-02-17T05:34:02.302 INFO:tasks.rados.rados.0.trial118.stdout:1427: done (1 left) 2026-02-17T05:34:02.302 INFO:tasks.rados.rados.0.trial118.stdout:1428: done (0 left) 2026-02-17T05:34:02.302 INFO:tasks.rados.rados.0.trial118.stdout:1429: write (excl) oid 20 current snap is 147 2026-02-17T05:34:02.302 INFO:tasks.rados.rados.0.trial118.stdout:1429: seq_num 536 ranges {608552=478174,1848819=707173} 2026-02-17T05:34:02.304 INFO:tasks.rados.rados.0.trial118.stdout:1429: writing trial11845692-20 from 608552 to 1086726 tid 1 2026-02-17T05:34:02.310 INFO:tasks.rados.rados.0.trial118.stdout:1429: writing trial11845692-20 from 1848819 to 2555992 tid 2 2026-02-17T05:34:02.310 INFO:tasks.rados.rados.0.trial118.stdout:1430: read oid 9 snap 145 2026-02-17T05:34:02.311 INFO:tasks.rados.rados.0.trial118.stdout:1430: expect (ObjNum 508 snap 137 seq_num 508) 2026-02-17T05:34:02.311 INFO:tasks.rados.rados.0.trial118.stdout:1431: copy_from oid 17 from oid 26 current snap is 147 2026-02-17T05:34:02.311 INFO:tasks.rados.rados.0.trial118.stdout:1429: finishing write tid 1 to trial11845692-20 2026-02-17T05:34:02.311 INFO:tasks.rados.rados.0.trial118.stdout:1432: snap_create 2026-02-17T05:34:02.312 INFO:tasks.rados.rados.0.trial118.stdout:1429: finishing write tid 2 to trial11845692-20 2026-02-17T05:34:02.312 INFO:tasks.rados.rados.0.trial118.stdout:1429: finishing write tid 3 to trial11845692-20 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:1429: finishing write tid 4 to trial11845692-20 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:1429: oid 20 updating version 0 to 830 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:1429: oid 20 version 830 is already newer than 829 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:1429: oid 20 version 830 is already newer than 828 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 830 (ObjNum 536 snap 147 seq_num 536) dirty exists 2026-02-17T05:34:02.313 INFO:tasks.rados.rados.0.trial118.stdout:1429: left oid 20 (ObjNum 536 snap 147 seq_num 536) 2026-02-17T05:34:02.314 INFO:tasks.rados.rados.0.trial118.stdout:1430: expect (ObjNum 508 snap 137 seq_num 508) 2026-02-17T05:34:02.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: monmap: 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.315 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.314620+0000 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.314620+0000 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 1 Processor -- start 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 1 -- start start 2026-02-17T05:34:02.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: init 2026-02-17T05:34:02.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.313+0000 7f20b42cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-c con 0x7f20ac13ec40 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-b con 0x7f20ac13f010 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-a con 0x7f20ac1811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac08a7d0 con 0x7f20ac1811f0 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac08d5c0 con 0x7f20ac13ec40 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac08d800 con 0x7f20ac13f010 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient(hunting): authenticate will time out at 970.943052s 2026-02-17T05:34:02.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b2842640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f20ac1811f0 0x7f20ac1a15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58372/0 (socket says 10.20.193.106:58372) 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b2842640 1 -- 10.20.193.106:0/1012347083 learned_addr learned my addr 10.20.193.106:0/1012347083 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b1840640 1 --1- 10.20.193.106:0/1012347083 >> v1:10.20.193.106:6790/0 conn(0x7f20ac13f010 0x7f20ac13f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40902/0 (socket says 10.20.193.106:40902) 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864670291 0 0) 0x7f20ac08a7d0 con 0x7f20ac1811f0 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): my global_id is 64332 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20940035e0 con 0x7f20ac1811f0 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053851173 0 0) 0x7f20ac08d800 con 0x7f20ac13f010 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient(hunting): my global_id is 4736 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ac08a7d0 con 0x7f20ac13f010 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 401948070 0 0) 0x7f20940035e0 con 0x7f20ac1811f0 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 >> v1:10.20.193.106:6790/0 conn(0x7f20ac13f010 legacy=0x7f20ac13f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 >> v1:10.20.193.118:6789/0 conn(0x7f20ac13ec40 legacy=0x7f20ac08ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 monclient: found mon.noname-a 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac08a180 con 0x7f20ac1811f0 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 5 monclient: authenticate success, global_id 64332 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f20a8003eb0 con 0x7f20ac1811f0 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: dump: 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.327 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20a80040b0 con 0x7f20ac1811f0 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 1 -- 10.20.193.106:0/1012347083 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f20a80044c0 con 0x7f20ac1811f0 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b42cc640 4 set_mon_vals no callback set 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.314+0000 7f20b103f640 10 monclient: dump: 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.329 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: shutdown 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- 10.20.193.106:0/1012347083 >> v1:10.20.193.106:6789/0 conn(0x7f20ac1811f0 legacy=0x7f20ac1a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- 10.20.193.106:0/1012347083 shutdown_connections 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- 10.20.193.106:0/1012347083 >> 10.20.193.106:0/1012347083 conn(0x7f20ac0915f0 msgr2=0x7f20ac0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- 10.20.193.106:0/1012347083 shutdown_connections 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- 10.20.193.106:0/1012347083 wait complete. 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: monmap: 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.330 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 Processor -- start 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- start start 2026-02-17T05:34:02.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: init 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-c con 0x7f20ac13ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-a con 0x7f20ac13f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient(hunting): picked mon.noname-b con 0x7f20ac1811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac13bf00 con 0x7f20ac13f010 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac1a0a70 con 0x7f20ac1811f0 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac0585e0 con 0x7f20ac13ec40 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b42cc640 10 monclient(hunting): authenticate will time out at 970.944916s 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b2041640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f20ac13ec40 0x7f20ac0577c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40912/0 (socket says 10.20.193.106:40912) 2026-02-17T05:34:02.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.315+0000 7f20b2041640 1 -- 10.20.193.106:0/2244958864 learned_addr learned my addr 10.20.193.106:0/2244958864 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466236965 0 0) 0x7f20ac0585e0 con 0x7f20ac13ec40 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): my global_id is 4739 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f207c0035e0 con 0x7f20ac13ec40 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387642152 0 0) 0x7f20ac13bf00 con 0x7f20ac13f010 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): my global_id is 64335 2026-02-17T05:34:02.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ac0585e0 con 0x7f20ac13f010 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3191647563 0 0) 0x7f207c0035e0 con 0x7f20ac13ec40 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20ac13bf00 con 0x7f20ac13ec40 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f209c0030a0 con 0x7f20ac13ec40 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): dump: 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.334 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 709502647 0 0) 0x7f20ac0585e0 con 0x7f20ac13f010 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f207c0035e0 con 0x7f20ac13f010 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f20a00030f0 con 0x7f20ac13f010 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): dump: 2026-02-17T05:34:02.335 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036979452 0 0) 0x7f20ac1a0a70 con 0x7f20ac1811f0 2026-02-17T05:34:02.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient(hunting): my global_id is 84139 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ac0585e0 con 0x7f20ac1811f0 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 799555199 0 0) 0x7f20ac13bf00 con 0x7f20ac13ec40 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 >> v1:10.20.193.118:6789/0 conn(0x7f20ac1811f0 legacy=0x7f20ac18e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 >> v1:10.20.193.106:6789/0 conn(0x7f20ac13f010 legacy=0x7f20ac057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 monclient: found mon.c 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac05e8e0 con 0x7f20ac13ec40 2026-02-17T05:34:02.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 5 monclient: authenticate success, global_id 4739 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 10 monclient: _renew_subs 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac1a0790 con 0x7f20ac13ec40 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 10 monclient: _renew_subs 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f20ac19fb10 con 0x7f20ac13ec40 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f209c003410 con 0x7f20ac13ec40 2026-02-17T05:34:02.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f209c003b30 con 0x7f20ac13ec40 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f2092ffd640 10 monclient: dump: 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.339 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b083e640 4 set_mon_vals no callback set 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.316+0000 7f20b42cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f20b42cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f20b42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac059150 con 0x7f20ac13ec40 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f209c003c90 con 0x7f20ac13ec40 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7f209c04fd50 con 0x7f20ac13ec40 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.317+0000 7f20b1840640 10 monclient: get_auth_request con 0x7f207c040de0 auth_method 0 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.319+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f209c003f70 con 0x7f20ac13ec40 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.319+0000 7f2092ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.319+0000 7f2092ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:02.370 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2134859 2026-02-17T05:34:02.409 INFO:tasks.rados.rados.0.trial118.stdout:1431: finishing copy_from racing read to trial11845692-17 2026-02-17T05:34:02.409 INFO:tasks.rados.rados.0.trial118.stdout:1431: finishing copy_from to trial11845692-17 2026-02-17T05:34:02.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 256 (ObjNum 473 snap 122 seq_num 473) dirty exists 2026-02-17T05:34:02.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f20b42cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f20b42cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f20b42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f20ac1a05b0 con 0x7f20ac13ec40 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f2092ffd640 1 -- 10.20.193.106:0/2244958864 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1097342270) 0x7f209c016b50 con 0x7f20ac13ec40 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f2092ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.463+0000 7f2092ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:34:02.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 >> v1:10.20.193.118:6812/703720803 conn(0x7f207c040de0 legacy=0x7f207c061290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 10 monclient: shutdown 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 >> v1:10.20.193.106:6790/0 conn(0x7f20ac13ec40 legacy=0x7f20ac0577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 shutdown_connections 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 >> 10.20.193.106:0/2244958864 conn(0x7f20ac0915f0 msgr2=0x7f20ac08b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 shutdown_connections 2026-02-17T05:34:02.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.464+0000 7f20b42cc640 1 -- 10.20.193.106:0/2244958864 wait complete. 2026-02-17T05:34:02.473 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:34:02.473 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:34:02.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:34:02.474 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:34:02.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: monmap: 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.538584+0000 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.538584+0000 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.539 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 1 Processor -- start 2026-02-17T05:34:02.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 1 -- start start 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: init 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-c con 0x7fd75805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-a con 0x7fd75805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-b con 0x7fd758182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75808b060 con 0x7fd75805dee0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75805dc90 con 0x7fd75805d1b0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75808d6a0 con 0x7fd758182720 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.537+0000 7fd75fa12640 10 monclient(hunting): authenticate will time out at 971.166938s 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75df88640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd758182720 0x7fd7581a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40926/0 (socket says 10.20.193.106:40926) 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75df88640 1 -- 10.20.193.106:0/1069536019 learned_addr learned my addr 10.20.193.106:0/1069536019 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75cf86640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd75805dee0 0x7fd758181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58388/0 (socket says 10.20.193.106:58388) 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682069497 0 0) 0x7fd75808d6a0 con 0x7fd758182720 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): my global_id is 4742 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7400035e0 con 0x7fd758182720 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350041579 0 0) 0x7fd75808b060 con 0x7fd75805dee0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient(hunting): my global_id is 64338 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75808d6a0 con 0x7fd75805dee0 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609582722 0 0) 0x7fd7400035e0 con 0x7fd758182720 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 >> v1:10.20.193.118:6789/0 conn(0x7fd75805d1b0 legacy=0x7fd75805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 >> v1:10.20.193.106:6789/0 conn(0x7fd75805dee0 legacy=0x7fd758181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 monclient: found mon.noname-b 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd758057960 con 0x7fd758182720 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd754003eb0 con 0x7fd758182720 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 5 monclient: authenticate success, global_id 4742 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: dump: 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7540040b0 con 0x7fd758182720 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 1 -- 10.20.193.106:0/1069536019 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd7540044c0 con 0x7fd758182720 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd747fff640 10 monclient: dump: 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.542 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 4 set_mon_vals no callback set 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 10 monclient: shutdown 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 1 -- 10.20.193.106:0/1069536019 >> v1:10.20.193.106:6790/0 conn(0x7fd758182720 legacy=0x7fd7581a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 1 -- 10.20.193.106:0/1069536019 shutdown_connections 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 1 -- 10.20.193.106:0/1069536019 >> 10.20.193.106:0/1069536019 conn(0x7fd7580915f0 msgr2=0x7fd7580919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 1 -- 10.20.193.106:0/1069536019 shutdown_connections 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.538+0000 7fd75fa12640 1 -- 10.20.193.106:0/1069536019 wait complete. 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient: monmap: 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 1 Processor -- start 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 1 -- start start 2026-02-17T05:34:02.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient: init 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-c con 0x7fd75805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-b con 0x7fd75805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient(hunting): picked mon.noname-a con 0x7fd758182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75805ccb0 con 0x7fd758182720 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd758129190 con 0x7fd75805dee0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75805e8e0 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75fa12640 10 monclient(hunting): authenticate will time out at 971.168629s 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75d787640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd75805d1b0 0x7fd758128370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40928/0 (socket says 10.20.193.106:40928) 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd75d787640 1 -- 10.20.193.106:0/4131822185 learned_addr learned my addr 10.20.193.106:0/4131822185 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202878466 0 0) 0x7fd75805e8e0 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): my global_id is 4745 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7280035e0 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553657642 0 0) 0x7fd75805ccb0 con 0x7fd758182720 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 10 monclient(hunting): my global_id is 64341 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.539+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75805e8e0 con 0x7fd758182720 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1647115884 0 0) 0x7fd7280035e0 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75805ccb0 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd748003170 con 0x7fd75805d1b0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): dump: 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.546 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 24323682 0 0) 0x7fd75805e8e0 con 0x7fd758182720 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7280035e0 con 0x7fd758182720 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd754004220 con 0x7fd758182720 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient(hunting): dump: 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 235270115 0 0) 0x7fd75805ccb0 con 0x7fd75805d1b0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.118:6789/0 conn(0x7fd75805dee0 legacy=0x7fd758128a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6789/0 conn(0x7fd758182720 legacy=0x7fd758181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 monclient: found mon.c 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75812b190 con 0x7fd75805d1b0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 5 monclient: authenticate success, global_id 4745 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 10 monclient: _renew_subs 2026-02-17T05:34:02.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd75812c000 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 10 monclient: _renew_subs 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd75812c420 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7480034e0 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd748003b30 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 10 monclient: dump: 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd7477fe640 4 set_mon_vals no callback set 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd7580008d0 con 0x7fd75812a9a0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.540+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd748003c90 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7fd74804fdc0 con 0x7fd75805d1b0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985849668 0 0) 0x7fd7580008d0 con 0x7fd75812a9a0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient(hunting): my global_id is 64344 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75805ccb0 con 0x7fd75812a9a0 2026-02-17T05:34:02.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd75df88640 10 monclient: get_auth_request con 0x7fd728040b60 auth_method 0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2047973665 0 0) 0x7fd75805ccb0 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7580008d0 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd74c002fc0 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient: dump: 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2077427112 0 0) 0x7fd7580008d0 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd758057ca0 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd74c003390 con 0x7fd75812a9a0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6789/0 conn(0x7fd75812a9a0 legacy=0x7fd758058d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.541+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6789/0 conn(0x7fd75812a9a0 legacy=0x7fd758058d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd75fa12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd75808e510 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318497213 0 0) 0x7fd75808e510 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 10 monclient(hunting): my global_id is 64347 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.544+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7580008d0 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3563446261 0 0) 0x7fd7580008d0 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75808e510 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd74c004c40 con 0x7fd7580594a0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 10 monclient: dump: 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.550 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2174121782 0 0) 0x7fd75808e510 con 0x7fd7580594a0 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd758129ce0 con 0x7fd7580594a0 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 242655752) 0x7fd74c004ff0 con 0x7fd7580594a0 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6789/0 conn(0x7fd7580594a0 legacy=0x7fd758197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd745ffb640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6789/0 conn(0x7fd7580594a0 legacy=0x7fd758197330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 240083, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.551 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:02.552 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.553 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.554 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.555 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:02.556 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.118:6812/703720803 conn(0x7fd728040b60 legacy=0x7fd728061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 10 monclient: shutdown 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 >> v1:10.20.193.106:6790/0 conn(0x7fd75805d1b0 legacy=0x7fd758128370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75df88640 1 -- 10.20.193.106:0/4131822185 reap_dead start 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75df88640 1 -- 10.20.193.106:0/4131822185 reap_dead start 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 shutdown_connections 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 >> 10.20.193.106:0/4131822185 conn(0x7fd7580915f0 msgr2=0x7fd75805c060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 shutdown_connections 2026-02-17T05:34:02.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.545+0000 7fd75fa12640 1 -- 10.20.193.106:0/4131822185 wait complete. 2026-02-17T05:34:02.557 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:02.557 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:34:02.557 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 10 monclient: monmap: 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.622735+0000 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.622735+0000 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.623 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 1 Processor -- start 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 1 -- start start 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.621+0000 7f60d5bae640 10 monclient: init 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-c con 0x7f60d005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-a con 0x7f60d005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-b con 0x7f60d0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d008b060 con 0x7f60d005dee0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d005dc90 con 0x7f60d005d1b0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d008d6a0 con 0x7f60d0182720 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient(hunting): authenticate will time out at 971.251106s 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ceffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f60d005dee0 0x7f60d0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58422/0 (socket says 10.20.193.106:58422) 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ceffd640 1 -- 10.20.193.106:0/2864214657 learned_addr learned my addr 10.20.193.106:0/2864214657 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287946785 0 0) 0x7f60d008d6a0 con 0x7f60d0182720 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): my global_id is 4748 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60b40035e0 con 0x7f60d0182720 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348193998 0 0) 0x7f60d008b060 con 0x7f60d005dee0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient(hunting): my global_id is 64350 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d008d6a0 con 0x7f60d005dee0 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1470458808 0 0) 0x7f60b40035e0 con 0x7f60d0182720 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 >> v1:10.20.193.118:6789/0 conn(0x7f60d005d1b0 legacy=0x7f60d005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 >> v1:10.20.193.106:6789/0 conn(0x7f60d005dee0 legacy=0x7f60d0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 monclient: found mon.noname-b 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d0057960 con 0x7f60d0182720 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60c4003eb0 con 0x7f60d0182720 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 5 monclient: authenticate success, global_id 4748 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: dump: 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60c40040f0 con 0x7f60d0182720 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 1 -- 10.20.193.106:0/2864214657 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60c4004500 con 0x7f60d0182720 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 4 set_mon_vals no callback set 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60ce7fc640 10 monclient: dump: 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 10 monclient: shutdown 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- 10.20.193.106:0/2864214657 >> v1:10.20.193.106:6790/0 conn(0x7f60d0182720 legacy=0x7f60d01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- 10.20.193.106:0/2864214657 shutdown_connections 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- 10.20.193.106:0/2864214657 >> 10.20.193.106:0/2864214657 conn(0x7f60d00915f0 msgr2=0x7f60d00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- 10.20.193.106:0/2864214657 shutdown_connections 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.622+0000 7f60d5bae640 1 -- 10.20.193.106:0/2864214657 wait complete. 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient: monmap: 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 1 Processor -- start 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 1 -- start start 2026-02-17T05:34:02.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient: init 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-b con 0x7f60d005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-a con 0x7f60d005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient(hunting): picked mon.noname-c con 0x7f60d0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d012bfd0 con 0x7f60d005dee0 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d005e8e0 con 0x7f60d005d1b0 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d01284b0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60d5bae640 10 monclient(hunting): authenticate will time out at 971.252709s 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60cffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f60d0182720 0x7f60d0181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40958/0 (socket says 10.20.193.106:40958) 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60cffff640 1 -- 10.20.193.106:0/1939598510 learned_addr learned my addr 10.20.193.106:0/1939598510 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214077390 0 0) 0x7f60d01284b0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): my global_id is 4751 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a00035e0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609300744 0 0) 0x7f60d012bfd0 con 0x7f60d005dee0 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 10 monclient(hunting): my global_id is 64353 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.623+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d01284b0 con 0x7f60d005dee0 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1118906769 0 0) 0x7f60a00035e0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60d012bfd0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60c4003dc0 con 0x7f60d0182720 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): dump: 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.630 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2746966144 0 0) 0x7f60d01284b0 con 0x7f60d005dee0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60a00035e0 con 0x7f60d005dee0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60c0003210 con 0x7f60d005dee0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient(hunting): dump: 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2497347421 0 0) 0x7f60d012bfd0 con 0x7f60d0182720 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.118:6789/0 conn(0x7f60d005d1b0 legacy=0x7f60d012b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6789/0 conn(0x7f60d005dee0 legacy=0x7f60d012b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 monclient: found mon.c 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d010bc40 con 0x7f60d0182720 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 5 monclient: authenticate success, global_id 4751 2026-02-17T05:34:02.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 10 monclient: _renew_subs 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60d010a750 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 10 monclient: _renew_subs 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f60d010cab0 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60c4004a20 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60c4004e00 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 10 monclient: dump: 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60cdffb640 4 set_mon_vals no callback set 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f60d010b680 con 0x7f60d010b2b0 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.624+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f60c4004f60 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7f60c4050f90 con 0x7f60d0182720 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748714683 0 0) 0x7f60d010b680 con 0x7f60d010b2b0 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient(hunting): my global_id is 4754 2026-02-17T05:34:02.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d012bfd0 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1155553756 0 0) 0x7f60d012bfd0 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60d010b680 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60bc002ab0 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient: dump: 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3107668565 0 0) 0x7f60d010b680 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60d0057ca0 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60ceffd640 10 monclient: get_auth_request con 0x7f60a0040b10 auth_method 0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f60bc003030 con 0x7f60d010b2b0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6790/0 conn(0x7f60d010b2b0 legacy=0x7f60d00590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.625+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6790/0 conn(0x7f60d010b2b0 legacy=0x7f60d00590c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.628+0000 7f60d5bae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.628+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f60d0055570 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837595799 0 0) 0x7f60d0055570 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient(hunting): my global_id is 4757 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d010b680 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3895490386 0 0) 0x7f60d010b680 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60d0055570 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f60bc0038c0 con 0x7f60d0109cf0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient: dump: 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.634 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1860488314 0 0) 0x7f60d0055570 con 0x7f60d0109cf0 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60d0128110 con 0x7f60d0109cf0 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2984863564) 0x7f60bc005ac0 con 0x7f60d0109cf0 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6790/0 conn(0x7f60d0109cf0 legacy=0x7f60d00597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60abfff640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6790/0 conn(0x7f60d0109cf0 legacy=0x7f60d00597d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 367390, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:02.635 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.636 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.637 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.638 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:02.639 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:02.640 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.118:6812/703720803 conn(0x7f60a0040b10 legacy=0x7f60a0060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 10 monclient: shutdown 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 >> v1:10.20.193.106:6790/0 conn(0x7f60d0182720 legacy=0x7f60d0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60cffff640 1 -- 10.20.193.106:0/1939598510 reap_dead start 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60cffff640 1 -- 10.20.193.106:0/1939598510 reap_dead start 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 shutdown_connections 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 >> 10.20.193.106:0/1939598510 conn(0x7f60d00915f0 msgr2=0x7f60d005be70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 shutdown_connections 2026-02-17T05:34:02.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.629+0000 7f60d5bae640 1 -- 10.20.193.106:0/1939598510 wait complete. 2026-02-17T05:34:02.642 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:02.642 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:34:02.642 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:34:02.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.704+0000 7f88b6a5b640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.704+0000 7f88b6a5b640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.704+0000 7f88b6a5b640 10 monclient: monmap: 2026-02-17T05:34:02.706 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.706 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.705965+0000 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.705965+0000 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.707 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.704+0000 7f88b6a5b640 1 Processor -- start 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 1 -- start start 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient: init 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f88b008c1e0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f88b008c5b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f88b0188eb0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b008ca30 con 0x7f88b008c1e0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b008d000 con 0x7f88b0188eb0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b00889b0 con 0x7f88b008c5b0 2026-02-17T05:34:02.713 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient(hunting): authenticate will time out at 971.334349s 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88affff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f88b008c1e0 0x7f88b008ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58448/0 (socket says 10.20.193.106:58448) 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88affff640 1 -- 10.20.193.106:0/2676254692 learned_addr learned my addr 10.20.193.106:0/2676254692 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88af7fe640 1 --1- 10.20.193.106:0/2676254692 >> v1:10.20.193.106:6790/0 conn(0x7f88b008c5b0 0x7f88b0187790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40986/0 (socket says 10.20.193.106:40986) 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175373638 0 0) 0x7f88b00889b0 con 0x7f88b008c5b0 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): my global_id is 4760 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88940035e0 con 0x7f88b008c5b0 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879485123 0 0) 0x7f88b008ca30 con 0x7f88b008c1e0 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient(hunting): my global_id is 64356 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b00889b0 con 0x7f88b008c1e0 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1530383428 0 0) 0x7f88940035e0 con 0x7f88b008c5b0 2026-02-17T05:34:02.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 >> v1:10.20.193.118:6789/0 conn(0x7f88b0188eb0 legacy=0x7f88b01a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 >> v1:10.20.193.106:6789/0 conn(0x7f88b008c1e0 legacy=0x7f88b008ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 monclient: found mon.noname-b 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b0089000 con 0x7f88b008c5b0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f88a0002dd0 con 0x7f88b008c5b0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 5 monclient: authenticate success, global_id 4760 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: dump: 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.715 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88a0002fa0 con 0x7f88b008c5b0 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 1 -- 10.20.193.106:0/2676254692 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f88a00033b0 con 0x7f88b008c5b0 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88b6a5b640 4 set_mon_vals no callback set 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.705+0000 7f88aeffd640 10 monclient: dump: 2026-02-17T05:34:02.716 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 10 monclient: shutdown 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- 10.20.193.106:0/2676254692 >> v1:10.20.193.106:6790/0 conn(0x7f88b008c5b0 legacy=0x7f88b0187790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- 10.20.193.106:0/2676254692 shutdown_connections 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- 10.20.193.106:0/2676254692 >> 10.20.193.106:0/2676254692 conn(0x7f88b00915f0 msgr2=0x7f88b00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- 10.20.193.106:0/2676254692 shutdown_connections 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- 10.20.193.106:0/2676254692 wait complete. 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 10 monclient: monmap: 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 Processor -- start 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 1 -- start start 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.706+0000 7f88b6a5b640 10 monclient: init 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f88b008c1e0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f88b008c5b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f88b0188eb0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b005b830 con 0x7f88b0188eb0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b005d4f0 con 0x7f88b008c5b0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b005e8e0 con 0x7f88b008c1e0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient(hunting): authenticate will time out at 971.336083s 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88affff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f88b008c1e0 0x7f88b005aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40988/0 (socket says 10.20.193.106:40988) 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88affff640 1 -- 10.20.193.106:0/3200930865 learned_addr learned my addr 10.20.193.106:0/3200930865 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692000421 0 0) 0x7f88b005b830 con 0x7f88b0188eb0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): my global_id is 64359 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88800035e0 con 0x7f88b0188eb0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955574903 0 0) 0x7f88b005e8e0 con 0x7f88b008c1e0 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): my global_id is 4763 2026-02-17T05:34:02.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b005b830 con 0x7f88b008c1e0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3082358769 0 0) 0x7f88800035e0 con 0x7f88b0188eb0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88b005e8e0 con 0x7f88b0188eb0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f88a4004150 con 0x7f88b0188eb0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): dump: 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1756145159 0 0) 0x7f88b005b830 con 0x7f88b008c1e0 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88800035e0 con 0x7f88b008c1e0 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f889c003170 con 0x7f88b008c1e0 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient(hunting): dump: 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1884250379 0 0) 0x7f88b005e8e0 con 0x7f88b0188eb0 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.106:6790/0 conn(0x7f88b008c1e0 legacy=0x7f88b005aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6789/0 conn(0x7f88b008c5b0 legacy=0x7f88b005b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 monclient: found mon.a 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b0130890 con 0x7f88b0188eb0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 5 monclient: authenticate success, global_id 64359 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _renew_subs 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88b01305b0 con 0x7f88b0188eb0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _renew_subs 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f88b005c630 con 0x7f88b0188eb0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88a4004650 con 0x7f88b0188eb0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f88a4004970 con 0x7f88b0188eb0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88acff9640 10 monclient: dump: 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88ae7fc640 4 set_mon_vals no callback set 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.707+0000 7f88b6a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f88b005cec0 con 0x7f88b01300f0 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f88a4011910 con 0x7f88b0188eb0 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7f88a404fbc0 con 0x7f88b0188eb0 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586768798 0 0) 0x7f88b005cec0 con 0x7f88b01300f0 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient(hunting): my global_id is 84154 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b005e8e0 con 0x7f88b01300f0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88af7fe640 10 monclient: get_auth_request con 0x7f8880040bf0 auth_method 0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3861408764 0 0) 0x7f88b005e8e0 con 0x7f88b01300f0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88b005cec0 con 0x7f88b01300f0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f889c004a50 con 0x7f88b01300f0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 10 monclient: dump: 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3781495485 0 0) 0x7f88b005cec0 con 0x7f88b01300f0 2026-02-17T05:34:02.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.708+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88b01aa9b0 con 0x7f88b01300f0 2026-02-17T05:34:02.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.709+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f889c004e20 con 0x7f88b01300f0 2026-02-17T05:34:02.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.709+0000 7f88acff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.709+0000 7f88acff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:02.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.709+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6789/0 conn(0x7f88b01300f0 legacy=0x7f88b01a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.709+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6789/0 conn(0x7f88b01300f0 legacy=0x7f88b01a9290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.712+0000 7f88b6a5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.712+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f88b0115f40 con 0x7f88b0115b70 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297279229 0 0) 0x7f88b0115f40 con 0x7f88b0115b70 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient(hunting): my global_id is 84157 2026-02-17T05:34:02.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b005cec0 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1263623374 0 0) 0x7f88b005cec0 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88b0115f40 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f889c003570 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 10 monclient: dump: 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2754093322 0 0) 0x7f88b0115f40 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.713+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88b0055570 con 0x7f88b0115b70 2026-02-17T05:34:02.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 4053580635) 0x7f889c006970 con 0x7f88b0115b70 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88acff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88acff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6789/0 conn(0x7f88b0115b70 legacy=0x7f88b01a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88acff9640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6789/0 conn(0x7f88b0115b70 legacy=0x7f88b01a99a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 20, 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 17181, 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:02.728 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.729 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:02.730 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:02.731 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.732 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.733 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.734 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:02.735 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:02.736 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.118:6812/703720803 conn(0x7f8880040bf0 legacy=0x7f88800610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 10 monclient: shutdown 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 >> v1:10.20.193.106:6789/0 conn(0x7f88b0188eb0 legacy=0x7f88b0188520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b4fd1640 1 -- 10.20.193.106:0/3200930865 reap_dead start 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b4fd1640 1 -- 10.20.193.106:0/3200930865 reap_dead start 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 shutdown_connections 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 >> 10.20.193.106:0/3200930865 conn(0x7f88b00915f0 msgr2=0x7f88b010ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 shutdown_connections 2026-02-17T05:34:02.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.714+0000 7f88b6a5b640 1 -- 10.20.193.106:0/3200930865 wait complete. 2026-02-17T05:34:02.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:34:02.738 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T05:34:02.738 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:34:02.738 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T05:34:02.738 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b store 2026-02-17T05:34:02.738 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b sync_force --yes-i-really-mean-it 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: monmap: 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.802465+0000 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.802465+0000 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.803 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.804 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.804 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.804 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.804 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 1 Processor -- start 2026-02-17T05:34:02.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 1 -- start start 2026-02-17T05:34:02.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: init 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.801+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-b con 0x7ffa4813f070 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-c con 0x7ffa4808fe90 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-a con 0x7ffa480902f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa48091b00 con 0x7ffa480902f0 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa480917e0 con 0x7ffa4808fe90 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa48057620 con 0x7ffa4813f070 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient(hunting): authenticate will time out at 971.431046s 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa47fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ffa480902f0 0x7ffa481a48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58460/0 (socket says 10.20.193.106:58460) 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa47fff640 1 -- 10.20.193.106:0/3627795333 learned_addr learned my addr 10.20.193.106:0/3627795333 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa477fe640 1 --1- 10.20.193.106:0/3627795333 >> v1:10.20.193.106:6790/0 conn(0x7ffa4813f070 0x7ffa4813f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:40998/0 (socket says 10.20.193.106:40998) 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369461749 0 0) 0x7ffa48091b00 con 0x7ffa480902f0 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): my global_id is 64362 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa2c0035e0 con 0x7ffa480902f0 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226684833 0 0) 0x7ffa48057620 con 0x7ffa4813f070 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient(hunting): my global_id is 4766 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa48091b00 con 0x7ffa4813f070 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2790005979 0 0) 0x7ffa2c0035e0 con 0x7ffa480902f0 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 >> v1:10.20.193.106:6790/0 conn(0x7ffa4813f070 legacy=0x7ffa4813f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 >> v1:10.20.193.118:6789/0 conn(0x7ffa4808fe90 legacy=0x7ffa48183170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 monclient: found mon.noname-a 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa48057900 con 0x7ffa480902f0 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa3c003eb0 con 0x7ffa480902f0 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: dump: 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.813 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 5 monclient: authenticate success, global_id 64362 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa3c004040 con 0x7ffa480902f0 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 4 set_mon_vals no callback set 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 1 -- 10.20.193.106:0/3627795333 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa3c004450 con 0x7ffa480902f0 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa467fc640 10 monclient: dump: 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.814 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 10 monclient: shutdown 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- 10.20.193.106:0/3627795333 >> v1:10.20.193.106:6789/0 conn(0x7ffa480902f0 legacy=0x7ffa481a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- 10.20.193.106:0/3627795333 shutdown_connections 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- 10.20.193.106:0/3627795333 >> 10.20.193.106:0/3627795333 conn(0x7ffa4805e460 msgr2=0x7ffa48095490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- 10.20.193.106:0/3627795333 shutdown_connections 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.802+0000 7ffa4e25b640 1 -- 10.20.193.106:0/3627795333 wait complete. 2026-02-17T05:34:02.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient: monmap: 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 1 Processor -- start 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 1 -- start start 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient: init 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:34:02.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-c con 0x7ffa4808fe90 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-b con 0x7ffa4813f070 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient(hunting): picked mon.noname-a con 0x7ffa4812f840 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4808bab0 con 0x7ffa4812f840 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa48131d10 con 0x7ffa4813f070 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4808c680 con 0x7ffa4808fe90 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa4e25b640 10 monclient(hunting): authenticate will time out at 971.432870s 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa477fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ffa4808fe90 0x7ffa481522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41014/0 (socket says 10.20.193.106:41014) 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.803+0000 7ffa477fe640 1 -- 10.20.193.106:0/391458127 learned_addr learned my addr 10.20.193.106:0/391458127 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179049242 0 0) 0x7ffa4808bab0 con 0x7ffa4812f840 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): my global_id is 64365 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa180035e0 con 0x7ffa4812f840 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412230121 0 0) 0x7ffa4808c680 con 0x7ffa4808fe90 2026-02-17T05:34:02.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): my global_id is 4769 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa4808bab0 con 0x7ffa4808fe90 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4233039030 0 0) 0x7ffa180035e0 con 0x7ffa4812f840 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa4808c680 con 0x7ffa4812f840 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa3c003890 con 0x7ffa4812f840 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): dump: 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.818 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2557303709 0 0) 0x7ffa4808bab0 con 0x7ffa4808fe90 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa180035e0 con 0x7ffa4808fe90 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa34003170 con 0x7ffa4808fe90 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient(hunting): dump: 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.819 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3819703372 0 0) 0x7ffa4808c680 con 0x7ffa4812f840 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.106:6790/0 conn(0x7ffa4808fe90 legacy=0x7ffa481522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6789/0 conn(0x7ffa4813f070 legacy=0x7ffa48192f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 monclient: found mon.a 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa481325b0 con 0x7ffa4812f840 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 5 monclient: authenticate success, global_id 64365 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 10 monclient: _renew_subs 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa48130250 con 0x7ffa4812f840 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 10 monclient: _renew_subs 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa48130db0 con 0x7ffa4812f840 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa3c005c30 con 0x7ffa4812f840 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa3c005f50 con 0x7ffa4812f840 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 10 monclient: dump: 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.821 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa45ffb640 4 set_mon_vals no callback set 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffa4812fd40 con 0x7ffa480902d0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.804+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ffa3c012ef0 con 0x7ffa4812f840 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7ffa3c050ed0 con 0x7ffa4812f840 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa46ffd640 10 monclient: get_auth_request con 0x7ffa18040bb0 auth_method 0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511621658 0 0) 0x7ffa4812fd40 con 0x7ffa480902d0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient(hunting): my global_id is 84163 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa4808c680 con 0x7ffa480902d0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3121627783 0 0) 0x7ffa4808c680 con 0x7ffa480902d0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa4812fd40 con 0x7ffa480902d0 2026-02-17T05:34:02.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa34004a50 con 0x7ffa480902d0 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.805+0000 7ffa23fff640 10 monclient: dump: 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2463621136 0 0) 0x7ffa4812fd40 con 0x7ffa480902d0 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa48131ec0 con 0x7ffa480902d0 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffa34007a20 con 0x7ffa480902d0 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6789/0 conn(0x7ffa480902d0 legacy=0x7ffa4808a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.806+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6789/0 conn(0x7ffa480902d0 legacy=0x7ffa4808a710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa4e25b640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffa4805fd90 con 0x7ffa4804d200 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632242477 0 0) 0x7ffa4805fd90 con 0x7ffa4804d200 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient(hunting): my global_id is 84166 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa4812fd40 con 0x7ffa4804d200 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1367094323 0 0) 0x7ffa4812fd40 con 0x7ffa4804d200 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa4805fd90 con 0x7ffa4804d200 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffa340054f0 con 0x7ffa4804d200 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.810+0000 7ffa23fff640 10 monclient: dump: 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.826 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2977761925 0 0) 0x7ffa4805fd90 con 0x7ffa4804d200 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7ffa481529e0 con 0x7ffa4804d200 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7ffa34005650 con 0x7ffa4804d200 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6789/0 conn(0x7ffa4804d200 legacy=0x7ffa48196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa23fff640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6789/0 conn(0x7ffa4804d200 legacy=0x7ffa48196de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stdout: "ret": 0, 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-17T05:34:02.827 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:02.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.118:6812/703720803 conn(0x7ffa18040bb0 legacy=0x7ffa18061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 10 monclient: shutdown 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 >> v1:10.20.193.106:6789/0 conn(0x7ffa4812f840 legacy=0x7ffa481946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa47fff640 1 -- 10.20.193.106:0/391458127 reap_dead start 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa47fff640 1 -- 10.20.193.106:0/391458127 reap_dead start 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 shutdown_connections 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 >> 10.20.193.106:0/391458127 conn(0x7ffa4805e460 msgr2=0x7ffa48087e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 shutdown_connections 2026-02-17T05:34:02.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.811+0000 7ffa4e25b640 1 -- 10.20.193.106:0/391458127 wait complete. 2026-02-17T05:34:02.829 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T05:34:02.830 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T05:34:02.830 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:34:02.839 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T05:34:02.840 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:34:02.840 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:34:02.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.902+0000 7f41ab2cc640 10 monclient: get_monmap_and_config 2026-02-17T05:34:02.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.902+0000 7f41ab2cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.902+0000 7f41ab2cc640 10 monclient: monmap: 2026-02-17T05:34:02.912 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.912 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:02.904099+0000 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:02.904099+0000 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 1 Processor -- start 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 1 -- start start 2026-02-17T05:34:02.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient: init 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-a con 0x7f41a405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-b con 0x7f41a405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f41a4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a408b060 con 0x7f41a405d1b0 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a405dc90 con 0x7f41a4182720 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a408d6a0 con 0x7f41a405dee0 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 10 monclient(hunting): authenticate will time out at 971.532454s 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41a9041640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f41a405d1b0 0x7f41a405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58484/0 (socket says 10.20.193.106:58484) 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41a9041640 1 -- 10.20.193.106:0/1444407908 learned_addr learned my addr 10.20.193.106:0/1444407908 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41a9842640 1 -- 10.20.193.106:0/1444407908 >> v1:10.20.193.118:6789/0 conn(0x7f41a4182720 legacy=0x7f41a41a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281272957 0 0) 0x7f41a408b060 con 0x7f41a405d1b0 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): my global_id is 64368 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f418c0035e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520136295 0 0) 0x7f41a408d6a0 con 0x7f41a405dee0 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient(hunting): my global_id is 4772 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a408b060 con 0x7f41a405dee0 2026-02-17T05:34:02.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2422578338 0 0) 0x7f418c0035e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 >> v1:10.20.193.106:6790/0 conn(0x7f41a405dee0 legacy=0x7f41a4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 >> v1:10.20.193.118:6789/0 conn(0x7f41a4182720 legacy=0x7f41a41a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 monclient: found mon.noname-a 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a4057960 con 0x7f41a405d1b0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4194002dd0 con 0x7f41a405d1b0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f4193fff640 10 monclient: dump: 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 5 monclient: authenticate success, global_id 64368 2026-02-17T05:34:02.917 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.903+0000 7f41ab2cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4194003090 con 0x7f41a405d1b0 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 1 -- 10.20.193.106:0/1444407908 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f41940034a0 con 0x7f41a405d1b0 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f4193fff640 10 monclient: dump: 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.918 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 4 set_mon_vals no callback set 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 10 monclient: shutdown 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- 10.20.193.106:0/1444407908 >> v1:10.20.193.106:6789/0 conn(0x7f41a405d1b0 legacy=0x7f41a405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- 10.20.193.106:0/1444407908 shutdown_connections 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- 10.20.193.106:0/1444407908 >> 10.20.193.106:0/1444407908 conn(0x7f41a40915f0 msgr2=0x7f41a40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- 10.20.193.106:0/1444407908 shutdown_connections 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- 10.20.193.106:0/1444407908 wait complete. 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:02.919 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 10 monclient: monmap: 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 Processor -- start 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 1 -- start start 2026-02-17T05:34:02.920 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.904+0000 7f41ab2cc640 10 monclient: init 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-a con 0x7f41a405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-b con 0x7f41a405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f41a4182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a405e8e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a405cdb0 con 0x7f41a405dee0 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a408a040 con 0x7f41a4182720 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient(hunting): authenticate will time out at 971.534209s 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41a9041640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f41a405d1b0 0x7f41a412a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:58494/0 (socket says 10.20.193.106:58494) 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41a9041640 1 -- 10.20.193.106:0/845540264 learned_addr learned my addr 10.20.193.106:0/845540264 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:02.921 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41a8840640 1 -- 10.20.193.106:0/845540264 >> v1:10.20.193.118:6789/0 conn(0x7f41a405dee0 legacy=0x7f41a412a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326206809 0 0) 0x7f41a405e8e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): my global_id is 64371 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41740035e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56700958 0 0) 0x7f41a408a040 con 0x7f41a4182720 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): my global_id is 4775 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a405e8e0 con 0x7f41a4182720 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 664534582 0 0) 0x7f41740035e0 con 0x7f41a405d1b0 2026-02-17T05:34:02.922 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41a408a040 con 0x7f41a405d1b0 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f41940033b0 con 0x7f41a405d1b0 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): dump: 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.923 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3484084283 0 0) 0x7f41a405e8e0 con 0x7f41a4182720 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41740035e0 con 0x7f41a4182720 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f41a0005160 con 0x7f41a4182720 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient(hunting): dump: 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.924 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2349676622 0 0) 0x7f41a408a040 con 0x7f41a405d1b0 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 >> v1:10.20.193.106:6790/0 conn(0x7f41a4182720 legacy=0x7f41a4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 >> v1:10.20.193.118:6789/0 conn(0x7f41a405dee0 legacy=0x7f41a412a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 monclient: found mon.a 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a410e6b0 con 0x7f41a405d1b0 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: _finish_auth 0 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:34:02.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 5 monclient: authenticate success, global_id 64371 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _renew_subs 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41a41824f0 con 0x7f41a405d1b0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _renew_subs 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41a410d430 con 0x7f41a405d1b0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41940028c0 con 0x7f41a405d1b0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4194004e60 con 0x7f41a405d1b0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f4191ffb640 10 monclient: dump: 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:02.926 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.905+0000 7f41937fe640 4 set_mon_vals no callback set 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f41ab2cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f41ab2cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f41ab2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a412e4b0 con 0x7f41a405d1b0 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4194011e00 con 0x7f41a405d1b0 2026-02-17T05:34:02.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7f419404ff70 con 0x7f41a405d1b0 2026-02-17T05:34:02.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.906+0000 7f41a8840640 10 monclient: get_auth_request con 0x7f4174040a70 auth_method 0 2026-02-17T05:34:02.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.908+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f4194017680 con 0x7f41a405d1b0 2026-02-17T05:34:02.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.908+0000 7f4191ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:02.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:02.908+0000 7f4191ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:03.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f41ab2cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f41ab2cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f41ab2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f41a4055570 con 0x7f41a405d1b0 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f4191ffb640 1 -- 10.20.193.106:0/845540264 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2039387550) 0x7f4194015610 con 0x7f41a405d1b0 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f4191ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.053+0000 7f4191ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:03.056 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:34:03.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 >> v1:10.20.193.118:6812/703720803 conn(0x7f4174040a70 legacy=0x7f4174060f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 10 monclient: shutdown 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 >> v1:10.20.193.106:6789/0 conn(0x7f41a405d1b0 legacy=0x7f41a412a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 shutdown_connections 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 >> 10.20.193.106:0/845540264 conn(0x7f41a40915f0 msgr2=0x7f41a408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 shutdown_connections 2026-02-17T05:34:03.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:03.055+0000 7f41ab2cc640 1 -- 10.20.193.106:0/845540264 wait complete. 2026-02-17T05:34:06.065 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:34:06.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 10 monclient: get_monmap_and_config 2026-02-17T05:34:06.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:06.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 10 monclient: monmap: 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:06.131721+0000 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:06.131721+0000 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:06.140 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 1 Processor -- start 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 1 -- start start 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.131+0000 7fce6c4cc640 10 monclient: init 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-c con 0x7fce6405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-a con 0x7fce6405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-b con 0x7fce64182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6408b060 con 0x7fce6405dee0 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6405dc90 con 0x7fce6405d1b0 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6408d6a0 con 0x7fce64182720 2026-02-17T05:34:06.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient(hunting): authenticate will time out at 974.760111s 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6a241640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7fce6405d1b0 legacy=0x7fce6405d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce69a40640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fce6405dee0 0x7fce64181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:48282/0 (socket says 10.20.193.106:48282) 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce69a40640 1 -- 10.20.193.106:0/4202464689 learned_addr learned my addr 10.20.193.106:0/4202464689 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003769914 0 0) 0x7fce6408d6a0 con 0x7fce64182720 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient(hunting): _negotiate 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient(hunting): my global_id is 4778 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c0035e0 con 0x7fce64182720 2026-02-17T05:34:06.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1752244170 0 0) 0x7fce4c0035e0 con 0x7fce64182720 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 >> v1:10.20.193.118:6789/0 conn(0x7fce6405d1b0 legacy=0x7fce6405d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 >> v1:10.20.193.106:6789/0 conn(0x7fce6405dee0 legacy=0x7fce64181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: _finish_hunting 0 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 monclient: found mon.noname-b 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64057960 con 0x7fce64182720 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: _finish_auth 0 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: _check_auth_tickets 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fce60003eb0 con 0x7fce64182720 2026-02-17T05:34:06.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: dump: 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:06.144 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 5 monclient: authenticate success, global_id 4778 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce600040f0 con 0x7fce64182720 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 1 -- 10.20.193.106:0/4202464689 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fce60004500 con 0x7fce64182720 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6923f640 10 monclient: dump: 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:06.145 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 4 set_mon_vals no callback set 2026-02-17T05:34:06.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 10 monclient: shutdown 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- 10.20.193.106:0/4202464689 >> v1:10.20.193.106:6790/0 conn(0x7fce64182720 legacy=0x7fce641a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- 10.20.193.106:0/4202464689 shutdown_connections 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- 10.20.193.106:0/4202464689 >> 10.20.193.106:0/4202464689 conn(0x7fce640915f0 msgr2=0x7fce640919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- 10.20.193.106:0/4202464689 shutdown_connections 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.132+0000 7fce6c4cc640 1 -- 10.20.193.106:0/4202464689 wait complete. 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient: build_initial_monmap 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient: monmap: 2026-02-17T05:34:06.147 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 1 Processor -- start 2026-02-17T05:34:06.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 1 -- start start 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient: init 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-c con 0x7fce6405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-a con 0x7fce6405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient(hunting): picked mon.noname-b con 0x7fce64182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6410ec70 con 0x7fce6405dee0 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6413f0b0 con 0x7fce64182720 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6412aef0 con 0x7fce6405d1b0 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6c4cc640 10 monclient(hunting): authenticate will time out at 974.761784s 2026-02-17T05:34:06.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce69a40640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fce6405dee0 0x7fce6412a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:48294/0 (socket says 10.20.193.106:48294) 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce69a40640 1 -- 10.20.193.106:0/692936753 learned_addr learned my addr 10.20.193.106:0/692936753 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.133+0000 7fce6aa42640 1 -- 10.20.193.106:0/692936753 >> v1:10.20.193.118:6789/0 conn(0x7fce64182720 legacy=0x7fce64181de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214144570 0 0) 0x7fce6412aef0 con 0x7fce6405d1b0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): my global_id is 4781 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce340035e0 con 0x7fce6405d1b0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2411233744 0 0) 0x7fce340035e0 con 0x7fce6405d1b0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce6412aef0 con 0x7fce6405d1b0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fce54004190 con 0x7fce6405d1b0 2026-02-17T05:34:06.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): dump: 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:06.151 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1588028356 0 0) 0x7fce6412aef0 con 0x7fce6405d1b0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 >> v1:10.20.193.118:6789/0 conn(0x7fce64182720 legacy=0x7fce64181de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 >> v1:10.20.193.106:6789/0 conn(0x7fce6405dee0 legacy=0x7fce6412a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: _finish_hunting 0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 monclient: found mon.c 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6408a040 con 0x7fce6405d1b0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: _finish_auth 0 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: _check_auth_tickets 2026-02-17T05:34:06.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 5 monclient: authenticate success, global_id 4781 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _renew_subs 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fce64182550 con 0x7fce6405d1b0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _renew_subs 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fce6412e460 con 0x7fce6405d1b0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce540043d0 con 0x7fce6405d1b0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fce540047b0 con 0x7fce6405d1b0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:06.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce68a3e640 4 set_mon_vals no callback set 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 10 monclient: dump: 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:06.154 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6410d4f0 con 0x7fce6405d1b0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.134+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fce54004910 con 0x7fce6405d1b0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.135+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3963+0+0 (unknown 2333422855 0 0) 0x7fce5404fd70 con 0x7fce6405d1b0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.135+0000 7fce69a40640 10 monclient: get_auth_request con 0x7fce34040740 auth_method 0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.137+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fce6410d4f0 con 0x7fce6405d1b0 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.137+0000 7fce4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:06.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.137+0000 7fce4affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:06.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce6c4cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce6c4cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce6c4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fce64057ca0 con 0x7fce6405d1b0 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce4affd640 1 -- 10.20.193.106:0/692936753 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 534903998) 0x7fce540173c0 con 0x7fce6405d1b0 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.282+0000 7fce4affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:06.284 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:34:06.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 >> v1:10.20.193.118:6812/703720803 conn(0x7fce34040740 legacy=0x7fce34060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:06.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 10 monclient: shutdown 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 >> v1:10.20.193.106:6790/0 conn(0x7fce6405d1b0 legacy=0x7fce6412a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 shutdown_connections 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 >> 10.20.193.106:0/692936753 conn(0x7fce640915f0 msgr2=0x7fce6413f640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 shutdown_connections 2026-02-17T05:34:06.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:06.283+0000 7fce6c4cc640 1 -- 10.20.193.106:0/692936753 wait complete. 2026-02-17T05:34:09.293 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.358+0000 7f9cee25b640 10 monclient: get_monmap_and_config 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.358+0000 7f9cee25b640 10 monclient: build_initial_monmap 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.358+0000 7f9cee25b640 10 monclient: monmap: 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:09.359 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:09.359229+0000 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:09.359229+0000 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:09.360 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 1 Processor -- start 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 1 -- start start 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient: init 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-b con 0x7f9ce805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-a con 0x7f9ce805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-c con 0x7f9ce8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce808b060 con 0x7f9ce805dee0 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce805dc90 con 0x7f9ce8182720 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce808d6a0 con 0x7f9ce805d1b0 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9cee25b640 10 monclient(hunting): authenticate will time out at 977.987591s 2026-02-17T05:34:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9ce6ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 0x7f9ce8181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:48310/0 (socket says 10.20.193.106:48310) 2026-02-17T05:34:09.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9ce7fff640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9ce81a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:09.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9ce6ffd640 1 -- 10.20.193.106:0/1236437699 learned_addr learned my addr 10.20.193.106:0/1236437699 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:09.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.359+0000 7f9ce77fe640 1 --1- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6790/0 conn(0x7f9ce805d1b0 0x7f9ce805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38006/0 (socket says 10.20.193.106:38006) 2026-02-17T05:34:09.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.560+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9ce81a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:09.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:09.961+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9ce81a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:10.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:10.762+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9ce81a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:12.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): tick 2026-02-17T05:34:12.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 monclient(hunting): continuing hunt 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6790/0 conn(0x7f9ce805d1b0 legacy=0x7f9ce805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9ce81a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 legacy=0x7f9ce8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-c con 0x7f9ce8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-a con 0x7f9ce805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-b con 0x7f9ce805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce8057960 con 0x7f9ce805dee0 2026-02-17T05:34:12.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce805dc90 con 0x7f9ce8182720 2026-02-17T05:34:12.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc4069f80 con 0x7f9ce805d1b0 2026-02-17T05:34:12.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce57fa640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:12.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.359+0000 7f9ce77fe640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc4023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:12.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.561+0000 7f9ce77fe640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc4023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:12.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:12.962+0000 7f9ce77fe640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc4023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:13.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:13.763+0000 7f9ce77fe640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc4023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): tick 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 monclient(hunting): continuing hunt 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6790/0 conn(0x7f9ce805d1b0 legacy=0x7f9cc4066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc4023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:15.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 legacy=0x7f9cc4044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-b con 0x7f9ce805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-a con 0x7f9ce805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): picked mon.noname-c con 0x7f9ce8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc406b1e0 con 0x7f9ce805dee0 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce805dc90 con 0x7f9ce8182720 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc4023870 con 0x7f9ce805d1b0 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce57fa640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:15.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.359+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc406a210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:15.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.560+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc406a210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:15.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:15.961+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc406a210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:16.763+0000 7f9ce7fff640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc406a210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259854019 0 0) 0x7f9cc406b1e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient(hunting): my global_id is 64374 2026-02-17T05:34:17.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ccc0035e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3898037361 0 0) 0x7f9ccc0035e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6790/0 conn(0x7f9ce805d1b0 legacy=0x7f9cc40666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.118:6789/0 conn(0x7f9ce8182720 legacy=0x7f9cc406a210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 monclient: found mon.noname-a 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc4023aa0 con 0x7f9ce805dee0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9cd8002d30 con 0x7f9ce805dee0 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9ce67fc640 10 monclient: dump: 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.316 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9cee25b640 5 monclient: authenticate success, global_id 64374 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.305+0000 7f9cee25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cd8002f00 con 0x7f9ce805dee0 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 1 -- 10.20.193.106:0/1236437699 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9cd80032d0 con 0x7f9ce805dee0 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9ce67fc640 10 monclient: dump: 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.317 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 4 set_mon_vals no callback set 2026-02-17T05:34:17.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 10 monclient: shutdown 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 1 -- 10.20.193.106:0/1236437699 >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 legacy=0x7f9cc4044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 1 -- 10.20.193.106:0/1236437699 shutdown_connections 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 1 -- 10.20.193.106:0/1236437699 >> 10.20.193.106:0/1236437699 conn(0x7f9ce80915f0 msgr2=0x7f9ce80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 1 -- 10.20.193.106:0/1236437699 shutdown_connections 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.306+0000 7f9cee25b640 1 -- 10.20.193.106:0/1236437699 wait complete. 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient: build_initial_monmap 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient: monmap: 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:17.319 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 1 Processor -- start 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 1 -- start start 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient: init 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-b con 0x7f9ce805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:17.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-a con 0x7f9ce805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient(hunting): picked mon.noname-c con 0x7f9ce8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce805e8e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce8130360 con 0x7f9ce805d1b0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce8130640 con 0x7f9ce8182720 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9cee25b640 10 monclient(hunting): authenticate will time out at 985.936760s 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9ce77fe640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f9ce805d1b0 legacy=0x7f9ce80885f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9ce6ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 0x7f9ce8088d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51596/0 (socket says 10.20.193.106:51596) 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.307+0000 7f9ce6ffd640 1 -- 10.20.193.106:0/844709644 learned_addr learned my addr 10.20.193.106:0/844709644 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636348172 0 0) 0x7f9ce805e8e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.321 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): my global_id is 64377 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb80035e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798636903 0 0) 0x7f9ce8130640 con 0x7f9ce8182720 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): my global_id is 4784 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce805e8e0 con 0x7f9ce8182720 2026-02-17T05:34:17.322 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1947369070 0 0) 0x7f9ce805e8e0 con 0x7f9ce8182720 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ce8130640 con 0x7f9ce8182720 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9cdc005420 con 0x7f9ce8182720 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): dump: 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.323 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2454335856 0 0) 0x7f9cb80035e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ce805e8e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9cd80032e0 con 0x7f9ce805dee0 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient(hunting): dump: 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.324 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1631775510 0 0) 0x7f9ce8130640 con 0x7f9ce8182720 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 >> v1:10.20.193.118:6789/0 conn(0x7f9ce805d1b0 legacy=0x7f9ce80885f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 >> v1:10.20.193.106:6789/0 conn(0x7f9ce805dee0 legacy=0x7f9ce8088d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.325 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 monclient: found mon.c 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce8089410 con 0x7f9ce8182720 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 5 monclient: authenticate success, global_id 4784 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 10 monclient: _renew_subs 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce812eb20 con 0x7f9ce8182720 2026-02-17T05:34:17.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 10 monclient: _renew_subs 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ce808a040 con 0x7f9ce8182720 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cdc005830 con 0x7f9ce8182720 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9cdc005c10 con 0x7f9ce8182720 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9cc3fff640 10 monclient: dump: 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.327 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.308+0000 7f9ce5ffb640 4 set_mon_vals no callback set 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cee25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cee25b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cee25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce80008d0 con 0x7f9ce8182720 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9cdc005d70 con 0x7f9ce8182720 2026-02-17T05:34:17.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(314..314 src has 1..314) ==== 3963+0+0 (unknown 2135915726 0 0) 0x7f9cdc050e70 con 0x7f9ce8182720 2026-02-17T05:34:17.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.309+0000 7f9ce77fe640 10 monclient: get_auth_request con 0x7f9cb8040b10 auth_method 0 2026-02-17T05:34:17.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.312+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9cdc018460 con 0x7f9ce8182720 2026-02-17T05:34:17.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.312+0000 7f9cc3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.312+0000 7f9cc3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:17.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.460+0000 7f9cee25b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:34:17.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.460+0000 7f9cee25b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:17.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.460+0000 7f9cee25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.460+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ce812fe00 con 0x7f9ce8182720 2026-02-17T05:34:17.463 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.461+0000 7f9cc3fff640 1 -- 10.20.193.106:0/844709644 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1285142589) 0x7f9cdc017c10 con 0x7f9ce8182720 2026-02-17T05:34:17.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.461+0000 7f9cc3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:34:17.464 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.461+0000 7f9cc3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:17.464 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":24,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:34:17.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 >> v1:10.20.193.118:6812/703720803 conn(0x7f9cb8040b10 legacy=0x7f9cb8060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 10 monclient: shutdown 2026-02-17T05:34:17.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 >> v1:10.20.193.106:6790/0 conn(0x7f9ce8182720 legacy=0x7f9ce81742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.465 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 shutdown_connections 2026-02-17T05:34:17.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 >> 10.20.193.106:0/844709644 conn(0x7f9ce80915f0 msgr2=0x7f9ce8058d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 shutdown_connections 2026-02-17T05:34:17.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.462+0000 7f9cee25b640 1 -- 10.20.193.106:0/844709644 wait complete. 2026-02-17T05:34:17.472 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:34:17.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T05:34:17.472 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:34:17.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 10 monclient: get_monmap_and_config 2026-02-17T05:34:17.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 10 monclient: build_initial_monmap 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 10 monclient: monmap: 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:17.540906+0000 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:17.540906+0000 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:17.542 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:17.543 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 1 Processor -- start 2026-02-17T05:34:17.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 1 -- start start 2026-02-17T05:34:17.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.539+0000 7f663a90c640 10 monclient: init 2026-02-17T05:34:17.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-b con 0x7f663405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-a con 0x7f663405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-c con 0x7f6634182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663408b060 con 0x7f663405dee0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663405dc90 con 0x7f6634182720 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663408d6a0 con 0x7f663405d1b0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient(hunting): authenticate will time out at 986.169305s 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6638e82640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f6634182720 legacy=0x7f66341a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6633fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f663405d1b0 0x7f663405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42590/0 (socket says 10.20.193.106:42590) 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6633fff640 1 -- 10.20.193.106:0/1842105077 learned_addr learned my addr 10.20.193.106:0/1842105077 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f66337fe640 1 --1- 10.20.193.106:0/1842105077 >> v1:10.20.193.106:6789/0 conn(0x7f663405dee0 0x7f6634181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51610/0 (socket says 10.20.193.106:51610) 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666815325 0 0) 0x7f663408d6a0 con 0x7f663405d1b0 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): my global_id is 4787 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66180035e0 con 0x7f663405d1b0 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801961955 0 0) 0x7f663408b060 con 0x7f663405dee0 2026-02-17T05:34:17.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient(hunting): my global_id is 64380 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663408d6a0 con 0x7f663405dee0 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 537452991 0 0) 0x7f66180035e0 con 0x7f663405d1b0 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 >> v1:10.20.193.118:6789/0 conn(0x7f6634182720 legacy=0x7f66341a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 >> v1:10.20.193.106:6789/0 conn(0x7f663405dee0 legacy=0x7f6634181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 monclient: found mon.noname-b 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6634057960 con 0x7f663405d1b0 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6620002dd0 con 0x7f663405d1b0 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: dump: 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.556 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 5 monclient: authenticate success, global_id 4787 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6620003050 con 0x7f663405d1b0 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 1 -- 10.20.193.106:0/1842105077 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6620003460 con 0x7f663405d1b0 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f6632ffd640 10 monclient: dump: 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:17.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.540+0000 7f663a90c640 4 set_mon_vals no callback set 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: shutdown 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- 10.20.193.106:0/1842105077 >> v1:10.20.193.106:6790/0 conn(0x7f663405d1b0 legacy=0x7f663405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- 10.20.193.106:0/1842105077 shutdown_connections 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- 10.20.193.106:0/1842105077 >> 10.20.193.106:0/1842105077 conn(0x7f66340915f0 msgr2=0x7f66340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- 10.20.193.106:0/1842105077 shutdown_connections 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- 10.20.193.106:0/1842105077 wait complete. 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: build_initial_monmap 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: monmap: 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:17.559 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 Processor -- start 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 1 -- start start 2026-02-17T05:34:17.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: init 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.541+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-c con 0x7f663405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-b con 0x7f663405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient(hunting): picked mon.noname-a con 0x7f6634182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663413cce0 con 0x7f6634182720 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663413f500 con 0x7f663405dee0 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663412bf70 con 0x7f663405d1b0 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:17.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient(hunting): authenticate will time out at 986.171023s 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6633fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f663405d1b0 0x7f6634128150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42606/0 (socket says 10.20.193.106:42606) 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6633fff640 1 -- 10.20.193.106:0/1942855742 learned_addr learned my addr 10.20.193.106:0/1942855742 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f66337fe640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.118:6789/0 conn(0x7f663405dee0 legacy=0x7f6634128860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976704510 0 0) 0x7f663412bf70 con 0x7f663405d1b0 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): my global_id is 4790 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66040035e0 con 0x7f663405d1b0 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790368896 0 0) 0x7f663413cce0 con 0x7f6634182720 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): my global_id is 64383 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663412bf70 con 0x7f6634182720 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 321231551 0 0) 0x7f66040035e0 con 0x7f663405d1b0 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f663413cce0 con 0x7f663405d1b0 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6620003370 con 0x7f663405d1b0 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): dump: 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.563 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 638230273 0 0) 0x7f663412bf70 con 0x7f6634182720 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66040035e0 con 0x7f6634182720 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6628005160 con 0x7f6634182720 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient(hunting): dump: 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3215152389 0 0) 0x7f663413cce0 con 0x7f663405d1b0 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.118:6789/0 conn(0x7f663405dee0 legacy=0x7f6634128860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6789/0 conn(0x7f6634182720 legacy=0x7f6634181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 monclient: found mon.c 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6634128f70 con 0x7f663405d1b0 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 5 monclient: authenticate success, global_id 4790 2026-02-17T05:34:17.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient: _renew_subs 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f663405e8e0 con 0x7f663405d1b0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient: _renew_subs 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6634129c10 con 0x7f663405d1b0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66200028c0 con 0x7f663405d1b0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6620004e60 con 0x7f663405d1b0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f6630ff9640 10 monclient: dump: 2026-02-17T05:34:17.567 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f66327fc640 4 set_mon_vals no callback set 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.542+0000 7f663a90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f663405c4c0 con 0x7f6634058b60 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6620011e00 con 0x7f663405d1b0 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(314..314 src has 1..314) ==== 3963+0+0 (unknown 2135915726 0 0) 0x7f662004ff60 con 0x7f663405d1b0 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798867868 0 0) 0x7f663405c4c0 con 0x7f6634058b60 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient(hunting): my global_id is 64386 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663413cce0 con 0x7f6634058b60 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1450104535 0 0) 0x7f663413cce0 con 0x7f6634058b60 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6638e82640 10 monclient: get_auth_request con 0x7f6604040a70 auth_method 0 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f663405c4c0 con 0x7f6634058b60 2026-02-17T05:34:17.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6624002da0 con 0x7f6634058b60 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient: dump: 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4213933887 0 0) 0x7f663405c4c0 con 0x7f6634058b60 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6634057ca0 con 0x7f6634058b60 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6624003300 con 0x7f6634058b60 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6789/0 conn(0x7f6634058b60 legacy=0x7f6634058f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.543+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6789/0 conn(0x7f6634058b60 legacy=0x7f6634058f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f663a90c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6634059a10 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011604523 0 0) 0x7f6634059a10 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient(hunting): my global_id is 64389 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663405c4c0 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4118849656 0 0) 0x7f663405c4c0 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6634059a10 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6624003540 con 0x7f6634059640 2026-02-17T05:34:17.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient: dump: 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.573 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4293694797 0 0) 0x7f6634059a10 con 0x7f6634059640 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f663408e3d0 con 0x7f6634059640 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 42815528) 0x7f6624004ef0 con 0x7f6634059640 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6789/0 conn(0x7f6634059640 legacy=0x7f6634197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.547+0000 7f6630ff9640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6789/0 conn(0x7f6634059640 legacy=0x7f6634197330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:17.574 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 24, 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 255085, 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:17.575 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.576 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.577 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:17.578 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.579 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.580 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.581 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:17.582 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.583 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.584 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.585 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:17.586 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.118:6812/703720803 conn(0x7f6604040a70 legacy=0x7f6604060f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 10 monclient: shutdown 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 >> v1:10.20.193.106:6790/0 conn(0x7f663405d1b0 legacy=0x7f6634128150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f6638e82640 1 -- 10.20.193.106:0/1942855742 reap_dead start 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f6638e82640 1 -- 10.20.193.106:0/1942855742 reap_dead start 2026-02-17T05:34:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 shutdown_connections 2026-02-17T05:34:17.588 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 >> 10.20.193.106:0/1942855742 conn(0x7f66340915f0 msgr2=0x7f663408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.588 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 shutdown_connections 2026-02-17T05:34:17.588 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.548+0000 7f663a90c640 1 -- 10.20.193.106:0/1942855742 wait complete. 2026-02-17T05:34:17.588 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:34:17.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:34:17.588 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:34:17.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.652+0000 7f860d436640 10 monclient: get_monmap_and_config 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.652+0000 7f860d436640 10 monclient: build_initial_monmap 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.652+0000 7f860d436640 10 monclient: monmap: 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:34:17.654224+0000 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:34:17.654224+0000 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:17.664 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 1 Processor -- start 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 1 -- start start 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient: init 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient(hunting): picked mon.noname-a con 0x7f860805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient(hunting): picked mon.noname-c con 0x7f860805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient(hunting): picked mon.noname-b con 0x7f8608182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860808b060 con 0x7f860805d1b0 2026-02-17T05:34:17.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860805dc90 con 0x7f860805dee0 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860808d6a0 con 0x7f8608182720 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f860d436640 10 monclient(hunting): authenticate will time out at 986.282590s 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f86067fc640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f860805dee0 legacy=0x7f8608181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8606ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f860805d1b0 0x7f860805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51646/0 (socket says 10.20.193.106:51646) 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8606ffd640 1 -- 10.20.193.106:0/4208515203 learned_addr learned my addr 10.20.193.106:0/4208515203 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74247798 0 0) 0x7f860808b060 con 0x7f860805d1b0 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): my global_id is 64392 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f40035e0 con 0x7f860805d1b0 2026-02-17T05:34:17.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651066059 0 0) 0x7f860808d6a0 con 0x7f8608182720 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.653+0000 7f8605ffb640 10 monclient(hunting): my global_id is 4793 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f860808b060 con 0x7f8608182720 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2670531250 0 0) 0x7f85f40035e0 con 0x7f860805d1b0 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 >> v1:10.20.193.106:6790/0 conn(0x7f8608182720 legacy=0x7f86081a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 >> v1:10.20.193.118:6789/0 conn(0x7f860805dee0 legacy=0x7f8608181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 monclient: found mon.noname-a 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:34:17.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8608057960 con 0x7f860805d1b0 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85fc002dd0 con 0x7f860805d1b0 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: dump: 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.668 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 5 monclient: authenticate success, global_id 64392 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85fc003090 con 0x7f860805d1b0 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 1 -- 10.20.193.106:0/4208515203 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85fc0034a0 con 0x7f860805d1b0 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f8605ffb640 10 monclient: dump: 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.669 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 10 monclient: get_monmap_and_config success 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 4 set_mon_vals no callback set 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 10 monclient: shutdown 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 1 -- 10.20.193.106:0/4208515203 >> v1:10.20.193.106:6789/0 conn(0x7f860805d1b0 legacy=0x7f860805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 1 -- 10.20.193.106:0/4208515203 shutdown_connections 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 1 -- 10.20.193.106:0/4208515203 >> 10.20.193.106:0/4208515203 conn(0x7f86080915f0 msgr2=0x7f86080919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 1 -- 10.20.193.106:0/4208515203 shutdown_connections 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 1 -- 10.20.193.106:0/4208515203 wait complete. 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 10 monclient: build_initial_monmap 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.654+0000 7f860d436640 10 monclient: monmap: 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:34:17.671 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 1 Processor -- start 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 1 -- start start 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient: init 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient: _reopen_session rank -1 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:34:17.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient(hunting): picked mon.noname-c con 0x7f860805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient(hunting): picked mon.noname-a con 0x7f860805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient(hunting): picked mon.noname-b con 0x7f8608182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860805e950 con 0x7f860805dee0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860810cb70 con 0x7f8608182720 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860812c090 con 0x7f860805d1b0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient(hunting): _renew_subs 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient(hunting): authenticate will time out at 986.284428s 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f86067fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f860805dee0 0x7f860812b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51650/0 (socket says 10.20.193.106:51650) 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f86067fc640 1 -- 10.20.193.106:0/3393139884 learned_addr learned my addr 10.20.193.106:0/3393139884 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f86077fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.118:6789/0 conn(0x7f8608182720 legacy=0x7f8608181de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459677845 0 0) 0x7f85f0003ab0 con 0x7f860805dee0 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): my global_id is 64395 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d40035e0 con 0x7f860805dee0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2842885571 0 0) 0x7f860812c090 con 0x7f860805d1b0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): my global_id is 4796 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f0003ab0 con 0x7f860805d1b0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2364135627 0 0) 0x7f85d40035e0 con 0x7f860805dee0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f860812c090 con 0x7f860805dee0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85f0005380 con 0x7f860805dee0 2026-02-17T05:34:17.674 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): dump: 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 578551902 0 0) 0x7f85f0003ab0 con 0x7f860805d1b0 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85d40035e0 con 0x7f860805d1b0 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85fc0033b0 con 0x7f860805d1b0 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient(hunting): dump: 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.676 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3771248900 0 0) 0x7f860812c090 con 0x7f860805dee0 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6790/0 conn(0x7f860805d1b0 legacy=0x7f860812b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.118:6789/0 conn(0x7f8608182720 legacy=0x7f8608181de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient: _finish_hunting 0 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 monclient: found mon.a 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860810bd00 con 0x7f860805dee0 2026-02-17T05:34:17.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient: _finish_auth 0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 10 monclient: _check_auth_tickets 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f85e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 5 monclient: authenticate success, global_id 64395 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient: _renew_subs 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.655+0000 7f860d436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f860810a810 con 0x7f860805dee0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 10 monclient: _renew_subs 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f860810b370 con 0x7f860805dee0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85f0003d30 con 0x7f860805dee0 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:34:17.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85f00040d0 con 0x7f860805dee0 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 10 monclient: dump: 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.679 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f86057fa640 4 set_mon_vals no callback set 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f86081285d0 con 0x7f8608128200 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f85f0004230 con 0x7f860805dee0 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.656+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(314..314 src has 1..314) ==== 3963+0+0 (unknown 2135915726 0 0) 0x7f85f004fd70 con 0x7f860805dee0 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529764248 0 0) 0x7f86081285d0 con 0x7f8608128200 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient(hunting): my global_id is 4799 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f860812c090 con 0x7f8608128200 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f86077fe640 10 monclient: get_auth_request con 0x7f85d4040ac0 auth_method 0 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2000289469 0 0) 0x7f860812c090 con 0x7f8608128200 2026-02-17T05:34:17.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86081285d0 con 0x7f8608128200 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85fc004a00 con 0x7f8608128200 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient: dump: 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.681 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1732420933 0 0) 0x7f86081285d0 con 0x7f8608128200 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8608057cd0 con 0x7f8608128200 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f85fc004ec0 con 0x7f8608128200 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6790/0 conn(0x7f8608128200 legacy=0x7f8608059dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.657+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6790/0 conn(0x7f8608128200 legacy=0x7f8608059dd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.660+0000 7f860d436640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.660+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f860805e950 con 0x7f8608109eb0 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485531843 0 0) 0x7f85d40035e0 con 0x7f8608109eb0 2026-02-17T05:34:17.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient(hunting): my global_id is 4802 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86081285d0 con 0x7f8608109eb0 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2338421073 0 0) 0x7f86081285d0 con 0x7f8608109eb0 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85d40035e0 con 0x7f8608109eb0 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f85fc0054a0 con 0x7f8608109eb0 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient: dump: 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.683 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 679198101 0 0) 0x7f85d40035e0 con 0x7f8608109eb0 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8608055570 con 0x7f8608109eb0 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 3760712003) 0x7f85fc0068d0 con 0x7f8608109eb0 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6790/0 conn(0x7f8608109eb0 legacy=0x7f860804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f85e77fe640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6790/0 conn(0x7f8608109eb0 legacy=0x7f860804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 24, 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 382423, 2026-02-17T05:34:17.685 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.686 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.687 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:34:17.688 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:34:17.689 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.690 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.691 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:34:17.692 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.693 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.694 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:34:17.695 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:34:17.696 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:34:17.696 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.118:6812/703720803 conn(0x7f85d4040ac0 legacy=0x7f85d4060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 10 monclient: shutdown 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 >> v1:10.20.193.106:6789/0 conn(0x7f860805dee0 legacy=0x7f860812b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f86077fe640 1 -- 10.20.193.106:0/3393139884 reap_dead start 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f86077fe640 1 -- 10.20.193.106:0/3393139884 reap_dead start 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 shutdown_connections 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 >> 10.20.193.106:0/3393139884 conn(0x7f86080915f0 msgr2=0x7f86081a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 shutdown_connections 2026-02-17T05:34:17.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:34:17.661+0000 7f860d436640 1 -- 10.20.193.106:0/3393139884 wait complete. 2026-02-17T05:34:17.697 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:34:17.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:34:18.310 INFO:tasks.rados.rados.0.trial118.stdout:1429: done (3 left) 2026-02-17T05:34:18.310 INFO:tasks.rados.rados.0.trial118.stdout:1430: done (2 left) 2026-02-17T05:34:18.310 INFO:tasks.rados.rados.0.trial118.stdout:1431: done (1 left) 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1432: done (0 left) 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1433: read oid 19 snap -1 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1433: expect (ObjNum 522 snap 143 seq_num 522) 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1434: read oid 16 snap -1 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1434: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1435: rollback oid 2 current snap is 148 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 144 2026-02-17T05:34:18.311 INFO:tasks.rados.rados.0.trial118.stdout:1436: delete oid 20 current snap is 148 2026-02-17T05:34:18.315 INFO:tasks.rados.rados.0.trial118.stdout:1434: expect (ObjNum 430 snap 114 seq_num 430) 2026-02-17T05:34:18.403 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2453865 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1435: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1434: done (3 left) 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1436: done (2 left) 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1437: read oid 40 snap -1 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1437: expect (ObjNum 525 snap 144 seq_num 525) 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1438: read oid 43 snap -1 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1438: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:34:18.423 INFO:tasks.rados.rados.0.trial118.stdout:1439: snap_remove snap 147 2026-02-17T05:34:19.314 INFO:tasks.rados.rados.0.trial118.stdout:1439: done (4 left) 2026-02-17T05:34:19.314 INFO:tasks.rados.rados.0.trial118.stdout:1440: delete oid 6 current snap is 148 2026-02-17T05:34:19.314 INFO:tasks.rados.rados.0.trial118.stdout:1433: expect (ObjNum 522 snap 143 seq_num 522) 2026-02-17T05:34:19.366 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1071595 2026-02-17T05:34:19.451 INFO:tasks.rados.rados.0.trial118.stdout:1435: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:34:19.451 INFO:tasks.rados.rados.0.trial118.stdout:1435: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:34:19.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 834 (ObjNum 459 snap 119 seq_num 459) dirty exists 2026-02-17T05:34:19.451 INFO:tasks.rados.rados.0.trial118.stdout:1438: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:34:19.451 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:19.610 INFO:tasks.rados.rados.0.trial118.stdout:1437: expect (ObjNum 525 snap 144 seq_num 525) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1433: done (4 left) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1435: done (3 left) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1437: done (2 left) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1438: done (1 left) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1440: done (0 left) 2026-02-17T05:34:19.725 INFO:tasks.rados.rados.0.trial118.stdout:1441: delete oid 22 current snap is 148 2026-02-17T05:34:19.726 INFO:tasks.rados.rados.0.trial118.stdout:1441: done (0 left) 2026-02-17T05:34:19.726 INFO:tasks.rados.rados.0.trial118.stdout:1442: snap_create 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1442: done (0 left) 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1443: read oid 21 snap -1 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1443: expect (ObjNum 433 snap 115 seq_num 433) 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1444: copy_from oid 49 from oid 46 current snap is 149 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1445: read oid 32 snap -1 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1445: expect deleted 2026-02-17T05:34:20.280 INFO:tasks.rados.rados.0.trial118.stdout:1446: snap_create 2026-02-17T05:34:20.284 INFO:tasks.rados.rados.0.trial118.stdout:1443: expect (ObjNum 433 snap 115 seq_num 433) 2026-02-17T05:34:20.308 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2500597 2026-02-17T05:34:20.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2157312 2026-02-17T05:34:20.430 INFO:tasks.rados.rados.0.trial118.stdout:1444: finishing copy_from racing read to trial11845692-49 2026-02-17T05:34:20.430 INFO:tasks.rados.rados.0.trial118.stdout:1444: finishing copy_from to trial11845692-49 2026-02-17T05:34:20.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 409 (ObjNum 487 snap 132 seq_num 487) dirty exists 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1443: done (3 left) 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1444: done (2 left) 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1445: done (1 left) 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1446: done (0 left) 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1447: copy_from oid 16 from oid 6 current snap is 150 2026-02-17T05:34:21.281 INFO:tasks.rados.rados.0.trial118.stdout:1448: snap_create 2026-02-17T05:34:21.282 INFO:tasks.rados.rados.0.trial118.stdout:1447: finishing copy_from to trial11845692-16 2026-02-17T05:34:21.282 INFO:tasks.rados.rados.0.trial118.stdout:1447: got expected ENOENT (src dne) 2026-02-17T05:34:21.282 INFO:tasks.rados.rados.0.trial118.stdout:1447: finishing copy_from racing read to trial11845692-16 2026-02-17T05:34:22.281 INFO:tasks.rados.rados.0.trial118.stdout:1447: done (1 left) 2026-02-17T05:34:22.282 INFO:tasks.rados.rados.0.trial118.stdout:1448: done (0 left) 2026-02-17T05:34:22.282 INFO:tasks.rados.rados.0.trial118.stdout:1449: copy_from oid 15 from oid 23 current snap is 151 2026-02-17T05:34:22.282 INFO:tasks.rados.rados.0.trial118.stdout:1450: write oid 40 current snap is 151 2026-02-17T05:34:22.282 INFO:tasks.rados.rados.0.trial118.stdout:1450: seq_num 540 ranges {675780=495523,1682747=714511,3012769=63011} 2026-02-17T05:34:22.287 INFO:tasks.rados.rados.0.trial118.stdout:1450: writing trial11845692-40 from 675780 to 1171303 tid 1 2026-02-17T05:34:22.291 INFO:tasks.rados.rados.0.trial118.stdout:1450: writing trial11845692-40 from 1682747 to 2397258 tid 2 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1450: writing trial11845692-40 from 3012769 to 3075780 tid 3 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1451: copy_from oid 2 from oid 3 current snap is 151 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1449: finishing copy_from racing read to trial11845692-15 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1450: finishing write tid 1 to trial11845692-40 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1452: write (excl) oid 39 current snap is 151 2026-02-17T05:34:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1452: seq_num 541 ranges {692587=570772,2024876=574522,3040192=52395} 2026-02-17T05:34:22.299 INFO:tasks.rados.rados.0.trial118.stdout:1452: writing trial11845692-39 from 692587 to 1263359 tid 1 2026-02-17T05:34:22.303 INFO:tasks.rados.rados.0.trial118.stdout:1452: writing trial11845692-39 from 2024876 to 2599398 tid 2 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1452: writing trial11845692-39 from 3040192 to 3092587 tid 3 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1453: snap_create 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1450: finishing write tid 2 to trial11845692-40 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1449: finishing copy_from to trial11845692-15 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 402 (ObjNum 371 snap 89 seq_num 371) dirty exists 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1450: finishing write tid 3 to trial11845692-40 2026-02-17T05:34:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1450: finishing write tid 4 to trial11845692-40 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: finishing write tid 5 to trial11845692-40 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: oid 40 updating version 0 to 755 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: oid 40 updating version 755 to 757 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: oid 40 version 757 is already newer than 756 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: oid 40 updating version 757 to 758 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 758 (ObjNum 540 snap 151 seq_num 540) dirty exists 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1450: left oid 40 (ObjNum 540 snap 151 seq_num 540) 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1451: finishing copy_from racing read to trial11845692-2 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1452: finishing write tid 1 to trial11845692-39 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1451: finishing copy_from to trial11845692-2 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 629 (ObjNum 484 snap 128 seq_num 484) dirty exists 2026-02-17T05:34:22.307 INFO:tasks.rados.rados.0.trial118.stdout:1452: finishing write tid 2 to trial11845692-39 2026-02-17T05:34:22.308 INFO:tasks.rados.rados.0.trial118.stdout:1452: finishing write tid 3 to trial11845692-39 2026-02-17T05:34:22.308 INFO:tasks.rados.rados.0.trial118.stdout:1452: finishing write tid 4 to trial11845692-39 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: finishing write tid 5 to trial11845692-39 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: oid 39 updating version 0 to 747 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: oid 39 version 747 is already newer than 745 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: oid 39 version 747 is already newer than 746 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: oid 39 version 747 is already newer than 744 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 747 (ObjNum 541 snap 151 seq_num 541) dirty exists 2026-02-17T05:34:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1452: left oid 39 (ObjNum 541 snap 151 seq_num 541) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1449: done (4 left) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1450: done (3 left) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1451: done (2 left) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1452: done (1 left) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1453: done (0 left) 2026-02-17T05:34:23.282 INFO:tasks.rados.rados.0.trial118.stdout:1454: snap_remove snap 151 2026-02-17T05:34:24.283 INFO:tasks.rados.rados.0.trial118.stdout:1454: done (0 left) 2026-02-17T05:34:24.283 INFO:tasks.rados.rados.0.trial118.stdout:1455: read oid 3 snap 146 2026-02-17T05:34:24.283 INFO:tasks.rados.rados.0.trial118.stdout:1455: expect (ObjNum 484 snap 128 seq_num 484) 2026-02-17T05:34:24.283 INFO:tasks.rados.rados.0.trial118.stdout:1456: write (excl) oid 8 current snap is 152 2026-02-17T05:34:24.284 INFO:tasks.rados.rados.0.trial118.stdout:1456: seq_num 542 ranges {709394=646021,2083358=718180} 2026-02-17T05:34:24.288 INFO:tasks.rados.rados.0.trial118.stdout:1456: writing trial11845692-8 from 709394 to 1355415 tid 1 2026-02-17T05:34:24.294 INFO:tasks.rados.rados.0.trial118.stdout:1456: writing trial11845692-8 from 2083358 to 2801538 tid 2 2026-02-17T05:34:24.294 INFO:tasks.rados.rados.0.trial118.stdout:1457: read oid 49 snap 145 2026-02-17T05:34:24.294 INFO:tasks.rados.rados.0.trial118.stdout:1457: expect deleted 2026-02-17T05:34:24.294 INFO:tasks.rados.rados.0.trial118.stdout:1458: snap_remove snap 143 2026-02-17T05:34:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1458: done (3 left) 2026-02-17T05:34:25.290 INFO:tasks.rados.rados.0.trial118.stdout:1459: snap_remove snap 150 2026-02-17T05:34:26.292 INFO:tasks.rados.rados.0.trial118.stdout:1459: done (3 left) 2026-02-17T05:34:26.293 INFO:tasks.rados.rados.0.trial118.stdout:1460: snap_create 2026-02-17T05:34:26.293 INFO:tasks.rados.rados.0.trial118.stdout:1455: expect (ObjNum 484 snap 128 seq_num 484) 2026-02-17T05:34:26.293 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:26.345 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: finishing write tid 1 to trial11845692-8 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: finishing write tid 2 to trial11845692-8 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: finishing write tid 3 to trial11845692-8 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: finishing write tid 4 to trial11845692-8 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: oid 8 updating version 0 to 845 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: oid 8 version 845 is already newer than 844 2026-02-17T05:34:26.371 INFO:tasks.rados.rados.0.trial118.stdout:1456: oid 8 updating version 845 to 846 2026-02-17T05:34:26.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 846 (ObjNum 542 snap 152 seq_num 542) dirty exists 2026-02-17T05:34:26.372 INFO:tasks.rados.rados.0.trial118.stdout:1456: left oid 8 (ObjNum 542 snap 152 seq_num 542) 2026-02-17T05:34:27.294 INFO:tasks.rados.rados.0.trial118.stdout:1455: done (3 left) 2026-02-17T05:34:27.294 INFO:tasks.rados.rados.0.trial118.stdout:1456: done (2 left) 2026-02-17T05:34:27.295 INFO:tasks.rados.rados.0.trial118.stdout:1457: done (1 left) 2026-02-17T05:34:27.295 INFO:tasks.rados.rados.0.trial118.stdout:1460: done (0 left) 2026-02-17T05:34:27.295 INFO:tasks.rados.rados.0.trial118.stdout:1461: write oid 32 current snap is 153 2026-02-17T05:34:27.295 INFO:tasks.rados.rados.0.trial118.stdout:1461: seq_num 543 ranges {726201=721270,2141840=578191} 2026-02-17T05:34:27.299 INFO:tasks.rados.rados.0.trial118.stdout:1461: writing trial11845692-32 from 726201 to 1447471 tid 1 2026-02-17T05:34:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1461: writing trial11845692-32 from 2141840 to 2720031 tid 2 2026-02-17T05:34:27.305 INFO:tasks.rados.rados.0.trial118.stdout:1462: delete oid 42 current snap is 153 2026-02-17T05:34:27.305 INFO:tasks.rados.rados.0.trial118.stdout:1461: finishing write tid 1 to trial11845692-32 2026-02-17T05:34:27.306 INFO:tasks.rados.rados.0.trial118.stdout:1461: finishing write tid 2 to trial11845692-32 2026-02-17T05:34:27.306 INFO:tasks.rados.rados.0.trial118.stdout:1461: finishing write tid 3 to trial11845692-32 2026-02-17T05:34:27.306 INFO:tasks.rados.rados.0.trial118.stdout:1461: finishing write tid 4 to trial11845692-32 2026-02-17T05:34:27.306 INFO:tasks.rados.rados.0.trial118.stdout:1461: oid 32 updating version 0 to 410 2026-02-17T05:34:27.306 INFO:tasks.rados.rados.0.trial118.stdout:1461: oid 32 updating version 410 to 412 2026-02-17T05:34:27.307 INFO:tasks.rados.rados.0.trial118.stdout:1461: oid 32 version 412 is already newer than 411 2026-02-17T05:34:27.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:34:27.307 INFO:tasks.rados.rados.0.trial118.stdout:1461: left oid 32 (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1461: done (1 left) 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1462: done (0 left) 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1463: delete oid 38 current snap is 153 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1463: done (0 left) 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1464: write oid 15 current snap is 153 2026-02-17T05:34:27.308 INFO:tasks.rados.rados.0.trial118.stdout:1464: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2026-02-17T05:34:27.313 INFO:tasks.rados.rados.0.trial118.stdout:1464: writing trial11845692-15 from 776622 to 1323639 tid 1 2026-02-17T05:34:27.317 INFO:tasks.rados.rados.0.trial118.stdout:1464: writing trial11845692-15 from 1800933 to 2526451 tid 2 2026-02-17T05:34:27.320 INFO:tasks.rados.rados.0.trial118.stdout:1464: writing trial11845692-15 from 2944601 to 3176622 tid 3 2026-02-17T05:34:27.320 INFO:tasks.rados.rados.0.trial118.stdout:1465: delete oid 29 current snap is 153 2026-02-17T05:34:27.320 INFO:tasks.rados.rados.0.trial118.stdout:1464: finishing write tid 1 to trial11845692-15 2026-02-17T05:34:27.320 INFO:tasks.rados.rados.0.trial118.stdout:1464: finishing write tid 2 to trial11845692-15 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: finishing write tid 3 to trial11845692-15 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: finishing write tid 4 to trial11845692-15 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: finishing write tid 5 to trial11845692-15 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: oid 15 updating version 0 to 682 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: oid 15 version 682 is already newer than 681 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: oid 15 updating version 682 to 683 2026-02-17T05:34:27.321 INFO:tasks.rados.rados.0.trial118.stdout:1464: oid 15 version 683 is already newer than 680 2026-02-17T05:34:27.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 683 (ObjNum 546 snap 153 seq_num 546) dirty exists 2026-02-17T05:34:27.322 INFO:tasks.rados.rados.0.trial118.stdout:1464: left oid 15 (ObjNum 546 snap 153 seq_num 546) 2026-02-17T05:34:27.322 INFO:tasks.rados.rados.0.trial118.stdout:1464: done (1 left) 2026-02-17T05:34:27.323 INFO:tasks.rados.rados.0.trial118.stdout:1465: done (0 left) 2026-02-17T05:34:27.323 INFO:tasks.rados.rados.0.trial118.stdout:1466: rollback oid 19 current snap is 153 2026-02-17T05:34:27.323 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 146 2026-02-17T05:34:27.323 INFO:tasks.rados.rados.0.trial118.stdout:1467: write (excl) oid 44 current snap is 153 2026-02-17T05:34:27.323 INFO:tasks.rados.rados.0.trial118.stdout:1467: seq_num 548 ranges {410236=413868,1234250=729187,2715800=423063} 2026-02-17T05:34:27.325 INFO:tasks.rados.rados.0.trial118.stdout:1467: writing trial11845692-44 from 410236 to 824104 tid 1 2026-02-17T05:34:27.329 INFO:tasks.rados.rados.0.trial118.stdout:1467: writing trial11845692-44 from 1234250 to 1963437 tid 2 2026-02-17T05:34:27.334 INFO:tasks.rados.rados.0.trial118.stdout:1467: writing trial11845692-44 from 2715800 to 3138863 tid 3 2026-02-17T05:34:27.334 INFO:tasks.rados.rados.0.trial118.stdout:1468: write oid 4 current snap is 153 2026-02-17T05:34:27.334 INFO:tasks.rados.rados.0.trial118.stdout:1468: seq_num 549 ranges {427043=489117,1576379=472845,2626870=600173} 2026-02-17T05:34:27.337 INFO:tasks.rados.rados.0.trial118.stdout:1468: writing trial11845692-4 from 427043 to 916160 tid 1 2026-02-17T05:34:27.342 INFO:tasks.rados.rados.0.trial118.stdout:1468: writing trial11845692-4 from 1576379 to 2049224 tid 2 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1468: writing trial11845692-4 from 2626870 to 3227043 tid 3 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1469: delete oid 5 current snap is 153 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1466: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1466: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1466: finishing rollback tid 2 to trial11845692-19 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 638 (ObjNum 522 snap 143 seq_num 522) dirty exists 2026-02-17T05:34:27.347 INFO:tasks.rados.rados.0.trial118.stdout:1467: finishing write tid 1 to trial11845692-44 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: finishing write tid 2 to trial11845692-44 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: finishing write tid 3 to trial11845692-44 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: finishing write tid 4 to trial11845692-44 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: finishing write tid 5 to trial11845692-44 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: oid 44 updating version 0 to 247 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: oid 44 updating version 247 to 248 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: oid 44 updating version 248 to 249 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: oid 44 updating version 249 to 250 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 250 (ObjNum 548 snap 153 seq_num 548) dirty exists 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1467: left oid 44 (ObjNum 548 snap 153 seq_num 548) 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1468: finishing write tid 1 to trial11845692-4 2026-02-17T05:34:27.348 INFO:tasks.rados.rados.0.trial118.stdout:1468: finishing write tid 2 to trial11845692-4 2026-02-17T05:34:27.349 INFO:tasks.rados.rados.0.trial118.stdout:1466: done (3 left) 2026-02-17T05:34:27.349 INFO:tasks.rados.rados.0.trial118.stdout:1467: done (2 left) 2026-02-17T05:34:27.349 INFO:tasks.rados.rados.0.trial118.stdout:1469: done (1 left) 2026-02-17T05:34:27.349 INFO:tasks.rados.rados.0.trial118.stdout:1470: write oid 37 current snap is 153 2026-02-17T05:34:27.349 INFO:tasks.rados.rados.0.trial118.stdout:1470: seq_num 551 ranges {460657=639615,1693343=476514,2681716=578941} 2026-02-17T05:34:27.352 INFO:tasks.rados.rados.0.trial118.stdout:1470: writing trial11845692-37 from 460657 to 1100272 tid 1 2026-02-17T05:34:27.356 INFO:tasks.rados.rados.0.trial118.stdout:1470: writing trial11845692-37 from 1693343 to 2169857 tid 2 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1470: writing trial11845692-37 from 2681716 to 3260657 tid 3 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1471: delete oid 35 current snap is 153 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: finishing write tid 3 to trial11845692-4 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: finishing write tid 4 to trial11845692-4 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: finishing write tid 5 to trial11845692-4 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: oid 4 updating version 0 to 703 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: oid 4 version 703 is already newer than 702 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: oid 4 version 703 is already newer than 701 2026-02-17T05:34:27.361 INFO:tasks.rados.rados.0.trial118.stdout:1468: oid 4 updating version 703 to 704 2026-02-17T05:34:27.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 704 (ObjNum 549 snap 153 seq_num 549) dirty exists 2026-02-17T05:34:27.362 INFO:tasks.rados.rados.0.trial118.stdout:1468: left oid 4 (ObjNum 549 snap 153 seq_num 549) 2026-02-17T05:34:27.362 INFO:tasks.rados.rados.0.trial118.stdout:1470: finishing write tid 1 to trial11845692-37 2026-02-17T05:34:27.362 INFO:tasks.rados.rados.0.trial118.stdout:1470: finishing write tid 2 to trial11845692-37 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1470: finishing write tid 3 to trial11845692-37 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1470: finishing write tid 4 to trial11845692-37 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1468: done (2 left) 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1471: done (1 left) 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1472: rollback oid 28 current snap is 153 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 148 2026-02-17T05:34:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1470: finishing write tid 5 to trial11845692-37 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: oid 37 updating version 0 to 139 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: oid 37 version 139 is already newer than 138 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: oid 37 updating version 139 to 141 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: oid 37 version 141 is already newer than 140 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 141 (ObjNum 551 snap 153 seq_num 551) dirty exists 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: left oid 37 (ObjNum 551 snap 153 seq_num 551) 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1470: done (1 left) 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1473: delete oid 42 current snap is 153 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1473: done (1 left) 2026-02-17T05:34:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1474: snap_remove snap 145 2026-02-17T05:34:28.299 INFO:tasks.rados.rados.0.trial118.stdout:1474: done (1 left) 2026-02-17T05:34:28.299 INFO:tasks.rados.rados.0.trial118.stdout:1475: write oid 35 current snap is 153 2026-02-17T05:34:28.299 INFO:tasks.rados.rados.0.trial118.stdout:1475: seq_num 554 ranges {511078=465362,1752436=740194,3163985=147093} 2026-02-17T05:34:28.303 INFO:tasks.rados.rados.0.trial118.stdout:1475: writing trial11845692-35 from 511078 to 976440 tid 1 2026-02-17T05:34:28.309 INFO:tasks.rados.rados.0.trial118.stdout:1475: writing trial11845692-35 from 1752436 to 2492630 tid 2 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1475: writing trial11845692-35 from 3163985 to 3311078 tid 3 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1476: write oid 16 current snap is 153 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1472: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1472: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1472: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:34:28.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 367 (ObjNum 533 snap 146 seq_num 533) dirty exists 2026-02-17T05:34:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1475: finishing write tid 1 to trial11845692-35 2026-02-17T05:34:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1475: finishing write tid 2 to trial11845692-35 2026-02-17T05:34:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1476: seq_num 555 ranges {527885=656964,1927271=483852,3191408=136477} 2026-02-17T05:34:28.316 INFO:tasks.rados.rados.0.trial118.stdout:1476: writing trial11845692-16 from 527885 to 1184849 tid 1 2026-02-17T05:34:28.321 INFO:tasks.rados.rados.0.trial118.stdout:1476: writing trial11845692-16 from 1927271 to 2411123 tid 2 2026-02-17T05:34:28.325 INFO:tasks.rados.rados.0.trial118.stdout:1476: writing trial11845692-16 from 3191408 to 3327885 tid 3 2026-02-17T05:34:28.325 INFO:tasks.rados.rados.0.trial118.stdout:1472: done (2 left) 2026-02-17T05:34:28.325 INFO:tasks.rados.rados.0.trial118.stdout:1477: snap_remove snap 149 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1477: done (2 left) 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1478: delete oid 36 current snap is 153 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1475: finishing write tid 3 to trial11845692-35 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1475: finishing write tid 4 to trial11845692-35 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1475: finishing write tid 5 to trial11845692-35 2026-02-17T05:34:29.300 INFO:tasks.rados.rados.0.trial118.stdout:1475: oid 35 updating version 0 to 257 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1475: oid 35 updating version 257 to 260 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1475: oid 35 version 260 is already newer than 258 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1475: oid 35 version 260 is already newer than 259 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 260 (ObjNum 554 snap 153 seq_num 554) dirty exists 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1475: left oid 35 (ObjNum 554 snap 153 seq_num 554) 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: finishing write tid 1 to trial11845692-16 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: finishing write tid 2 to trial11845692-16 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: finishing write tid 3 to trial11845692-16 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: finishing write tid 4 to trial11845692-16 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: finishing write tid 5 to trial11845692-16 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: oid 16 updating version 0 to 710 2026-02-17T05:34:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1476: oid 16 updating version 710 to 713 2026-02-17T05:34:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1476: oid 16 version 713 is already newer than 711 2026-02-17T05:34:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1476: oid 16 version 713 is already newer than 712 2026-02-17T05:34:29.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 713 (ObjNum 555 snap 153 seq_num 555) dirty exists 2026-02-17T05:34:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1476: left oid 16 (ObjNum 555 snap 153 seq_num 555) 2026-02-17T05:34:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1475: done (2 left) 2026-02-17T05:34:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1476: done (1 left) 2026-02-17T05:34:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1478: done (0 left) 2026-02-17T05:34:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1479: write (excl) oid 28 current snap is 153 2026-02-17T05:34:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1479: seq_num 557 ranges {561499=407462,1527882=487521,2729901=557217} 2026-02-17T05:34:29.306 INFO:tasks.rados.rados.0.trial118.stdout:1479: writing trial11845692-28 from 561499 to 968961 tid 1 2026-02-17T05:34:29.310 INFO:tasks.rados.rados.0.trial118.stdout:1479: writing trial11845692-28 from 1527882 to 2015403 tid 2 2026-02-17T05:34:29.315 INFO:tasks.rados.rados.0.trial118.stdout:1479: writing trial11845692-28 from 2729901 to 3287118 tid 3 2026-02-17T05:34:29.315 INFO:tasks.rados.rados.0.trial118.stdout:1480: snap_remove snap 146 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1480: done (1 left) 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1481: read oid 4 snap -1 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1481: expect (ObjNum 549 snap 153 seq_num 549) 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1482: snap_create 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1479: finishing write tid 1 to trial11845692-28 2026-02-17T05:34:30.283 INFO:tasks.rados.rados.0.trial118.stdout:1479: finishing write tid 2 to trial11845692-28 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: finishing write tid 3 to trial11845692-28 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: finishing write tid 4 to trial11845692-28 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: finishing write tid 5 to trial11845692-28 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: oid 28 updating version 0 to 370 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: oid 28 updating version 370 to 373 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: oid 28 updating version 373 to 375 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: oid 28 version 375 is already newer than 374 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 375 (ObjNum 557 snap 153 seq_num 557) dirty exists 2026-02-17T05:34:30.284 INFO:tasks.rados.rados.0.trial118.stdout:1479: left oid 28 (ObjNum 557 snap 153 seq_num 557) 2026-02-17T05:34:30.289 INFO:tasks.rados.rados.0.trial118.stdout:1481: expect (ObjNum 549 snap 153 seq_num 549) 2026-02-17T05:34:30.342 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:31.281 INFO:tasks.rados.rados.0.trial118.stdout:1479: done (2 left) 2026-02-17T05:34:31.282 INFO:tasks.rados.rados.0.trial118.stdout:1481: done (1 left) 2026-02-17T05:34:31.282 INFO:tasks.rados.rados.0.trial118.stdout:1482: done (0 left) 2026-02-17T05:34:31.282 INFO:tasks.rados.rados.0.trial118.stdout:1483: write oid 3 current snap is 154 2026-02-17T05:34:31.282 INFO:tasks.rados.rados.0.trial118.stdout:1483: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2026-02-17T05:34:31.285 INFO:tasks.rados.rados.0.trial118.stdout:1483: writing trial11845692-3 from 578306 to 1061017 tid 1 2026-02-17T05:34:31.289 INFO:tasks.rados.rados.0.trial118.stdout:1483: writing trial11845692-3 from 1586364 to 2217543 tid 2 2026-02-17T05:34:31.293 INFO:tasks.rados.rados.0.trial118.stdout:1483: writing trial11845692-3 from 2757324 to 3242166 tid 3 2026-02-17T05:34:31.294 INFO:tasks.rados.rados.0.trial118.stdout:1484: write (excl) oid 29 current snap is 154 2026-02-17T05:34:31.294 INFO:tasks.rados.rados.0.trial118.stdout:1484: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2026-02-17T05:34:31.297 INFO:tasks.rados.rados.0.trial118.stdout:1484: writing trial11845692-29 from 595113 to 1153073 tid 1 2026-02-17T05:34:31.301 INFO:tasks.rados.rados.0.trial118.stdout:1484: writing trial11845692-29 from 1644846 to 2136036 tid 2 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1484: writing trial11845692-29 from 2784747 to 3395113 tid 3 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1485: read oid 14 snap -1 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1485: expect (ObjNum 529 snap 145 seq_num 529) 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1486: copy_from oid 19 from oid 27 current snap is 154 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1483: finishing write tid 1 to trial11845692-3 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1483: finishing write tid 2 to trial11845692-3 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1483: finishing write tid 3 to trial11845692-3 2026-02-17T05:34:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1483: finishing write tid 4 to trial11845692-3 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: finishing write tid 5 to trial11845692-3 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: oid 3 updating version 0 to 642 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: oid 3 version 642 is already newer than 640 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: oid 3 version 642 is already newer than 641 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: oid 3 version 642 is already newer than 639 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 642 (ObjNum 558 snap 154 seq_num 558) dirty exists 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: left oid 3 (ObjNum 558 snap 154 seq_num 558) 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1484: finishing write tid 1 to trial11845692-29 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1483: done (3 left) 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1487: snap_create 2026-02-17T05:34:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1484: finishing write tid 2 to trial11845692-29 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: finishing write tid 3 to trial11845692-29 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: finishing write tid 4 to trial11845692-29 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: finishing write tid 5 to trial11845692-29 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: oid 29 updating version 0 to 726 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: oid 29 updating version 726 to 728 2026-02-17T05:34:31.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: oid 29 updating version 728 to 729 2026-02-17T05:34:31.310 INFO:tasks.rados.rados.0.trial118.stdout:1484: oid 29 version 729 is already newer than 727 2026-02-17T05:34:31.310 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 729 (ObjNum 559 snap 154 seq_num 559) dirty exists 2026-02-17T05:34:31.310 INFO:tasks.rados.rados.0.trial118.stdout:1484: left oid 29 (ObjNum 559 snap 154 seq_num 559) 2026-02-17T05:34:31.313 INFO:tasks.rados.rados.0.trial118.stdout:1485: expect (ObjNum 529 snap 145 seq_num 529) 2026-02-17T05:34:31.313 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:31.390 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 828148 2026-02-17T05:34:31.419 INFO:tasks.rados.rados.0.trial118.stdout:1486: finishing copy_from racing read to trial11845692-19 2026-02-17T05:34:31.420 INFO:tasks.rados.rados.0.trial118.stdout:1486: finishing copy_from to trial11845692-19 2026-02-17T05:34:31.420 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 674 (ObjNum 495 snap 134 seq_num 495) dirty exists 2026-02-17T05:34:32.309 INFO:tasks.rados.rados.0.trial118.stdout:1484: done (3 left) 2026-02-17T05:34:32.309 INFO:tasks.rados.rados.0.trial118.stdout:1485: done (2 left) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1486: done (1 left) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1487: done (0 left) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1488: read oid 8 snap -1 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1488: expect (ObjNum 542 snap 152 seq_num 542) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1489: read oid 9 snap -1 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1489: expect (ObjNum 508 snap 137 seq_num 508) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1490: read oid 31 snap -1 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1490: expect (ObjNum 532 snap 145 seq_num 532) 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:1491: rollback oid 21 current snap is 155 2026-02-17T05:34:32.310 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 152 2026-02-17T05:34:32.311 INFO:tasks.rados.rados.0.trial118.stdout:1492: write oid 22 current snap is 155 2026-02-17T05:34:32.311 INFO:tasks.rados.rados.0.trial118.stdout:1492: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2026-02-17T05:34:32.314 INFO:tasks.rados.rados.0.trial118.stdout:1492: writing trial11845692-22 from 611920 to 1245129 tid 1 2026-02-17T05:34:32.318 INFO:tasks.rados.rados.0.trial118.stdout:1492: writing trial11845692-22 from 1703328 to 2338176 tid 2 2026-02-17T05:34:32.322 INFO:tasks.rados.rados.0.trial118.stdout:1492: writing trial11845692-22 from 2812170 to 3319556 tid 3 2026-02-17T05:34:32.322 INFO:tasks.rados.rados.0.trial118.stdout:1493: rollback oid 40 current snap is 155 2026-02-17T05:34:32.322 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 153 2026-02-17T05:34:32.322 INFO:tasks.rados.rados.0.trial118.stdout:1494: read oid 7 snap -1 2026-02-17T05:34:32.322 INFO:tasks.rados.rados.0.trial118.stdout:1494: expect (ObjNum 479 snap 125 seq_num 479) 2026-02-17T05:34:32.323 INFO:tasks.rados.rados.0.trial118.stdout:1495: rollback oid 3 current snap is 155 2026-02-17T05:34:32.323 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 154 2026-02-17T05:34:32.323 INFO:tasks.rados.rados.0.trial118.stdout:1489: expect (ObjNum 508 snap 137 seq_num 508) 2026-02-17T05:34:32.356 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:32.419 INFO:tasks.rados.rados.0.trial118.stdout:1491: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:34:32.419 INFO:tasks.rados.rados.0.trial118.stdout:1491: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:34:32.419 INFO:tasks.rados.rados.0.trial118.stdout:1489: done (7 left) 2026-02-17T05:34:32.419 INFO:tasks.rados.rados.0.trial118.stdout:1496: rollback oid 39 current snap is 155 2026-02-17T05:34:32.419 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 154 2026-02-17T05:34:32.420 INFO:tasks.rados.rados.0.trial118.stdout:1491: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:34:32.420 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 776 (ObjNum 433 snap 115 seq_num 433) dirty exists 2026-02-17T05:34:32.420 INFO:tasks.rados.rados.0.trial118.stdout:1488: expect (ObjNum 542 snap 152 seq_num 542) 2026-02-17T05:34:32.454 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 912708 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1492: finishing write tid 1 to trial11845692-22 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1488: done (7 left) 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1491: done (6 left) 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1497: rollback oid 6 current snap is 155 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 152 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1492: finishing write tid 2 to trial11845692-22 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:1490: expect (ObjNum 532 snap 145 seq_num 532) 2026-02-17T05:34:32.507 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:32.601 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:32.649 INFO:tasks.rados.rados.0.trial118.stdout:1492: finishing write tid 3 to trial11845692-22 2026-02-17T05:34:32.649 INFO:tasks.rados.rados.0.trial118.stdout:1490: done (6 left) 2026-02-17T05:34:32.649 INFO:tasks.rados.rados.0.trial118.stdout:1498: read oid 5 snap -1 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1498: expect deleted 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1499: delete oid 45 current snap is 155 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: finishing write tid 4 to trial11845692-22 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: finishing write tid 5 to trial11845692-22 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: oid 22 updating version 0 to 688 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: oid 22 version 688 is already newer than 687 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: oid 22 version 688 is already newer than 685 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: oid 22 version 688 is already newer than 686 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 688 (ObjNum 560 snap 155 seq_num 560) dirty exists 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1492: left oid 22 (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:34:32.650 INFO:tasks.rados.rados.0.trial118.stdout:1495: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1495: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1493: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1493: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1495: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 677 (ObjNum 558 snap 154 seq_num 558) dirty exists 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1493: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 780 (ObjNum 540 snap 151 seq_num 540) dirty exists 2026-02-17T05:34:32.651 INFO:tasks.rados.rados.0.trial118.stdout:1494: expect (ObjNum 479 snap 125 seq_num 479) 2026-02-17T05:34:32.663 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:32.679 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1116705 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:1496: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:1496: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:1496: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 782 (ObjNum 541 snap 151 seq_num 541) dirty exists 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:1497: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 642 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:34:32.689 INFO:tasks.rados.rados.0.trial118.stdout:1492: done (7 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1493: done (6 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1494: done (5 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1495: done (4 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1496: done (3 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1497: done (2 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1498: done (1 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1499: done (0 left) 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1500: read oid 42 snap 154 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1500: expect deleted 2026-02-17T05:34:32.690 INFO:tasks.rados.rados.0.trial118.stdout:1501: read oid 36 snap -1 2026-02-17T05:34:32.691 INFO:tasks.rados.rados.0.trial118.stdout:1501: expect deleted 2026-02-17T05:34:32.691 INFO:tasks.rados.rados.0.trial118.stdout:1502: write (excl) oid 27 current snap is 155 2026-02-17T05:34:32.691 INFO:tasks.rados.rados.0.trial118.stdout:1502: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2026-02-17T05:34:32.693 INFO:tasks.rados.rados.0.trial118.stdout:1502: writing trial11845692-27 from 645534 to 1429241 tid 1 2026-02-17T05:34:32.698 INFO:tasks.rados.rados.0.trial118.stdout:1502: writing trial11845692-27 from 2103939 to 2742456 tid 2 2026-02-17T05:34:32.701 INFO:tasks.rados.rados.0.trial118.stdout:1502: writing trial11845692-27 from 3150663 to 3445534 tid 3 2026-02-17T05:34:32.701 INFO:tasks.rados.rados.0.trial118.stdout:1503: write (excl) oid 35 current snap is 155 2026-02-17T05:34:32.701 INFO:tasks.rados.rados.0.trial118.stdout:1503: seq_num 563 ranges {662341=575309,1878774=498528,2894439=457555} 2026-02-17T05:34:32.705 INFO:tasks.rados.rados.0.trial118.stdout:1503: writing trial11845692-35 from 662341 to 1237650 tid 1 2026-02-17T05:34:32.709 INFO:tasks.rados.rados.0.trial118.stdout:1503: writing trial11845692-35 from 1878774 to 2377302 tid 2 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1503: writing trial11845692-35 from 2894439 to 3351994 tid 3 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1504: copy_from oid 24 from oid 32 current snap is 155 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: finishing write tid 1 to trial11845692-27 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: finishing write tid 2 to trial11845692-27 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1500: done (4 left) 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1501: done (3 left) 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1505: delete oid 33 current snap is 155 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: finishing write tid 3 to trial11845692-27 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: finishing write tid 4 to trial11845692-27 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: finishing write tid 5 to trial11845692-27 2026-02-17T05:34:32.713 INFO:tasks.rados.rados.0.trial118.stdout:1502: oid 27 updating version 0 to 879 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1502: oid 27 updating version 879 to 881 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1502: oid 27 version 881 is already newer than 878 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1502: oid 27 version 881 is already newer than 880 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 881 (ObjNum 562 snap 155 seq_num 562) dirty exists 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1502: left oid 27 (ObjNum 562 snap 155 seq_num 562) 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1503: finishing write tid 1 to trial11845692-35 2026-02-17T05:34:32.714 INFO:tasks.rados.rados.0.trial118.stdout:1503: finishing write tid 2 to trial11845692-35 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1502: done (3 left) 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1505: done (2 left) 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1506: read oid 15 snap -1 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1506: expect (ObjNum 546 snap 153 seq_num 546) 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1507: rollback oid 29 current snap is 155 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 153 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1508: delete oid 23 current snap is 155 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: finishing write tid 3 to trial11845692-35 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: finishing write tid 4 to trial11845692-35 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: finishing write tid 5 to trial11845692-35 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: oid 35 updating version 0 to 271 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: oid 35 updating version 271 to 273 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: oid 35 version 273 is already newer than 270 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: oid 35 version 273 is already newer than 272 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 273 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:34:32.715 INFO:tasks.rados.rados.0.trial118.stdout:1503: left oid 35 (ObjNum 563 snap 155 seq_num 563) 2026-02-17T05:34:32.716 INFO:tasks.rados.rados.0.trial118.stdout:1507: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:34:32.716 INFO:tasks.rados.rados.0.trial118.stdout:1503: done (4 left) 2026-02-17T05:34:32.716 INFO:tasks.rados.rados.0.trial118.stdout:1508: done (3 left) 2026-02-17T05:34:32.716 INFO:tasks.rados.rados.0.trial118.stdout:1509: write oid 21 current snap is 155 2026-02-17T05:34:32.716 INFO:tasks.rados.rados.0.trial118.stdout:1509: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2026-02-17T05:34:32.720 INFO:tasks.rados.rados.0.trial118.stdout:1509: writing trial11845692-21 from 712762 to 1113818 tid 1 2026-02-17T05:34:32.724 INFO:tasks.rados.rados.0.trial118.stdout:1509: writing trial11845692-21 from 1537867 to 2183722 tid 2 2026-02-17T05:34:32.729 INFO:tasks.rados.rados.0.trial118.stdout:1509: writing trial11845692-21 from 2860355 to 3512762 tid 3 2026-02-17T05:34:32.729 INFO:tasks.rados.rados.0.trial118.stdout:1510: rollback oid 37 current snap is 155 2026-02-17T05:34:32.729 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 154 2026-02-17T05:34:32.729 INFO:tasks.rados.rados.0.trial118.stdout:1507: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:34:32.730 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 732 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:34:32.730 INFO:tasks.rados.rados.0.trial118.stdout:1506: expect (ObjNum 546 snap 153 seq_num 546) 2026-02-17T05:34:32.824 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2382133 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1504: finishing copy_from racing read to trial11845692-24 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1506: done (4 left) 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1507: done (3 left) 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1511: copy_from oid 16 from oid 36 current snap is 155 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1509: finishing write tid 1 to trial11845692-21 2026-02-17T05:34:32.834 INFO:tasks.rados.rados.0.trial118.stdout:1504: finishing copy_from to trial11845692-24 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: finishing write tid 2 to trial11845692-21 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1510: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1510: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: finishing write tid 3 to trial11845692-21 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1510: finishing rollback tid 2 to trial11845692-37 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 144 (ObjNum 551 snap 153 seq_num 551) dirty exists 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: finishing write tid 4 to trial11845692-21 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: finishing write tid 5 to trial11845692-21 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: oid 21 updating version 0 to 786 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: oid 21 version 786 is already newer than 785 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: oid 21 version 786 is already newer than 783 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: oid 21 version 786 is already newer than 784 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 786 (ObjNum 566 snap 155 seq_num 566) dirty exists 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: left oid 21 (ObjNum 566 snap 155 seq_num 566) 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1504: done (3 left) 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1509: done (2 left) 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1510: done (1 left) 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1512: write (excl) oid 18 current snap is 155 2026-02-17T05:34:32.835 INFO:tasks.rados.rados.0.trial118.stdout:1512: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2026-02-17T05:34:32.839 INFO:tasks.rados.rados.0.trial118.stdout:1512: writing trial11845692-18 from 729569 to 1205874 tid 1 2026-02-17T05:34:32.844 INFO:tasks.rados.rados.0.trial118.stdout:1512: writing trial11845692-18 from 1996349 to 2502215 tid 2 2026-02-17T05:34:32.848 INFO:tasks.rados.rados.0.trial118.stdout:1512: writing trial11845692-18 from 3004131 to 3529569 tid 3 2026-02-17T05:34:32.848 INFO:tasks.rados.rados.0.trial118.stdout:1513: snap_remove snap 148 2026-02-17T05:34:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1513: done (2 left) 2026-02-17T05:34:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1514: rollback oid 20 current snap is 155 2026-02-17T05:34:33.312 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 154 2026-02-17T05:34:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1511: finishing copy_from to trial11845692-16 2026-02-17T05:34:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1511: got expected ENOENT (src dne) 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1511: finishing copy_from racing read to trial11845692-16 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: finishing write tid 1 to trial11845692-18 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: finishing write tid 2 to trial11845692-18 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: finishing write tid 3 to trial11845692-18 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: finishing write tid 4 to trial11845692-18 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: finishing write tid 5 to trial11845692-18 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: oid 18 updating version 0 to 379 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: oid 18 updating version 379 to 381 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: oid 18 version 381 is already newer than 380 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:1512: oid 18 updating version 381 to 382 2026-02-17T05:34:33.313 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 382 (ObjNum 567 snap 155 seq_num 567) dirty exists 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1512: left oid 18 (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1511: done (2 left) 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1512: done (1 left) 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1515: read oid 44 snap -1 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1515: expect (ObjNum 548 snap 153 seq_num 548) 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1516: read oid 22 snap -1 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1516: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:34:33.314 INFO:tasks.rados.rados.0.trial118.stdout:1517: delete oid 33 current snap is 155 2026-02-17T05:34:33.315 INFO:tasks.rados.rados.0.trial118.stdout:1517: done (3 left) 2026-02-17T05:34:33.315 INFO:tasks.rados.rados.0.trial118.stdout:1518: write oid 19 current snap is 155 2026-02-17T05:34:33.315 INFO:tasks.rados.rados.0.trial118.stdout:1518: seq_num 569 ranges {763183=626803,1996960=793182,3226271=336912} 2026-02-17T05:34:33.319 INFO:tasks.rados.rados.0.trial118.stdout:1518: writing trial11845692-19 from 763183 to 1389986 tid 1 2026-02-17T05:34:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1518: writing trial11845692-19 from 1996960 to 2790142 tid 2 2026-02-17T05:34:33.327 INFO:tasks.rados.rados.0.trial118.stdout:1518: writing trial11845692-19 from 3226271 to 3563183 tid 3 2026-02-17T05:34:33.327 INFO:tasks.rados.rados.0.trial118.stdout:1519: read oid 37 snap -1 2026-02-17T05:34:33.327 INFO:tasks.rados.rados.0.trial118.stdout:1519: expect (ObjNum 551 snap 153 seq_num 551) 2026-02-17T05:34:33.327 INFO:tasks.rados.rados.0.trial118.stdout:1520: snap_remove snap 152 2026-02-17T05:34:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1520: done (5 left) 2026-02-17T05:34:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1521: delete oid 28 current snap is 155 2026-02-17T05:34:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1514: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:34:34.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 836 (ObjNum 129 snap 0 seq_num 12424848) dirty dne 2026-02-17T05:34:34.316 INFO:tasks.rados.rados.0.trial118.stdout:1515: expect (ObjNum 548 snap 153 seq_num 548) 2026-02-17T05:34:34.321 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1046660 2026-02-17T05:34:34.392 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2270984 2026-02-17T05:34:34.406 INFO:tasks.rados.rados.0.trial118.stdout:1516: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:34:34.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:34.477 INFO:tasks.rados.rados.0.trial118.stdout:1518: finishing write tid 1 to trial11845692-19 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: finishing write tid 2 to trial11845692-19 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: finishing write tid 3 to trial11845692-19 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: finishing write tid 4 to trial11845692-19 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: finishing write tid 5 to trial11845692-19 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: oid 19 updating version 0 to 681 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: oid 19 version 681 is already newer than 679 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: oid 19 version 681 is already newer than 678 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: oid 19 version 681 is already newer than 680 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 681 (ObjNum 569 snap 155 seq_num 569) dirty exists 2026-02-17T05:34:34.478 INFO:tasks.rados.rados.0.trial118.stdout:1518: left oid 19 (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:34:34.479 INFO:tasks.rados.rados.0.trial118.stdout:1519: expect (ObjNum 551 snap 153 seq_num 551) 2026-02-17T05:34:34.543 INFO:tasks.rados.rados.0.trial118.stdout:1514: done (5 left) 2026-02-17T05:34:34.543 INFO:tasks.rados.rados.0.trial118.stdout:1515: done (4 left) 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1516: done (3 left) 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1518: done (2 left) 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1519: done (1 left) 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1521: done (0 left) 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1522: rollback oid 31 current snap is 155 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 154 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1523: copy_from oid 3 from oid 17 current snap is 155 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1524: write oid 21 current snap is 155 2026-02-17T05:34:34.544 INFO:tasks.rados.rados.0.trial118.stdout:1524: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2026-02-17T05:34:34.547 INFO:tasks.rados.rados.0.trial118.stdout:1524: writing trial11845692-21 from 796797 to 1290451 tid 1 2026-02-17T05:34:34.552 INFO:tasks.rados.rados.0.trial118.stdout:1524: writing trial11845692-21 from 1830277 to 2627128 tid 2 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:1524: writing trial11845692-21 from 3397470 to 3596797 tid 3 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:1525: copy_from oid 10 from oid 11 current snap is 155 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:1522: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:1522: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:1522: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:34:34.557 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 894 (ObjNum 532 snap 145 seq_num 532) dirty exists 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1524: finishing write tid 1 to trial11845692-21 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1523: finishing copy_from racing read to trial11845692-3 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1524: finishing write tid 2 to trial11845692-21 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1523: finishing copy_from to trial11845692-3 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 256 (ObjNum 473 snap 122 seq_num 473) dirty exists 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1522: done (3 left) 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1523: done (2 left) 2026-02-17T05:34:34.558 INFO:tasks.rados.rados.0.trial118.stdout:1526: snap_remove snap 144 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1526: done (2 left) 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1527: delete oid 15 current snap is 155 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1525: finishing copy_from to trial11845692-10 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1525: got expected ENOENT (src dne) 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1525: finishing copy_from racing read to trial11845692-10 2026-02-17T05:34:35.284 INFO:tasks.rados.rados.0.trial118.stdout:1524: finishing write tid 3 to trial11845692-21 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: finishing write tid 4 to trial11845692-21 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: finishing write tid 5 to trial11845692-21 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: oid 21 updating version 0 to 802 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: oid 21 updating version 802 to 803 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: oid 21 version 803 is already newer than 801 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: oid 21 version 803 is already newer than 800 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 803 (ObjNum 571 snap 155 seq_num 571) dirty exists 2026-02-17T05:34:35.285 INFO:tasks.rados.rados.0.trial118.stdout:1524: left oid 21 (ObjNum 571 snap 155 seq_num 571) 2026-02-17T05:34:35.289 INFO:tasks.rados.rados.0.trial118.stdout:1524: done (2 left) 2026-02-17T05:34:35.289 INFO:tasks.rados.rados.0.trial118.stdout:1525: done (1 left) 2026-02-17T05:34:35.289 INFO:tasks.rados.rados.0.trial118.stdout:1527: done (0 left) 2026-02-17T05:34:35.289 INFO:tasks.rados.rados.0.trial118.stdout:1528: snap_create 2026-02-17T05:34:36.286 INFO:tasks.rados.rados.0.trial118.stdout:1528: done (0 left) 2026-02-17T05:34:36.286 INFO:tasks.rados.rados.0.trial118.stdout:1529: snap_remove snap 154 2026-02-17T05:34:37.287 INFO:tasks.rados.rados.0.trial118.stdout:1529: done (0 left) 2026-02-17T05:34:37.287 INFO:tasks.rados.rados.0.trial118.stdout:1530: write oid 8 current snap is 156 2026-02-17T05:34:37.287 INFO:tasks.rados.rados.0.trial118.stdout:1530: seq_num 573 ranges {430411=644152,1830888=400520,2935963=402981} 2026-02-17T05:34:37.291 INFO:tasks.rados.rados.0.trial118.stdout:1530: writing trial11845692-8 from 430411 to 1074563 tid 1 2026-02-17T05:34:37.295 INFO:tasks.rados.rados.0.trial118.stdout:1530: writing trial11845692-8 from 1830888 to 2231408 tid 2 2026-02-17T05:34:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1530: writing trial11845692-8 from 2935963 to 3338944 tid 3 2026-02-17T05:34:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1531: rollback oid 35 current snap is 156 2026-02-17T05:34:37.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 155 2026-02-17T05:34:37.300 INFO:tasks.rados.rados.0.trial118.stdout:1530: finishing write tid 1 to trial11845692-8 2026-02-17T05:34:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1530: finishing write tid 2 to trial11845692-8 2026-02-17T05:34:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1532: read oid 22 snap -1 2026-02-17T05:34:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1532: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:34:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1533: write (excl) oid 30 current snap is 156 2026-02-17T05:34:37.301 INFO:tasks.rados.rados.0.trial118.stdout:1533: seq_num 574 ranges {447218=719401,1889370=660531,2963386=614253} 2026-02-17T05:34:37.304 INFO:tasks.rados.rados.0.trial118.stdout:1533: writing trial11845692-30 from 447218 to 1166619 tid 1 2026-02-17T05:34:37.309 INFO:tasks.rados.rados.0.trial118.stdout:1533: writing trial11845692-30 from 1889370 to 2549901 tid 2 2026-02-17T05:34:37.313 INFO:tasks.rados.rados.0.trial118.stdout:1533: writing trial11845692-30 from 2963386 to 3577639 tid 3 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1534: snap_create 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: finishing write tid 3 to trial11845692-8 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: finishing write tid 4 to trial11845692-8 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: finishing write tid 5 to trial11845692-8 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: oid 8 updating version 0 to 913 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: oid 8 version 913 is already newer than 911 2026-02-17T05:34:37.314 INFO:tasks.rados.rados.0.trial118.stdout:1530: oid 8 version 913 is already newer than 910 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1530: oid 8 version 913 is already newer than 912 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 913 (ObjNum 573 snap 156 seq_num 573) dirty exists 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1530: left oid 8 (ObjNum 573 snap 156 seq_num 573) 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1531: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1531: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1531: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 415 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:34:37.315 INFO:tasks.rados.rados.0.trial118.stdout:1532: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:34:37.317 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 840428 2026-02-17T05:34:37.363 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2666030 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: finishing write tid 1 to trial11845692-30 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: finishing write tid 2 to trial11845692-30 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: finishing write tid 3 to trial11845692-30 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: finishing write tid 4 to trial11845692-30 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: finishing write tid 5 to trial11845692-30 2026-02-17T05:34:37.372 INFO:tasks.rados.rados.0.trial118.stdout:1533: oid 30 updating version 0 to 820 2026-02-17T05:34:37.373 INFO:tasks.rados.rados.0.trial118.stdout:1533: oid 30 updating version 820 to 822 2026-02-17T05:34:37.373 INFO:tasks.rados.rados.0.trial118.stdout:1533: oid 30 version 822 is already newer than 819 2026-02-17T05:34:37.373 INFO:tasks.rados.rados.0.trial118.stdout:1533: oid 30 version 822 is already newer than 821 2026-02-17T05:34:37.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 822 (ObjNum 574 snap 156 seq_num 574) dirty exists 2026-02-17T05:34:37.373 INFO:tasks.rados.rados.0.trial118.stdout:1533: left oid 30 (ObjNum 574 snap 156 seq_num 574) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1530: done (4 left) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1531: done (3 left) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1532: done (2 left) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1533: done (1 left) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1534: done (0 left) 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1535: copy_from oid 20 from oid 22 current snap is 157 2026-02-17T05:34:38.291 INFO:tasks.rados.rados.0.trial118.stdout:1536: read oid 19 snap -1 2026-02-17T05:34:38.292 INFO:tasks.rados.rados.0.trial118.stdout:1536: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:34:38.292 INFO:tasks.rados.rados.0.trial118.stdout:1537: write oid 39 current snap is 157 2026-02-17T05:34:38.292 INFO:tasks.rados.rados.0.trial118.stdout:1537: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2026-02-17T05:34:38.297 INFO:tasks.rados.rados.0.trial118.stdout:1537: writing trial11845692-39 from 464025 to 1258675 tid 1 2026-02-17T05:34:38.302 INFO:tasks.rados.rados.0.trial118.stdout:1537: writing trial11845692-39 from 1947852 to 2352041 tid 2 2026-02-17T05:34:38.307 INFO:tasks.rados.rados.0.trial118.stdout:1537: writing trial11845692-39 from 2990809 to 3416334 tid 3 2026-02-17T05:34:38.307 INFO:tasks.rados.rados.0.trial118.stdout:1538: read oid 38 snap -1 2026-02-17T05:34:38.307 INFO:tasks.rados.rados.0.trial118.stdout:1538: expect deleted 2026-02-17T05:34:38.307 INFO:tasks.rados.rados.0.trial118.stdout:1539: copy_from oid 12 from oid 44 current snap is 157 2026-02-17T05:34:38.307 INFO:tasks.rados.rados.0.trial118.stdout:1536: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:34:38.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1522495 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1535: finishing copy_from racing read to trial11845692-20 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1535: finishing copy_from to trial11845692-20 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 688 (ObjNum 560 snap 155 seq_num 560) dirty exists 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1537: finishing write tid 1 to trial11845692-39 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1537: finishing write tid 2 to trial11845692-39 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1535: done (4 left) 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1536: done (3 left) 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1540: copy_from oid 4 from oid 43 current snap is 157 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1537: finishing write tid 3 to trial11845692-39 2026-02-17T05:34:38.423 INFO:tasks.rados.rados.0.trial118.stdout:1537: finishing write tid 4 to trial11845692-39 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: finishing write tid 5 to trial11845692-39 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: oid 39 updating version 0 to 806 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: oid 39 version 806 is already newer than 804 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: oid 39 updating version 806 to 807 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: oid 39 version 807 is already newer than 805 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 807 (ObjNum 575 snap 157 seq_num 575) dirty exists 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: left oid 39 (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1539: finishing copy_from racing read to trial11845692-12 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1539: finishing copy_from to trial11845692-12 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 250 (ObjNum 548 snap 153 seq_num 548) dirty exists 2026-02-17T05:34:38.424 INFO:tasks.rados.rados.0.trial118.stdout:1537: done (3 left) 2026-02-17T05:34:38.425 INFO:tasks.rados.rados.0.trial118.stdout:1538: done (2 left) 2026-02-17T05:34:38.425 INFO:tasks.rados.rados.0.trial118.stdout:1539: done (1 left) 2026-02-17T05:34:38.425 INFO:tasks.rados.rados.0.trial118.stdout:1541: write oid 34 current snap is 157 2026-02-17T05:34:38.425 INFO:tasks.rados.rados.0.trial118.stdout:1541: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2026-02-17T05:34:38.426 INFO:tasks.rados.rados.0.trial118.stdout:1541: writing trial11845692-34 from 480832 to 950731 tid 1 2026-02-17T05:34:38.431 INFO:tasks.rados.rados.0.trial118.stdout:1541: writing trial11845692-34 from 1606334 to 2270534 tid 2 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1541: writing trial11845692-34 from 3018232 to 3680832 tid 3 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1542: write (excl) oid 7 current snap is 157 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1540: finishing copy_from racing read to trial11845692-4 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1540: finishing copy_from to trial11845692-4 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 725 (ObjNum 528 snap 145 seq_num 528) dirty exists 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1541: finishing write tid 1 to trial11845692-34 2026-02-17T05:34:38.436 INFO:tasks.rados.rados.0.trial118.stdout:1542: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2026-02-17T05:34:38.440 INFO:tasks.rados.rados.0.trial118.stdout:1542: writing trial11845692-7 from 497639 to 1042787 tid 1 2026-02-17T05:34:38.443 INFO:tasks.rados.rados.0.trial118.stdout:1542: writing trial11845692-7 from 1548463 to 1956321 tid 2 2026-02-17T05:34:38.447 INFO:tasks.rados.rados.0.trial118.stdout:1542: writing trial11845692-7 from 2529302 to 3093724 tid 3 2026-02-17T05:34:38.449 INFO:tasks.rados.rados.0.trial118.stdout:1542: writing trial11845692-7 from 3528143 to 3697639 tid 4 2026-02-17T05:34:38.450 INFO:tasks.rados.rados.0.trial118.stdout:1540: done (2 left) 2026-02-17T05:34:38.450 INFO:tasks.rados.rados.0.trial118.stdout:1543: snap_remove snap 156 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1543: done (2 left) 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1544: snap_create 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1541: finishing write tid 2 to trial11845692-34 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1541: finishing write tid 3 to trial11845692-34 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1541: finishing write tid 4 to trial11845692-34 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1541: finishing write tid 5 to trial11845692-34 2026-02-17T05:34:39.296 INFO:tasks.rados.rados.0.trial118.stdout:1541: oid 34 updating version 0 to 401 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1541: oid 34 updating version 401 to 403 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1541: oid 34 updating version 403 to 404 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1541: oid 34 version 404 is already newer than 402 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 404 (ObjNum 576 snap 157 seq_num 576) dirty exists 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1541: left oid 34 (ObjNum 576 snap 157 seq_num 576) 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 1 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 2 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 3 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 4 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 5 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: finishing write tid 6 to trial11845692-7 2026-02-17T05:34:39.297 INFO:tasks.rados.rados.0.trial118.stdout:1542: oid 7 updating version 0 to 761 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1542: oid 7 version 761 is already newer than 760 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1542: oid 7 version 761 is already newer than 759 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1542: oid 7 version 761 is already newer than 758 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1542: oid 7 updating version 761 to 762 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 762 (ObjNum 577 snap 157 seq_num 577) dirty exists 2026-02-17T05:34:39.298 INFO:tasks.rados.rados.0.trial118.stdout:1542: left oid 7 (ObjNum 577 snap 157 seq_num 577) 2026-02-17T05:34:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1541: done (2 left) 2026-02-17T05:34:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1542: done (1 left) 2026-02-17T05:34:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1544: done (0 left) 2026-02-17T05:34:40.283 INFO:tasks.rados.rados.0.trial118.stdout:1545: snap_create 2026-02-17T05:34:41.283 INFO:tasks.rados.rados.0.trial118.stdout:1545: done (0 left) 2026-02-17T05:34:41.284 INFO:tasks.rados.rados.0.trial118.stdout:1546: write (excl) oid 17 current snap is 159 2026-02-17T05:34:41.284 INFO:tasks.rados.rados.0.trial118.stdout:1546: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2026-02-17T05:34:41.288 INFO:tasks.rados.rados.0.trial118.stdout:1546: writing trial11845692-17 from 514446 to 1251196 tid 1 2026-02-17T05:34:41.292 INFO:tasks.rados.rados.0.trial118.stdout:1546: writing trial11845692-17 from 1723298 to 2391167 tid 2 2026-02-17T05:34:41.297 INFO:tasks.rados.rados.0.trial118.stdout:1546: writing trial11845692-17 from 3073078 to 3714446 tid 3 2026-02-17T05:34:41.297 INFO:tasks.rados.rados.0.trial118.stdout:1547: read oid 10 snap -1 2026-02-17T05:34:41.298 INFO:tasks.rados.rados.0.trial118.stdout:1547: expect (ObjNum 526 snap 144 seq_num 526) 2026-02-17T05:34:41.298 INFO:tasks.rados.rados.0.trial118.stdout:1548: snap_create 2026-02-17T05:34:41.298 INFO:tasks.rados.rados.0.trial118.stdout:1546: finishing write tid 1 to trial11845692-17 2026-02-17T05:34:41.298 INFO:tasks.rados.rados.0.trial118.stdout:1546: finishing write tid 2 to trial11845692-17 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: finishing write tid 3 to trial11845692-17 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: finishing write tid 4 to trial11845692-17 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: finishing write tid 5 to trial11845692-17 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: oid 17 updating version 0 to 414 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: oid 17 version 414 is already newer than 413 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: oid 17 updating version 414 to 416 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: oid 17 version 416 is already newer than 415 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 416 (ObjNum 578 snap 159 seq_num 578) dirty exists 2026-02-17T05:34:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1546: left oid 17 (ObjNum 578 snap 159 seq_num 578) 2026-02-17T05:34:41.300 INFO:tasks.rados.rados.0.trial118.stdout:1547: expect (ObjNum 526 snap 144 seq_num 526) 2026-02-17T05:34:42.301 INFO:tasks.rados.rados.0.trial118.stdout:1546: done (2 left) 2026-02-17T05:34:42.301 INFO:tasks.rados.rados.0.trial118.stdout:1547: done (1 left) 2026-02-17T05:34:42.301 INFO:tasks.rados.rados.0.trial118.stdout:1548: done (0 left) 2026-02-17T05:34:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1549: copy_from oid 14 from oid 33 current snap is 160 2026-02-17T05:34:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1550: snap_create 2026-02-17T05:34:42.302 INFO:tasks.rados.rados.0.trial118.stdout:1549: finishing copy_from to trial11845692-14 2026-02-17T05:34:42.303 INFO:tasks.rados.rados.0.trial118.stdout:1549: got expected ENOENT (src dne) 2026-02-17T05:34:42.303 INFO:tasks.rados.rados.0.trial118.stdout:1549: finishing copy_from racing read to trial11845692-14 2026-02-17T05:34:43.301 INFO:tasks.rados.rados.0.trial118.stdout:1549: done (1 left) 2026-02-17T05:34:43.302 INFO:tasks.rados.rados.0.trial118.stdout:1550: done (0 left) 2026-02-17T05:34:43.302 INFO:tasks.rados.rados.0.trial118.stdout:1551: snap_remove snap 158 2026-02-17T05:34:44.302 INFO:tasks.rados.rados.0.trial118.stdout:1551: done (0 left) 2026-02-17T05:34:44.302 INFO:tasks.rados.rados.0.trial118.stdout:1552: snap_remove snap 157 2026-02-17T05:34:45.283 INFO:tasks.rados.rados.0.trial118.stdout:1552: done (0 left) 2026-02-17T05:34:45.283 INFO:tasks.rados.rados.0.trial118.stdout:1553: copy_from oid 3 from oid 5 current snap is 161 2026-02-17T05:34:45.283 INFO:tasks.rados.rados.0.trial118.stdout:1554: snap_remove snap 153 2026-02-17T05:34:46.285 INFO:tasks.rados.rados.0.trial118.stdout:1554: done (1 left) 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1555: read oid 15 snap 159 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1555: expect deleted 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1556: read oid 32 snap -1 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1556: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1557: read oid 50 snap -1 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1557: expect (ObjNum 531 snap 145 seq_num 531) 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1558: read oid 49 snap 159 2026-02-17T05:34:46.286 INFO:tasks.rados.rados.0.trial118.stdout:1558: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:34:46.287 INFO:tasks.rados.rados.0.trial118.stdout:1559: write oid 6 current snap is 161 2026-02-17T05:34:46.287 INFO:tasks.rados.rados.0.trial118.stdout:1553: finishing copy_from to trial11845692-3 2026-02-17T05:34:46.287 INFO:tasks.rados.rados.0.trial118.stdout:1553: got expected ENOENT (src dne) 2026-02-17T05:34:46.287 INFO:tasks.rados.rados.0.trial118.stdout:1553: finishing copy_from racing read to trial11845692-3 2026-02-17T05:34:46.287 INFO:tasks.rados.rados.0.trial118.stdout:1559: seq_num 579 ranges {531253=411999,1381780=411527,2300501=586966,3376974=354279} 2026-02-17T05:34:46.289 INFO:tasks.rados.rados.0.trial118.stdout:1559: writing trial11845692-6 from 531253 to 943252 tid 1 2026-02-17T05:34:46.293 INFO:tasks.rados.rados.0.trial118.stdout:1559: writing trial11845692-6 from 1381780 to 1793307 tid 2 2026-02-17T05:34:46.297 INFO:tasks.rados.rados.0.trial118.stdout:1559: writing trial11845692-6 from 2300501 to 2887467 tid 3 2026-02-17T05:34:46.301 INFO:tasks.rados.rados.0.trial118.stdout:1559: writing trial11845692-6 from 3376974 to 3731253 tid 4 2026-02-17T05:34:46.302 INFO:tasks.rados.rados.0.trial118.stdout:1553: done (5 left) 2026-02-17T05:34:46.302 INFO:tasks.rados.rados.0.trial118.stdout:1560: read oid 12 snap -1 2026-02-17T05:34:46.302 INFO:tasks.rados.rados.0.trial118.stdout:1560: expect (ObjNum 548 snap 153 seq_num 548) 2026-02-17T05:34:46.302 INFO:tasks.rados.rados.0.trial118.stdout:1561: snap_remove snap 155 2026-02-17T05:34:47.286 INFO:tasks.rados.rados.0.trial118.stdout:1561: done (6 left) 2026-02-17T05:34:47.286 INFO:tasks.rados.rados.0.trial118.stdout:1562: write oid 38 current snap is 161 2026-02-17T05:34:47.287 INFO:tasks.rados.rados.0.trial118.stdout:1562: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2026-02-17T05:34:47.291 INFO:tasks.rados.rados.0.trial118.stdout:1562: writing trial11845692-38 from 548060 to 1035308 tid 1 2026-02-17T05:34:47.295 INFO:tasks.rados.rados.0.trial118.stdout:1562: writing trial11845692-38 from 1440262 to 2111800 tid 2 2026-02-17T05:34:47.301 INFO:tasks.rados.rados.0.trial118.stdout:1562: writing trial11845692-38 from 2844277 to 3642515 tid 3 2026-02-17T05:34:47.301 INFO:tasks.rados.rados.0.trial118.stdout:1563: snap_remove snap 160 2026-02-17T05:34:48.289 INFO:tasks.rados.rados.0.trial118.stdout:1563: done (7 left) 2026-02-17T05:34:48.290 INFO:tasks.rados.rados.0.trial118.stdout:1564: delete oid 4 current snap is 161 2026-02-17T05:34:48.290 INFO:tasks.rados.rados.0.trial118.stdout:1556: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:34:48.336 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2579919 2026-02-17T05:34:48.340 INFO:tasks.rados.rados.0.trial118.stdout:1557: expect (ObjNum 531 snap 145 seq_num 531) 2026-02-17T05:34:48.340 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:48.421 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 1 to trial11845692-6 2026-02-17T05:34:48.421 INFO:tasks.rados.rados.0.trial118.stdout:1558: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:34:48.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 602347 2026-02-17T05:34:48.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 2 to trial11845692-6 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 3 to trial11845692-6 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 4 to trial11845692-6 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 5 to trial11845692-6 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: finishing write tid 6 to trial11845692-6 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: oid 6 updating version 0 to 644 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: oid 6 updating version 644 to 645 2026-02-17T05:34:48.496 INFO:tasks.rados.rados.0.trial118.stdout:1559: oid 6 updating version 645 to 647 2026-02-17T05:34:48.497 INFO:tasks.rados.rados.0.trial118.stdout:1559: oid 6 version 647 is already newer than 646 2026-02-17T05:34:48.497 INFO:tasks.rados.rados.0.trial118.stdout:1559: oid 6 updating version 647 to 648 2026-02-17T05:34:48.497 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:34:48.497 INFO:tasks.rados.rados.0.trial118.stdout:1559: left oid 6 (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:34:48.497 INFO:tasks.rados.rados.0.trial118.stdout:1560: expect (ObjNum 548 snap 153 seq_num 548) 2026-02-17T05:34:48.578 INFO:tasks.rados.rados.0.trial118.stdout:1562: finishing write tid 1 to trial11845692-38 2026-02-17T05:34:48.578 INFO:tasks.rados.rados.0.trial118.stdout:1562: finishing write tid 2 to trial11845692-38 2026-02-17T05:34:48.578 INFO:tasks.rados.rados.0.trial118.stdout:1555: done (7 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1556: done (6 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1557: done (5 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1558: done (4 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1559: done (3 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1560: done (2 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1564: done (1 left) 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1565: write (excl) oid 33 current snap is 161 2026-02-17T05:34:48.579 INFO:tasks.rados.rados.0.trial118.stdout:1565: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2026-02-17T05:34:48.582 INFO:tasks.rados.rados.0.trial118.stdout:1565: writing trial11845692-33 from 581674 to 1219420 tid 1 2026-02-17T05:34:48.587 INFO:tasks.rados.rados.0.trial118.stdout:1565: writing trial11845692-33 from 1840873 to 2399727 tid 2 2026-02-17T05:34:48.592 INFO:tasks.rados.rados.0.trial118.stdout:1565: writing trial11845692-33 from 3066417 to 3603552 tid 3 2026-02-17T05:34:48.592 INFO:tasks.rados.rados.0.trial118.stdout:1566: write oid 8 current snap is 161 2026-02-17T05:34:48.592 INFO:tasks.rados.rados.0.trial118.stdout:1562: finishing write tid 3 to trial11845692-38 2026-02-17T05:34:48.592 INFO:tasks.rados.rados.0.trial118.stdout:1562: finishing write tid 4 to trial11845692-38 2026-02-17T05:34:48.593 INFO:tasks.rados.rados.0.trial118.stdout:1566: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2026-02-17T05:34:48.597 INFO:tasks.rados.rados.0.trial118.stdout:1566: writing trial11845692-8 from 598481 to 1311476 tid 1 2026-02-17T05:34:48.601 INFO:tasks.rados.rados.0.trial118.stdout:1566: writing trial11845692-8 from 1899355 to 2318220 tid 2 2026-02-17T05:34:48.607 INFO:tasks.rados.rados.0.trial118.stdout:1566: writing trial11845692-8 from 3093840 to 3798481 tid 3 2026-02-17T05:34:48.607 INFO:tasks.rados.rados.0.trial118.stdout:1567: copy_from oid 11 from oid 24 current snap is 161 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: finishing write tid 5 to trial11845692-38 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: oid 38 updating version 0 to 816 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: oid 38 version 816 is already newer than 814 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: oid 38 updating version 816 to 817 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: oid 38 version 817 is already newer than 815 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 817 (ObjNum 580 snap 161 seq_num 580) dirty exists 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: left oid 38 (ObjNum 580 snap 161 seq_num 580) 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1565: finishing write tid 1 to trial11845692-33 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1562: done (3 left) 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1568: delete oid 26 current snap is 161 2026-02-17T05:34:48.608 INFO:tasks.rados.rados.0.trial118.stdout:1565: finishing write tid 2 to trial11845692-33 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: finishing write tid 3 to trial11845692-33 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: finishing write tid 4 to trial11845692-33 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: finishing write tid 5 to trial11845692-33 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: oid 33 updating version 0 to 835 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: oid 33 version 835 is already newer than 833 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: oid 33 version 835 is already newer than 834 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: oid 33 updating version 835 to 836 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 836 (ObjNum 582 snap 161 seq_num 582) dirty exists 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1565: left oid 33 (ObjNum 582 snap 161 seq_num 582) 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1566: finishing write tid 1 to trial11845692-8 2026-02-17T05:34:48.609 INFO:tasks.rados.rados.0.trial118.stdout:1566: finishing write tid 2 to trial11845692-8 2026-02-17T05:34:48.610 INFO:tasks.rados.rados.0.trial118.stdout:1565: done (3 left) 2026-02-17T05:34:48.610 INFO:tasks.rados.rados.0.trial118.stdout:1568: done (2 left) 2026-02-17T05:34:48.610 INFO:tasks.rados.rados.0.trial118.stdout:1569: rollback oid 31 current snap is 161 2026-02-17T05:34:48.610 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 159 2026-02-17T05:34:48.611 INFO:tasks.rados.rados.0.trial118.stdout:1570: write oid 28 current snap is 161 2026-02-17T05:34:48.611 INFO:tasks.rados.rados.0.trial118.stdout:1570: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2026-02-17T05:34:48.613 INFO:tasks.rados.rados.0.trial118.stdout:1570: writing trial11845692-28 from 632095 to 1095588 tid 1 2026-02-17T05:34:48.617 INFO:tasks.rados.rados.0.trial118.stdout:1570: writing trial11845692-28 from 1616319 to 2038853 tid 2 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1570: writing trial11845692-28 from 2748686 to 3235990 tid 3 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1571: write (excl) oid 15 current snap is 161 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1566: finishing write tid 3 to trial11845692-8 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1566: finishing write tid 4 to trial11845692-8 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1566: finishing write tid 5 to trial11845692-8 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1566: oid 8 updating version 0 to 924 2026-02-17T05:34:48.622 INFO:tasks.rados.rados.0.trial118.stdout:1566: oid 8 updating version 924 to 927 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1566: oid 8 version 927 is already newer than 925 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1566: oid 8 version 927 is already newer than 926 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 927 (ObjNum 583 snap 161 seq_num 583) dirty exists 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1566: left oid 8 (ObjNum 583 snap 161 seq_num 583) 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1569: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1569: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:34:48.623 INFO:tasks.rados.rados.0.trial118.stdout:1571: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2026-02-17T05:34:48.626 INFO:tasks.rados.rados.0.trial118.stdout:1571: writing trial11845692-15 from 648902 to 1303997 tid 1 2026-02-17T05:34:48.631 INFO:tasks.rados.rados.0.trial118.stdout:1571: writing trial11845692-15 from 2074801 to 2640993 tid 2 2026-02-17T05:34:48.636 INFO:tasks.rados.rados.0.trial118.stdout:1571: writing trial11845692-15 from 3176109 to 3848902 tid 3 2026-02-17T05:34:48.636 INFO:tasks.rados.rados.0.trial118.stdout:1566: done (4 left) 2026-02-17T05:34:48.636 INFO:tasks.rados.rados.0.trial118.stdout:1572: rollback oid 35 current snap is 161 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 159 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1569: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 931 (ObjNum 532 snap 145 seq_num 532) dirty exists 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1570: finishing write tid 1 to trial11845692-28 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1567: finishing copy_from racing read to trial11845692-11 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1567: finishing copy_from to trial11845692-11 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1570: finishing write tid 2 to trial11845692-28 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1567: done (4 left) 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1569: done (3 left) 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1573: read oid 5 snap -1 2026-02-17T05:34:48.637 INFO:tasks.rados.rados.0.trial118.stdout:1573: expect deleted 2026-02-17T05:34:48.638 INFO:tasks.rados.rados.0.trial118.stdout:1574: write oid 37 current snap is 161 2026-02-17T05:34:48.638 INFO:tasks.rados.rados.0.trial118.stdout:1574: seq_num 587 ranges {665709=730344,2133283=426203,3203532=509848} 2026-02-17T05:34:48.641 INFO:tasks.rados.rados.0.trial118.stdout:1574: writing trial11845692-37 from 665709 to 1396053 tid 1 2026-02-17T05:34:48.645 INFO:tasks.rados.rados.0.trial118.stdout:1574: writing trial11845692-37 from 2133283 to 2559486 tid 2 2026-02-17T05:34:48.650 INFO:tasks.rados.rados.0.trial118.stdout:1574: writing trial11845692-37 from 3203532 to 3713380 tid 3 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1575: read oid 38 snap -1 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1575: expect (ObjNum 580 snap 161 seq_num 580) 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1576: rollback oid 12 current snap is 161 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 159 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: finishing write tid 3 to trial11845692-28 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: finishing write tid 4 to trial11845692-28 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: finishing write tid 5 to trial11845692-28 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: oid 28 updating version 0 to 410 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: oid 28 updating version 410 to 411 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: oid 28 updating version 411 to 412 2026-02-17T05:34:48.651 INFO:tasks.rados.rados.0.trial118.stdout:1570: oid 28 version 412 is already newer than 409 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 412 (ObjNum 585 snap 161 seq_num 585) dirty exists 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1570: left oid 28 (ObjNum 585 snap 161 seq_num 585) 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1571: finishing write tid 1 to trial11845692-15 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1571: finishing write tid 2 to trial11845692-15 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1570: done (6 left) 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1577: snap_create 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1572: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1571: finishing write tid 3 to trial11845692-15 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1572: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1571: finishing write tid 4 to trial11845692-15 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:1572: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:34:48.652 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 418 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: finishing write tid 5 to trial11845692-15 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: oid 15 updating version 0 to 692 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: oid 15 updating version 692 to 694 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: oid 15 version 694 is already newer than 691 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: oid 15 version 694 is already newer than 693 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 694 (ObjNum 586 snap 161 seq_num 586) dirty exists 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1571: left oid 15 (ObjNum 586 snap 161 seq_num 586) 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1574: finishing write tid 1 to trial11845692-37 2026-02-17T05:34:48.653 INFO:tasks.rados.rados.0.trial118.stdout:1574: finishing write tid 2 to trial11845692-37 2026-02-17T05:34:48.654 INFO:tasks.rados.rados.0.trial118.stdout:1574: finishing write tid 3 to trial11845692-37 2026-02-17T05:34:48.654 INFO:tasks.rados.rados.0.trial118.stdout:1574: finishing write tid 4 to trial11845692-37 2026-02-17T05:34:48.654 INFO:tasks.rados.rados.0.trial118.stdout:1574: finishing write tid 5 to trial11845692-37 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1574: oid 37 updating version 0 to 147 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1574: oid 37 updating version 147 to 148 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1574: oid 37 version 148 is already newer than 145 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1574: oid 37 version 148 is already newer than 146 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 148 (ObjNum 587 snap 161 seq_num 587) dirty exists 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1574: left oid 37 (ObjNum 587 snap 161 seq_num 587) 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1576: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1576: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:1576: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:34:48.655 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 731 (ObjNum 548 snap 153 seq_num 548) dirty exists 2026-02-17T05:34:48.656 INFO:tasks.rados.rados.0.trial118.stdout:1575: expect (ObjNum 580 snap 161 seq_num 580) 2026-02-17T05:34:48.661 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1632206 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1571: done (6 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1572: done (5 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1573: done (4 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1574: done (3 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1575: done (2 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1576: done (1 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1577: done (0 left) 2026-02-17T05:34:49.293 INFO:tasks.rados.rados.0.trial118.stdout:1578: delete oid 36 current snap is 162 2026-02-17T05:34:49.294 INFO:tasks.rados.rados.0.trial118.stdout:1578: done (0 left) 2026-02-17T05:34:49.294 INFO:tasks.rados.rados.0.trial118.stdout:1579: copy_from oid 44 from oid 11 current snap is 162 2026-02-17T05:34:49.294 INFO:tasks.rados.rados.0.trial118.stdout:1580: delete oid 9 current snap is 162 2026-02-17T05:34:49.296 INFO:tasks.rados.rados.0.trial118.stdout:1580: done (1 left) 2026-02-17T05:34:49.296 INFO:tasks.rados.rados.0.trial118.stdout:1581: write (excl) oid 17 current snap is 162 2026-02-17T05:34:49.296 INFO:tasks.rados.rados.0.trial118.stdout:1581: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2026-02-17T05:34:49.301 INFO:tasks.rados.rados.0.trial118.stdout:1581: writing trial11845692-17 from 716130 to 1272221 tid 1 2026-02-17T05:34:49.305 INFO:tasks.rados.rados.0.trial118.stdout:1581: writing trial11845692-17 from 1792376 to 2365906 tid 2 2026-02-17T05:34:49.308 INFO:tasks.rados.rados.0.trial118.stdout:1581: writing trial11845692-17 from 2769448 to 3229465 tid 3 2026-02-17T05:34:49.310 INFO:tasks.rados.rados.0.trial118.stdout:1581: writing trial11845692-17 from 3821956 to 3916130 tid 4 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1582: rollback oid 33 current snap is 162 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 159 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 1 to trial11845692-17 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1579: finishing copy_from racing read to trial11845692-44 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1579: finishing copy_from to trial11845692-44 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 2 to trial11845692-17 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 3 to trial11845692-17 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1579: done (2 left) 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1583: snap_create 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 4 to trial11845692-17 2026-02-17T05:34:49.311 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 5 to trial11845692-17 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: finishing write tid 6 to trial11845692-17 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: oid 17 updating version 0 to 418 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: oid 17 updating version 418 to 419 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: oid 17 updating version 419 to 420 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: oid 17 version 420 is already newer than 417 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: oid 17 updating version 420 to 421 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 421 (ObjNum 590 snap 162 seq_num 590) dirty exists 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1581: left oid 17 (ObjNum 590 snap 162 seq_num 590) 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1582: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:1582: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:34:49.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 839 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:34:50.286 INFO:tasks.rados.rados.0.trial118.stdout:1581: done (2 left) 2026-02-17T05:34:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1582: done (1 left) 2026-02-17T05:34:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1583: done (0 left) 2026-02-17T05:34:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1584: read oid 45 snap -1 2026-02-17T05:34:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1584: expect deleted 2026-02-17T05:34:50.287 INFO:tasks.rados.rados.0.trial118.stdout:1585: snap_remove snap 159 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1585: done (1 left) 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1586: copy_from oid 16 from oid 26 current snap is 163 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1584: done (1 left) 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1587: copy_from oid 1 from oid 44 current snap is 163 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1588: write (excl) oid 14 current snap is 163 2026-02-17T05:34:51.286 INFO:tasks.rados.rados.0.trial118.stdout:1588: seq_num 591 ranges {732937=631340,1850858=433541,2796871=671289,3888195=44742} 2026-02-17T05:34:51.291 INFO:tasks.rados.rados.0.trial118.stdout:1588: writing trial11845692-14 from 732937 to 1364277 tid 1 2026-02-17T05:34:51.294 INFO:tasks.rados.rados.0.trial118.stdout:1588: writing trial11845692-14 from 1850858 to 2284399 tid 2 2026-02-17T05:34:51.299 INFO:tasks.rados.rados.0.trial118.stdout:1588: writing trial11845692-14 from 2796871 to 3468160 tid 3 2026-02-17T05:34:51.301 INFO:tasks.rados.rados.0.trial118.stdout:1588: writing trial11845692-14 from 3888195 to 3932937 tid 4 2026-02-17T05:34:51.302 INFO:tasks.rados.rados.0.trial118.stdout:1589: read oid 39 snap -1 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1589: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1590: read oid 19 snap -1 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1590: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1591: write oid 28 current snap is 163 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1586: finishing copy_from to trial11845692-16 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1586: got expected ENOENT (src dne) 2026-02-17T05:34:51.303 INFO:tasks.rados.rados.0.trial118.stdout:1586: finishing copy_from racing read to trial11845692-16 2026-02-17T05:34:51.304 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 1 to trial11845692-14 2026-02-17T05:34:51.304 INFO:tasks.rados.rados.0.trial118.stdout:1591: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2026-02-17T05:34:51.308 INFO:tasks.rados.rados.0.trial118.stdout:1591: writing trial11845692-28 from 749744 to 1456333 tid 1 2026-02-17T05:34:51.312 INFO:tasks.rados.rados.0.trial118.stdout:1591: writing trial11845692-28 from 1909340 to 2486539 tid 2 2026-02-17T05:34:51.316 INFO:tasks.rados.rados.0.trial118.stdout:1591: writing trial11845692-28 from 3224294 to 3706855 tid 3 2026-02-17T05:34:51.316 INFO:tasks.rados.rados.0.trial118.stdout:1586: done (5 left) 2026-02-17T05:34:51.317 INFO:tasks.rados.rados.0.trial118.stdout:1592: snap_remove snap 161 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1592: done (5 left) 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1593: snap_create 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1587: finishing copy_from racing read to trial11845692-1 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 2 to trial11845692-14 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1587: finishing copy_from to trial11845692-1 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:34:52.301 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 3 to trial11845692-14 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 4 to trial11845692-14 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 5 to trial11845692-14 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: finishing write tid 6 to trial11845692-14 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: oid 14 updating version 0 to 592 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: oid 14 updating version 592 to 593 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: oid 14 updating version 593 to 596 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: oid 14 version 596 is already newer than 595 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: oid 14 version 596 is already newer than 594 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 596 (ObjNum 591 snap 163 seq_num 591) dirty exists 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1588: left oid 14 (ObjNum 591 snap 163 seq_num 591) 2026-02-17T05:34:52.302 INFO:tasks.rados.rados.0.trial118.stdout:1590: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:34:52.325 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2966867 2026-02-17T05:34:52.333 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:52.371 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:52.410 INFO:tasks.rados.rados.0.trial118.stdout:1589: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:34:52.498 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1830084 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: finishing write tid 1 to trial11845692-28 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: finishing write tid 2 to trial11845692-28 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: finishing write tid 3 to trial11845692-28 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: finishing write tid 4 to trial11845692-28 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: finishing write tid 5 to trial11845692-28 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: oid 28 updating version 0 to 414 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: oid 28 updating version 414 to 415 2026-02-17T05:34:52.624 INFO:tasks.rados.rados.0.trial118.stdout:1591: oid 28 updating version 415 to 416 2026-02-17T05:34:52.625 INFO:tasks.rados.rados.0.trial118.stdout:1591: oid 28 updating version 416 to 417 2026-02-17T05:34:52.625 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 417 (ObjNum 592 snap 163 seq_num 592) dirty exists 2026-02-17T05:34:52.625 INFO:tasks.rados.rados.0.trial118.stdout:1591: left oid 28 (ObjNum 592 snap 163 seq_num 592) 2026-02-17T05:34:53.301 INFO:tasks.rados.rados.0.trial118.stdout:1587: done (5 left) 2026-02-17T05:34:53.301 INFO:tasks.rados.rados.0.trial118.stdout:1588: done (4 left) 2026-02-17T05:34:53.301 INFO:tasks.rados.rados.0.trial118.stdout:1589: done (3 left) 2026-02-17T05:34:53.301 INFO:tasks.rados.rados.0.trial118.stdout:1590: done (2 left) 2026-02-17T05:34:53.301 INFO:tasks.rados.rados.0.trial118.stdout:1591: done (1 left) 2026-02-17T05:34:53.302 INFO:tasks.rados.rados.0.trial118.stdout:1593: done (0 left) 2026-02-17T05:34:53.302 INFO:tasks.rados.rados.0.trial118.stdout:1594: rollback oid 17 current snap is 164 2026-02-17T05:34:53.302 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 162 2026-02-17T05:34:53.302 INFO:tasks.rados.rados.0.trial118.stdout:1595: snap_create 2026-02-17T05:34:53.304 INFO:tasks.rados.rados.0.trial118.stdout:1594: finishing rollback tid 0 to trial11845692-17 2026-02-17T05:34:53.304 INFO:tasks.rados.rados.0.trial118.stdout:1594: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:34:53.304 INFO:tasks.rados.rados.0.trial118.stdout:1594: finishing rollback tid 2 to trial11845692-17 2026-02-17T05:34:53.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 424 (ObjNum 590 snap 162 seq_num 590) dirty exists 2026-02-17T05:34:54.304 INFO:tasks.rados.rados.0.trial118.stdout:1594: done (1 left) 2026-02-17T05:34:54.304 INFO:tasks.rados.rados.0.trial118.stdout:1595: done (0 left) 2026-02-17T05:34:54.304 INFO:tasks.rados.rados.0.trial118.stdout:1596: copy_from oid 42 from oid 36 current snap is 165 2026-02-17T05:34:54.304 INFO:tasks.rados.rados.0.trial118.stdout:1597: delete oid 27 current snap is 165 2026-02-17T05:34:54.305 INFO:tasks.rados.rados.0.trial118.stdout:1596: finishing copy_from to trial11845692-42 2026-02-17T05:34:54.305 INFO:tasks.rados.rados.0.trial118.stdout:1596: got expected ENOENT (src dne) 2026-02-17T05:34:54.305 INFO:tasks.rados.rados.0.trial118.stdout:1596: finishing copy_from racing read to trial11845692-42 2026-02-17T05:34:54.307 INFO:tasks.rados.rados.0.trial118.stdout:1596: done (1 left) 2026-02-17T05:34:54.307 INFO:tasks.rados.rados.0.trial118.stdout:1597: done (0 left) 2026-02-17T05:34:54.307 INFO:tasks.rados.rados.0.trial118.stdout:1598: copy_from oid 2 from oid 38 current snap is 165 2026-02-17T05:34:54.307 INFO:tasks.rados.rados.0.trial118.stdout:1599: read oid 42 snap 162 2026-02-17T05:34:54.307 INFO:tasks.rados.rados.0.trial118.stdout:1599: expect deleted 2026-02-17T05:34:54.308 INFO:tasks.rados.rados.0.trial118.stdout:1600: snap_create 2026-02-17T05:34:54.316 INFO:tasks.rados.rados.0.trial118.stdout:1598: finishing copy_from racing read to trial11845692-2 2026-02-17T05:34:54.316 INFO:tasks.rados.rados.0.trial118.stdout:1598: finishing copy_from to trial11845692-2 2026-02-17T05:34:54.316 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 817 (ObjNum 580 snap 161 seq_num 580) dirty exists 2026-02-17T05:34:55.285 INFO:tasks.rados.rados.0.trial118.stdout:1598: done (2 left) 2026-02-17T05:34:55.285 INFO:tasks.rados.rados.0.trial118.stdout:1599: done (1 left) 2026-02-17T05:34:55.285 INFO:tasks.rados.rados.0.trial118.stdout:1600: done (0 left) 2026-02-17T05:34:55.285 INFO:tasks.rados.rados.0.trial118.stdout:1601: delete oid 12 current snap is 166 2026-02-17T05:34:55.289 INFO:tasks.rados.rados.0.trial118.stdout:1601: done (0 left) 2026-02-17T05:34:55.289 INFO:tasks.rados.rados.0.trial118.stdout:1602: copy_from oid 50 from oid 18 current snap is 166 2026-02-17T05:34:55.289 INFO:tasks.rados.rados.0.trial118.stdout:1603: delete oid 46 current snap is 166 2026-02-17T05:34:55.291 INFO:tasks.rados.rados.0.trial118.stdout:1603: done (1 left) 2026-02-17T05:34:55.291 INFO:tasks.rados.rados.0.trial118.stdout:1604: write oid 14 current snap is 166 2026-02-17T05:34:55.291 INFO:tasks.rados.rados.0.trial118.stdout:1604: seq_num 596 ranges {416972=723938,1743268=273704} 2026-02-17T05:34:55.295 INFO:tasks.rados.rados.0.trial118.stdout:1604: writing trial11845692-14 from 416972 to 1140910 tid 1 2026-02-17T05:34:55.299 INFO:tasks.rados.rados.0.trial118.stdout:1604: writing trial11845692-14 from 1743268 to 2016972 tid 2 2026-02-17T05:34:55.299 INFO:tasks.rados.rados.0.trial118.stdout:1605: rollback oid 13 current snap is 166 2026-02-17T05:34:55.299 INFO:tasks.rados.rados.0.trial118.stdout:1602: finishing copy_from racing read to trial11845692-50 2026-02-17T05:34:55.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 162 2026-02-17T05:34:55.300 INFO:tasks.rados.rados.0.trial118.stdout:1606: snap_create 2026-02-17T05:34:55.300 INFO:tasks.rados.rados.0.trial118.stdout:1604: finishing write tid 1 to trial11845692-14 2026-02-17T05:34:55.300 INFO:tasks.rados.rados.0.trial118.stdout:1602: finishing copy_from to trial11845692-50 2026-02-17T05:34:55.300 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 382 (ObjNum 567 snap 155 seq_num 567) dirty exists 2026-02-17T05:34:55.301 INFO:tasks.rados.rados.0.trial118.stdout:1604: finishing write tid 2 to trial11845692-14 2026-02-17T05:34:55.301 INFO:tasks.rados.rados.0.trial118.stdout:1604: finishing write tid 3 to trial11845692-14 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1604: finishing write tid 4 to trial11845692-14 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1604: oid 14 updating version 0 to 597 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1604: oid 14 updating version 597 to 599 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1604: oid 14 version 599 is already newer than 598 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 599 (ObjNum 596 snap 166 seq_num 596) dirty exists 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1604: left oid 14 (ObjNum 596 snap 166 seq_num 596) 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1605: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:34:55.302 INFO:tasks.rados.rados.0.trial118.stdout:1605: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:34:55.303 INFO:tasks.rados.rados.0.trial118.stdout:1605: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:34:55.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 684 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1602: done (3 left) 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1604: done (2 left) 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1605: done (1 left) 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1606: done (0 left) 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1607: write (excl) oid 16 current snap is 167 2026-02-17T05:34:56.288 INFO:tasks.rados.rados.0.trial118.stdout:1607: seq_num 597 ranges {433779=799187,1801750=232029} 2026-02-17T05:34:56.292 INFO:tasks.rados.rados.0.trial118.stdout:1607: writing trial11845692-16 from 433779 to 1232966 tid 1 2026-02-17T05:34:56.297 INFO:tasks.rados.rados.0.trial118.stdout:1607: writing trial11845692-16 from 1801750 to 2033779 tid 2 2026-02-17T05:34:56.297 INFO:tasks.rados.rados.0.trial118.stdout:1608: rollback oid 21 current snap is 167 2026-02-17T05:34:56.297 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 163 2026-02-17T05:34:56.297 INFO:tasks.rados.rados.0.trial118.stdout:1609: snap_remove snap 165 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1609: done (2 left) 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1610: copy_from oid 47 from oid 4 current snap is 167 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: finishing write tid 1 to trial11845692-16 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: finishing write tid 2 to trial11845692-16 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: finishing write tid 3 to trial11845692-16 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: finishing write tid 4 to trial11845692-16 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: oid 16 updating version 0 to 786 2026-02-17T05:34:57.291 INFO:tasks.rados.rados.0.trial118.stdout:1607: oid 16 updating version 786 to 788 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1607: oid 16 version 788 is already newer than 787 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 788 (ObjNum 597 snap 167 seq_num 597) dirty exists 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1607: left oid 16 (ObjNum 597 snap 167 seq_num 597) 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1608: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1607: done (2 left) 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1611: snap_create 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1608: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:1608: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:34:57.292 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 849 (ObjNum 571 snap 155 seq_num 571) dirty exists 2026-02-17T05:34:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1610: finishing copy_from to trial11845692-47 2026-02-17T05:34:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1610: got expected ENOENT (src dne) 2026-02-17T05:34:57.293 INFO:tasks.rados.rados.0.trial118.stdout:1610: finishing copy_from racing read to trial11845692-47 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1608: done (2 left) 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1610: done (1 left) 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1611: done (0 left) 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1612: read oid 16 snap -1 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1612: expect (ObjNum 597 snap 167 seq_num 597) 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1613: rollback oid 48 current snap is 168 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 166 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1614: copy_from oid 22 from oid 18 current snap is 168 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1615: read oid 46 snap -1 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1615: expect deleted 2026-02-17T05:34:58.294 INFO:tasks.rados.rados.0.trial118.stdout:1616: read oid 49 snap -1 2026-02-17T05:34:58.295 INFO:tasks.rados.rados.0.trial118.stdout:1616: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:34:58.295 INFO:tasks.rados.rados.0.trial118.stdout:1617: write (excl) oid 10 current snap is 168 2026-02-17T05:34:58.295 INFO:tasks.rados.rados.0.trial118.stdout:1617: seq_num 598 ranges {450586=474436,1343879=588206} 2026-02-17T05:34:58.298 INFO:tasks.rados.rados.0.trial118.stdout:1617: writing trial11845692-10 from 450586 to 925022 tid 1 2026-02-17T05:34:58.302 INFO:tasks.rados.rados.0.trial118.stdout:1617: writing trial11845692-10 from 1343879 to 1932085 tid 2 2026-02-17T05:34:58.302 INFO:tasks.rados.rados.0.trial118.stdout:1618: read oid 39 snap -1 2026-02-17T05:34:58.303 INFO:tasks.rados.rados.0.trial118.stdout:1618: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:34:58.303 INFO:tasks.rados.rados.0.trial118.stdout:1619: read oid 21 snap -1 2026-02-17T05:34:58.303 INFO:tasks.rados.rados.0.trial118.stdout:1619: expect (ObjNum 571 snap 155 seq_num 571) 2026-02-17T05:34:58.303 INFO:tasks.rados.rados.0.trial118.stdout:1620: write (excl) oid 38 current snap is 168 2026-02-17T05:34:58.303 INFO:tasks.rados.rados.0.trial118.stdout:1620: seq_num 599 ranges {467393=549685,1802361=265032} 2026-02-17T05:34:58.307 INFO:tasks.rados.rados.0.trial118.stdout:1620: writing trial11845692-38 from 467393 to 1017078 tid 1 2026-02-17T05:34:58.312 INFO:tasks.rados.rados.0.trial118.stdout:1620: writing trial11845692-38 from 1802361 to 2067393 tid 2 2026-02-17T05:34:58.312 INFO:tasks.rados.rados.0.trial118.stdout:1621: snap_create 2026-02-17T05:34:58.312 INFO:tasks.rados.rados.0.trial118.stdout:1616: expect (ObjNum 487 snap 132 seq_num 487) 2026-02-17T05:34:58.317 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 716363 2026-02-17T05:34:58.340 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 766412 2026-02-17T05:34:58.383 INFO:tasks.rados.rados.0.trial118.stdout:1612: expect (ObjNum 597 snap 167 seq_num 597) 2026-02-17T05:34:58.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:58.453 INFO:tasks.rados.rados.0.trial118.stdout:1613: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1613: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1613: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 697 (ObjNum 479 snap 125 seq_num 479) dirty exists 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: finishing write tid 1 to trial11845692-10 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: finishing write tid 2 to trial11845692-10 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: finishing write tid 3 to trial11845692-10 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: finishing write tid 4 to trial11845692-10 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: oid 10 updating version 0 to 414 2026-02-17T05:34:58.454 INFO:tasks.rados.rados.0.trial118.stdout:1617: oid 10 version 414 is already newer than 413 2026-02-17T05:34:58.455 INFO:tasks.rados.rados.0.trial118.stdout:1617: oid 10 updating version 414 to 415 2026-02-17T05:34:58.455 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 415 (ObjNum 598 snap 168 seq_num 598) dirty exists 2026-02-17T05:34:58.455 INFO:tasks.rados.rados.0.trial118.stdout:1617: left oid 10 (ObjNum 598 snap 168 seq_num 598) 2026-02-17T05:34:58.455 INFO:tasks.rados.rados.0.trial118.stdout:1618: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:34:58.514 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3261910 2026-02-17T05:34:58.595 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:58.670 INFO:tasks.rados.rados.0.trial118.stdout:1614: finishing copy_from racing read to trial11845692-22 2026-02-17T05:34:58.670 INFO:tasks.rados.rados.0.trial118.stdout:1614: finishing copy_from to trial11845692-22 2026-02-17T05:34:58.670 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 382 (ObjNum 567 snap 155 seq_num 567) dirty exists 2026-02-17T05:34:58.670 INFO:tasks.rados.rados.0.trial118.stdout:1619: expect (ObjNum 571 snap 155 seq_num 571) 2026-02-17T05:34:58.670 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:34:58.796 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1864290 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: finishing write tid 1 to trial11845692-38 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: finishing write tid 2 to trial11845692-38 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: finishing write tid 3 to trial11845692-38 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: finishing write tid 4 to trial11845692-38 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: oid 38 updating version 0 to 819 2026-02-17T05:34:58.823 INFO:tasks.rados.rados.0.trial118.stdout:1620: oid 38 updating version 819 to 821 2026-02-17T05:34:58.824 INFO:tasks.rados.rados.0.trial118.stdout:1620: oid 38 version 821 is already newer than 820 2026-02-17T05:34:58.824 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 821 (ObjNum 599 snap 168 seq_num 599) dirty exists 2026-02-17T05:34:58.824 INFO:tasks.rados.rados.0.trial118.stdout:1620: left oid 38 (ObjNum 599 snap 168 seq_num 599) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1612: done (9 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1613: done (8 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1614: done (7 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1615: done (6 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1616: done (5 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1617: done (4 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1618: done (3 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1619: done (2 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1620: done (1 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1621: done (0 left) 2026-02-17T05:34:59.297 INFO:tasks.rados.rados.0.trial118.stdout:1622: read oid 38 snap -1 2026-02-17T05:34:59.298 INFO:tasks.rados.rados.0.trial118.stdout:1622: expect (ObjNum 599 snap 168 seq_num 599) 2026-02-17T05:34:59.298 INFO:tasks.rados.rados.0.trial118.stdout:1623: rollback oid 12 current snap is 169 2026-02-17T05:34:59.298 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 168 2026-02-17T05:34:59.298 INFO:tasks.rados.rados.0.trial118.stdout:1624: write (excl) oid 50 current snap is 169 2026-02-17T05:34:59.298 INFO:tasks.rados.rados.0.trial118.stdout:1624: seq_num 600 ranges {484200=624934,1860843=223357} 2026-02-17T05:34:59.301 INFO:tasks.rados.rados.0.trial118.stdout:1624: writing trial11845692-50 from 484200 to 1109134 tid 1 2026-02-17T05:34:59.304 INFO:tasks.rados.rados.0.trial118.stdout:1624: writing trial11845692-50 from 1860843 to 2084200 tid 2 2026-02-17T05:34:59.304 INFO:tasks.rados.rados.0.trial118.stdout:1625: snap_remove snap 164 2026-02-17T05:35:00.286 INFO:tasks.rados.rados.0.trial118.stdout:1625: done (3 left) 2026-02-17T05:35:00.286 INFO:tasks.rados.rados.0.trial118.stdout:1626: snap_create 2026-02-17T05:35:00.286 INFO:tasks.rados.rados.0.trial118.stdout:1623: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:35:00.286 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 732 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:35:00.286 INFO:tasks.rados.rados.0.trial118.stdout:1622: expect (ObjNum 599 snap 168 seq_num 599) 2026-02-17T05:35:00.343 INFO:tasks.rados.rados.0.trial118.stdout:1624: finishing write tid 1 to trial11845692-50 2026-02-17T05:35:00.343 INFO:tasks.rados.rados.0.trial118.stdout:1624: finishing write tid 2 to trial11845692-50 2026-02-17T05:35:00.343 INFO:tasks.rados.rados.0.trial118.stdout:1624: finishing write tid 3 to trial11845692-50 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:1624: finishing write tid 4 to trial11845692-50 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:1624: oid 50 updating version 0 to 733 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:1624: oid 50 updating version 733 to 735 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:1624: oid 50 version 735 is already newer than 734 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 735 (ObjNum 600 snap 169 seq_num 600) dirty exists 2026-02-17T05:35:00.344 INFO:tasks.rados.rados.0.trial118.stdout:1624: left oid 50 (ObjNum 600 snap 169 seq_num 600) 2026-02-17T05:35:01.286 INFO:tasks.rados.rados.0.trial118.stdout:1622: done (3 left) 2026-02-17T05:35:01.286 INFO:tasks.rados.rados.0.trial118.stdout:1623: done (2 left) 2026-02-17T05:35:01.286 INFO:tasks.rados.rados.0.trial118.stdout:1624: done (1 left) 2026-02-17T05:35:01.286 INFO:tasks.rados.rados.0.trial118.stdout:1626: done (0 left) 2026-02-17T05:35:01.286 INFO:tasks.rados.rados.0.trial118.stdout:1627: snap_create 2026-02-17T05:35:02.287 INFO:tasks.rados.rados.0.trial118.stdout:1627: done (0 left) 2026-02-17T05:35:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1628: copy_from oid 6 from oid 33 current snap is 171 2026-02-17T05:35:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1629: copy_from oid 30 from oid 32 current snap is 171 2026-02-17T05:35:02.288 INFO:tasks.rados.rados.0.trial118.stdout:1630: snap_remove snap 168 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:1630: done (2 left) 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:1631: rollback oid 22 current snap is 171 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 170 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:1628: finishing copy_from to trial11845692-6 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:1628: got expected ENOENT (src dne) 2026-02-17T05:35:03.291 INFO:tasks.rados.rados.0.trial118.stdout:1628: finishing copy_from racing read to trial11845692-6 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1629: finishing copy_from racing read to trial11845692-30 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1629: finishing copy_from to trial11845692-30 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1628: done (2 left) 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1629: done (1 left) 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1632: copy_from oid 30 from oid 6 current snap is 171 2026-02-17T05:35:03.292 INFO:tasks.rados.rados.0.trial118.stdout:1633: snap_create 2026-02-17T05:35:03.293 INFO:tasks.rados.rados.0.trial118.stdout:1631: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:35:03.293 INFO:tasks.rados.rados.0.trial118.stdout:1631: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:35:03.293 INFO:tasks.rados.rados.0.trial118.stdout:1631: finishing rollback tid 2 to trial11845692-22 2026-02-17T05:35:03.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 700 (ObjNum 567 snap 155 seq_num 567) dirty exists 2026-02-17T05:35:03.303 INFO:tasks.rados.rados.0.trial118.stdout:1632: finishing copy_from racing read to trial11845692-30 2026-02-17T05:35:03.304 INFO:tasks.rados.rados.0.trial118.stdout:1632: finishing copy_from to trial11845692-30 2026-02-17T05:35:03.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:35:04.294 INFO:tasks.rados.rados.0.trial118.stdout:1631: done (2 left) 2026-02-17T05:35:04.294 INFO:tasks.rados.rados.0.trial118.stdout:1632: done (1 left) 2026-02-17T05:35:04.294 INFO:tasks.rados.rados.0.trial118.stdout:1633: done (0 left) 2026-02-17T05:35:04.294 INFO:tasks.rados.rados.0.trial118.stdout:1634: copy_from oid 28 from oid 22 current snap is 172 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1635: read oid 6 snap -1 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1635: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1636: read oid 8 snap -1 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1636: expect (ObjNum 583 snap 161 seq_num 583) 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1637: rollback oid 33 current snap is 172 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 169 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1638: read oid 41 snap -1 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1638: expect deleted 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1639: rollback oid 35 current snap is 172 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 170 2026-02-17T05:35:04.295 INFO:tasks.rados.rados.0.trial118.stdout:1640: copy_from oid 27 from oid 30 current snap is 172 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1641: read oid 13 snap -1 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1641: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1642: read oid 45 snap -1 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1642: expect deleted 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1643: rollback oid 21 current snap is 172 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 163 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1644: write oid 18 current snap is 172 2026-02-17T05:35:04.296 INFO:tasks.rados.rados.0.trial118.stdout:1644: seq_num 601 ranges {501007=416536,1635678=465329} 2026-02-17T05:35:04.297 INFO:tasks.rados.rados.0.trial118.stdout:1644: writing trial11845692-18 from 501007 to 917543 tid 1 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1644: writing trial11845692-18 from 1635678 to 2101007 tid 2 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1645: snap_create 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1637: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1639: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1639: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1639: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 421 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:35:04.302 INFO:tasks.rados.rados.0.trial118.stdout:1635: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:35:04.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 628945 2026-02-17T05:35:04.379 INFO:tasks.rados.rados.0.trial118.stdout:1643: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:35:04.379 INFO:tasks.rados.rados.0.trial118.stdout:1643: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:35:04.379 INFO:tasks.rados.rados.0.trial118.stdout:1643: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:35:04.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 862 (ObjNum 571 snap 155 seq_num 571) dirty exists 2026-02-17T05:35:04.379 INFO:tasks.rados.rados.0.trial118.stdout:1641: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:35:04.417 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1226350 2026-02-17T05:35:04.432 INFO:tasks.rados.rados.0.trial118.stdout:1644: finishing write tid 1 to trial11845692-18 2026-02-17T05:35:04.433 INFO:tasks.rados.rados.0.trial118.stdout:1636: expect (ObjNum 583 snap 161 seq_num 583) 2026-02-17T05:35:04.433 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:1634: finishing copy_from racing read to trial11845692-28 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:1634: finishing copy_from to trial11845692-28 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 700 (ObjNum 567 snap 155 seq_num 567) dirty exists 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:1644: finishing write tid 2 to trial11845692-18 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:1644: finishing write tid 3 to trial11845692-18 2026-02-17T05:35:04.592 INFO:tasks.rados.rados.0.trial118.stdout:1644: finishing write tid 4 to trial11845692-18 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1644: oid 18 updating version 0 to 701 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1644: oid 18 version 701 is already newer than 421 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1644: oid 18 updating version 701 to 702 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 702 (ObjNum 601 snap 172 seq_num 601) dirty exists 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1644: left oid 18 (ObjNum 601 snap 172 seq_num 601) 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1640: finishing copy_from racing read to trial11845692-27 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:1640: finishing copy_from to trial11845692-27 2026-02-17T05:35:04.593 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:35:05.289 INFO:tasks.rados.rados.0.trial118.stdout:1634: done (11 left) 2026-02-17T05:35:05.289 INFO:tasks.rados.rados.0.trial118.stdout:1635: done (10 left) 2026-02-17T05:35:05.289 INFO:tasks.rados.rados.0.trial118.stdout:1636: done (9 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1637: done (8 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1638: done (7 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1639: done (6 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1640: done (5 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1641: done (4 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1642: done (3 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1643: done (2 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1644: done (1 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1645: done (0 left) 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1646: write oid 40 current snap is 173 2026-02-17T05:35:05.290 INFO:tasks.rados.rados.0.trial118.stdout:1646: seq_num 602 ranges {517814=491785,1577807=540007} 2026-02-17T05:35:05.293 INFO:tasks.rados.rados.0.trial118.stdout:1646: writing trial11845692-40 from 517814 to 1009599 tid 1 2026-02-17T05:35:05.297 INFO:tasks.rados.rados.0.trial118.stdout:1646: writing trial11845692-40 from 1577807 to 2117814 tid 2 2026-02-17T05:35:05.297 INFO:tasks.rados.rados.0.trial118.stdout:1647: snap_create 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: finishing write tid 1 to trial11845692-40 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: finishing write tid 2 to trial11845692-40 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: finishing write tid 3 to trial11845692-40 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: finishing write tid 4 to trial11845692-40 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: oid 40 updating version 0 to 866 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: oid 40 version 866 is already newer than 864 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: oid 40 version 866 is already newer than 865 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 866 (ObjNum 602 snap 173 seq_num 602) dirty exists 2026-02-17T05:35:05.301 INFO:tasks.rados.rados.0.trial118.stdout:1646: left oid 40 (ObjNum 602 snap 173 seq_num 602) 2026-02-17T05:35:06.300 INFO:tasks.rados.rados.0.trial118.stdout:1646: done (1 left) 2026-02-17T05:35:06.300 INFO:tasks.rados.rados.0.trial118.stdout:1647: done (0 left) 2026-02-17T05:35:06.300 INFO:tasks.rados.rados.0.trial118.stdout:1648: write (excl) oid 36 current snap is 174 2026-02-17T05:35:06.300 INFO:tasks.rados.rados.0.trial118.stdout:1648: seq_num 603 ranges {534621=567034,1636289=498332} 2026-02-17T05:35:06.305 INFO:tasks.rados.rados.0.trial118.stdout:1648: writing trial11845692-36 from 534621 to 1101655 tid 1 2026-02-17T05:35:06.310 INFO:tasks.rados.rados.0.trial118.stdout:1648: writing trial11845692-36 from 1636289 to 2134621 tid 2 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1649: copy_from oid 35 from oid 37 current snap is 174 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1648: finishing write tid 1 to trial11845692-36 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1650: read oid 42 snap -1 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1650: expect deleted 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1651: rollback oid 21 current snap is 174 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 162 2026-02-17T05:35:06.311 INFO:tasks.rados.rados.0.trial118.stdout:1652: snap_remove snap 170 2026-02-17T05:35:07.303 INFO:tasks.rados.rados.0.trial118.stdout:1652: done (4 left) 2026-02-17T05:35:07.303 INFO:tasks.rados.rados.0.trial118.stdout:1653: read oid 48 snap -1 2026-02-17T05:35:07.303 INFO:tasks.rados.rados.0.trial118.stdout:1653: expect (ObjNum 479 snap 125 seq_num 479) 2026-02-17T05:35:07.304 INFO:tasks.rados.rados.0.trial118.stdout:1654: write (excl) oid 8 current snap is 174 2026-02-17T05:35:07.304 INFO:tasks.rados.rados.0.trial118.stdout:1654: seq_num 604 ranges {551428=642283,1694771=456657} 2026-02-17T05:35:07.307 INFO:tasks.rados.rados.0.trial118.stdout:1654: writing trial11845692-8 from 551428 to 1193711 tid 1 2026-02-17T05:35:07.311 INFO:tasks.rados.rados.0.trial118.stdout:1654: writing trial11845692-8 from 1694771 to 2151428 tid 2 2026-02-17T05:35:07.311 INFO:tasks.rados.rados.0.trial118.stdout:1655: write (excl) oid 45 current snap is 174 2026-02-17T05:35:07.311 INFO:tasks.rados.rados.0.trial118.stdout:1655: seq_num 605 ranges {568235=717532,1753253=414982} 2026-02-17T05:35:07.316 INFO:tasks.rados.rados.0.trial118.stdout:1655: writing trial11845692-45 from 568235 to 1285767 tid 1 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1655: writing trial11845692-45 from 1753253 to 2168235 tid 2 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1656: rollback oid 3 current snap is 174 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 167 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1648: finishing write tid 2 to trial11845692-36 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1648: finishing write tid 3 to trial11845692-36 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1648: finishing write tid 4 to trial11845692-36 2026-02-17T05:35:07.320 INFO:tasks.rados.rados.0.trial118.stdout:1648: oid 36 updating version 0 to 703 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1648: oid 36 version 703 is already newer than 701 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1648: oid 36 version 703 is already newer than 702 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 703 (ObjNum 603 snap 174 seq_num 603) dirty exists 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1648: left oid 36 (ObjNum 603 snap 174 seq_num 603) 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1651: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1648: done (7 left) 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1650: done (6 left) 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1657: snap_create 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1651: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1651: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 870 (ObjNum 571 snap 155 seq_num 571) dirty exists 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1649: finishing copy_from racing read to trial11845692-35 2026-02-17T05:35:07.321 INFO:tasks.rados.rados.0.trial118.stdout:1649: finishing copy_from to trial11845692-35 2026-02-17T05:35:07.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 148 (ObjNum 587 snap 161 seq_num 587) dirty exists 2026-02-17T05:35:07.322 INFO:tasks.rados.rados.0.trial118.stdout:1653: expect (ObjNum 479 snap 125 seq_num 479) 2026-02-17T05:35:07.347 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1545080 2026-02-17T05:35:07.354 INFO:tasks.rados.rados.0.trial118.stdout:1654: finishing write tid 1 to trial11845692-8 2026-02-17T05:35:07.354 INFO:tasks.rados.rados.0.trial118.stdout:1654: finishing write tid 2 to trial11845692-8 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: finishing write tid 3 to trial11845692-8 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: finishing write tid 4 to trial11845692-8 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: oid 8 updating version 0 to 948 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: oid 8 version 948 is already newer than 947 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: oid 8 updating version 948 to 949 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 949 (ObjNum 604 snap 174 seq_num 604) dirty exists 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1654: left oid 8 (ObjNum 604 snap 174 seq_num 604) 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1655: finishing write tid 1 to trial11845692-45 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1655: finishing write tid 2 to trial11845692-45 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1655: finishing write tid 3 to trial11845692-45 2026-02-17T05:35:07.355 INFO:tasks.rados.rados.0.trial118.stdout:1655: finishing write tid 4 to trial11845692-45 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1655: oid 45 updating version 0 to 704 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1655: oid 45 updating version 704 to 705 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1655: oid 45 updating version 705 to 706 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 706 (ObjNum 605 snap 174 seq_num 605) dirty exists 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1655: left oid 45 (ObjNum 605 snap 174 seq_num 605) 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1656: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1656: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:1656: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:35:07.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 687 (ObjNum 473 snap 122 seq_num 473) dirty exists 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1649: done (6 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1651: done (5 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1653: done (4 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1654: done (3 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1655: done (2 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1656: done (1 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1657: done (0 left) 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1658: write (excl) oid 36 current snap is 175 2026-02-17T05:35:08.306 INFO:tasks.rados.rados.0.trial118.stdout:1658: seq_num 606 ranges {585042=792781,2095382=89660} 2026-02-17T05:35:08.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: writing trial11845692-36 from 585042 to 1377823 tid 1 2026-02-17T05:35:08.314 INFO:tasks.rados.rados.0.trial118.stdout:1658: writing trial11845692-36 from 2095382 to 2185042 tid 2 2026-02-17T05:35:08.314 INFO:tasks.rados.rados.0.trial118.stdout:1659: read oid 45 snap -1 2026-02-17T05:35:08.314 INFO:tasks.rados.rados.0.trial118.stdout:1659: expect (ObjNum 605 snap 174 seq_num 605) 2026-02-17T05:35:08.315 INFO:tasks.rados.rados.0.trial118.stdout:1660: copy_from oid 40 from oid 39 current snap is 175 2026-02-17T05:35:08.315 INFO:tasks.rados.rados.0.trial118.stdout:1661: snap_remove snap 171 2026-02-17T05:35:09.310 INFO:tasks.rados.rados.0.trial118.stdout:1661: done (3 left) 2026-02-17T05:35:09.310 INFO:tasks.rados.rados.0.trial118.stdout:1662: rollback oid 19 current snap is 175 2026-02-17T05:35:09.310 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 169 2026-02-17T05:35:09.310 INFO:tasks.rados.rados.0.trial118.stdout:1658: finishing write tid 1 to trial11845692-36 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: finishing write tid 2 to trial11845692-36 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: finishing write tid 3 to trial11845692-36 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: finishing write tid 4 to trial11845692-36 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: oid 36 updating version 0 to 709 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: oid 36 version 709 is already newer than 708 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: oid 36 version 709 is already newer than 707 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 709 (ObjNum 606 snap 175 seq_num 606) dirty exists 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1658: left oid 36 (ObjNum 606 snap 175 seq_num 606) 2026-02-17T05:35:09.311 INFO:tasks.rados.rados.0.trial118.stdout:1659: expect (ObjNum 605 snap 174 seq_num 605) 2026-02-17T05:35:09.324 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:09.339 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:09.355 INFO:tasks.rados.rados.0.trial118.stdout:1660: finishing copy_from racing read to trial11845692-40 2026-02-17T05:35:09.355 INFO:tasks.rados.rados.0.trial118.stdout:1660: finishing copy_from to trial11845692-40 2026-02-17T05:35:09.355 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 807 (ObjNum 575 snap 157 seq_num 575) dirty exists 2026-02-17T05:35:09.355 INFO:tasks.rados.rados.0.trial118.stdout:1662: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:35:09.355 INFO:tasks.rados.rados.0.trial118.stdout:1662: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1662: finishing rollback tid 2 to trial11845692-19 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 690 (ObjNum 569 snap 155 seq_num 569) dirty exists 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1658: done (3 left) 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1659: done (2 left) 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1660: done (1 left) 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1662: done (0 left) 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1663: read oid 39 snap -1 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1663: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1664: write oid 13 current snap is 175 2026-02-17T05:35:09.356 INFO:tasks.rados.rados.0.trial118.stdout:1664: seq_num 607 ranges {601849=468030,1753864=447985} 2026-02-17T05:35:09.359 INFO:tasks.rados.rados.0.trial118.stdout:1664: writing trial11845692-13 from 601849 to 1069879 tid 1 2026-02-17T05:35:09.364 INFO:tasks.rados.rados.0.trial118.stdout:1664: writing trial11845692-13 from 1753864 to 2201849 tid 2 2026-02-17T05:35:09.364 INFO:tasks.rados.rados.0.trial118.stdout:1665: snap_create 2026-02-17T05:35:09.364 INFO:tasks.rados.rados.0.trial118.stdout:1663: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:09.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 467276 2026-02-17T05:35:09.511 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: finishing write tid 1 to trial11845692-13 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: finishing write tid 2 to trial11845692-13 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: finishing write tid 3 to trial11845692-13 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: finishing write tid 4 to trial11845692-13 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: oid 13 updating version 0 to 692 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: oid 13 version 692 is already newer than 691 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: oid 13 updating version 692 to 693 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 693 (ObjNum 607 snap 175 seq_num 607) dirty exists 2026-02-17T05:35:09.586 INFO:tasks.rados.rados.0.trial118.stdout:1664: left oid 13 (ObjNum 607 snap 175 seq_num 607) 2026-02-17T05:35:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1663: done (2 left) 2026-02-17T05:35:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1664: done (1 left) 2026-02-17T05:35:10.288 INFO:tasks.rados.rados.0.trial118.stdout:1665: done (0 left) 2026-02-17T05:35:10.289 INFO:tasks.rados.rados.0.trial118.stdout:1666: read oid 29 snap 172 2026-02-17T05:35:10.289 INFO:tasks.rados.rados.0.trial118.stdout:1666: expect deleted 2026-02-17T05:35:10.289 INFO:tasks.rados.rados.0.trial118.stdout:1667: write (excl) oid 41 current snap is 176 2026-02-17T05:35:10.289 INFO:tasks.rados.rados.0.trial118.stdout:1667: seq_num 608 ranges {618656=543279,1812346=406310} 2026-02-17T05:35:10.292 INFO:tasks.rados.rados.0.trial118.stdout:1667: writing trial11845692-41 from 618656 to 1161935 tid 1 2026-02-17T05:35:10.297 INFO:tasks.rados.rados.0.trial118.stdout:1667: writing trial11845692-41 from 1812346 to 2218656 tid 2 2026-02-17T05:35:10.297 INFO:tasks.rados.rados.0.trial118.stdout:1668: snap_create 2026-02-17T05:35:10.297 INFO:tasks.rados.rados.0.trial118.stdout:1667: finishing write tid 1 to trial11845692-41 2026-02-17T05:35:10.298 INFO:tasks.rados.rados.0.trial118.stdout:1667: finishing write tid 2 to trial11845692-41 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: finishing write tid 3 to trial11845692-41 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: finishing write tid 4 to trial11845692-41 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: oid 41 updating version 0 to 794 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: oid 41 version 794 is already newer than 793 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: oid 41 updating version 794 to 795 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 795 (ObjNum 608 snap 176 seq_num 608) dirty exists 2026-02-17T05:35:10.299 INFO:tasks.rados.rados.0.trial118.stdout:1667: left oid 41 (ObjNum 608 snap 176 seq_num 608) 2026-02-17T05:35:11.288 INFO:tasks.rados.rados.0.trial118.stdout:1666: done (2 left) 2026-02-17T05:35:11.288 INFO:tasks.rados.rados.0.trial118.stdout:1667: done (1 left) 2026-02-17T05:35:11.288 INFO:tasks.rados.rados.0.trial118.stdout:1668: done (0 left) 2026-02-17T05:35:11.288 INFO:tasks.rados.rados.0.trial118.stdout:1669: write (excl) oid 14 current snap is 177 2026-02-17T05:35:11.288 INFO:tasks.rados.rados.0.trial118.stdout:1669: seq_num 609 ranges {635463=734881,1987181=248282} 2026-02-17T05:35:11.294 INFO:tasks.rados.rados.0.trial118.stdout:1669: writing trial11845692-14 from 635463 to 1370344 tid 1 2026-02-17T05:35:11.298 INFO:tasks.rados.rados.0.trial118.stdout:1669: writing trial11845692-14 from 1987181 to 2235463 tid 2 2026-02-17T05:35:11.298 INFO:tasks.rados.rados.0.trial118.stdout:1670: read oid 20 snap 172 2026-02-17T05:35:11.298 INFO:tasks.rados.rados.0.trial118.stdout:1670: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:35:11.298 INFO:tasks.rados.rados.0.trial118.stdout:1671: write oid 33 current snap is 177 2026-02-17T05:35:11.298 INFO:tasks.rados.rados.0.trial118.stdout:1671: seq_num 610 ranges {652270=410130,1529310=493867} 2026-02-17T05:35:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1671: writing trial11845692-33 from 652270 to 1062400 tid 1 2026-02-17T05:35:11.305 INFO:tasks.rados.rados.0.trial118.stdout:1671: writing trial11845692-33 from 1529310 to 2023177 tid 2 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1672: snap_create 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: finishing write tid 1 to trial11845692-14 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: finishing write tid 2 to trial11845692-14 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: finishing write tid 3 to trial11845692-14 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: finishing write tid 4 to trial11845692-14 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: oid 14 updating version 0 to 602 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: oid 14 version 602 is already newer than 601 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: oid 14 version 602 is already newer than 600 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 602 (ObjNum 609 snap 177 seq_num 609) dirty exists 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1669: left oid 14 (ObjNum 609 snap 177 seq_num 609) 2026-02-17T05:35:11.306 INFO:tasks.rados.rados.0.trial118.stdout:1670: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:35:11.310 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1093688 2026-02-17T05:35:11.325 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:11.368 INFO:tasks.rados.rados.0.trial118.stdout:1671: finishing write tid 1 to trial11845692-33 2026-02-17T05:35:11.368 INFO:tasks.rados.rados.0.trial118.stdout:1671: finishing write tid 2 to trial11845692-33 2026-02-17T05:35:11.368 INFO:tasks.rados.rados.0.trial118.stdout:1671: finishing write tid 3 to trial11845692-33 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:1671: finishing write tid 4 to trial11845692-33 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:1671: oid 33 updating version 0 to 883 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:1671: oid 33 updating version 883 to 884 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:1671: oid 33 updating version 884 to 885 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 885 (ObjNum 610 snap 177 seq_num 610) dirty exists 2026-02-17T05:35:11.369 INFO:tasks.rados.rados.0.trial118.stdout:1671: left oid 33 (ObjNum 610 snap 177 seq_num 610) 2026-02-17T05:35:12.289 INFO:tasks.rados.rados.0.trial118.stdout:1669: done (3 left) 2026-02-17T05:35:12.289 INFO:tasks.rados.rados.0.trial118.stdout:1670: done (2 left) 2026-02-17T05:35:12.289 INFO:tasks.rados.rados.0.trial118.stdout:1671: done (1 left) 2026-02-17T05:35:12.289 INFO:tasks.rados.rados.0.trial118.stdout:1672: done (0 left) 2026-02-17T05:35:12.289 INFO:tasks.rados.rados.0.trial118.stdout:1673: snap_remove snap 167 2026-02-17T05:35:13.290 INFO:tasks.rados.rados.0.trial118.stdout:1673: done (0 left) 2026-02-17T05:35:13.290 INFO:tasks.rados.rados.0.trial118.stdout:1674: write oid 10 current snap is 178 2026-02-17T05:35:13.290 INFO:tasks.rados.rados.0.trial118.stdout:1674: seq_num 611 ranges {669077=485379,1587792=681285} 2026-02-17T05:35:13.295 INFO:tasks.rados.rados.0.trial118.stdout:1674: writing trial11845692-10 from 669077 to 1154456 tid 1 2026-02-17T05:35:13.299 INFO:tasks.rados.rados.0.trial118.stdout:1674: writing trial11845692-10 from 1587792 to 2269077 tid 2 2026-02-17T05:35:13.299 INFO:tasks.rados.rados.0.trial118.stdout:1675: read oid 20 snap -1 2026-02-17T05:35:13.300 INFO:tasks.rados.rados.0.trial118.stdout:1675: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:35:13.300 INFO:tasks.rados.rados.0.trial118.stdout:1676: write (excl) oid 39 current snap is 178 2026-02-17T05:35:13.300 INFO:tasks.rados.rados.0.trial118.stdout:1676: seq_num 612 ranges {685884=560628,2046274=239610} 2026-02-17T05:35:13.303 INFO:tasks.rados.rados.0.trial118.stdout:1676: writing trial11845692-39 from 685884 to 1246512 tid 1 2026-02-17T05:35:13.307 INFO:tasks.rados.rados.0.trial118.stdout:1676: writing trial11845692-39 from 2046274 to 2285884 tid 2 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1677: write (excl) oid 47 current snap is 178 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: finishing write tid 1 to trial11845692-10 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: finishing write tid 2 to trial11845692-10 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: finishing write tid 3 to trial11845692-10 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: finishing write tid 4 to trial11845692-10 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: oid 10 updating version 0 to 416 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: oid 10 updating version 416 to 418 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: oid 10 version 418 is already newer than 417 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 418 (ObjNum 611 snap 178 seq_num 611) dirty exists 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1674: left oid 10 (ObjNum 611 snap 178 seq_num 611) 2026-02-17T05:35:13.308 INFO:tasks.rados.rados.0.trial118.stdout:1675: expect (ObjNum 560 snap 155 seq_num 560) 2026-02-17T05:35:13.310 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1687526 2026-02-17T05:35:13.325 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 412479 2026-02-17T05:35:13.370 INFO:tasks.rados.rados.0.trial118.stdout:1676: finishing write tid 1 to trial11845692-39 2026-02-17T05:35:13.370 INFO:tasks.rados.rados.0.trial118.stdout:1677: seq_num 613 ranges {702691=635877,2104756=197935} 2026-02-17T05:35:13.375 INFO:tasks.rados.rados.0.trial118.stdout:1677: writing trial11845692-47 from 702691 to 1338568 tid 1 2026-02-17T05:35:13.380 INFO:tasks.rados.rados.0.trial118.stdout:1677: writing trial11845692-47 from 2104756 to 2302691 tid 2 2026-02-17T05:35:13.380 INFO:tasks.rados.rados.0.trial118.stdout:1674: done (3 left) 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1675: done (2 left) 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1678: copy_from oid 13 from oid 9 current snap is 178 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: finishing write tid 2 to trial11845692-39 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: finishing write tid 3 to trial11845692-39 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: finishing write tid 4 to trial11845692-39 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: oid 39 updating version 0 to 829 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: oid 39 version 829 is already newer than 828 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: oid 39 version 829 is already newer than 827 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 829 (ObjNum 612 snap 178 seq_num 612) dirty exists 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: left oid 39 (ObjNum 612 snap 178 seq_num 612) 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1677: finishing write tid 1 to trial11845692-47 2026-02-17T05:35:13.381 INFO:tasks.rados.rados.0.trial118.stdout:1676: done (2 left) 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:1679: rollback oid 19 current snap is 178 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 175 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:1680: read oid 44 snap -1 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:1680: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:1681: copy_from oid 3 from oid 45 current snap is 178 2026-02-17T05:35:13.382 INFO:tasks.rados.rados.0.trial118.stdout:1682: delete oid 24 current snap is 178 2026-02-17T05:35:13.383 INFO:tasks.rados.rados.0.trial118.stdout:1677: finishing write tid 2 to trial11845692-47 2026-02-17T05:35:13.383 INFO:tasks.rados.rados.0.trial118.stdout:1677: finishing write tid 3 to trial11845692-47 2026-02-17T05:35:13.383 INFO:tasks.rados.rados.0.trial118.stdout:1677: finishing write tid 4 to trial11845692-47 2026-02-17T05:35:13.383 INFO:tasks.rados.rados.0.trial118.stdout:1677: oid 47 updating version 0 to 832 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1677: oid 47 version 832 is already newer than 831 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1677: oid 47 updating version 832 to 833 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 833 (ObjNum 613 snap 178 seq_num 613) dirty exists 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1677: left oid 47 (ObjNum 613 snap 178 seq_num 613) 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1678: finishing copy_from to trial11845692-13 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1678: got expected ENOENT (src dne) 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1678: finishing copy_from racing read to trial11845692-13 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1679: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1679: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:1679: finishing rollback tid 2 to trial11845692-19 2026-02-17T05:35:13.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 696 (ObjNum 569 snap 155 seq_num 569) dirty exists 2026-02-17T05:35:13.386 INFO:tasks.rados.rados.0.trial118.stdout:1680: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:13.409 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 419064 2026-02-17T05:35:13.430 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:13.452 INFO:tasks.rados.rados.0.trial118.stdout:1681: finishing copy_from racing read to trial11845692-3 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1681: finishing copy_from to trial11845692-3 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 706 (ObjNum 605 snap 174 seq_num 605) dirty exists 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1677: done (5 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1678: done (4 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1679: done (3 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1680: done (2 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1681: done (1 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1682: done (0 left) 2026-02-17T05:35:13.453 INFO:tasks.rados.rados.0.trial118.stdout:1683: snap_create 2026-02-17T05:35:14.295 INFO:tasks.rados.rados.0.trial118.stdout:1683: done (0 left) 2026-02-17T05:35:14.295 INFO:tasks.rados.rados.0.trial118.stdout:1684: rollback oid 10 current snap is 179 2026-02-17T05:35:14.295 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 163 2026-02-17T05:35:14.295 INFO:tasks.rados.rados.0.trial118.stdout:1685: read oid 39 snap -1 2026-02-17T05:35:14.296 INFO:tasks.rados.rados.0.trial118.stdout:1685: expect (ObjNum 612 snap 178 seq_num 612) 2026-02-17T05:35:14.296 INFO:tasks.rados.rados.0.trial118.stdout:1686: snap_create 2026-02-17T05:35:14.296 INFO:tasks.rados.rados.0.trial118.stdout:1684: finishing rollback tid 0 to trial11845692-10 2026-02-17T05:35:14.297 INFO:tasks.rados.rados.0.trial118.stdout:1684: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:35:14.297 INFO:tasks.rados.rados.0.trial118.stdout:1684: finishing rollback tid 2 to trial11845692-10 2026-02-17T05:35:14.297 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 421 (ObjNum 526 snap 144 seq_num 526) dirty exists 2026-02-17T05:35:14.299 INFO:tasks.rados.rados.0.trial118.stdout:1685: expect (ObjNum 612 snap 178 seq_num 612) 2026-02-17T05:35:14.340 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2245397 2026-02-17T05:35:14.408 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1368800 2026-02-17T05:35:15.288 INFO:tasks.rados.rados.0.trial118.stdout:1684: done (2 left) 2026-02-17T05:35:15.288 INFO:tasks.rados.rados.0.trial118.stdout:1685: done (1 left) 2026-02-17T05:35:15.288 INFO:tasks.rados.rados.0.trial118.stdout:1686: done (0 left) 2026-02-17T05:35:15.288 INFO:tasks.rados.rados.0.trial118.stdout:1687: snap_remove snap 175 2026-02-17T05:35:16.290 INFO:tasks.rados.rados.0.trial118.stdout:1687: done (0 left) 2026-02-17T05:35:16.291 INFO:tasks.rados.rados.0.trial118.stdout:1688: snap_create 2026-02-17T05:35:17.292 INFO:tasks.rados.rados.0.trial118.stdout:1688: done (0 left) 2026-02-17T05:35:17.292 INFO:tasks.rados.rados.0.trial118.stdout:1689: write oid 35 current snap is 181 2026-02-17T05:35:17.292 INFO:tasks.rados.rados.0.trial118.stdout:1689: seq_num 615 ranges {736305=786375,2105367=230938} 2026-02-17T05:35:17.298 INFO:tasks.rados.rados.0.trial118.stdout:1689: writing trial11845692-35 from 736305 to 1522680 tid 1 2026-02-17T05:35:17.302 INFO:tasks.rados.rados.0.trial118.stdout:1689: writing trial11845692-35 from 2105367 to 2336305 tid 2 2026-02-17T05:35:17.302 INFO:tasks.rados.rados.0.trial118.stdout:1690: write oid 22 current snap is 181 2026-02-17T05:35:17.302 INFO:tasks.rados.rados.0.trial118.stdout:1690: seq_num 616 ranges {753112=577977,1880202=472910} 2026-02-17T05:35:17.306 INFO:tasks.rados.rados.0.trial118.stdout:1690: writing trial11845692-22 from 753112 to 1331089 tid 1 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1690: writing trial11845692-22 from 1880202 to 2353112 tid 2 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1691: read oid 40 snap -1 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1691: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1692: read oid 6 snap -1 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1692: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1693: delete oid 41 current snap is 181 2026-02-17T05:35:17.311 INFO:tasks.rados.rados.0.trial118.stdout:1689: finishing write tid 1 to trial11845692-35 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: finishing write tid 2 to trial11845692-35 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: finishing write tid 3 to trial11845692-35 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: finishing write tid 4 to trial11845692-35 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: oid 35 updating version 0 to 425 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: oid 35 version 425 is already newer than 424 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: oid 35 version 425 is already newer than 423 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 425 (ObjNum 615 snap 181 seq_num 615) dirty exists 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1689: left oid 35 (ObjNum 615 snap 181 seq_num 615) 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1690: finishing write tid 1 to trial11845692-22 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1690: finishing write tid 2 to trial11845692-22 2026-02-17T05:35:17.312 INFO:tasks.rados.rados.0.trial118.stdout:1690: finishing write tid 3 to trial11845692-22 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1690: finishing write tid 4 to trial11845692-22 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1690: oid 22 updating version 0 to 710 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1690: oid 22 updating version 710 to 712 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1690: oid 22 version 712 is already newer than 711 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 712 (ObjNum 616 snap 181 seq_num 616) dirty exists 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1690: left oid 22 (ObjNum 616 snap 181 seq_num 616) 2026-02-17T05:35:17.313 INFO:tasks.rados.rados.0.trial118.stdout:1692: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:35:17.378 INFO:tasks.rados.rados.0.trial118.stdout:1691: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:17.453 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1689: done (4 left) 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1690: done (3 left) 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1691: done (2 left) 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1692: done (1 left) 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1693: done (0 left) 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1694: read oid 37 snap -1 2026-02-17T05:35:17.599 INFO:tasks.rados.rados.0.trial118.stdout:1694: expect (ObjNum 587 snap 161 seq_num 587) 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1695: read oid 40 snap -1 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1695: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1696: read oid 2 snap 169 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1696: expect (ObjNum 580 snap 161 seq_num 580) 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1697: write (excl) oid 27 current snap is 181 2026-02-17T05:35:17.600 INFO:tasks.rados.rados.0.trial118.stdout:1697: seq_num 618 ranges {786726=728475,2280813=105913} 2026-02-17T05:35:17.604 INFO:tasks.rados.rados.0.trial118.stdout:1697: writing trial11845692-27 from 786726 to 1515201 tid 1 2026-02-17T05:35:17.608 INFO:tasks.rados.rados.0.trial118.stdout:1697: writing trial11845692-27 from 2280813 to 2386726 tid 2 2026-02-17T05:35:17.608 INFO:tasks.rados.rados.0.trial118.stdout:1698: rollback oid 35 current snap is 181 2026-02-17T05:35:17.608 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 163 2026-02-17T05:35:17.609 INFO:tasks.rados.rados.0.trial118.stdout:1694: expect (ObjNum 587 snap 161 seq_num 587) 2026-02-17T05:35:17.639 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:17.706 INFO:tasks.rados.rados.0.trial118.stdout:1695: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:35:17.818 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2590346 2026-02-17T05:35:17.923 INFO:tasks.rados.rados.0.trial118.stdout:1696: expect (ObjNum 580 snap 161 seq_num 580) 2026-02-17T05:35:17.938 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:17.984 INFO:tasks.rados.rados.0.trial118.stdout:1697: finishing write tid 1 to trial11845692-27 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1694: done (4 left) 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1695: done (3 left) 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1696: done (2 left) 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1699: write (excl) oid 24 current snap is 181 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1698: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1698: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1697: finishing write tid 2 to trial11845692-27 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1698: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 428 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:35:17.985 INFO:tasks.rados.rados.0.trial118.stdout:1697: finishing write tid 3 to trial11845692-27 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1697: finishing write tid 4 to trial11845692-27 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1697: oid 27 updating version 0 to 956 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1697: oid 27 updating version 956 to 957 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1697: oid 27 version 957 is already newer than 955 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 957 (ObjNum 618 snap 181 seq_num 618) dirty exists 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1697: left oid 27 (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:35:17.986 INFO:tasks.rados.rados.0.trial118.stdout:1699: seq_num 619 ranges {403533=403724,1539295=652201} 2026-02-17T05:35:17.987 INFO:tasks.rados.rados.0.trial118.stdout:1699: writing trial11845692-24 from 403533 to 807257 tid 1 2026-02-17T05:35:17.993 INFO:tasks.rados.rados.0.trial118.stdout:1699: writing trial11845692-24 from 1539295 to 2191496 tid 2 2026-02-17T05:35:17.993 INFO:tasks.rados.rados.0.trial118.stdout:1697: done (2 left) 2026-02-17T05:35:17.993 INFO:tasks.rados.rados.0.trial118.stdout:1698: done (1 left) 2026-02-17T05:35:17.993 INFO:tasks.rados.rados.0.trial118.stdout:1700: rollback oid 17 current snap is 181 2026-02-17T05:35:17.993 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 179 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1699: finishing write tid 1 to trial11845692-24 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1701: rollback oid 33 current snap is 181 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 176 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1702: read oid 31 snap -1 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1702: expect (ObjNum 532 snap 145 seq_num 532) 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1703: write oid 22 current snap is 181 2026-02-17T05:35:17.994 INFO:tasks.rados.rados.0.trial118.stdout:1703: seq_num 620 ranges {420340=478973,1597777=512212} 2026-02-17T05:35:17.996 INFO:tasks.rados.rados.0.trial118.stdout:1703: writing trial11845692-22 from 420340 to 899313 tid 1 2026-02-17T05:35:18.001 INFO:tasks.rados.rados.0.trial118.stdout:1703: writing trial11845692-22 from 1597777 to 2109989 tid 2 2026-02-17T05:35:18.001 INFO:tasks.rados.rados.0.trial118.stdout:1704: snap_create 2026-02-17T05:35:18.001 INFO:tasks.rados.rados.0.trial118.stdout:1701: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:35:18.001 INFO:tasks.rados.rados.0.trial118.stdout:1699: finishing write tid 2 to trial11845692-24 2026-02-17T05:35:18.001 INFO:tasks.rados.rados.0.trial118.stdout:1701: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 894 (ObjNum 33 snap 0 seq_num 13194543) dirty dne 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: finishing write tid 3 to trial11845692-24 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: finishing write tid 4 to trial11845692-24 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: oid 24 updating version 0 to 429 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: oid 24 updating version 429 to 431 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: oid 24 version 431 is already newer than 430 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 431 (ObjNum 619 snap 181 seq_num 619) dirty exists 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1699: left oid 24 (ObjNum 619 snap 181 seq_num 619) 2026-02-17T05:35:18.002 INFO:tasks.rados.rados.0.trial118.stdout:1702: expect (ObjNum 532 snap 145 seq_num 532) 2026-02-17T05:35:18.047 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 279906 2026-02-17T05:35:18.093 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:18.140 INFO:tasks.rados.rados.0.trial118.stdout:1700: finishing rollback tid 0 to trial11845692-17 2026-02-17T05:35:18.140 INFO:tasks.rados.rados.0.trial118.stdout:1700: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:35:18.140 INFO:tasks.rados.rados.0.trial118.stdout:1700: finishing rollback tid 2 to trial11845692-17 2026-02-17T05:35:18.140 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 428 (ObjNum 590 snap 162 seq_num 590) dirty exists 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: finishing write tid 1 to trial11845692-22 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: finishing write tid 2 to trial11845692-22 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: finishing write tid 3 to trial11845692-22 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: finishing write tid 4 to trial11845692-22 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: oid 22 updating version 0 to 713 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: oid 22 updating version 713 to 714 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: oid 22 updating version 714 to 715 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 715 (ObjNum 620 snap 181 seq_num 620) dirty exists 2026-02-17T05:35:18.141 INFO:tasks.rados.rados.0.trial118.stdout:1703: left oid 22 (ObjNum 620 snap 181 seq_num 620) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1699: done (5 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1700: done (4 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1701: done (3 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1702: done (2 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1703: done (1 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1704: done (0 left) 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:1705: rollback oid 14 current snap is 182 2026-02-17T05:35:18.295 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 169 2026-02-17T05:35:18.296 INFO:tasks.rados.rados.0.trial118.stdout:1706: read oid 19 snap -1 2026-02-17T05:35:18.296 INFO:tasks.rados.rados.0.trial118.stdout:1706: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:35:18.296 INFO:tasks.rados.rados.0.trial118.stdout:1707: snap_remove snap 181 2026-02-17T05:35:19.297 INFO:tasks.rados.rados.0.trial118.stdout:1707: done (2 left) 2026-02-17T05:35:19.297 INFO:tasks.rados.rados.0.trial118.stdout:1708: write (excl) oid 44 current snap is 182 2026-02-17T05:35:19.297 INFO:tasks.rados.rados.0.trial118.stdout:1708: seq_num 621 ranges {437147=554222,1656259=655870} 2026-02-17T05:35:19.301 INFO:tasks.rados.rados.0.trial118.stdout:1708: writing trial11845692-44 from 437147 to 991369 tid 1 2026-02-17T05:35:19.306 INFO:tasks.rados.rados.0.trial118.stdout:1708: writing trial11845692-44 from 1656259 to 2312129 tid 2 2026-02-17T05:35:19.306 INFO:tasks.rados.rados.0.trial118.stdout:1709: snap_remove snap 178 2026-02-17T05:35:20.289 INFO:tasks.rados.rados.0.trial118.stdout:1709: done (3 left) 2026-02-17T05:35:20.289 INFO:tasks.rados.rados.0.trial118.stdout:1710: read oid 41 snap -1 2026-02-17T05:35:20.290 INFO:tasks.rados.rados.0.trial118.stdout:1710: expect deleted 2026-02-17T05:35:20.290 INFO:tasks.rados.rados.0.trial118.stdout:1711: snap_remove snap 162 2026-02-17T05:35:21.290 INFO:tasks.rados.rados.0.trial118.stdout:1711: done (4 left) 2026-02-17T05:35:21.290 INFO:tasks.rados.rados.0.trial118.stdout:1712: snap_create 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:1705: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:1705: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:1705: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 605 (ObjNum 596 snap 166 seq_num 596) dirty exists 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:1706: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:35:21.291 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:21.344 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1656014 2026-02-17T05:35:21.384 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2642082 2026-02-17T05:35:21.395 INFO:tasks.rados.rados.0.trial118.stdout:1708: finishing write tid 1 to trial11845692-44 2026-02-17T05:35:21.395 INFO:tasks.rados.rados.0.trial118.stdout:1708: finishing write tid 2 to trial11845692-44 2026-02-17T05:35:21.395 INFO:tasks.rados.rados.0.trial118.stdout:1708: finishing write tid 3 to trial11845692-44 2026-02-17T05:35:21.395 INFO:tasks.rados.rados.0.trial118.stdout:1708: finishing write tid 4 to trial11845692-44 2026-02-17T05:35:21.395 INFO:tasks.rados.rados.0.trial118.stdout:1708: oid 44 updating version 0 to 433 2026-02-17T05:35:21.396 INFO:tasks.rados.rados.0.trial118.stdout:1708: oid 44 updating version 433 to 434 2026-02-17T05:35:21.396 INFO:tasks.rados.rados.0.trial118.stdout:1708: oid 44 version 434 is already newer than 432 2026-02-17T05:35:21.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 434 (ObjNum 621 snap 182 seq_num 621) dirty exists 2026-02-17T05:35:21.396 INFO:tasks.rados.rados.0.trial118.stdout:1708: left oid 44 (ObjNum 621 snap 182 seq_num 621) 2026-02-17T05:35:22.291 INFO:tasks.rados.rados.0.trial118.stdout:1705: done (4 left) 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1706: done (3 left) 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1708: done (2 left) 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1710: done (1 left) 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1712: done (0 left) 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1713: copy_from oid 31 from oid 7 current snap is 183 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1714: copy_from oid 22 from oid 12 current snap is 183 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1715: copy_from oid 8 from oid 27 current snap is 183 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1716: write oid 38 current snap is 183 2026-02-17T05:35:22.292 INFO:tasks.rados.rados.0.trial118.stdout:1716: seq_num 622 ranges {453954=629471,1598388=515881} 2026-02-17T05:35:22.295 INFO:tasks.rados.rados.0.trial118.stdout:1716: writing trial11845692-38 from 453954 to 1083425 tid 1 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1716: writing trial11845692-38 from 1598388 to 2114269 tid 2 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1717: copy_from oid 16 from oid 37 current snap is 183 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1714: finishing copy_from to trial11845692-22 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1714: got expected ENOENT (src dne) 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1714: finishing copy_from racing read to trial11845692-22 2026-02-17T05:35:22.300 INFO:tasks.rados.rados.0.trial118.stdout:1716: finishing write tid 1 to trial11845692-38 2026-02-17T05:35:22.301 INFO:tasks.rados.rados.0.trial118.stdout:1714: done (4 left) 2026-02-17T05:35:22.301 INFO:tasks.rados.rados.0.trial118.stdout:1718: snap_create 2026-02-17T05:35:22.301 INFO:tasks.rados.rados.0.trial118.stdout:1716: finishing write tid 2 to trial11845692-38 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: finishing write tid 3 to trial11845692-38 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: finishing write tid 4 to trial11845692-38 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: oid 38 updating version 0 to 846 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: oid 38 updating version 846 to 847 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: oid 38 version 847 is already newer than 845 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 847 (ObjNum 622 snap 183 seq_num 622) dirty exists 2026-02-17T05:35:22.302 INFO:tasks.rados.rados.0.trial118.stdout:1716: left oid 38 (ObjNum 622 snap 183 seq_num 622) 2026-02-17T05:35:22.304 INFO:tasks.rados.rados.0.trial118.stdout:1715: finishing copy_from racing read to trial11845692-8 2026-02-17T05:35:22.304 INFO:tasks.rados.rados.0.trial118.stdout:1713: finishing copy_from racing read to trial11845692-31 2026-02-17T05:35:22.305 INFO:tasks.rados.rados.0.trial118.stdout:1713: finishing copy_from to trial11845692-31 2026-02-17T05:35:22.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 762 (ObjNum 577 snap 157 seq_num 577) dirty exists 2026-02-17T05:35:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1715: finishing copy_from to trial11845692-8 2026-02-17T05:35:22.306 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 957 (ObjNum 618 snap 181 seq_num 618) dirty exists 2026-02-17T05:35:22.306 INFO:tasks.rados.rados.0.trial118.stdout:1717: finishing copy_from racing read to trial11845692-16 2026-02-17T05:35:22.309 INFO:tasks.rados.rados.0.trial118.stdout:1717: finishing copy_from to trial11845692-16 2026-02-17T05:35:22.309 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 148 (ObjNum 587 snap 161 seq_num 587) dirty exists 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1713: done (4 left) 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1715: done (3 left) 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1716: done (2 left) 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1717: done (1 left) 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1718: done (0 left) 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1719: write (excl) oid 29 current snap is 184 2026-02-17T05:35:23.301 INFO:tasks.rados.rados.0.trial118.stdout:1719: seq_num 623 ranges {470761=704720,1656870=659539} 2026-02-17T05:35:23.306 INFO:tasks.rados.rados.0.trial118.stdout:1719: writing trial11845692-29 from 470761 to 1175481 tid 1 2026-02-17T05:35:23.310 INFO:tasks.rados.rados.0.trial118.stdout:1719: writing trial11845692-29 from 1656870 to 2316409 tid 2 2026-02-17T05:35:23.310 INFO:tasks.rados.rados.0.trial118.stdout:1720: snap_create 2026-02-17T05:35:23.310 INFO:tasks.rados.rados.0.trial118.stdout:1719: finishing write tid 1 to trial11845692-29 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: finishing write tid 2 to trial11845692-29 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: finishing write tid 3 to trial11845692-29 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: finishing write tid 4 to trial11845692-29 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: oid 29 updating version 0 to 804 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: oid 29 updating version 804 to 805 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: oid 29 updating version 805 to 806 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 806 (ObjNum 623 snap 184 seq_num 623) dirty exists 2026-02-17T05:35:23.312 INFO:tasks.rados.rados.0.trial118.stdout:1719: left oid 29 (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:35:24.303 INFO:tasks.rados.rados.0.trial118.stdout:1719: done (1 left) 2026-02-17T05:35:24.303 INFO:tasks.rados.rados.0.trial118.stdout:1720: done (0 left) 2026-02-17T05:35:24.303 INFO:tasks.rados.rados.0.trial118.stdout:1721: write (excl) oid 6 current snap is 185 2026-02-17T05:35:24.303 INFO:tasks.rados.rados.0.trial118.stdout:1721: seq_num 624 ranges {487568=496322,1431705=519550} 2026-02-17T05:35:24.307 INFO:tasks.rados.rados.0.trial118.stdout:1721: writing trial11845692-6 from 487568 to 983890 tid 1 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1721: writing trial11845692-6 from 1431705 to 1951255 tid 2 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1722: rollback oid 24 current snap is 185 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 174 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1723: copy_from oid 50 from oid 11 current snap is 185 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1724: read oid 34 snap -1 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1724: expect (ObjNum 576 snap 157 seq_num 576) 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1725: write (excl) oid 10 current snap is 185 2026-02-17T05:35:24.311 INFO:tasks.rados.rados.0.trial118.stdout:1725: seq_num 625 ranges {504375=571571,1490187=663208} 2026-02-17T05:35:24.315 INFO:tasks.rados.rados.0.trial118.stdout:1725: writing trial11845692-10 from 504375 to 1075946 tid 1 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1725: writing trial11845692-10 from 1490187 to 2153395 tid 2 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1726: read oid 19 snap 166 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1726: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1727: read oid 4 snap -1 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1727: expect deleted 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1728: read oid 28 snap -1 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1728: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1729: copy_from oid 2 from oid 35 current snap is 185 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: finishing write tid 1 to trial11845692-6 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: finishing write tid 2 to trial11845692-6 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: finishing write tid 3 to trial11845692-6 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: finishing write tid 4 to trial11845692-6 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: oid 6 updating version 0 to 651 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: oid 6 version 651 is already newer than 650 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: oid 6 version 651 is already newer than 649 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 651 (ObjNum 624 snap 185 seq_num 624) dirty exists 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1721: left oid 6 (ObjNum 624 snap 185 seq_num 624) 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1722: finishing rollback tid 0 to trial11845692-24 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1722: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1722: finishing rollback tid 2 to trial11845692-24 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 437 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:24.321 INFO:tasks.rados.rados.0.trial118.stdout:1724: expect (ObjNum 576 snap 157 seq_num 576) 2026-02-17T05:35:24.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:24.392 INFO:tasks.rados.rados.0.trial118.stdout:1725: finishing write tid 1 to trial11845692-10 2026-02-17T05:35:24.392 INFO:tasks.rados.rados.0.trial118.stdout:1723: finishing copy_from racing read to trial11845692-50 2026-02-17T05:35:24.392 INFO:tasks.rados.rados.0.trial118.stdout:1721: done (8 left) 2026-02-17T05:35:24.392 INFO:tasks.rados.rados.0.trial118.stdout:1722: done (7 left) 2026-02-17T05:35:24.392 INFO:tasks.rados.rados.0.trial118.stdout:1724: done (6 left) 2026-02-17T05:35:24.393 INFO:tasks.rados.rados.0.trial118.stdout:1730: write (excl) oid 32 current snap is 185 2026-02-17T05:35:24.393 INFO:tasks.rados.rados.0.trial118.stdout:1723: finishing copy_from to trial11845692-50 2026-02-17T05:35:24.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:24.393 INFO:tasks.rados.rados.0.trial118.stdout:1725: finishing write tid 2 to trial11845692-10 2026-02-17T05:35:24.393 INFO:tasks.rados.rados.0.trial118.stdout:1730: seq_num 626 ranges {521182=646820,1948669=523219} 2026-02-17T05:35:24.395 INFO:tasks.rados.rados.0.trial118.stdout:1730: writing trial11845692-32 from 521182 to 1168002 tid 1 2026-02-17T05:35:24.401 INFO:tasks.rados.rados.0.trial118.stdout:1730: writing trial11845692-32 from 1948669 to 2471888 tid 2 2026-02-17T05:35:24.401 INFO:tasks.rados.rados.0.trial118.stdout:1723: done (6 left) 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1727: done (5 left) 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1731: delete oid 48 current snap is 185 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: finishing write tid 3 to trial11845692-10 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: finishing write tid 4 to trial11845692-10 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: oid 10 updating version 0 to 422 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: oid 10 updating version 422 to 424 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: oid 10 version 424 is already newer than 423 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 424 (ObjNum 625 snap 185 seq_num 625) dirty exists 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1725: left oid 10 (ObjNum 625 snap 185 seq_num 625) 2026-02-17T05:35:24.402 INFO:tasks.rados.rados.0.trial118.stdout:1728: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:35:24.508 INFO:tasks.rados.rados.0.trial118.stdout:1726: expect (ObjNum 569 snap 155 seq_num 569) 2026-02-17T05:35:24.548 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:24.627 INFO:tasks.rados.rados.0.trial118.stdout:1729: finishing copy_from racing read to trial11845692-2 2026-02-17T05:35:24.627 INFO:tasks.rados.rados.0.trial118.stdout:1729: finishing copy_from to trial11845692-2 2026-02-17T05:35:24.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 428 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: finishing write tid 1 to trial11845692-32 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: finishing write tid 2 to trial11845692-32 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: finishing write tid 3 to trial11845692-32 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: finishing write tid 4 to trial11845692-32 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: oid 32 updating version 0 to 427 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: oid 32 version 427 is already newer than 426 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: oid 32 version 427 is already newer than 425 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 427 (ObjNum 626 snap 185 seq_num 626) dirty exists 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: left oid 32 (ObjNum 626 snap 185 seq_num 626) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1725: done (5 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1726: done (4 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1728: done (3 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1729: done (2 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1730: done (1 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1731: done (0 left) 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1732: write oid 37 current snap is 185 2026-02-17T05:35:24.628 INFO:tasks.rados.rados.0.trial118.stdout:1732: seq_num 628 ranges {554796=797318,1949280=526888} 2026-02-17T05:35:24.632 INFO:tasks.rados.rados.0.trial118.stdout:1732: writing trial11845692-37 from 554796 to 1352114 tid 1 2026-02-17T05:35:24.637 INFO:tasks.rados.rados.0.trial118.stdout:1732: writing trial11845692-37 from 1949280 to 2476168 tid 2 2026-02-17T05:35:24.637 INFO:tasks.rados.rados.0.trial118.stdout:1733: write (excl) oid 25 current snap is 185 2026-02-17T05:35:24.637 INFO:tasks.rados.rados.0.trial118.stdout:1733: seq_num 629 ranges {571603=472567,1607762=670546} 2026-02-17T05:35:24.640 INFO:tasks.rados.rados.0.trial118.stdout:1733: writing trial11845692-25 from 571603 to 1044170 tid 1 2026-02-17T05:35:24.645 INFO:tasks.rados.rados.0.trial118.stdout:1733: writing trial11845692-25 from 1607762 to 2278308 tid 2 2026-02-17T05:35:24.645 INFO:tasks.rados.rados.0.trial118.stdout:1734: snap_remove snap 172 2026-02-17T05:35:25.292 INFO:tasks.rados.rados.0.trial118.stdout:1734: done (2 left) 2026-02-17T05:35:25.292 INFO:tasks.rados.rados.0.trial118.stdout:1735: copy_from oid 11 from oid 34 current snap is 185 2026-02-17T05:35:25.292 INFO:tasks.rados.rados.0.trial118.stdout:1732: finishing write tid 1 to trial11845692-37 2026-02-17T05:35:25.292 INFO:tasks.rados.rados.0.trial118.stdout:1732: finishing write tid 2 to trial11845692-37 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: finishing write tid 3 to trial11845692-37 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: finishing write tid 4 to trial11845692-37 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: oid 37 updating version 0 to 151 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: oid 37 version 151 is already newer than 149 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: oid 37 version 151 is already newer than 150 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 151 (ObjNum 628 snap 185 seq_num 628) dirty exists 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: left oid 37 (ObjNum 628 snap 185 seq_num 628) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: finishing write tid 1 to trial11845692-25 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: finishing write tid 2 to trial11845692-25 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: finishing write tid 3 to trial11845692-25 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: finishing write tid 4 to trial11845692-25 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: oid 25 updating version 0 to 908 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: oid 25 version 908 is already newer than 907 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: oid 25 version 908 is already newer than 906 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 908 (ObjNum 629 snap 185 seq_num 629) dirty exists 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: left oid 25 (ObjNum 629 snap 185 seq_num 629) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1732: done (2 left) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1733: done (1 left) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1736: copy_from oid 46 from oid 23 current snap is 185 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1737: read oid 10 snap -1 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1737: expect (ObjNum 625 snap 185 seq_num 625) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1738: copy_from oid 26 from oid 31 current snap is 185 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1739: snap_create 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1736: finishing copy_from to trial11845692-46 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1736: got expected ENOENT (src dne) 2026-02-17T05:35:25.293 INFO:tasks.rados.rados.0.trial118.stdout:1736: finishing copy_from racing read to trial11845692-46 2026-02-17T05:35:25.298 INFO:tasks.rados.rados.0.trial118.stdout:1737: expect (ObjNum 625 snap 185 seq_num 625) 2026-02-17T05:35:25.298 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:25.326 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 200032 2026-02-17T05:35:25.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 366158 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:1735: finishing copy_from racing read to trial11845692-11 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:1738: finishing copy_from racing read to trial11845692-26 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:1735: finishing copy_from to trial11845692-11 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 404 (ObjNum 576 snap 157 seq_num 576) dirty exists 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:1738: finishing copy_from to trial11845692-26 2026-02-17T05:35:25.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 762 (ObjNum 577 snap 157 seq_num 577) dirty exists 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1735: done (4 left) 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1736: done (3 left) 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1737: done (2 left) 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1738: done (1 left) 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1739: done (0 left) 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:1740: rollback oid 11 current snap is 186 2026-02-17T05:35:26.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 163 2026-02-17T05:35:26.297 INFO:tasks.rados.rados.0.trial118.stdout:1741: snap_create 2026-02-17T05:35:26.300 INFO:tasks.rados.rados.0.trial118.stdout:1740: finishing rollback tid 0 to trial11845692-11 2026-02-17T05:35:26.300 INFO:tasks.rados.rados.0.trial118.stdout:1740: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:35:26.301 INFO:tasks.rados.rados.0.trial118.stdout:1740: finishing rollback tid 2 to trial11845692-11 2026-02-17T05:35:26.301 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 985 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:27.296 INFO:tasks.rados.rados.0.trial118.stdout:1740: done (1 left) 2026-02-17T05:35:27.296 INFO:tasks.rados.rados.0.trial118.stdout:1741: done (0 left) 2026-02-17T05:35:27.297 INFO:tasks.rados.rados.0.trial118.stdout:1742: write oid 34 current snap is 187 2026-02-17T05:35:27.297 INFO:tasks.rados.rados.0.trial118.stdout:1742: seq_num 630 ranges {588410=547816,1666244=414204,2484603=103807} 2026-02-17T05:35:27.301 INFO:tasks.rados.rados.0.trial118.stdout:1742: writing trial11845692-34 from 588410 to 1136226 tid 1 2026-02-17T05:35:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1742: writing trial11845692-34 from 1666244 to 2080448 tid 2 2026-02-17T05:35:27.307 INFO:tasks.rados.rados.0.trial118.stdout:1742: writing trial11845692-34 from 2484603 to 2588410 tid 3 2026-02-17T05:35:27.307 INFO:tasks.rados.rados.0.trial118.stdout:1743: snap_remove snap 179 2026-02-17T05:35:28.300 INFO:tasks.rados.rados.0.trial118.stdout:1743: done (1 left) 2026-02-17T05:35:28.300 INFO:tasks.rados.rados.0.trial118.stdout:1744: read oid 10 snap -1 2026-02-17T05:35:28.301 INFO:tasks.rados.rados.0.trial118.stdout:1744: expect (ObjNum 625 snap 185 seq_num 625) 2026-02-17T05:35:28.301 INFO:tasks.rados.rados.0.trial118.stdout:1745: write (excl) oid 26 current snap is 187 2026-02-17T05:35:28.301 INFO:tasks.rados.rados.0.trial118.stdout:1745: seq_num 631 ranges {605217=739418,2124726=480491} 2026-02-17T05:35:28.306 INFO:tasks.rados.rados.0.trial118.stdout:1745: writing trial11845692-26 from 605217 to 1344635 tid 1 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1745: writing trial11845692-26 from 2124726 to 2605217 tid 2 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1746: read oid 32 snap 173 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1746: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1747: read oid 9 snap -1 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1747: expect deleted 2026-02-17T05:35:28.312 INFO:tasks.rados.rados.0.trial118.stdout:1748: rollback oid 48 current snap is 187 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 169 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: finishing write tid 1 to trial11845692-34 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1749: write (excl) oid 17 current snap is 187 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: finishing write tid 2 to trial11845692-34 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: finishing write tid 3 to trial11845692-34 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: finishing write tid 4 to trial11845692-34 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: finishing write tid 5 to trial11845692-34 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: oid 34 updating version 0 to 704 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: oid 34 version 704 is already newer than 703 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: oid 34 updating version 704 to 706 2026-02-17T05:35:28.313 INFO:tasks.rados.rados.0.trial118.stdout:1742: oid 34 version 706 is already newer than 705 2026-02-17T05:35:28.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 706 (ObjNum 630 snap 187 seq_num 630) dirty exists 2026-02-17T05:35:28.314 INFO:tasks.rados.rados.0.trial118.stdout:1742: left oid 34 (ObjNum 630 snap 187 seq_num 630) 2026-02-17T05:35:28.314 INFO:tasks.rados.rados.0.trial118.stdout:1744: expect (ObjNum 625 snap 185 seq_num 625) 2026-02-17T05:35:28.334 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:28.387 INFO:tasks.rados.rados.0.trial118.stdout:1745: finishing write tid 1 to trial11845692-26 2026-02-17T05:35:28.387 INFO:tasks.rados.rados.0.trial118.stdout:1748: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:35:28.387 INFO:tasks.rados.rados.0.trial118.stdout:1748: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:35:28.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 722 (ObjNum 479 snap 125 seq_num 479) dirty exists 2026-02-17T05:35:28.387 INFO:tasks.rados.rados.0.trial118.stdout:1745: finishing write tid 2 to trial11845692-26 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: finishing write tid 3 to trial11845692-26 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: finishing write tid 4 to trial11845692-26 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: oid 26 updating version 0 to 765 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: oid 26 version 765 is already newer than 764 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: oid 26 version 765 is already newer than 763 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 765 (ObjNum 631 snap 187 seq_num 631) dirty exists 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1745: left oid 26 (ObjNum 631 snap 187 seq_num 631) 2026-02-17T05:35:28.388 INFO:tasks.rados.rados.0.trial118.stdout:1746: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:28.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 840398 2026-02-17T05:35:28.427 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:28.450 INFO:tasks.rados.rados.0.trial118.stdout:1749: seq_num 632 ranges {622024=414667,1783208=417873} 2026-02-17T05:35:28.454 INFO:tasks.rados.rados.0.trial118.stdout:1749: writing trial11845692-17 from 622024 to 1036691 tid 1 2026-02-17T05:35:28.459 INFO:tasks.rados.rados.0.trial118.stdout:1749: writing trial11845692-17 from 1783208 to 2201081 tid 2 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1742: done (6 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1744: done (5 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1745: done (4 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1746: done (3 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1747: done (2 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1748: done (1 left) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1750: read oid 43 snap -1 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1750: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1751: snap_create 2026-02-17T05:35:28.460 INFO:tasks.rados.rados.0.trial118.stdout:1749: finishing write tid 1 to trial11845692-17 2026-02-17T05:35:28.461 INFO:tasks.rados.rados.0.trial118.stdout:1750: expect (ObjNum 528 snap 145 seq_num 528) 2026-02-17T05:35:28.614 INFO:tasks.rados.rados.0.trial118.stdout:1749: finishing write tid 2 to trial11845692-17 2026-02-17T05:35:28.614 INFO:tasks.rados.rados.0.trial118.stdout:1749: finishing write tid 3 to trial11845692-17 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:1749: finishing write tid 4 to trial11845692-17 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:1749: oid 17 updating version 0 to 429 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:1749: oid 17 updating version 429 to 431 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:1749: oid 17 version 431 is already newer than 430 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 431 (ObjNum 632 snap 187 seq_num 632) dirty exists 2026-02-17T05:35:28.615 INFO:tasks.rados.rados.0.trial118.stdout:1749: left oid 17 (ObjNum 632 snap 187 seq_num 632) 2026-02-17T05:35:29.301 INFO:tasks.rados.rados.0.trial118.stdout:1749: done (2 left) 2026-02-17T05:35:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1750: done (1 left) 2026-02-17T05:35:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1751: done (0 left) 2026-02-17T05:35:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1752: copy_from oid 42 from oid 18 current snap is 188 2026-02-17T05:35:29.302 INFO:tasks.rados.rados.0.trial118.stdout:1753: delete oid 26 current snap is 188 2026-02-17T05:35:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1753: done (1 left) 2026-02-17T05:35:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1754: copy_from oid 31 from oid 1 current snap is 188 2026-02-17T05:35:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1755: write oid 47 current snap is 188 2026-02-17T05:35:29.303 INFO:tasks.rados.rados.0.trial118.stdout:1755: seq_num 634 ranges {655638=565165,1900172=421542} 2026-02-17T05:35:29.308 INFO:tasks.rados.rados.0.trial118.stdout:1755: writing trial11845692-47 from 655638 to 1220803 tid 1 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:1755: writing trial11845692-47 from 1900172 to 2321714 tid 2 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:1756: snap_create 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:1752: finishing copy_from racing read to trial11845692-42 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:1752: finishing copy_from to trial11845692-42 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 702 (ObjNum 601 snap 172 seq_num 601) dirty exists 2026-02-17T05:35:29.312 INFO:tasks.rados.rados.0.trial118.stdout:1755: finishing write tid 1 to trial11845692-47 2026-02-17T05:35:29.313 INFO:tasks.rados.rados.0.trial118.stdout:1754: finishing copy_from racing read to trial11845692-31 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: finishing write tid 2 to trial11845692-47 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: finishing write tid 3 to trial11845692-47 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: finishing write tid 4 to trial11845692-47 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: oid 47 updating version 0 to 858 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: oid 47 updating version 858 to 860 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: oid 47 version 860 is already newer than 859 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 860 (ObjNum 634 snap 188 seq_num 634) dirty exists 2026-02-17T05:35:29.314 INFO:tasks.rados.rados.0.trial118.stdout:1755: left oid 47 (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:35:29.315 INFO:tasks.rados.rados.0.trial118.stdout:1754: finishing copy_from to trial11845692-31 2026-02-17T05:35:29.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 412 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:30.293 INFO:tasks.rados.rados.0.trial118.stdout:1752: done (3 left) 2026-02-17T05:35:30.293 INFO:tasks.rados.rados.0.trial118.stdout:1754: done (2 left) 2026-02-17T05:35:30.293 INFO:tasks.rados.rados.0.trial118.stdout:1755: done (1 left) 2026-02-17T05:35:30.293 INFO:tasks.rados.rados.0.trial118.stdout:1756: done (0 left) 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1757: read oid 41 snap -1 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1757: expect deleted 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1758: rollback oid 42 current snap is 189 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 173 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1759: copy_from oid 44 from oid 32 current snap is 189 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1760: copy_from oid 19 from oid 36 current snap is 189 2026-02-17T05:35:30.294 INFO:tasks.rados.rados.0.trial118.stdout:1761: snap_create 2026-02-17T05:35:30.295 INFO:tasks.rados.rados.0.trial118.stdout:1758: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:35:30.295 INFO:tasks.rados.rados.0.trial118.stdout:1758: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:35:30.295 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 863 (ObjNum 65 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:35:30.302 INFO:tasks.rados.rados.0.trial118.stdout:1760: finishing copy_from racing read to trial11845692-19 2026-02-17T05:35:30.303 INFO:tasks.rados.rados.0.trial118.stdout:1759: finishing copy_from racing read to trial11845692-44 2026-02-17T05:35:30.303 INFO:tasks.rados.rados.0.trial118.stdout:1760: finishing copy_from to trial11845692-19 2026-02-17T05:35:30.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 709 (ObjNum 606 snap 175 seq_num 606) dirty exists 2026-02-17T05:35:30.304 INFO:tasks.rados.rados.0.trial118.stdout:1759: finishing copy_from to trial11845692-44 2026-02-17T05:35:30.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 427 (ObjNum 626 snap 185 seq_num 626) dirty exists 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1757: done (4 left) 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1758: done (3 left) 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1759: done (2 left) 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1760: done (1 left) 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1761: done (0 left) 2026-02-17T05:35:31.292 INFO:tasks.rados.rados.0.trial118.stdout:1762: delete oid 40 current snap is 190 2026-02-17T05:35:31.296 INFO:tasks.rados.rados.0.trial118.stdout:1762: done (0 left) 2026-02-17T05:35:31.296 INFO:tasks.rados.rados.0.trial118.stdout:1763: write (excl) oid 22 current snap is 190 2026-02-17T05:35:31.297 INFO:tasks.rados.rados.0.trial118.stdout:1763: seq_num 636 ranges {689252=715663,1900783=425211} 2026-02-17T05:35:31.302 INFO:tasks.rados.rados.0.trial118.stdout:1763: writing trial11845692-22 from 689252 to 1404915 tid 1 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1763: writing trial11845692-22 from 1900783 to 2325994 tid 2 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1764: read oid 8 snap -1 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1764: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1765: rollback oid 20 current snap is 190 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 180 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:1766: rollback oid 21 current snap is 190 2026-02-17T05:35:31.307 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 189 2026-02-17T05:35:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1767: write oid 15 current snap is 190 2026-02-17T05:35:31.308 INFO:tasks.rados.rados.0.trial118.stdout:1767: seq_num 637 ranges {706059=790912,1959265=685222} 2026-02-17T05:35:31.312 INFO:tasks.rados.rados.0.trial118.stdout:1767: writing trial11845692-15 from 706059 to 1496971 tid 1 2026-02-17T05:35:31.317 INFO:tasks.rados.rados.0.trial118.stdout:1767: writing trial11845692-15 from 1959265 to 2644487 tid 2 2026-02-17T05:35:31.317 INFO:tasks.rados.rados.0.trial118.stdout:1768: read oid 6 snap -1 2026-02-17T05:35:31.317 INFO:tasks.rados.rados.0.trial118.stdout:1768: expect (ObjNum 624 snap 185 seq_num 624) 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1769: read oid 33 snap -1 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1769: expect deleted 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1770: write oid 16 current snap is 190 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1763: finishing write tid 1 to trial11845692-22 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1763: finishing write tid 2 to trial11845692-22 2026-02-17T05:35:31.318 INFO:tasks.rados.rados.0.trial118.stdout:1770: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2026-02-17T05:35:31.321 INFO:tasks.rados.rados.0.trial118.stdout:1770: writing trial11845692-16 from 722866 to 1189027 tid 1 2026-02-17T05:35:31.325 INFO:tasks.rados.rados.0.trial118.stdout:1770: writing trial11845692-16 from 1617747 to 2046627 tid 2 2026-02-17T05:35:31.327 INFO:tasks.rados.rados.0.trial118.stdout:1770: writing trial11845692-16 from 2587634 to 2722866 tid 3 2026-02-17T05:35:31.327 INFO:tasks.rados.rados.0.trial118.stdout:1771: snap_remove snap 184 2026-02-17T05:35:32.308 INFO:tasks.rados.rados.0.trial118.stdout:1771: done (8 left) 2026-02-17T05:35:32.308 INFO:tasks.rados.rados.0.trial118.stdout:1772: snap_remove snap 176 2026-02-17T05:35:33.311 INFO:tasks.rados.rados.0.trial118.stdout:1772: done (8 left) 2026-02-17T05:35:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1773: write oid 19 current snap is 190 2026-02-17T05:35:33.312 INFO:tasks.rados.rados.0.trial118.stdout:1773: seq_num 639 ranges {739673=657763,2076229=663444} 2026-02-17T05:35:33.317 INFO:tasks.rados.rados.0.trial118.stdout:1773: writing trial11845692-19 from 739673 to 1397436 tid 1 2026-02-17T05:35:33.323 INFO:tasks.rados.rados.0.trial118.stdout:1773: writing trial11845692-19 from 2076229 to 2739673 tid 2 2026-02-17T05:35:33.323 INFO:tasks.rados.rados.0.trial118.stdout:1774: delete oid 18 current snap is 190 2026-02-17T05:35:33.323 INFO:tasks.rados.rados.0.trial118.stdout:1763: finishing write tid 3 to trial11845692-22 2026-02-17T05:35:33.323 INFO:tasks.rados.rados.0.trial118.stdout:1763: finishing write tid 4 to trial11845692-22 2026-02-17T05:35:33.323 INFO:tasks.rados.rados.0.trial118.stdout:1763: oid 22 updating version 0 to 724 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1763: oid 22 updating version 724 to 725 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1763: oid 22 updating version 725 to 726 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 726 (ObjNum 636 snap 190 seq_num 636) dirty exists 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1763: left oid 22 (ObjNum 636 snap 190 seq_num 636) 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1766: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1766: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1766: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 924 (ObjNum 571 snap 155 seq_num 571) dirty exists 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:1764: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:35:33.324 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:33.346 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:33.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 898369 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1765: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1765: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1765: finishing rollback tid 2 to trial11845692-20 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1001 (ObjNum 560 snap 155 seq_num 560) dirty exists 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1767: finishing write tid 1 to trial11845692-15 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1763: done (9 left) 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1764: done (8 left) 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1765: done (7 left) 2026-02-17T05:35:33.389 INFO:tasks.rados.rados.0.trial118.stdout:1766: done (6 left) 2026-02-17T05:35:33.390 INFO:tasks.rados.rados.0.trial118.stdout:1774: done (5 left) 2026-02-17T05:35:33.390 INFO:tasks.rados.rados.0.trial118.stdout:1775: write (excl) oid 5 current snap is 190 2026-02-17T05:35:33.390 INFO:tasks.rados.rados.0.trial118.stdout:1775: seq_num 641 ranges {773287=408261,1793193=576207} 2026-02-17T05:35:33.392 INFO:tasks.rados.rados.0.trial118.stdout:1775: writing trial11845692-5 from 773287 to 1181548 tid 1 2026-02-17T05:35:33.397 INFO:tasks.rados.rados.0.trial118.stdout:1775: writing trial11845692-5 from 1793193 to 2369400 tid 2 2026-02-17T05:35:33.398 INFO:tasks.rados.rados.0.trial118.stdout:1776: write oid 7 current snap is 190 2026-02-17T05:35:33.398 INFO:tasks.rados.rados.0.trial118.stdout:1776: seq_num 642 ranges {790094=483510,1851675=436218} 2026-02-17T05:35:33.402 INFO:tasks.rados.rados.0.trial118.stdout:1776: writing trial11845692-7 from 790094 to 1273604 tid 1 2026-02-17T05:35:33.406 INFO:tasks.rados.rados.0.trial118.stdout:1776: writing trial11845692-7 from 1851675 to 2287893 tid 2 2026-02-17T05:35:33.406 INFO:tasks.rados.rados.0.trial118.stdout:1777: read oid 47 snap -1 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1777: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1778: snap_create 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: finishing write tid 2 to trial11845692-15 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: finishing write tid 3 to trial11845692-15 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: finishing write tid 4 to trial11845692-15 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: oid 15 updating version 0 to 730 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: oid 15 version 730 is already newer than 729 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: oid 15 version 730 is already newer than 728 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 730 (ObjNum 637 snap 190 seq_num 637) dirty exists 2026-02-17T05:35:33.407 INFO:tasks.rados.rados.0.trial118.stdout:1767: left oid 15 (ObjNum 637 snap 190 seq_num 637) 2026-02-17T05:35:33.408 INFO:tasks.rados.rados.0.trial118.stdout:1768: expect (ObjNum 624 snap 185 seq_num 624) 2026-02-17T05:35:33.482 INFO:tasks.rados.rados.0.trial118.stdout:1770: finishing write tid 1 to trial11845692-16 2026-02-17T05:35:33.482 INFO:tasks.rados.rados.0.trial118.stdout:1770: finishing write tid 2 to trial11845692-16 2026-02-17T05:35:33.482 INFO:tasks.rados.rados.0.trial118.stdout:1770: finishing write tid 3 to trial11845692-16 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: finishing write tid 4 to trial11845692-16 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: finishing write tid 5 to trial11845692-16 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: oid 16 updating version 0 to 817 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: oid 16 version 817 is already newer than 814 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: oid 16 version 817 is already newer than 816 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: oid 16 version 817 is already newer than 815 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 817 (ObjNum 638 snap 190 seq_num 638) dirty exists 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1770: left oid 16 (ObjNum 638 snap 190 seq_num 638) 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: finishing write tid 1 to trial11845692-19 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: finishing write tid 2 to trial11845692-19 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: finishing write tid 3 to trial11845692-19 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: finishing write tid 4 to trial11845692-19 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: oid 19 updating version 0 to 710 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: oid 19 updating version 710 to 712 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: oid 19 version 712 is already newer than 711 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 712 (ObjNum 639 snap 190 seq_num 639) dirty exists 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1773: left oid 19 (ObjNum 639 snap 190 seq_num 639) 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: finishing write tid 1 to trial11845692-5 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: finishing write tid 2 to trial11845692-5 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: finishing write tid 3 to trial11845692-5 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: finishing write tid 4 to trial11845692-5 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: oid 5 updating version 0 to 607 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: oid 5 updating version 607 to 608 2026-02-17T05:35:33.483 INFO:tasks.rados.rados.0.trial118.stdout:1775: oid 5 version 608 is already newer than 606 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 608 (ObjNum 641 snap 190 seq_num 641) dirty exists 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1775: left oid 5 (ObjNum 641 snap 190 seq_num 641) 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: finishing write tid 1 to trial11845692-7 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: finishing write tid 2 to trial11845692-7 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: finishing write tid 3 to trial11845692-7 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: finishing write tid 4 to trial11845692-7 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: oid 7 updating version 0 to 825 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: oid 7 updating version 825 to 826 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: oid 7 updating version 826 to 827 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 827 (ObjNum 642 snap 190 seq_num 642) dirty exists 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1776: left oid 7 (ObjNum 642 snap 190 seq_num 642) 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:1777: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:35:33.484 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:33.559 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1511677 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1767: done (8 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1768: done (7 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1769: done (6 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1770: done (5 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1773: done (4 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1775: done (3 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1776: done (2 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1777: done (1 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1778: done (0 left) 2026-02-17T05:35:34.315 INFO:tasks.rados.rados.0.trial118.stdout:1779: snap_remove snap 177 2026-02-17T05:35:35.316 INFO:tasks.rados.rados.0.trial118.stdout:1779: done (0 left) 2026-02-17T05:35:35.316 INFO:tasks.rados.rados.0.trial118.stdout:1780: copy_from oid 5 from oid 40 current snap is 191 2026-02-17T05:35:35.316 INFO:tasks.rados.rados.0.trial118.stdout:1781: write oid 42 current snap is 191 2026-02-17T05:35:35.316 INFO:tasks.rados.rados.0.trial118.stdout:1781: seq_num 643 ranges {406901=558759,1393804=579876,2608396=198505} 2026-02-17T05:35:35.320 INFO:tasks.rados.rados.0.trial118.stdout:1781: writing trial11845692-42 from 406901 to 965660 tid 1 2026-02-17T05:35:35.324 INFO:tasks.rados.rados.0.trial118.stdout:1781: writing trial11845692-42 from 1393804 to 1973680 tid 2 2026-02-17T05:35:35.327 INFO:tasks.rados.rados.0.trial118.stdout:1781: writing trial11845692-42 from 2608396 to 2806901 tid 3 2026-02-17T05:35:35.327 INFO:tasks.rados.rados.0.trial118.stdout:1782: read oid 25 snap -1 2026-02-17T05:35:35.327 INFO:tasks.rados.rados.0.trial118.stdout:1782: expect (ObjNum 629 snap 185 seq_num 629) 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1783: write oid 18 current snap is 191 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1780: finishing copy_from to trial11845692-5 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1780: got expected ENOENT (src dne) 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1780: finishing copy_from racing read to trial11845692-5 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1781: finishing write tid 1 to trial11845692-42 2026-02-17T05:35:35.328 INFO:tasks.rados.rados.0.trial118.stdout:1783: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2026-02-17T05:35:35.331 INFO:tasks.rados.rados.0.trial118.stdout:1783: writing trial11845692-18 from 423708 to 1057716 tid 1 2026-02-17T05:35:35.336 INFO:tasks.rados.rados.0.trial118.stdout:1783: writing trial11845692-18 from 1852286 to 2292173 tid 2 2026-02-17T05:35:35.338 INFO:tasks.rados.rados.0.trial118.stdout:1783: writing trial11845692-18 from 2752172 to 2823708 tid 3 2026-02-17T05:35:35.338 INFO:tasks.rados.rados.0.trial118.stdout:1780: done (3 left) 2026-02-17T05:35:35.338 INFO:tasks.rados.rados.0.trial118.stdout:1784: copy_from oid 27 from oid 29 current snap is 191 2026-02-17T05:35:35.338 INFO:tasks.rados.rados.0.trial118.stdout:1781: finishing write tid 2 to trial11845692-42 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: finishing write tid 3 to trial11845692-42 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: finishing write tid 4 to trial11845692-42 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: finishing write tid 5 to trial11845692-42 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: oid 42 updating version 0 to 878 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: oid 42 updating version 878 to 880 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: oid 42 updating version 880 to 881 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: oid 42 version 881 is already newer than 879 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 881 (ObjNum 643 snap 191 seq_num 643) dirty exists 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1781: left oid 42 (ObjNum 643 snap 191 seq_num 643) 2026-02-17T05:35:35.339 INFO:tasks.rados.rados.0.trial118.stdout:1782: expect (ObjNum 629 snap 185 seq_num 629) 2026-02-17T05:35:35.409 INFO:tasks.rados.rados.0.trial118.stdout:1783: finishing write tid 1 to trial11845692-18 2026-02-17T05:35:35.409 INFO:tasks.rados.rados.0.trial118.stdout:1783: finishing write tid 2 to trial11845692-18 2026-02-17T05:35:35.409 INFO:tasks.rados.rados.0.trial118.stdout:1781: done (3 left) 2026-02-17T05:35:35.409 INFO:tasks.rados.rados.0.trial118.stdout:1782: done (2 left) 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1785: rollback oid 13 current snap is 191 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 173 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: finishing write tid 3 to trial11845692-18 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: finishing write tid 4 to trial11845692-18 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: finishing write tid 5 to trial11845692-18 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: oid 18 updating version 0 to 708 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: oid 18 updating version 708 to 711 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: oid 18 version 711 is already newer than 709 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: oid 18 version 711 is already newer than 710 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 711 (ObjNum 644 snap 191 seq_num 644) dirty exists 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1783: left oid 18 (ObjNum 644 snap 191 seq_num 644) 2026-02-17T05:35:35.410 INFO:tasks.rados.rados.0.trial118.stdout:1784: finishing copy_from racing read to trial11845692-27 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1784: finishing copy_from to trial11845692-27 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 806 (ObjNum 623 snap 184 seq_num 623) dirty exists 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1783: done (2 left) 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1784: done (1 left) 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1786: read oid 9 snap -1 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1786: expect deleted 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1787: read oid 27 snap -1 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1787: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:35:35.411 INFO:tasks.rados.rados.0.trial118.stdout:1788: snap_remove snap 183 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1788: done (3 left) 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1789: copy_from oid 36 from oid 14 current snap is 191 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1785: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1785: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1785: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 715 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-17T05:35:36.321 INFO:tasks.rados.rados.0.trial118.stdout:1787: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:35:36.337 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 22921 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1789: finishing copy_from racing read to trial11845692-36 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1789: finishing copy_from to trial11845692-36 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 605 (ObjNum 596 snap 166 seq_num 596) dirty exists 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1785: done (3 left) 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1786: done (2 left) 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1787: done (1 left) 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1789: done (0 left) 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1790: write (excl) oid 15 current snap is 191 2026-02-17T05:35:36.371 INFO:tasks.rados.rados.0.trial118.stdout:1790: seq_num 645 ranges {440515=709257,1910768=583545} 2026-02-17T05:35:36.376 INFO:tasks.rados.rados.0.trial118.stdout:1790: writing trial11845692-15 from 440515 to 1149772 tid 1 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1790: writing trial11845692-15 from 1910768 to 2494313 tid 2 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1791: copy_from oid 17 from oid 11 current snap is 191 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1790: finishing write tid 1 to trial11845692-15 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1792: read oid 35 snap -1 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1792: expect (ObjNum 563 snap 155 seq_num 563) 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1793: read oid 38 snap 186 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1793: expect (ObjNum 622 snap 183 seq_num 622) 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1794: rollback oid 40 current snap is 191 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 185 2026-02-17T05:35:36.381 INFO:tasks.rados.rados.0.trial118.stdout:1795: snap_remove snap 173 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1795: done (5 left) 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1796: rollback oid 6 current snap is 191 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 166 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1790: finishing write tid 2 to trial11845692-15 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1790: finishing write tid 3 to trial11845692-15 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1790: finishing write tid 4 to trial11845692-15 2026-02-17T05:35:37.325 INFO:tasks.rados.rados.0.trial118.stdout:1790: oid 15 updating version 0 to 759 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1790: oid 15 updating version 759 to 760 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1790: oid 15 version 760 is already newer than 758 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 760 (ObjNum 645 snap 191 seq_num 645) dirty exists 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1790: left oid 15 (ObjNum 645 snap 191 seq_num 645) 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1794: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1794: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 952 (ObjNum 575 snap 157 seq_num 575) dirty exists 2026-02-17T05:35:37.326 INFO:tasks.rados.rados.0.trial118.stdout:1792: expect (ObjNum 563 snap 155 seq_num 563) 2026-02-17T05:35:37.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:37.388 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:37.424 INFO:tasks.rados.rados.0.trial118.stdout:1793: expect (ObjNum 622 snap 183 seq_num 622) 2026-02-17T05:35:37.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:37.485 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 301097 2026-02-17T05:35:37.515 INFO:tasks.rados.rados.0.trial118.stdout:1791: finishing copy_from racing read to trial11845692-17 2026-02-17T05:35:37.515 INFO:tasks.rados.rados.0.trial118.stdout:1791: finishing copy_from to trial11845692-17 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 985 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1796: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1796: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1796: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 654 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1790: done (5 left) 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1791: done (4 left) 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1792: done (3 left) 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1793: done (2 left) 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1794: done (1 left) 2026-02-17T05:35:37.516 INFO:tasks.rados.rados.0.trial118.stdout:1796: done (0 left) 2026-02-17T05:35:37.517 INFO:tasks.rados.rados.0.trial118.stdout:1797: write (excl) oid 9 current snap is 191 2026-02-17T05:35:37.517 INFO:tasks.rados.rados.0.trial118.stdout:1797: seq_num 646 ranges {457322=784506,1969250=443556} 2026-02-17T05:35:37.520 INFO:tasks.rados.rados.0.trial118.stdout:1797: writing trial11845692-9 from 457322 to 1241828 tid 1 2026-02-17T05:35:37.524 INFO:tasks.rados.rados.0.trial118.stdout:1797: writing trial11845692-9 from 1969250 to 2412806 tid 2 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:1798: copy_from oid 5 from oid 43 current snap is 191 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:1797: finishing write tid 1 to trial11845692-9 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:1799: rollback oid 23 current snap is 191 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 23 to 186 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:1800: delete oid 45 current snap is 191 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:1799: finishing rollback tid 1 to trial11845692-23 2026-02-17T05:35:37.525 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1799: done (3 left) 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1800: done (2 left) 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1801: copy_from oid 40 from oid 33 current snap is 191 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1802: read oid 17 snap -1 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1802: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:37.526 INFO:tasks.rados.rados.0.trial118.stdout:1803: snap_remove snap 174 2026-02-17T05:35:38.328 INFO:tasks.rados.rados.0.trial118.stdout:1803: done (4 left) 2026-02-17T05:35:38.328 INFO:tasks.rados.rados.0.trial118.stdout:1804: write oid 19 current snap is 191 2026-02-17T05:35:38.328 INFO:tasks.rados.rados.0.trial118.stdout:1804: seq_num 648 ranges {490936=651357,1686214=447225,2861864=29072} 2026-02-17T05:35:38.333 INFO:tasks.rados.rados.0.trial118.stdout:1804: writing trial11845692-19 from 490936 to 1142293 tid 1 2026-02-17T05:35:38.337 INFO:tasks.rados.rados.0.trial118.stdout:1804: writing trial11845692-19 from 1686214 to 2133439 tid 2 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1804: writing trial11845692-19 from 2861864 to 2890936 tid 3 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1805: delete oid 39 current snap is 191 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: finishing write tid 2 to trial11845692-9 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: finishing write tid 3 to trial11845692-9 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: finishing write tid 4 to trial11845692-9 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: oid 9 updating version 0 to 844 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: oid 9 version 844 is already newer than 842 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: oid 9 version 844 is already newer than 843 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 844 (ObjNum 646 snap 191 seq_num 646) dirty exists 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1797: left oid 9 (ObjNum 646 snap 191 seq_num 646) 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1798: finishing copy_from racing read to trial11845692-5 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1801: finishing copy_from to trial11845692-40 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1801: got expected ENOENT (src dne) 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1801: finishing copy_from racing read to trial11845692-40 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1798: finishing copy_from to trial11845692-5 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 725 (ObjNum 528 snap 145 seq_num 528) dirty exists 2026-02-17T05:35:38.341 INFO:tasks.rados.rados.0.trial118.stdout:1802: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:38.342 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:38.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1221922 2026-02-17T05:35:38.405 INFO:tasks.rados.rados.0.trial118.stdout:1804: finishing write tid 1 to trial11845692-19 2026-02-17T05:35:38.405 INFO:tasks.rados.rados.0.trial118.stdout:1797: done (5 left) 2026-02-17T05:35:38.406 INFO:tasks.rados.rados.0.trial118.stdout:1798: done (4 left) 2026-02-17T05:35:38.406 INFO:tasks.rados.rados.0.trial118.stdout:1801: done (3 left) 2026-02-17T05:35:38.406 INFO:tasks.rados.rados.0.trial118.stdout:1802: done (2 left) 2026-02-17T05:35:38.406 INFO:tasks.rados.rados.0.trial118.stdout:1805: done (1 left) 2026-02-17T05:35:38.406 INFO:tasks.rados.rados.0.trial118.stdout:1806: snap_remove snap 189 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1806: done (1 left) 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1807: read oid 46 snap -1 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1807: expect deleted 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1808: copy_from oid 24 from oid 47 current snap is 191 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1804: finishing write tid 2 to trial11845692-19 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1804: finishing write tid 3 to trial11845692-19 2026-02-17T05:35:39.331 INFO:tasks.rados.rados.0.trial118.stdout:1804: finishing write tid 4 to trial11845692-19 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: finishing write tid 5 to trial11845692-19 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: oid 19 updating version 0 to 716 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: oid 19 updating version 716 to 718 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: oid 19 version 718 is already newer than 717 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: oid 19 updating version 718 to 719 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 719 (ObjNum 648 snap 191 seq_num 648) dirty exists 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: left oid 19 (ObjNum 648 snap 191 seq_num 648) 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1804: done (2 left) 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1809: write (excl) oid 31 current snap is 191 2026-02-17T05:35:39.332 INFO:tasks.rados.rados.0.trial118.stdout:1809: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2026-02-17T05:35:39.335 INFO:tasks.rados.rados.0.trial118.stdout:1809: writing trial11845692-31 from 524550 to 926405 tid 1 2026-02-17T05:35:39.338 INFO:tasks.rados.rados.0.trial118.stdout:1809: writing trial11845692-31 from 1403178 to 1854072 tid 2 2026-02-17T05:35:39.342 INFO:tasks.rados.rados.0.trial118.stdout:1809: writing trial11845692-31 from 2516710 to 2924550 tid 3 2026-02-17T05:35:39.342 INFO:tasks.rados.rados.0.trial118.stdout:1810: snap_remove snap 190 2026-02-17T05:35:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1810: done (3 left) 2026-02-17T05:35:40.295 INFO:tasks.rados.rados.0.trial118.stdout:1811: write oid 6 current snap is 191 2026-02-17T05:35:40.296 INFO:tasks.rados.rados.0.trial118.stdout:1811: seq_num 651 ranges {541357=477104,1745307=594552} 2026-02-17T05:35:40.299 INFO:tasks.rados.rados.0.trial118.stdout:1811: writing trial11845692-6 from 541357 to 1018461 tid 1 2026-02-17T05:35:40.304 INFO:tasks.rados.rados.0.trial118.stdout:1811: writing trial11845692-6 from 1745307 to 2339859 tid 2 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1812: copy_from oid 50 from oid 41 current snap is 191 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: finishing write tid 1 to trial11845692-31 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1808: finishing copy_from racing read to trial11845692-24 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1808: finishing copy_from to trial11845692-24 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 860 (ObjNum 634 snap 188 seq_num 634) dirty exists 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: finishing write tid 2 to trial11845692-31 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: finishing write tid 3 to trial11845692-31 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: finishing write tid 4 to trial11845692-31 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: finishing write tid 5 to trial11845692-31 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: oid 31 updating version 0 to 1077 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: oid 31 updating version 1077 to 1078 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: oid 31 version 1078 is already newer than 1075 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: oid 31 version 1078 is already newer than 1076 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1078 (ObjNum 650 snap 191 seq_num 650) dirty exists 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: left oid 31 (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1811: finishing write tid 1 to trial11845692-6 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1807: done (4 left) 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1808: done (3 left) 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1809: done (2 left) 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1813: write oid 25 current snap is 191 2026-02-17T05:35:40.305 INFO:tasks.rados.rados.0.trial118.stdout:1813: seq_num 652 ranges {558164=552353,1803789=454563,2855203=102961} 2026-02-17T05:35:40.308 INFO:tasks.rados.rados.0.trial118.stdout:1813: writing trial11845692-25 from 558164 to 1110517 tid 1 2026-02-17T05:35:40.313 INFO:tasks.rados.rados.0.trial118.stdout:1813: writing trial11845692-25 from 1803789 to 2258352 tid 2 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1813: writing trial11845692-25 from 2855203 to 2958164 tid 3 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1814: read oid 16 snap -1 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1814: expect (ObjNum 638 snap 190 seq_num 638) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1815: read oid 28 snap -1 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1815: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1816: read oid 9 snap -1 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1816: expect (ObjNum 646 snap 191 seq_num 646) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1817: rollback oid 3 current snap is 191 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 182 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1812: finishing copy_from to trial11845692-50 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1812: got expected ENOENT (src dne) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1812: finishing copy_from racing read to trial11845692-50 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: finishing write tid 2 to trial11845692-6 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: finishing write tid 3 to trial11845692-6 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: finishing write tid 4 to trial11845692-6 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: oid 6 updating version 0 to 655 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: oid 6 updating version 655 to 656 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: oid 6 updating version 656 to 657 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 657 (ObjNum 651 snap 191 seq_num 651) dirty exists 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: left oid 6 (ObjNum 651 snap 191 seq_num 651) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1813: finishing write tid 1 to trial11845692-25 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1813: finishing write tid 2 to trial11845692-25 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1811: done (6 left) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1812: done (5 left) 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1818: write oid 47 current snap is 191 2026-02-17T05:35:40.316 INFO:tasks.rados.rados.0.trial118.stdout:1818: seq_num 653 ranges {574971=627602,1862271=598221} 2026-02-17T05:35:40.321 INFO:tasks.rados.rados.0.trial118.stdout:1818: writing trial11845692-47 from 574971 to 1202573 tid 1 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1818: writing trial11845692-47 from 1862271 to 2460492 tid 2 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1819: copy_from oid 48 from oid 30 current snap is 191 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: finishing write tid 3 to trial11845692-25 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: finishing write tid 4 to trial11845692-25 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: finishing write tid 5 to trial11845692-25 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: oid 25 updating version 0 to 971 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: oid 25 updating version 971 to 972 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: oid 25 updating version 972 to 973 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:1813: oid 25 version 973 is already newer than 970 2026-02-17T05:35:40.327 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 973 (ObjNum 652 snap 191 seq_num 652) dirty exists 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1813: left oid 25 (ObjNum 652 snap 191 seq_num 652) 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1817: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1813: done (6 left) 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1820: snap_create 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1817: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1817: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 722 (ObjNum 605 snap 174 seq_num 605) dirty exists 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:1814: expect (ObjNum 638 snap 190 seq_num 638) 2026-02-17T05:35:40.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:40.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1025831 2026-02-17T05:35:40.425 INFO:tasks.rados.rados.0.trial118.stdout:1815: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:35:40.425 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:40.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:40.509 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1224463 2026-02-17T05:35:40.534 INFO:tasks.rados.rados.0.trial118.stdout:1816: expect (ObjNum 646 snap 191 seq_num 646) 2026-02-17T05:35:40.547 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:40.570 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 481577 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: finishing write tid 1 to trial11845692-47 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: finishing write tid 2 to trial11845692-47 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: finishing write tid 3 to trial11845692-47 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: finishing write tid 4 to trial11845692-47 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: oid 47 updating version 0 to 903 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: oid 47 updating version 903 to 904 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:1818: oid 47 updating version 904 to 905 2026-02-17T05:35:40.587 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 905 (ObjNum 653 snap 191 seq_num 653) dirty exists 2026-02-17T05:35:40.588 INFO:tasks.rados.rados.0.trial118.stdout:1818: left oid 47 (ObjNum 653 snap 191 seq_num 653) 2026-02-17T05:35:40.588 INFO:tasks.rados.rados.0.trial118.stdout:1819: finishing copy_from racing read to trial11845692-48 2026-02-17T05:35:40.588 INFO:tasks.rados.rados.0.trial118.stdout:1819: finishing copy_from to trial11845692-48 2026-02-17T05:35:40.588 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1814: done (6 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1815: done (5 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1816: done (4 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1817: done (3 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1818: done (2 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1819: done (1 left) 2026-02-17T05:35:41.295 INFO:tasks.rados.rados.0.trial118.stdout:1820: done (0 left) 2026-02-17T05:35:41.296 INFO:tasks.rados.rados.0.trial118.stdout:1821: rollback oid 3 current snap is 192 2026-02-17T05:35:41.296 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 182 2026-02-17T05:35:41.296 INFO:tasks.rados.rados.0.trial118.stdout:1822: write (excl) oid 1 current snap is 192 2026-02-17T05:35:41.296 INFO:tasks.rados.rados.0.trial118.stdout:1822: seq_num 654 ranges {591778=419204,1637106=741879,2910049=81729} 2026-02-17T05:35:41.299 INFO:tasks.rados.rados.0.trial118.stdout:1822: writing trial11845692-1 from 591778 to 1010982 tid 1 2026-02-17T05:35:41.304 INFO:tasks.rados.rados.0.trial118.stdout:1822: writing trial11845692-1 from 1637106 to 2378985 tid 2 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1822: writing trial11845692-1 from 2910049 to 2991778 tid 3 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1823: rollback oid 8 current snap is 192 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 191 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1821: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1821: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1821: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 725 (ObjNum 605 snap 174 seq_num 605) dirty exists 2026-02-17T05:35:41.307 INFO:tasks.rados.rados.0.trial118.stdout:1822: finishing write tid 1 to trial11845692-1 2026-02-17T05:35:41.308 INFO:tasks.rados.rados.0.trial118.stdout:1821: done (2 left) 2026-02-17T05:35:41.308 INFO:tasks.rados.rados.0.trial118.stdout:1824: write oid 47 current snap is 192 2026-02-17T05:35:41.308 INFO:tasks.rados.rados.0.trial118.stdout:1824: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2026-02-17T05:35:41.312 INFO:tasks.rados.rados.0.trial118.stdout:1824: writing trial11845692-47 from 608585 to 1103038 tid 1 2026-02-17T05:35:41.316 INFO:tasks.rados.rados.0.trial118.stdout:1824: writing trial11845692-47 from 1579235 to 2181125 tid 2 2026-02-17T05:35:41.319 INFO:tasks.rados.rados.0.trial118.stdout:1824: writing trial11845692-47 from 2821119 to 3008585 tid 3 2026-02-17T05:35:41.319 INFO:tasks.rados.rados.0.trial118.stdout:1825: read oid 11 snap 163 2026-02-17T05:35:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1825: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1826: read oid 12 snap -1 2026-02-17T05:35:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1826: expect deleted 2026-02-17T05:35:41.320 INFO:tasks.rados.rados.0.trial118.stdout:1827: snap_remove snap 186 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1827: done (5 left) 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1828: copy_from oid 43 from oid 5 current snap is 192 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: finishing write tid 2 to trial11845692-1 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: finishing write tid 3 to trial11845692-1 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: finishing write tid 4 to trial11845692-1 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: finishing write tid 5 to trial11845692-1 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: oid 1 updating version 0 to 978 2026-02-17T05:35:42.297 INFO:tasks.rados.rados.0.trial118.stdout:1822: oid 1 version 978 is already newer than 977 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1822: oid 1 version 978 is already newer than 976 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1822: oid 1 version 978 is already newer than 975 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 978 (ObjNum 654 snap 192 seq_num 654) dirty exists 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1822: left oid 1 (ObjNum 654 snap 192 seq_num 654) 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1823: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1823: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1823: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1086 (ObjNum 618 snap 181 seq_num 618) dirty exists 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1822: done (5 left) 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1823: done (4 left) 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1829: delete oid 21 current snap is 192 2026-02-17T05:35:42.298 INFO:tasks.rados.rados.0.trial118.stdout:1824: finishing write tid 1 to trial11845692-47 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: finishing write tid 2 to trial11845692-47 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: finishing write tid 3 to trial11845692-47 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: finishing write tid 4 to trial11845692-47 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: finishing write tid 5 to trial11845692-47 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: oid 47 updating version 0 to 909 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: oid 47 version 909 is already newer than 907 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: oid 47 updating version 909 to 910 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: oid 47 version 910 is already newer than 908 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 910 (ObjNum 655 snap 192 seq_num 655) dirty exists 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1824: left oid 47 (ObjNum 655 snap 192 seq_num 655) 2026-02-17T05:35:42.299 INFO:tasks.rados.rados.0.trial118.stdout:1825: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:42.319 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:42.342 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1828: finishing copy_from racing read to trial11845692-43 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1828: finishing copy_from to trial11845692-43 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 725 (ObjNum 528 snap 145 seq_num 528) dirty exists 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1824: done (4 left) 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1825: done (3 left) 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1826: done (2 left) 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1828: done (1 left) 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1829: done (0 left) 2026-02-17T05:35:42.365 INFO:tasks.rados.rados.0.trial118.stdout:1830: snap_create 2026-02-17T05:35:43.334 INFO:tasks.rados.rados.0.trial118.stdout:1830: done (0 left) 2026-02-17T05:35:43.334 INFO:tasks.rados.rados.0.trial118.stdout:1831: copy_from oid 49 from oid 24 current snap is 193 2026-02-17T05:35:43.335 INFO:tasks.rados.rados.0.trial118.stdout:1832: read oid 31 snap -1 2026-02-17T05:35:43.335 INFO:tasks.rados.rados.0.trial118.stdout:1832: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:35:43.335 INFO:tasks.rados.rados.0.trial118.stdout:1833: delete oid 19 current snap is 193 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1833: done (2 left) 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1834: copy_from oid 25 from oid 35 current snap is 193 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1835: rollback oid 14 current snap is 193 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 180 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1836: read oid 18 snap 187 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1836: expect (ObjNum 601 snap 172 seq_num 601) 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1837: read oid 13 snap -1 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1837: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:35:43.338 INFO:tasks.rados.rados.0.trial118.stdout:1838: snap_remove snap 185 2026-02-17T05:35:44.339 INFO:tasks.rados.rados.0.trial118.stdout:1838: done (6 left) 2026-02-17T05:35:44.339 INFO:tasks.rados.rados.0.trial118.stdout:1839: write (excl) oid 17 current snap is 193 2026-02-17T05:35:44.339 INFO:tasks.rados.rados.0.trial118.stdout:1839: seq_num 658 ranges {659006=720200,2154681=749217} 2026-02-17T05:35:44.345 INFO:tasks.rados.rados.0.trial118.stdout:1839: writing trial11845692-17 from 659006 to 1379206 tid 1 2026-02-17T05:35:44.351 INFO:tasks.rados.rados.0.trial118.stdout:1839: writing trial11845692-17 from 2154681 to 2903898 tid 2 2026-02-17T05:35:44.351 INFO:tasks.rados.rados.0.trial118.stdout:1840: write oid 46 current snap is 193 2026-02-17T05:35:44.351 INFO:tasks.rados.rados.0.trial118.stdout:1840: seq_num 659 ranges {675813=795449,2096810=609228} 2026-02-17T05:35:44.356 INFO:tasks.rados.rados.0.trial118.stdout:1840: writing trial11845692-46 from 675813 to 1471262 tid 1 2026-02-17T05:35:44.361 INFO:tasks.rados.rados.0.trial118.stdout:1840: writing trial11845692-46 from 2096810 to 2706038 tid 2 2026-02-17T05:35:44.362 INFO:tasks.rados.rados.0.trial118.stdout:1841: write oid 41 current snap is 193 2026-02-17T05:35:44.362 INFO:tasks.rados.rados.0.trial118.stdout:1841: seq_num 660 ranges {692620=470698,1755292=752886} 2026-02-17T05:35:44.366 INFO:tasks.rados.rados.0.trial118.stdout:1841: writing trial11845692-41 from 692620 to 1163318 tid 1 2026-02-17T05:35:44.372 INFO:tasks.rados.rados.0.trial118.stdout:1841: writing trial11845692-41 from 1755292 to 2508178 tid 2 2026-02-17T05:35:44.372 INFO:tasks.rados.rados.0.trial118.stdout:1842: rollback oid 39 current snap is 193 2026-02-17T05:35:44.372 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 180 2026-02-17T05:35:44.372 INFO:tasks.rados.rados.0.trial118.stdout:1832: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1835: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1835: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1832: done (9 left) 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1843: write oid 10 current snap is 193 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1835: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 728 (ObjNum 609 snap 177 seq_num 609) dirty exists 2026-02-17T05:35:44.446 INFO:tasks.rados.rados.0.trial118.stdout:1837: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-17T05:35:44.492 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1758870 2026-02-17T05:35:44.493 INFO:tasks.rados.rados.0.trial118.stdout:1836: expect (ObjNum 601 snap 172 seq_num 601) 2026-02-17T05:35:44.514 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1964012 2026-02-17T05:35:44.542 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 287833 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:1831: finishing copy_from racing read to trial11845692-49 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:1834: finishing copy_from racing read to trial11845692-25 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:1831: finishing copy_from to trial11845692-49 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 860 (ObjNum 634 snap 188 seq_num 634) dirty exists 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:1834: finishing copy_from to trial11845692-25 2026-02-17T05:35:44.569 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 428 (ObjNum 563 snap 155 seq_num 563) dirty exists 2026-02-17T05:35:44.570 INFO:tasks.rados.rados.0.trial118.stdout:1843: seq_num 661 ranges {709427=545947,1813774=612897,2985657=123770} 2026-02-17T05:35:44.574 INFO:tasks.rados.rados.0.trial118.stdout:1843: writing trial11845692-10 from 709427 to 1255374 tid 1 2026-02-17T05:35:44.578 INFO:tasks.rados.rados.0.trial118.stdout:1843: writing trial11845692-10 from 1813774 to 2426671 tid 2 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1843: writing trial11845692-10 from 2985657 to 3109427 tid 3 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1831: done (9 left) 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1834: done (8 left) 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1835: done (7 left) 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1836: done (6 left) 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1837: done (5 left) 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1844: delete oid 47 current snap is 193 2026-02-17T05:35:44.581 INFO:tasks.rados.rados.0.trial118.stdout:1839: finishing write tid 1 to trial11845692-17 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: finishing write tid 2 to trial11845692-17 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: finishing write tid 3 to trial11845692-17 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: finishing write tid 4 to trial11845692-17 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: oid 17 updating version 0 to 986 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: oid 17 updating version 986 to 988 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: oid 17 version 988 is already newer than 987 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 988 (ObjNum 658 snap 193 seq_num 658) dirty exists 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1839: left oid 17 (ObjNum 658 snap 193 seq_num 658) 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: finishing write tid 1 to trial11845692-46 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: finishing write tid 2 to trial11845692-46 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: finishing write tid 3 to trial11845692-46 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: finishing write tid 4 to trial11845692-46 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: oid 46 updating version 0 to 989 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: oid 46 updating version 989 to 991 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: oid 46 version 991 is already newer than 990 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 991 (ObjNum 659 snap 193 seq_num 659) dirty exists 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1840: left oid 46 (ObjNum 659 snap 193 seq_num 659) 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: finishing write tid 1 to trial11845692-41 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1842: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1842: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 920 (ObjNum 612 snap 178 seq_num 612) dirty exists 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: finishing write tid 2 to trial11845692-41 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: finishing write tid 3 to trial11845692-41 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: finishing write tid 4 to trial11845692-41 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: oid 41 updating version 0 to 861 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: oid 41 updating version 861 to 863 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: oid 41 version 863 is already newer than 862 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 863 (ObjNum 660 snap 193 seq_num 660) dirty exists 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1841: left oid 41 (ObjNum 660 snap 193 seq_num 660) 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1843: finishing write tid 1 to trial11845692-10 2026-02-17T05:35:44.582 INFO:tasks.rados.rados.0.trial118.stdout:1843: finishing write tid 2 to trial11845692-10 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: finishing write tid 3 to trial11845692-10 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: finishing write tid 4 to trial11845692-10 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: finishing write tid 5 to trial11845692-10 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: oid 10 updating version 0 to 863 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: oid 10 version 863 is already newer than 862 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: oid 10 version 863 is already newer than 861 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: oid 10 updating version 863 to 864 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 864 (ObjNum 661 snap 193 seq_num 661) dirty exists 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: left oid 10 (ObjNum 661 snap 193 seq_num 661) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1839: done (5 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1840: done (4 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1841: done (3 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1842: done (2 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1843: done (1 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1844: done (0 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1845: read oid 50 snap -1 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1845: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1846: delete oid 46 current snap is 193 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1846: done (1 left) 2026-02-17T05:35:44.583 INFO:tasks.rados.rados.0.trial118.stdout:1847: snap_create 2026-02-17T05:35:44.586 INFO:tasks.rados.rados.0.trial118.stdout:1845: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:35:44.618 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 965363 2026-02-17T05:35:45.340 INFO:tasks.rados.rados.0.trial118.stdout:1845: done (1 left) 2026-02-17T05:35:45.340 INFO:tasks.rados.rados.0.trial118.stdout:1847: done (0 left) 2026-02-17T05:35:45.340 INFO:tasks.rados.rados.0.trial118.stdout:1848: copy_from oid 41 from oid 10 current snap is 194 2026-02-17T05:35:45.340 INFO:tasks.rados.rados.0.trial118.stdout:1849: delete oid 15 current snap is 194 2026-02-17T05:35:45.343 INFO:tasks.rados.rados.0.trial118.stdout:1849: done (1 left) 2026-02-17T05:35:45.343 INFO:tasks.rados.rados.0.trial118.stdout:1850: snap_create 2026-02-17T05:35:45.349 INFO:tasks.rados.rados.0.trial118.stdout:1848: finishing copy_from racing read to trial11845692-41 2026-02-17T05:35:45.351 INFO:tasks.rados.rados.0.trial118.stdout:1848: finishing copy_from to trial11845692-41 2026-02-17T05:35:45.351 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 864 (ObjNum 661 snap 193 seq_num 661) dirty exists 2026-02-17T05:35:46.342 INFO:tasks.rados.rados.0.trial118.stdout:1848: done (1 left) 2026-02-17T05:35:46.343 INFO:tasks.rados.rados.0.trial118.stdout:1850: done (0 left) 2026-02-17T05:35:46.343 INFO:tasks.rados.rados.0.trial118.stdout:1851: snap_remove snap 187 2026-02-17T05:35:47.343 INFO:tasks.rados.rados.0.trial118.stdout:1851: done (0 left) 2026-02-17T05:35:47.343 INFO:tasks.rados.rados.0.trial118.stdout:1852: write oid 40 current snap is 195 2026-02-17T05:35:47.343 INFO:tasks.rados.rados.0.trial118.stdout:1852: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2026-02-17T05:35:47.348 INFO:tasks.rados.rados.0.trial118.stdout:1852: writing trial11845692-40 from 776655 to 1339951 tid 1 2026-02-17T05:35:47.353 INFO:tasks.rados.rados.0.trial118.stdout:1852: writing trial11845692-40 from 2047702 to 2667937 tid 2 2026-02-17T05:35:47.355 INFO:tasks.rados.rados.0.trial118.stdout:1852: writing trial11845692-40 from 3095349 to 3176655 tid 3 2026-02-17T05:35:47.355 INFO:tasks.rados.rados.0.trial118.stdout:1853: delete oid 21 current snap is 195 2026-02-17T05:35:47.355 INFO:tasks.rados.rados.0.trial118.stdout:1852: finishing write tid 1 to trial11845692-40 2026-02-17T05:35:47.355 INFO:tasks.rados.rados.0.trial118.stdout:1852: finishing write tid 2 to trial11845692-40 2026-02-17T05:35:47.358 INFO:tasks.rados.rados.0.trial118.stdout:1852: finishing write tid 3 to trial11845692-40 2026-02-17T05:35:47.358 INFO:tasks.rados.rados.0.trial118.stdout:1852: finishing write tid 4 to trial11845692-40 2026-02-17T05:35:47.358 INFO:tasks.rados.rados.0.trial118.stdout:1852: finishing write tid 5 to trial11845692-40 2026-02-17T05:35:47.358 INFO:tasks.rados.rados.0.trial118.stdout:1852: oid 40 updating version 0 to 1010 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1852: oid 40 version 1010 is already newer than 1009 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1852: oid 40 version 1010 is already newer than 1008 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1852: oid 40 updating version 1010 to 1011 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1011 (ObjNum 665 snap 195 seq_num 665) dirty exists 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1852: left oid 40 (ObjNum 665 snap 195 seq_num 665) 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1852: done (1 left) 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1853: done (0 left) 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1854: read oid 9 snap -1 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1854: expect (ObjNum 646 snap 191 seq_num 646) 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1855: copy_from oid 32 from oid 38 current snap is 195 2026-02-17T05:35:47.359 INFO:tasks.rados.rados.0.trial118.stdout:1856: delete oid 25 current snap is 195 2026-02-17T05:35:47.360 INFO:tasks.rados.rados.0.trial118.stdout:1856: done (2 left) 2026-02-17T05:35:47.360 INFO:tasks.rados.rados.0.trial118.stdout:1857: write (excl) oid 3 current snap is 195 2026-02-17T05:35:47.360 INFO:tasks.rados.rados.0.trial118.stdout:1857: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2026-02-17T05:35:47.363 INFO:tasks.rados.rados.0.trial118.stdout:1857: writing trial11845692-3 from 427076 to 1216119 tid 1 2026-02-17T05:35:47.368 INFO:tasks.rados.rados.0.trial118.stdout:1857: writing trial11845692-3 from 1706795 to 2474357 tid 2 2026-02-17T05:35:47.371 INFO:tasks.rados.rados.0.trial118.stdout:1857: writing trial11845692-3 from 2944912 to 3227076 tid 3 2026-02-17T05:35:47.371 INFO:tasks.rados.rados.0.trial118.stdout:1858: copy_from oid 42 from oid 6 current snap is 195 2026-02-17T05:35:47.371 INFO:tasks.rados.rados.0.trial118.stdout:1854: expect (ObjNum 646 snap 191 seq_num 646) 2026-02-17T05:35:47.413 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:35:47.434 INFO:tasks.rados.rados.0.trial118.stdout:1855: finishing copy_from racing read to trial11845692-32 2026-02-17T05:35:47.434 INFO:tasks.rados.rados.0.trial118.stdout:1855: finishing copy_from to trial11845692-32 2026-02-17T05:35:47.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 847 (ObjNum 622 snap 183 seq_num 622) dirty exists 2026-02-17T05:35:47.434 INFO:tasks.rados.rados.0.trial118.stdout:1857: finishing write tid 1 to trial11845692-3 2026-02-17T05:35:47.434 INFO:tasks.rados.rados.0.trial118.stdout:1854: done (3 left) 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1855: done (2 left) 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1859: write oid 50 current snap is 195 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: finishing write tid 2 to trial11845692-3 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: finishing write tid 3 to trial11845692-3 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: finishing write tid 4 to trial11845692-3 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: finishing write tid 5 to trial11845692-3 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: oid 3 updating version 0 to 728 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: oid 3 updating version 728 to 730 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: oid 3 version 730 is already newer than 729 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: oid 3 version 730 is already newer than 727 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 730 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:35:47.435 INFO:tasks.rados.rados.0.trial118.stdout:1857: left oid 3 (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:35:47.436 INFO:tasks.rados.rados.0.trial118.stdout:1858: finishing copy_from racing read to trial11845692-42 2026-02-17T05:35:47.436 INFO:tasks.rados.rados.0.trial118.stdout:1859: seq_num 669 ranges {443883=464292,1365277=511220,2572335=671548} 2026-02-17T05:35:47.437 INFO:tasks.rados.rados.0.trial118.stdout:1859: writing trial11845692-50 from 443883 to 908175 tid 1 2026-02-17T05:35:47.440 INFO:tasks.rados.rados.0.trial118.stdout:1859: writing trial11845692-50 from 1365277 to 1876497 tid 2 2026-02-17T05:35:47.446 INFO:tasks.rados.rados.0.trial118.stdout:1859: writing trial11845692-50 from 2572335 to 3243883 tid 3 2026-02-17T05:35:47.446 INFO:tasks.rados.rados.0.trial118.stdout:1857: done (2 left) 2026-02-17T05:35:47.446 INFO:tasks.rados.rados.0.trial118.stdout:1860: snap_remove snap 180 2026-02-17T05:35:47.699 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:35:47.699 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:35:47.699 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T05:35:47.699 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T05:35:47.702 INFO:tasks.ceph.mon.b:Started 2026-02-17T05:35:47.702 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:35:47.702 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:35:47.763 INFO:tasks.ceph.mon.b.trial118.stderr:2026-02-17T05:35:47.760+0000 7f97eb639c00 -1 mon.b@-1(???).log v0 log_external_backlog rewinding external_log_to from 283 -> 0 (sync_force? mon rebuild?) 2026-02-17T05:35:47.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.778+0000 7f506ea5b640 10 monclient: get_monmap_and_config 2026-02-17T05:35:47.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.778+0000 7f506ea5b640 10 monclient: build_initial_monmap 2026-02-17T05:35:47.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.778+0000 7f506ea5b640 10 monclient: monmap: 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:47.780003+0000 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:47.780003+0000 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:47.788 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 1 Processor -- start 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 1 -- start start 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient: init 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-a con 0x7f506805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-b con 0x7f506805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-c con 0x7f5068182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506808b060 con 0x7f506805d1b0 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506805dc90 con 0x7f5068182720 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506808d6a0 con 0x7f506805dee0 2026-02-17T05:35:47.789 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient(hunting): authenticate will time out at 1076.408419s 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5067fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f506805d1b0 0x7f506805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49844/0 (socket says 10.20.193.106:49844) 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5067fff640 1 -- 10.20.193.106:0/995892330 learned_addr learned my addr 10.20.193.106:0/995892330 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217188178 0 0) 0x7f506808b060 con 0x7f506805d1b0 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): my global_id is 64398 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f504c0035e0 con 0x7f506805d1b0 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811219529 0 0) 0x7f506808d6a0 con 0x7f506805dee0 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:47.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient(hunting): my global_id is 4805 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f506808b060 con 0x7f506805dee0 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 872709240 0 0) 0x7f504c0035e0 con 0x7f506805d1b0 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 >> v1:10.20.193.106:6790/0 conn(0x7f506805dee0 legacy=0x7f5068181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 >> v1:10.20.193.118:6789/0 conn(0x7f5068182720 legacy=0x7f50681a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 monclient: found mon.noname-a 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068057960 con 0x7f506805d1b0 2026-02-17T05:35:47.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: _finish_auth 0 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5054002dd0 con 0x7f506805d1b0 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 5 monclient: authenticate success, global_id 64398 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: dump: 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.792 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5054003010 con 0x7f506805d1b0 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f5066ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.779+0000 7f506ea5b640 4 set_mon_vals no callback set 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f5066ffd640 1 -- 10.20.193.106:0/995892330 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5054003420 con 0x7f506805d1b0 2026-02-17T05:35:47.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f5066ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f5066ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f5066ffd640 10 monclient: dump: 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:47.794 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 10 monclient: shutdown 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- 10.20.193.106:0/995892330 >> v1:10.20.193.106:6789/0 conn(0x7f506805d1b0 legacy=0x7f506805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- 10.20.193.106:0/995892330 shutdown_connections 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- 10.20.193.106:0/995892330 >> 10.20.193.106:0/995892330 conn(0x7f50680915f0 msgr2=0x7f50680919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- 10.20.193.106:0/995892330 shutdown_connections 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- 10.20.193.106:0/995892330 wait complete. 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 10 monclient: build_initial_monmap 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 10 monclient: monmap: 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:47.795 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 Processor -- start 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 1 -- start start 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.780+0000 7f506ea5b640 10 monclient: init 2026-02-17T05:35:47.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-c con 0x7f506805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-b con 0x7f506805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient(hunting): picked mon.noname-a con 0x7f5068182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506810eb80 con 0x7f5068182720 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506810ee60 con 0x7f506805dee0 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506812ad90 con 0x7f506805d1b0 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient(hunting): authenticate will time out at 1076.410077s 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5067fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f506805d1b0 0x7f5068129f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51592/0 (socket says 10.20.193.106:51592) 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5067fff640 1 -- 10.20.193.106:0/1271256861 learned_addr learned my addr 10.20.193.106:0/1271256861 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:47.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358117583 0 0) 0x7f506812ad90 con 0x7f506805d1b0 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): my global_id is 4808 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50380035e0 con 0x7f506805d1b0 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699096759 0 0) 0x7f506810eb80 con 0x7f5068182720 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): my global_id is 64401 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f506812ad90 con 0x7f5068182720 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496053091 0 0) 0x7f50380035e0 con 0x7f506805d1b0 2026-02-17T05:35:47.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f506810eb80 con 0x7f506805d1b0 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5054003330 con 0x7f506805d1b0 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): dump: 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:47.799 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1216550782 0 0) 0x7f506812ad90 con 0x7f5068182720 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50380035e0 con 0x7f5068182720 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f505c003d80 con 0x7f5068182720 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient(hunting): dump: 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.800 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4084181409 0 0) 0x7f506810eb80 con 0x7f506805d1b0 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 >> v1:10.20.193.118:6789/0 conn(0x7f506805dee0 legacy=0x7f506812a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 >> v1:10.20.193.106:6789/0 conn(0x7f5068182720 legacy=0x7f5068181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:35:47.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 monclient: found mon.c 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506805e8e0 con 0x7f506805d1b0 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: _finish_auth 0 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 5 monclient: authenticate success, global_id 4808 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _renew_subs 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f506813f690 con 0x7f506805d1b0 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _renew_subs 2026-02-17T05:35:47.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f50681824f0 con 0x7f506805d1b0 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5054004cb0 con 0x7f506805d1b0 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5054004fd0 con 0x7f506805d1b0 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f50667fc640 4 set_mon_vals no callback set 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.781+0000 7f5064ff9640 10 monclient: dump: 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:47.803 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f506ea5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f506ea5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f506ea5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506810d930 con 0x7f506805d1b0 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f5054011f70 con 0x7f506805d1b0 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(404..404 src has 224..404) ==== 3991+0+0 (unknown 753473876 0 0) 0x7f505404fe80 con 0x7f506805d1b0 2026-02-17T05:35:47.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.782+0000 7f50677fe640 10 monclient: get_auth_request con 0x7f5038040bf0 auth_method 0 2026-02-17T05:35:47.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.785+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f5054017570 con 0x7f506805d1b0 2026-02-17T05:35:47.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.785+0000 7f5064ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:47.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.785+0000 7f5064ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:47.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f506ea5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:35:47.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f506ea5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f506ea5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5068057cd0 con 0x7f506805d1b0 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f5064ff9640 1 -- 10.20.193.106:0/1271256861 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3276784296) 0x7f5054016d20 con 0x7f506805d1b0 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f5064ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.934+0000 7f5064ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:47.937 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:35:47.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 >> v1:10.20.193.118:6812/703720803 conn(0x7f5038040bf0 legacy=0x7f50380610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 10 monclient: shutdown 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 >> v1:10.20.193.106:6790/0 conn(0x7f506805d1b0 legacy=0x7f5068129f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 shutdown_connections 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 >> 10.20.193.106:0/1271256861 conn(0x7f50680915f0 msgr2=0x7f506808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 shutdown_connections 2026-02-17T05:35:47.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:47.935+0000 7f506ea5b640 1 -- 10.20.193.106:0/1271256861 wait complete. 2026-02-17T05:35:47.945 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:35:47.946 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:35:47.946 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:35:48.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.009+0000 7f3da210c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.009+0000 7f3da210c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.009+0000 7f3da210c640 10 monclient: monmap: 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:48.011322+0000 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:48.011322+0000 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.012 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:48.013 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:48.013 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 1 Processor -- start 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 1 -- start start 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient: init 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:48.024 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-a con 0x7f3d9c0585c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-b con 0x7f3d9c13f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-c con 0x7f3d9c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c056bb0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c0575d0 con 0x7f3d9c08c0d0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c0578b0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.010+0000 7f3da210c640 10 monclient(hunting): authenticate will time out at 1076.639936s 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9affd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3d9c13f6c0 0x7f3d9c183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51606/0 (socket says 10.20.193.106:51606) 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9affd640 1 -- 10.20.193.106:0/1018403123 learned_addr learned my addr 10.20.193.106:0/1018403123 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9b7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f3d9c0585c0 0x7f3d9c13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49862/0 (socket says 10.20.193.106:49862) 2026-02-17T05:35:48.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746959106 0 0) 0x7f3d9c0578b0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): my global_id is 4811 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d800035e0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895699566 0 0) 0x7f3d9c056bb0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient(hunting): my global_id is 64404 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c0578b0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3238331278 0 0) 0x7f3d800035e0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 >> v1:10.20.193.118:6789/0 conn(0x7f3d9c08c0d0 legacy=0x7f3d9c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c0585c0 legacy=0x7f3d9c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 monclient: found mon.noname-b 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c057b90 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d8c002dd0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: dump: 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.028 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 5 monclient: authenticate success, global_id 4811 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d8c003010 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 1 -- 10.20.193.106:0/1018403123 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d8c003420 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3d9a7fc640 10 monclient: dump: 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.030 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 4 set_mon_vals no callback set 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 10 monclient: shutdown 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 1 -- 10.20.193.106:0/1018403123 >> v1:10.20.193.106:6790/0 conn(0x7f3d9c13f6c0 legacy=0x7f3d9c183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 1 -- 10.20.193.106:0/1018403123 shutdown_connections 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 1 -- 10.20.193.106:0/1018403123 >> 10.20.193.106:0/1018403123 conn(0x7f3d9c05e410 msgr2=0x7f3d9c095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 1 -- 10.20.193.106:0/1018403123 shutdown_connections 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.011+0000 7f3da210c640 1 -- 10.20.193.106:0/1018403123 wait complete. 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient: monmap: 2026-02-17T05:35:48.031 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 1 Processor -- start 2026-02-17T05:35:48.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 1 -- start start 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient: init 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-c con 0x7f3d9c0585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-b con 0x7f3d9c08c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 10 monclient(hunting): picked mon.noname-a con 0x7f3d9c13f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c12e170 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.012+0000 7f3da210c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c12e6a0 con 0x7f3d9c08c0d0 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3da210c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c08c530 con 0x7f3d9c0585c0 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3da210c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3da210c640 10 monclient(hunting): authenticate will time out at 1076.642025s 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d9b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3d9c0585c0 0x7f3d9c13cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51608/0 (socket says 10.20.193.106:51608) 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d9b7fe640 1 -- 10.20.193.106:0/2315835965 learned_addr learned my addr 10.20.193.106:0/2315835965 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342364194 0 0) 0x7f3d9c08c530 con 0x7f3d9c0585c0 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): my global_id is 4814 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d6c0035e0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896223698 0 0) 0x7f3d9c12e170 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): my global_id is 64407 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c08c530 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182228600 0 0) 0x7f3d9c12e6a0 con 0x7f3d9c08c0d0 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): my global_id is 94099 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c12e170 con 0x7f3d9c08c0d0 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675839242 0 0) 0x7f3d6c0035e0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d9c12e6a0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d880030f0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): dump: 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.037 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1029923483 0 0) 0x7f3d9c08c530 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d6c0035e0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d900040d0 con 0x7f3d9c13f6c0 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient(hunting): dump: 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.038 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1230423271 0 0) 0x7f3d9c12e6a0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.118:6789/0 conn(0x7f3d9c08c0d0 legacy=0x7f3d9c193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c13f6c0 legacy=0x7f3d9c194b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 monclient: found mon.c 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.013+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c08b8b0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 5 monclient: authenticate success, global_id 4814 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 10 monclient: _renew_subs 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c12de60 con 0x7f3d9c0585c0 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 10 monclient: _renew_subs 2026-02-17T05:35:48.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d9c08b1d0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d88003440 con 0x7f3d9c0585c0 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d880032c0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient: dump: 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.041 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d99ffb640 4 set_mon_vals no callback set 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d9c093240 con 0x7f3d9c12bf20 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3d88011b40 con 0x7f3d9c0585c0 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(404..404 src has 224..404) ==== 3991+0+0 (unknown 753473876 0 0) 0x7f3d8804fde0 con 0x7f3d9c0585c0 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934343180 0 0) 0x7f3d9c093240 con 0x7f3d9c12bf20 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 10 monclient(hunting): my global_id is 64410 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c12e6a0 con 0x7f3d9c12bf20 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.014+0000 7f3d9bfff640 10 monclient: get_auth_request con 0x7f3d6c040d00 auth_method 0 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1144145241 0 0) 0x7f3d9c12e6a0 con 0x7f3d9c12bf20 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d9c093240 con 0x7f3d9c12bf20 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d8c002a60 con 0x7f3d9c12bf20 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 10 monclient: dump: 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.043 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3548163016 0 0) 0x7f3d9c093240 con 0x7f3d9c12bf20 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d9c058c70 con 0x7f3d9c12bf20 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3d8c002d50 con 0x7f3d9c12bf20 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c12bf20 legacy=0x7f3d9c08d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.015+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c12bf20 legacy=0x7f3d9c08d750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3da210c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d9c13d780 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480414910 0 0) 0x7f3d9c13d780 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 10 monclient(hunting): my global_id is 64413 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.018+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c093240 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 636121391 0 0) 0x7f3d9c093240 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d9c13d780 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d8c004cc0 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 10 monclient: dump: 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.046 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.047 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2002418290 0 0) 0x7f3d9c13d780 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d9c05fd90 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2068228289) 0x7f3d8c005070 con 0x7f3d9c13d3b0 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c13d3b0 legacy=0x7f3d9c08de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d77fff640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6789/0 conn(0x7f3d9c13d3b0 legacy=0x7f3d9c08de60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 345557, 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:48.049 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.050 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.051 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:48.052 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.053 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:48.054 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.055 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.056 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.057 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:35:48.058 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:48.059 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:48.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.118:6812/703720803 conn(0x7f3d6c040d00 legacy=0x7f3d6c0611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 10 monclient: shutdown 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 >> v1:10.20.193.106:6790/0 conn(0x7f3d9c0585c0 legacy=0x7f3d9c13cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d9bfff640 1 -- 10.20.193.106:0/2315835965 reap_dead start 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3d9bfff640 1 -- 10.20.193.106:0/2315835965 reap_dead start 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 shutdown_connections 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 >> 10.20.193.106:0/2315835965 conn(0x7f3d9c05e410 msgr2=0x7f3d9c141730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 shutdown_connections 2026-02-17T05:35:48.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.019+0000 7f3da210c640 1 -- 10.20.193.106:0/2315835965 wait complete. 2026-02-17T05:35:48.061 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:48.061 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:35:48.062 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:35:48.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 10 monclient: monmap: 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:48.127770+0000 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:48.127770+0000 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 1 Processor -- start 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 1 -- start start 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.126+0000 7f922954c640 10 monclient: init 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient(hunting): picked mon.noname-b con 0x7f922405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient(hunting): picked mon.noname-c con 0x7f922405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient(hunting): picked mon.noname-a con 0x7f9224182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922408b060 con 0x7f9224182720 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922405dc90 con 0x7f922405dee0 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922408d6a0 con 0x7f922405d1b0 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient(hunting): authenticate will time out at 1076.756145s 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f92237fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9224182720 0x7f92241a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49892/0 (socket says 10.20.193.106:49892) 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9222ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f922405d1b0 0x7f922405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51620/0 (socket says 10.20.193.106:51620) 2026-02-17T05:35:48.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f92237fe640 1 -- 10.20.193.106:0/1189355915 learned_addr learned my addr 10.20.193.106:0/1189355915 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201287771 0 0) 0x7f922408b060 con 0x7f9224182720 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): my global_id is 64416 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92100035e0 con 0x7f9224182720 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229936682 0 0) 0x7f922408d6a0 con 0x7f922405d1b0 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient(hunting): my global_id is 4817 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922408b060 con 0x7f922405d1b0 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2901862799 0 0) 0x7f92100035e0 con 0x7f9224182720 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 >> v1:10.20.193.106:6790/0 conn(0x7f922405d1b0 legacy=0x7f922405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 >> v1:10.20.193.118:6789/0 conn(0x7f922405dee0 legacy=0x7f9224181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 monclient: found mon.noname-a 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9224057960 con 0x7f9224182720 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9214003eb0 con 0x7f9224182720 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: dump: 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.138 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 5 monclient: authenticate success, global_id 64416 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9214004130 con 0x7f9224182720 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 4 set_mon_vals no callback set 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 1 -- 10.20.193.106:0/1189355915 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9214004540 con 0x7f9224182720 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f9221ffb640 10 monclient: dump: 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.139 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 10 monclient: shutdown 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.127+0000 7f922954c640 1 -- 10.20.193.106:0/1189355915 >> v1:10.20.193.106:6789/0 conn(0x7f9224182720 legacy=0x7f92241a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 -- 10.20.193.106:0/1189355915 shutdown_connections 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 -- 10.20.193.106:0/1189355915 >> 10.20.193.106:0/1189355915 conn(0x7f92240915f0 msgr2=0x7f92240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 -- 10.20.193.106:0/1189355915 shutdown_connections 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 -- 10.20.193.106:0/1189355915 wait complete. 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 10 monclient: monmap: 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 Processor -- start 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 1 -- start start 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.128+0000 7f922954c640 10 monclient: init 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:48.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient(hunting): picked mon.noname-c con 0x7f922405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient(hunting): picked mon.noname-b con 0x7f922405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient(hunting): picked mon.noname-a con 0x7f9224182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922410ee90 con 0x7f9224182720 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922412ae50 con 0x7f922405dee0 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922408a0e0 con 0x7f922405d1b0 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient(hunting): authenticate will time out at 1076.758104s 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f9222ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f922405d1b0 0x7f922412a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51636/0 (socket says 10.20.193.106:51636) 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f9222ffd640 1 -- 10.20.193.106:0/3869959523 learned_addr learned my addr 10.20.193.106:0/3869959523 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92237fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9224182720 0x7f9224181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49900/0 (socket says 10.20.193.106:49900) 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772707667 0 0) 0x7f922410ee90 con 0x7f9224182720 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): my global_id is 64419 2026-02-17T05:35:48.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f00035e0 con 0x7f9224182720 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958624533 0 0) 0x7f922408a0e0 con 0x7f922405d1b0 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): my global_id is 4820 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922410ee90 con 0x7f922405d1b0 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 196627011 0 0) 0x7f91f00035e0 con 0x7f9224182720 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f922408a0e0 con 0x7f9224182720 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f92140042a0 con 0x7f9224182720 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): dump: 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.143 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1615563523 0 0) 0x7f922410ee90 con 0x7f922405d1b0 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91f00035e0 con 0x7f922405d1b0 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9218003290 con 0x7f922405d1b0 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient(hunting): dump: 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.144 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2796545933 0 0) 0x7f922408a0e0 con 0x7f9224182720 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6790/0 conn(0x7f922405d1b0 legacy=0x7f922412a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.118:6789/0 conn(0x7f922405dee0 legacy=0x7f922412a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 monclient: found mon.a 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9224089a90 con 0x7f9224182720 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 5 monclient: authenticate success, global_id 64419 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _renew_subs 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f92241824f0 con 0x7f9224182720 2026-02-17T05:35:48.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _renew_subs 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f922412dfa0 con 0x7f9224182720 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9214004540 con 0x7f9224182720 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9214005f40 con 0x7f9224182720 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92217fa640 4 set_mon_vals no callback set 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f92037fe640 10 monclient: dump: 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.129+0000 7f922954c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f922410eb10 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9214012ee0 con 0x7f9224182720 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(404..404 src has 224..404) ==== 3991+0+0 (unknown 753473876 0 0) 0x7f9214050e00 con 0x7f9224182720 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427004364 0 0) 0x7f922410eb10 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient(hunting): my global_id is 4823 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922408a0e0 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1173190446 0 0) 0x7f922408a0e0 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f922410eb10 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9218004a50 con 0x7f922410d690 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 10 monclient: dump: 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.148 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92227fc640 10 monclient: get_auth_request con 0x7f91f0040b50 auth_method 0 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 899791670 0 0) 0x7f922410eb10 con 0x7f922410d690 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.130+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9224057cd0 con 0x7f922410d690 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.131+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f92180058d0 con 0x7f922410d690 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.131+0000 7f92037fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.131+0000 7f92037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.131+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6790/0 conn(0x7f922410d690 legacy=0x7f9224059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.131+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6790/0 conn(0x7f922410d690 legacy=0x7f9224059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f922954c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f922412d980 con 0x7f922412d5b0 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413265186 0 0) 0x7f922412d980 con 0x7f922412d5b0 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient(hunting): my global_id is 4826 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922410eb10 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1062888021 0 0) 0x7f922410eb10 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f922412d980 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9218005240 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 10 monclient: dump: 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3238346339 0 0) 0x7f922412d980 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.134+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9224055570 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1454192838) 0x7f9218005700 con 0x7f922412d5b0 2026-02-17T05:35:48.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92037fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6790/0 conn(0x7f922412d5b0 legacy=0x7f922404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92037fe640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6790/0 conn(0x7f922412d5b0 legacy=0x7f922404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 472897, 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:48.152 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.153 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:48.154 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.155 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.156 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.157 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.158 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:48.159 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.118:6812/703720803 conn(0x7f91f0040b50 legacy=0x7f91f0061000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 10 monclient: shutdown 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 >> v1:10.20.193.106:6789/0 conn(0x7f9224182720 legacy=0x7f9224181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f92237fe640 1 -- 10.20.193.106:0/3869959523 reap_dead start 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 shutdown_connections 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 >> 10.20.193.106:0/3869959523 conn(0x7f92240915f0 msgr2=0x7f922408c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 shutdown_connections 2026-02-17T05:35:48.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.135+0000 7f922954c640 1 -- 10.20.193.106:0/3869959523 wait complete. 2026-02-17T05:35:48.161 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:48.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:35:48.161 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 10 monclient: monmap: 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:48.225904+0000 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:48.225904+0000 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:48.226 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 1 Processor -- start 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 1 -- start start 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.224+0000 7f8e6494c640 10 monclient: init 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-a con 0x7f8e5c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-b con 0x7f8e5c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-c con 0x7f8e5c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c08b060 con 0x7f8e5c05d1b0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c05dc90 con 0x7f8e5c182720 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c08d6a0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient(hunting): authenticate will time out at 1076.854255s 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e626c1640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f8e5c05d1b0 0x7f8e5c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49910/0 (socket says 10.20.193.106:49910) 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e61ec0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8e5c05dee0 0x7f8e5c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51648/0 (socket says 10.20.193.106:51648) 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e626c1640 1 -- 10.20.193.106:0/103687894 learned_addr learned my addr 10.20.193.106:0/103687894 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708563892 0 0) 0x7f8e5c08d6a0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): my global_id is 4829 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e4c0035e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051370931 0 0) 0x7f8e5c08b060 con 0x7f8e5c05d1b0 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient(hunting): my global_id is 64422 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e5c08d6a0 con 0x7f8e5c05d1b0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260141536 0 0) 0x7f8e4c0035e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c182720 legacy=0x7f8e5c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 >> v1:10.20.193.106:6789/0 conn(0x7f8e5c05d1b0 legacy=0x7f8e5c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 monclient: found mon.noname-b 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c057960 con 0x7f8e5c05dee0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e48002dd0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: dump: 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 5 monclient: authenticate success, global_id 4829 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e48003090 con 0x7f8e5c05dee0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 4 set_mon_vals no callback set 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 1 -- 10.20.193.106:0/103687894 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e480034a0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e616bf640 10 monclient: dump: 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 10 monclient: shutdown 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.225+0000 7f8e6494c640 1 -- 10.20.193.106:0/103687894 >> v1:10.20.193.106:6790/0 conn(0x7f8e5c05dee0 legacy=0x7f8e5c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- 10.20.193.106:0/103687894 shutdown_connections 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- 10.20.193.106:0/103687894 >> 10.20.193.106:0/103687894 conn(0x7f8e5c0915f0 msgr2=0x7f8e5c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- 10.20.193.106:0/103687894 shutdown_connections 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- 10.20.193.106:0/103687894 wait complete. 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient: monmap: 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 Processor -- start 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- start start 2026-02-17T05:35:48.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient: init 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-b con 0x7f8e5c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-c con 0x7f8e5c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient(hunting): picked mon.noname-a con 0x7f8e5c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c12bf10 con 0x7f8e5c182720 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c129000 con 0x7f8e5c05d1b0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c13f4e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e6494c640 10 monclient(hunting): authenticate will time out at 1076.855816s 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e61ec0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8e5c05dee0 0x7f8e5c1288f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51650/0 (socket says 10.20.193.106:51650) 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e61ec0640 1 -- 10.20.193.106:0/91018548 learned_addr learned my addr 10.20.193.106:0/91018548 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e62ec2640 1 --1- 10.20.193.106:0/91018548 >> v1:10.20.193.106:6789/0 conn(0x7f8e5c182720 0x7f8e5c181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49916/0 (socket says 10.20.193.106:49916) 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.226+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214346008 0 0) 0x7f8e5c13f4e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): my global_id is 4832 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e2c0035e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479552167 0 0) 0x7f8e5c12bf10 con 0x7f8e5c182720 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): my global_id is 64425 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e5c13f4e0 con 0x7f8e5c182720 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702962803 0 0) 0x7f8e2c0035e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e5c12bf10 con 0x7f8e5c05dee0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e480033b0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): dump: 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3712501376 0 0) 0x7f8e5c13f4e0 con 0x7f8e5c182720 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e2c0035e0 con 0x7f8e5c182720 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e50004fd0 con 0x7f8e5c182720 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient(hunting): dump: 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.233 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2674103147 0 0) 0x7f8e5c12bf10 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c05d1b0 legacy=0x7f8e5c1281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.106:6789/0 conn(0x7f8e5c182720 legacy=0x7f8e5c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 monclient: found mon.c 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c05e8e0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 5 monclient: authenticate success, global_id 4832 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 10 monclient: _renew_subs 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c12b0a0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 10 monclient: _renew_subs 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8e5c12bc30 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e48002940 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e48004da0 con 0x7f8e5c05dee0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 10 monclient: dump: 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e60ebe640 4 set_mon_vals no callback set 2026-02-17T05:35:48.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8e5c13d870 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.227+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8e48011d40 con 0x7f8e5c05dee0 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(404..404 src has 224..404) ==== 3991+0+0 (unknown 753473876 0 0) 0x7f8e4804fe90 con 0x7f8e5c05dee0 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e62ec2640 10 monclient: get_auth_request con 0x7f8e2c040bb0 auth_method 0 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145651312 0 0) 0x7f8e5c13d870 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient(hunting): my global_id is 94105 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e5c12bf10 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2659465224 0 0) 0x7f8e5c12bf10 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e5c13d870 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e54002df0 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 10 monclient: dump: 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 766414508 0 0) 0x7f8e5c13d870 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.228+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e5c12c410 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.229+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8e54003280 con 0x7f8e5c058b50 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.229+0000 7f8e46ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.229+0000 7f8e46ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.229+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c058b50 legacy=0x7f8e5c058f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.229+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c058b50 legacy=0x7f8e5c058f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.232+0000 7f8e6494c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.232+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8e5c055570 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596575341 0 0) 0x7f8e5c055570 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient(hunting): my global_id is 94108 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e5c13d870 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 938321710 0 0) 0x7f8e5c13d870 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e5c055570 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8e54004d00 con 0x7f8e5c059630 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient: dump: 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.236 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2004673433 0 0) 0x7f8e5c055570 con 0x7f8e5c059630 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8e5c12b8b0 con 0x7f8e5c059630 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 3119291887) 0x7f8e54005940 con 0x7f8e5c059630 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c059630 legacy=0x7f8e5c197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e46ffd640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6789/0 conn(0x7f8e5c059630 legacy=0x7f8e5c197100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 475, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.237 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:48.238 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.239 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:48.240 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.118:6812/703720803 conn(0x7f8e2c040bb0 legacy=0x7f8e2c061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 10 monclient: shutdown 2026-02-17T05:35:48.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 >> v1:10.20.193.106:6790/0 conn(0x7f8e5c05dee0 legacy=0x7f8e5c1288f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e62ec2640 1 -- 10.20.193.106:0/91018548 reap_dead start 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e62ec2640 1 -- 10.20.193.106:0/91018548 reap_dead start 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 shutdown_connections 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 >> 10.20.193.106:0/91018548 conn(0x7f8e5c0915f0 msgr2=0x7f8e5c05caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 shutdown_connections 2026-02-17T05:35:48.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.233+0000 7f8e6494c640 1 -- 10.20.193.106:0/91018548 wait complete. 2026-02-17T05:35:48.242 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:48.242 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:35:48.242 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 10 monclient: monmap: 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:48.305872+0000 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:48.305872+0000 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:48.306 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 1 Processor -- start 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 1 -- start start 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.304+0000 7f600ab0c640 10 monclient: init 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-c con 0x7f600405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-b con 0x7f600405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-a con 0x7f6004182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600408b060 con 0x7f6004182720 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600405dc90 con 0x7f600405d1b0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600408d6a0 con 0x7f600405dee0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient(hunting): authenticate will time out at 1076.934222s 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffbfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f600405dee0 0x7f6004181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51652/0 (socket says 10.20.193.106:51652) 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffbfff640 1 -- 10.20.193.106:0/1245528586 learned_addr learned my addr 10.20.193.106:0/1245528586 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f6009082640 1 --1- 10.20.193.106:0/1245528586 >> v1:10.20.193.106:6789/0 conn(0x7f6004182720 0x7f60041a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49924/0 (socket says 10.20.193.106:49924) 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852427435 0 0) 0x7f600408d6a0 con 0x7f600405dee0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): my global_id is 4835 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff00035e0 con 0x7f600405dee0 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494902084 0 0) 0x7f600408b060 con 0x7f6004182720 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient(hunting): my global_id is 64428 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f600408d6a0 con 0x7f6004182720 2026-02-17T05:35:48.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 190303796 0 0) 0x7f5ff00035e0 con 0x7f600405dee0 2026-02-17T05:35:48.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 >> v1:10.20.193.118:6789/0 conn(0x7f600405d1b0 legacy=0x7f600405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 >> v1:10.20.193.106:6789/0 conn(0x7f6004182720 legacy=0x7f60041a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 monclient: found mon.noname-b 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6004057960 con 0x7f600405dee0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5fec002dd0 con 0x7f600405dee0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: dump: 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.311 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 5 monclient: authenticate success, global_id 4835 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fec003090 con 0x7f600405dee0 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 1 -- 10.20.193.106:0/1245528586 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5fec0034a0 con 0x7f600405dee0 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f600ab0c640 4 set_mon_vals no callback set 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.305+0000 7f5ffb7fe640 10 monclient: dump: 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.312 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: shutdown 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- 10.20.193.106:0/1245528586 >> v1:10.20.193.106:6790/0 conn(0x7f600405dee0 legacy=0x7f6004181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- 10.20.193.106:0/1245528586 shutdown_connections 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- 10.20.193.106:0/1245528586 >> 10.20.193.106:0/1245528586 conn(0x7f60040915f0 msgr2=0x7f60040919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- 10.20.193.106:0/1245528586 shutdown_connections 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- 10.20.193.106:0/1245528586 wait complete. 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: build_initial_monmap 2026-02-17T05:35:48.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: monmap: 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 Processor -- start 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- start start 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: init 2026-02-17T05:35:48.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-a con 0x7f600405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-c con 0x7f600405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient(hunting): picked mon.noname-b con 0x7f6004182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600405e950 con 0x7f600405d1b0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600412c2d0 con 0x7f6004182720 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600410bf40 con 0x7f600405dee0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f600ab0c640 10 monclient(hunting): authenticate will time out at 1076.935888s 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f6008881640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f600405d1b0 0x7f600412b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49934/0 (socket says 10.20.193.106:49934) 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f6008881640 1 -- 10.20.193.106:0/415697693 learned_addr learned my addr 10.20.193.106:0/415697693 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.306+0000 7f5ffbfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f600405dee0 0x7f600412bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51662/0 (socket says 10.20.193.106:51662) 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339415691 0 0) 0x7f600405dc90 con 0x7f600405d1b0 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): my global_id is 64431 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd40035e0 con 0x7f600405d1b0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591144353 0 0) 0x7f600410bf40 con 0x7f600405dee0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _negotiate 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): my global_id is 4838 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f600405dc90 con 0x7f600405dee0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1685285689 0 0) 0x7f5fd40035e0 con 0x7f600405d1b0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f600410bf40 con 0x7f600405d1b0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5ff40030e0 con 0x7f600405d1b0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:48.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): dump: 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1413434110 0 0) 0x7f600405dc90 con 0x7f600405dee0 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fd40035e0 con 0x7f600405dee0 2026-02-17T05:35:48.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5fec003200 con 0x7f600405dee0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient(hunting): dump: 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 890884520 0 0) 0x7f600410bf40 con 0x7f600405d1b0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 >> v1:10.20.193.106:6790/0 conn(0x7f600405dee0 legacy=0x7f600412bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 >> v1:10.20.193.118:6789/0 conn(0x7f6004182720 legacy=0x7f6004181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: _finish_hunting 0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 monclient: found mon.a 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600410aa50 con 0x7f600405d1b0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: _finish_auth 0 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: _check_auth_tickets 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:48.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 5 monclient: authenticate success, global_id 64431 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _renew_subs 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f600410cdb0 con 0x7f600405d1b0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _renew_subs 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f600410b7e0 con 0x7f600405d1b0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ff40032b0 con 0x7f600405d1b0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f5ff4003b30 con 0x7f600405d1b0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ffaffd640 4 set_mon_vals no callback set 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f5ff97fa640 10 monclient: dump: 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.307+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60040008d0 con 0x7f600405d1b0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.308+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f5ff4003c90 con 0x7f600405d1b0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.308+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(404..404 src has 224..404) ==== 3991+0+0 (unknown 753473876 0 0) 0x7f5ff404fc70 con 0x7f600405d1b0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.308+0000 7f5ffbfff640 10 monclient: get_auth_request con 0x7f5fd4040bf0 auth_method 0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.310+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f5ff40034d0 con 0x7f600405d1b0 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.310+0000 7f5ff97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:48.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.310+0000 7f5ff97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:48.346 INFO:tasks.rados.rados.0.trial118.stdout:1860: done (2 left) 2026-02-17T05:35:48.346 INFO:tasks.rados.rados.0.trial118.stdout:1861: write (excl) oid 9 current snap is 195 2026-02-17T05:35:48.346 INFO:tasks.rados.rados.0.trial118.stdout:1861: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2026-02-17T05:35:48.351 INFO:tasks.rados.rados.0.trial118.stdout:1861: writing trial11845692-9 from 460690 to 1116584 tid 1 2026-02-17T05:35:48.355 INFO:tasks.rados.rados.0.trial118.stdout:1861: writing trial11845692-9 from 1540112 to 2311343 tid 2 2026-02-17T05:35:48.359 INFO:tasks.rados.rados.0.trial118.stdout:1861: writing trial11845692-9 from 2716111 to 3255889 tid 3 2026-02-17T05:35:48.359 INFO:tasks.rados.rados.0.trial118.stdout:1862: write oid 24 current snap is 195 2026-02-17T05:35:48.359 INFO:tasks.rados.rados.0.trial118.stdout:1858: finishing copy_from to trial11845692-42 2026-02-17T05:35:48.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 657 (ObjNum 651 snap 191 seq_num 651) dirty exists 2026-02-17T05:35:48.359 INFO:tasks.rados.rados.0.trial118.stdout:1862: seq_num 671 ranges {477497=731143,1998594=514889,3143534=133963} 2026-02-17T05:35:48.363 INFO:tasks.rados.rados.0.trial118.stdout:1862: writing trial11845692-24 from 477497 to 1208640 tid 1 2026-02-17T05:35:48.368 INFO:tasks.rados.rados.0.trial118.stdout:1862: writing trial11845692-24 from 1998594 to 2513483 tid 2 2026-02-17T05:35:48.371 INFO:tasks.rados.rados.0.trial118.stdout:1862: writing trial11845692-24 from 3143534 to 3277497 tid 3 2026-02-17T05:35:48.371 INFO:tasks.rados.rados.0.trial118.stdout:1858: done (3 left) 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1863: snap_create 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: finishing write tid 1 to trial11845692-50 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: finishing write tid 2 to trial11845692-50 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: finishing write tid 3 to trial11845692-50 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: finishing write tid 4 to trial11845692-50 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: finishing write tid 5 to trial11845692-50 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: oid 50 updating version 0 to 737 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: oid 50 updating version 737 to 738 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: oid 50 updating version 738 to 739 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: oid 50 version 739 is already newer than 736 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 739 (ObjNum 669 snap 195 seq_num 669) dirty exists 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1859: left oid 50 (ObjNum 669 snap 195 seq_num 669) 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: finishing write tid 1 to trial11845692-9 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: finishing write tid 2 to trial11845692-9 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: finishing write tid 3 to trial11845692-9 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: finishing write tid 4 to trial11845692-9 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: finishing write tid 5 to trial11845692-9 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: oid 9 updating version 0 to 880 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: oid 9 version 880 is already newer than 878 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: oid 9 version 880 is already newer than 877 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: oid 9 version 880 is already newer than 879 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 880 (ObjNum 670 snap 195 seq_num 670) dirty exists 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1861: left oid 9 (ObjNum 670 snap 195 seq_num 670) 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1862: finishing write tid 1 to trial11845692-24 2026-02-17T05:35:48.372 INFO:tasks.rados.rados.0.trial118.stdout:1862: finishing write tid 2 to trial11845692-24 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: finishing write tid 3 to trial11845692-24 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: finishing write tid 4 to trial11845692-24 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: finishing write tid 5 to trial11845692-24 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: oid 24 updating version 0 to 864 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: oid 24 version 864 is already newer than 862 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: oid 24 version 864 is already newer than 863 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: oid 24 version 864 is already newer than 861 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 864 (ObjNum 671 snap 195 seq_num 671) dirty exists 2026-02-17T05:35:48.373 INFO:tasks.rados.rados.0.trial118.stdout:1862: left oid 24 (ObjNum 671 snap 195 seq_num 671) 2026-02-17T05:35:48.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.458+0000 7f600ab0c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:35:48.460 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.458+0000 7f600ab0c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:35:48.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.458+0000 7f600ab0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:48.461 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.458+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f600405e950 con 0x7f600405d1b0 2026-02-17T05:35:48.461 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.461 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=2897863185,config=1618278320,health=3423964923,kv=675723720,logm=3626085854}) 2026-02-17T05:35:48.461 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=1998537214,config=1618278320,health=4068333073,kv=675723720,logm=1974477727}) 2026-02-17T05:35:48.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.459+0000 7f5ff97fa640 1 -- 10.20.193.106:0/415697693 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f600405e950 con 0x7f600405d1b0 2026-02-17T05:35:48.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.459+0000 7f5ff97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:35:48.462 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.459+0000 7f5ff97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=2897863185,config=1618278320,health=3423964923,kv=675723720,logm=3626085854}) 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.459+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=1,health=12,kv=11,logm=61} crc {auth=4111937684,config=1228700967,health=2752441418,kv=675723720,logm=3007744977}) 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3236352215}) 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985653607}) 2026-02-17T05:35:48.464 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3236352215}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1851036139}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=666073093}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=263505373}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=666073093}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.460+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3728814706}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1097594517}) 2026-02-17T05:35:48.465 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712586449}) 2026-02-17T05:35:48.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1097594517}) 2026-02-17T05:35:48.466 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2347794814}) 2026-02-17T05:35:48.466 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 >> v1:10.20.193.118:6812/703720803 conn(0x7f5fd4040bf0 legacy=0x7f5fd40610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 10 monclient: shutdown 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 >> v1:10.20.193.106:6789/0 conn(0x7f600405d1b0 legacy=0x7f600412b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 shutdown_connections 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 >> 10.20.193.106:0/415697693 conn(0x7f60040915f0 msgr2=0x7f600413f830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 shutdown_connections 2026-02-17T05:35:48.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:48.461+0000 7f600ab0c640 1 -- 10.20.193.106:0/415697693 wait complete. 2026-02-17T05:35:48.472 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.472 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2834625531}) 2026-02-17T05:35:48.472 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3902705047}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2834625531}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2572700340}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1964601943}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923531978}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1964601943}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.461+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1491159565}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2988366164}) 2026-02-17T05:35:48.473 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10548943}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2988366164}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=578129518}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4185849970}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1554460785}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4185849970}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.462+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2718369972}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1791068320}) 2026-02-17T05:35:48.474 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1860422222}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1791068320}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2138357291}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2664361939}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=418169648}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2664361939}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1644059859}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3797593187}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2417852986}) 2026-02-17T05:35:48.475 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3797593187}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.463+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3657354177}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2806381895}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2296973666}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2806381895}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1446783018}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3302019959}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1184488959}) 2026-02-17T05:35:48.476 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3302019959}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=605257740}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3640310988}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4041286385}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3640310988}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.464+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3480761950}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218690291}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=162069436}) 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.477 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218690291}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=312905064}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4022844167}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3486452088}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4022844167}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.465+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=467410136}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38} crc {logm=3016801089,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=4111220771,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3783932148,osd_snap=1101096672}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39} crc {logm=3016801089,mdsmap=568353036,mgr=3072745722,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2713184690,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3783932148,osd_snap=4238207635}) 2026-02-17T05:35:48.478 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38} crc {logm=3016801089,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=4111220771,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3783932148,osd_snap=1101096672}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=44} crc {logm=4023740828,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2543400464,mon_config_key=713144630,monmap=1459694897,nvmeofgw=2188353204,osd_metadata=3070979325,osd_pg_creating=3783932148,osd_snap=2883212739}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=13,osdmap=87} crc {osd_snap=2923162937,osdmap=1965941066}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=15,osdmap=85} crc {osd_snap=2985053489,osdmap=118510792}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=13,osdmap=87} crc {osd_snap=2923162937,osdmap=1965941066}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=14,osdmap=86} crc {osd_snap=3792800343,osdmap=4074449407}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.466+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.467+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1615969442}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.467+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3633818719}) 2026-02-17T05:35:48.479 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.467+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.467+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1615969442}) 2026-02-17T05:35:48.480 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.467+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1884384193}) 2026-02-17T05:35:48.481 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:35:48.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=95} crc {osdmap=3758715437}) 2026-02-17T05:35:48.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=1472752879}) 2026-02-17T05:35:48.482 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:35:48.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=95} crc {osdmap=3758715437}) 2026-02-17T05:35:48.483 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:35:48.469+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=94} crc {osdmap=2549135768}) 2026-02-17T05:35:49.355 INFO:tasks.rados.rados.0.trial118.stdout:1859: done (3 left) 2026-02-17T05:35:49.355 INFO:tasks.rados.rados.0.trial118.stdout:1861: done (2 left) 2026-02-17T05:35:49.355 INFO:tasks.rados.rados.0.trial118.stdout:1862: done (1 left) 2026-02-17T05:35:49.355 INFO:tasks.rados.rados.0.trial118.stdout:1863: done (0 left) 2026-02-17T05:35:49.355 INFO:tasks.rados.rados.0.trial118.stdout:1864: delete oid 19 current snap is 196 2026-02-17T05:35:49.356 INFO:tasks.rados.rados.0.trial118.stdout:1864: done (0 left) 2026-02-17T05:35:49.356 INFO:tasks.rados.rados.0.trial118.stdout:1865: write oid 15 current snap is 196 2026-02-17T05:35:49.356 INFO:tasks.rados.rados.0.trial118.stdout:1865: seq_num 673 ranges {511111=481641,1599205=518558,2682027=489947} 2026-02-17T05:35:49.359 INFO:tasks.rados.rados.0.trial118.stdout:1865: writing trial11845692-15 from 511111 to 992752 tid 1 2026-02-17T05:35:49.364 INFO:tasks.rados.rados.0.trial118.stdout:1865: writing trial11845692-15 from 1599205 to 2117763 tid 2 2026-02-17T05:35:49.368 INFO:tasks.rados.rados.0.trial118.stdout:1865: writing trial11845692-15 from 2682027 to 3171974 tid 3 2026-02-17T05:35:49.368 INFO:tasks.rados.rados.0.trial118.stdout:1866: snap_remove snap 191 2026-02-17T05:35:49.369 INFO:tasks.rados.rados.0.trial118.stdout:1865: finishing write tid 1 to trial11845692-15 2026-02-17T05:35:49.482 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:35:49.482 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:35:49.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: get_monmap_and_config 2026-02-17T05:35:49.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: monmap: 2026-02-17T05:35:49.555 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.555 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:49.546463+0000 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:49.546463+0000 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 1 Processor -- start 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 1 -- start start 2026-02-17T05:35:49.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: init 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f989c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f989c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f989c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c08b060 con 0x7f989c05dee0 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c05dc90 con 0x7f989c182720 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c08d6a0 con 0x7f989c05d1b0 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f98a1ecc640 10 monclient(hunting): authenticate will time out at 1078.174808s 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f989b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f989c05d1b0 0x7f989c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51678/0 (socket says 10.20.193.106:51678) 2026-02-17T05:35:49.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.545+0000 7f989b7fe640 1 -- 10.20.193.106:0/2309306330 learned_addr learned my addr 10.20.193.106:0/2309306330 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891604459 0 0) 0x7f989c08b060 con 0x7f989c05dee0 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): my global_id is 64434 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98800035e0 con 0x7f989c05dee0 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703860193 0 0) 0x7f989c08d6a0 con 0x7f989c05d1b0 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient(hunting): my global_id is 4841 2026-02-17T05:35:49.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f989c08b060 con 0x7f989c05d1b0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 958992916 0 0) 0x7f98800035e0 con 0x7f989c05dee0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 >> v1:10.20.193.106:6790/0 conn(0x7f989c05d1b0 legacy=0x7f989c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 >> v1:10.20.193.118:6789/0 conn(0x7f989c182720 legacy=0x7f989c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 monclient: found mon.noname-a 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c057960 con 0x7f989c05dee0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f988c002dd0 con 0x7f989c05dee0 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: dump: 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.560 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 5 monclient: authenticate success, global_id 64434 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f988c003050 con 0x7f989c05dee0 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 1 -- 10.20.193.106:0/2309306330 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f988c003460 con 0x7f989c05dee0 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f989a7fc640 10 monclient: dump: 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.561 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 4 set_mon_vals no callback set 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 10 monclient: shutdown 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2309306330 >> v1:10.20.193.106:6789/0 conn(0x7f989c05dee0 legacy=0x7f989c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2309306330 shutdown_connections 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2309306330 >> 10.20.193.106:0/2309306330 conn(0x7f989c0915f0 msgr2=0x7f989c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2309306330 shutdown_connections 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.546+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2309306330 wait complete. 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient: monmap: 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.563 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 1 Processor -- start 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 1 -- start start 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient: init 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f989c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f989c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f989c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c10bda0 con 0x7f989c05d1b0 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c10c370 con 0x7f989c182720 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c05e8e0 con 0x7f989c05dee0 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f98a1ecc640 10 monclient(hunting): authenticate will time out at 1078.176862s 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f989b7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f989c05d1b0 0x7f989c128610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49964/0 (socket says 10.20.193.106:49964) 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.547+0000 7f989b7fe640 1 -- 10.20.193.106:0/2705536827 learned_addr learned my addr 10.20.193.106:0/2705536827 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359565321 0 0) 0x7f989c10bda0 con 0x7f989c05d1b0 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): my global_id is 64437 2026-02-17T05:35:49.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f986c0035e0 con 0x7f989c05d1b0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778235056 0 0) 0x7f989c05e8e0 con 0x7f989c05dee0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): my global_id is 4844 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f989c10bda0 con 0x7f989c05dee0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668786077 0 0) 0x7f986c0035e0 con 0x7f989c05d1b0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f989c05e8e0 con 0x7f989c05d1b0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98880030f0 con 0x7f989c05d1b0 2026-02-17T05:35:49.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): dump: 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.567 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3783387809 0 0) 0x7f989c10bda0 con 0x7f989c05dee0 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f986c0035e0 con 0x7f989c05dee0 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f988c003370 con 0x7f989c05dee0 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient(hunting): dump: 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.568 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3020536264 0 0) 0x7f989c05e8e0 con 0x7f989c05d1b0 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 >> v1:10.20.193.106:6790/0 conn(0x7f989c05dee0 legacy=0x7f989c180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 >> v1:10.20.193.118:6789/0 conn(0x7f989c182720 legacy=0x7f989c1141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 monclient: found mon.a 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c10a8b0 con 0x7f989c05d1b0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 5 monclient: authenticate success, global_id 64437 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _renew_subs 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f989c1824f0 con 0x7f989c05d1b0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _renew_subs 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f989c128270 con 0x7f989c05d1b0 2026-02-17T05:35:49.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98880048a0 con 0x7f989c05d1b0 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9888004bc0 con 0x7f989c05d1b0 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9899ffb640 4 set_mon_vals no callback set 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 10 monclient: dump: 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.571 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c0008d0 con 0x7f989c05d1b0 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.548+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9888011b60 con 0x7f989c05d1b0 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.549+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f988804fda0 con 0x7f989c05d1b0 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.549+0000 7f989affd640 10 monclient: get_auth_request con 0x7f986c040bb0 auth_method 0 2026-02-17T05:35:49.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.551+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9888017440 con 0x7f989c05d1b0 2026-02-17T05:35:49.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.551+0000 7f9877fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.551+0000 7f9877fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.695+0000 7f98a1ecc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.695+0000 7f98a1ecc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.695+0000 7f98a1ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.695+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f989c08e3d0 con 0x7f989c05d1b0 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.696+0000 7f9877fff640 1 -- 10.20.193.106:0/2705536827 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3572349640) 0x7f9888016bf0 con 0x7f989c05d1b0 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.696+0000 7f9877fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:49.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.696+0000 7f9877fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:49.699 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 >> v1:10.20.193.118:6812/703720803 conn(0x7f986c040bb0 legacy=0x7f986c061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 10 monclient: shutdown 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 >> v1:10.20.193.106:6789/0 conn(0x7f989c05d1b0 legacy=0x7f989c128610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 shutdown_connections 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 >> 10.20.193.106:0/2705536827 conn(0x7f989c0915f0 msgr2=0x7f989c1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 shutdown_connections 2026-02-17T05:35:49.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.697+0000 7f98a1ecc640 1 -- 10.20.193.106:0/2705536827 wait complete. 2026-02-17T05:35:49.706 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:35:49.707 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:35:49.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:35:49.707 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:35:49.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 10 monclient: get_monmap_and_config 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 10 monclient: monmap: 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:49.771738+0000 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:49.771738+0000 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.783 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 1 Processor -- start 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 1 -- start start 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.770+0000 7f9d74bee640 10 monclient: init 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-c con 0x7f9d7005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-a con 0x7f9d7005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-b con 0x7f9d70182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7008b060 con 0x7f9d7005dee0 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7005dc90 con 0x7f9d7005d1b0 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7008d6a0 con 0x7f9d70182720 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient(hunting): authenticate will time out at 1078.400140s 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6ed76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9d70182720 0x7f9d701a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51700/0 (socket says 10.20.193.106:51700) 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6ed76640 1 -- 10.20.193.106:0/503688865 learned_addr learned my addr 10.20.193.106:0/503688865 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584285135 0 0) 0x7f9d7008d6a0 con 0x7f9d70182720 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.785 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): my global_id is 4847 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d5c0035e0 con 0x7f9d70182720 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584978468 0 0) 0x7f9d7008b060 con 0x7f9d7005dee0 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.786 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient(hunting): my global_id is 64440 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7008d6a0 con 0x7f9d7005dee0 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910492534 0 0) 0x7f9d5c0035e0 con 0x7f9d70182720 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 >> v1:10.20.193.118:6789/0 conn(0x7f9d7005d1b0 legacy=0x7f9d7005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 >> v1:10.20.193.106:6789/0 conn(0x7f9d7005dee0 legacy=0x7f9d70181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 monclient: found mon.noname-b 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.787 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70057960 con 0x7f9d70182720 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d60003eb0 con 0x7f9d70182720 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:49.788 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: dump: 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.789 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 5 monclient: authenticate success, global_id 4847 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d600040b0 con 0x7f9d70182720 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.790 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 1 -- 10.20.193.106:0/503688865 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d600044c0 con 0x7f9d70182720 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 4 set_mon_vals no callback set 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d6d573640 10 monclient: dump: 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.791 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 10 monclient: shutdown 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.771+0000 7f9d74bee640 1 -- 10.20.193.106:0/503688865 >> v1:10.20.193.106:6790/0 conn(0x7f9d70182720 legacy=0x7f9d701a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- 10.20.193.106:0/503688865 shutdown_connections 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- 10.20.193.106:0/503688865 >> 10.20.193.106:0/503688865 conn(0x7f9d700915f0 msgr2=0x7f9d700919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- 10.20.193.106:0/503688865 shutdown_connections 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- 10.20.193.106:0/503688865 wait complete. 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient: monmap: 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.793 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.794 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 Processor -- start 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- start start 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient: init 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-a con 0x7f9d7005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-b con 0x7f9d7005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient(hunting): picked mon.noname-c con 0x7f9d70182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7013f6e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7012c4e0 con 0x7f9d7005dee0 2026-02-17T05:35:49.795 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7005e8e0 con 0x7f9d70182720 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d74bee640 10 monclient(hunting): authenticate will time out at 1078.401929s 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d6e575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f9d7005d1b0 0x7f9d701281c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:49974/0 (socket says 10.20.193.106:49974) 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.772+0000 7f9d6e575640 1 -- 10.20.193.106:0/1268612363 learned_addr learned my addr 10.20.193.106:0/1268612363 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35510861 0 0) 0x7f9d7013f6e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.796 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): my global_id is 64443 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d3c0035e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745454288 0 0) 0x7f9d7005e8e0 con 0x7f9d70182720 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): my global_id is 4850 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7013f6e0 con 0x7f9d70182720 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3967415760 0 0) 0x7f9d3c0035e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d7005e8e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.797 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d64003170 con 0x7f9d7005d1b0 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): dump: 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.798 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2610334968 0 0) 0x7f9d7013f6e0 con 0x7f9d70182720 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d3c0035e0 con 0x7f9d70182720 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d60003c10 con 0x7f9d70182720 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient(hunting): dump: 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.800 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 287524072 0 0) 0x7f9d7005e8e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6790/0 conn(0x7f9d70182720 legacy=0x7f9d70181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.118:6789/0 conn(0x7f9d7005dee0 legacy=0x7f9d701288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 monclient: found mon.a 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7012bd00 con 0x7f9d7005d1b0 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 5 monclient: authenticate success, global_id 64443 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 10 monclient: _renew_subs 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d70128fe0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 10 monclient: _renew_subs 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d7005c750 con 0x7f9d7005d1b0 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d640034e0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d64003b30 con 0x7f9d7005d1b0 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d56ffd640 10 monclient: dump: 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.803 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d6cd72640 4 set_mon_vals no callback set 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.773+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d701824f0 con 0x7f9d70058d40 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9d64003c90 con 0x7f9d7005d1b0 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f9d6404fed0 con 0x7f9d7005d1b0 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857804946 0 0) 0x7f9d701824f0 con 0x7f9d70058d40 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient(hunting): my global_id is 64446 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7005e8e0 con 0x7f9d70058d40 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d6ed76640 10 monclient: get_auth_request con 0x7f9d3c040bb0 auth_method 0 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2046881584 0 0) 0x7f9d7005e8e0 con 0x7f9d70058d40 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d701824f0 con 0x7f9d70058d40 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d58002fc0 con 0x7f9d70058d40 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient: dump: 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.805 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3417403758 0 0) 0x7f9d701824f0 con 0x7f9d70058d40 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d70057ca0 con 0x7f9d70058d40 2026-02-17T05:35:49.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9d580032b0 con 0x7f9d70058d40 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6789/0 conn(0x7f9d70058d40 legacy=0x7f9d70059110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.774+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6789/0 conn(0x7f9d70058d40 legacy=0x7f9d70059110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d74bee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d70059bf0 con 0x7f9d70059820 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805530498 0 0) 0x7f9d70059bf0 con 0x7f9d70059820 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient(hunting): my global_id is 64449 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d701824f0 con 0x7f9d70059820 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2455756076 0 0) 0x7f9d701824f0 con 0x7f9d70059820 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d70059bf0 con 0x7f9d70059820 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9d580039b0 con 0x7f9d70059820 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 10 monclient: dump: 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.808 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 884768528 0 0) 0x7f9d70059bf0 con 0x7f9d70059820 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.778+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d7008e3d0 con 0x7f9d70059820 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 99866522) 0x7f9d58005e00 con 0x7f9d70059820 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d56ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d56ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6789/0 conn(0x7f9d70059820 legacy=0x7f9d70197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d56ffd640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6789/0 conn(0x7f9d70059820 legacy=0x7f9d70197330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:49.809 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 347316, 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 1, 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.810 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.811 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:49.812 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.813 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.814 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.815 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.816 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.817 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:49.818 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:49.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.118:6812/703720803 conn(0x7f9d3c040bb0 legacy=0x7f9d3c061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 10 monclient: shutdown 2026-02-17T05:35:49.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 >> v1:10.20.193.106:6789/0 conn(0x7f9d7005d1b0 legacy=0x7f9d701281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d6ed76640 1 -- 10.20.193.106:0/1268612363 reap_dead start 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d6ed76640 1 -- 10.20.193.106:0/1268612363 reap_dead start 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 shutdown_connections 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 >> 10.20.193.106:0/1268612363 conn(0x7f9d700915f0 msgr2=0x7f9d7005bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 shutdown_connections 2026-02-17T05:35:49.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.779+0000 7f9d74bee640 1 -- 10.20.193.106:0/1268612363 wait complete. 2026-02-17T05:35:49.820 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:49.820 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:35:49.820 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: monmap: 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:49.886447+0000 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:49.886447+0000 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.887 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.888 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.888 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:49.888 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:49.888 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 1 Processor -- start 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 1 -- start start 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: init 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:49.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-b con 0x7f3f8805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-c con 0x7f3f8805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-a con 0x7f3f88182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8808b060 con 0x7f3f88182720 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8805dc90 con 0x7f3f8805dee0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8808d6a0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f9010c640 10 monclient(hunting): authenticate will time out at 1078.514870s 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f8de81640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3f8805d1b0 0x7f3f8805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51716/0 (socket says 10.20.193.106:51716) 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.885+0000 7f3f8de81640 1 -- 10.20.193.106:0/4042094477 learned_addr learned my addr 10.20.193.106:0/4042094477 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351184171 0 0) 0x7f3f8808d6a0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): my global_id is 4853 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f700035e0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985313637 0 0) 0x7f3f8808b060 con 0x7f3f88182720 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): my global_id is 64452 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8808d6a0 con 0x7f3f88182720 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165119995 0 0) 0x7f3f8805dc90 con 0x7f3f8805dee0 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient(hunting): my global_id is 94129 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8808b060 con 0x7f3f8805dee0 2026-02-17T05:35:49.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1697923723 0 0) 0x7f3f700035e0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 >> v1:10.20.193.118:6789/0 conn(0x7f3f8805dee0 legacy=0x7f3f88181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 >> v1:10.20.193.106:6789/0 conn(0x7f3f88182720 legacy=0x7f3f881a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 monclient: found mon.noname-b 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88057960 con 0x7f3f8805d1b0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f78002dd0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 5 monclient: authenticate success, global_id 4853 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: dump: 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f78002fa0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 1 -- 10.20.193.106:0/4042094477 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f780033b0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f8ce7f640 10 monclient: dump: 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 4 set_mon_vals no callback set 2026-02-17T05:35:49.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 10 monclient: shutdown 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 1 -- 10.20.193.106:0/4042094477 >> v1:10.20.193.106:6790/0 conn(0x7f3f8805d1b0 legacy=0x7f3f8805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 1 -- 10.20.193.106:0/4042094477 shutdown_connections 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 1 -- 10.20.193.106:0/4042094477 >> 10.20.193.106:0/4042094477 conn(0x7f3f880915f0 msgr2=0x7f3f880919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 1 -- 10.20.193.106:0/4042094477 shutdown_connections 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.886+0000 7f3f9010c640 1 -- 10.20.193.106:0/4042094477 wait complete. 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient: monmap: 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.902 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 1 Processor -- start 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 1 -- start start 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient: init 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-a con 0x7f3f8805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-c con 0x7f3f8805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient(hunting): picked mon.noname-b con 0x7f3f88182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8812b890 con 0x7f3f8805d1b0 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8805c700 con 0x7f3f88182720 2026-02-17T05:35:49.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8805e8e0 con 0x7f3f8805dee0 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f9010c640 10 monclient(hunting): authenticate will time out at 1078.516658s 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f8d680640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3f8805dee0 0x7f3f88180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51728/0 (socket says 10.20.193.106:51728) 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f8de81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f3f8805d1b0 0x7f3f881a3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50006/0 (socket says 10.20.193.106:50006) 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f8d680640 1 -- 10.20.193.106:0/697268151 learned_addr learned my addr 10.20.193.106:0/697268151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084105071 0 0) 0x7f3f8805e8e0 con 0x7f3f8805dee0 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): my global_id is 4856 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f580035e0 con 0x7f3f8805dee0 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387150808 0 0) 0x7f3f8812b890 con 0x7f3f8805d1b0 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 10 monclient(hunting): my global_id is 64455 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.887+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8805e8e0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2231196846 0 0) 0x7f3f580035e0 con 0x7f3f8805dee0 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f8812b890 con 0x7f3f8805dee0 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f7c0030f0 con 0x7f3f8805dee0 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): dump: 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.905 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988029049 0 0) 0x7f3f8805c700 con 0x7f3f88182720 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): my global_id is 94132 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f580035e0 con 0x7f3f88182720 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3014069228 0 0) 0x7f3f8805e8e0 con 0x7f3f8805d1b0 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f8805c700 con 0x7f3f8805d1b0 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f78002890 con 0x7f3f8805d1b0 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:49.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): dump: 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2676085560 0 0) 0x7f3f8812b890 con 0x7f3f8805dee0 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.118:6789/0 conn(0x7f3f88182720 legacy=0x7f3f8812e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6789/0 conn(0x7f3f8805d1b0 legacy=0x7f3f881a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: _finish_hunting 0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 monclient: found mon.c 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8812bda0 con 0x7f3f8805dee0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: _finish_auth 0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: _check_auth_tickets 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 5 monclient: authenticate success, global_id 4856 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 10 monclient: _renew_subs 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8812c080 con 0x7f3f8805dee0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 10 monclient: _renew_subs 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f881824f0 con 0x7f3f8805dee0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f7c0032c0 con 0x7f3f8805dee0 2026-02-17T05:35:49.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f7c003b30 con 0x7f3f8805dee0 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f77fff640 4 set_mon_vals no callback set 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient: dump: 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.909 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f8808a4d0 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333974057 0 0) 0x7f3f8808a4d0 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 10 monclient(hunting): my global_id is 4859 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8812b890 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.888+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3f7c003c90 con 0x7f3f8805dee0 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f3f7c04fd40 con 0x7f3f8805dee0 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2570938679 0 0) 0x7f3f8812b890 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f8808a4d0 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f78004d00 con 0x7f3f881a3d10 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 10 monclient: dump: 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3216179414 0 0) 0x7f3f8808a4d0 con 0x7f3f881a3d10 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f88057ca0 con 0x7f3f881a3d10 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f8e682640 10 monclient: get_auth_request con 0x7f3f58040d10 auth_method 0 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3f78007a20 con 0x7f3f881a3d10 2026-02-17T05:35:49.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6790/0 conn(0x7f3f881a3d10 legacy=0x7f3f88058d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.889+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6790/0 conn(0x7f3f881a3d10 legacy=0x7f3f88058d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.892+0000 7f3f9010c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.892+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f881299f0 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051638873 0 0) 0x7f3f88057960 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient(hunting): my global_id is 4862 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8808a4d0 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1478271294 0 0) 0x7f3f8808a4d0 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f88057960 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3f780054f0 con 0x7f3f881295f0 2026-02-17T05:35:49.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient: dump: 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2172806002 0 0) 0x7f3f88057960 con 0x7f3f881295f0 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f88055570 con 0x7f3f881295f0 2026-02-17T05:35:49.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 3131847979) 0x7f3f78005650 con 0x7f3f881295f0 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6790/0 conn(0x7f3f881295f0 legacy=0x7f3f88059430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f767fc640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6790/0 conn(0x7f3f881295f0 legacy=0x7f3f88059430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:35:49.914 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 474654, 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.915 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.916 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:49.917 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:49.918 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:49.919 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.920 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.921 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.922 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.923 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:49.924 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:49.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.118:6812/703720803 conn(0x7f3f58040d10 legacy=0x7f3f580611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 10 monclient: shutdown 2026-02-17T05:35:49.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:49.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 >> v1:10.20.193.106:6790/0 conn(0x7f3f8805dee0 legacy=0x7f3f88180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:49.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f8e682640 1 -- 10.20.193.106:0/697268151 reap_dead start 2026-02-17T05:35:49.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f8e682640 1 -- 10.20.193.106:0/697268151 reap_dead start 2026-02-17T05:35:49.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 shutdown_connections 2026-02-17T05:35:49.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 >> 10.20.193.106:0/697268151 conn(0x7f3f880915f0 msgr2=0x7f3f880885f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:49.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 shutdown_connections 2026-02-17T05:35:49.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.893+0000 7f3f9010c640 1 -- 10.20.193.106:0/697268151 wait complete. 2026-02-17T05:35:49.926 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:49.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:35:49.926 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: get_monmap_and_config 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: build_initial_monmap 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: monmap: 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:49.991582+0000 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:49.991582+0000 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:49.992 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:49.993 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:49.993 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:49.993 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 1 Processor -- start 2026-02-17T05:35:50.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 1 -- start start 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: init 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-b con 0x7fc8f405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-a con 0x7fc8f405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-c con 0x7fc8f4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f408b060 con 0x7fc8f405dee0 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f405dc90 con 0x7fc8f4182720 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f408d6a0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.990+0000 7fc8fc70c640 10 monclient(hunting): authenticate will time out at 1078.619950s 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fa481640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc8f405d1b0 0x7fc8f405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51754/0 (socket says 10.20.193.106:51754) 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fa481640 1 -- 10.20.193.106:0/2777189879 learned_addr learned my addr 10.20.193.106:0/2777189879 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976550649 0 0) 0x7fc8f408d6a0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): my global_id is 4865 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8dc0035e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623977283 0 0) 0x7fc8f408b060 con 0x7fc8f405dee0 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient(hunting): my global_id is 64458 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f408d6a0 con 0x7fc8f405dee0 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 646479397 0 0) 0x7fc8dc0035e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 >> v1:10.20.193.118:6789/0 conn(0x7fc8f4182720 legacy=0x7fc8f41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 >> v1:10.20.193.106:6789/0 conn(0x7fc8f405dee0 legacy=0x7fc8f4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 monclient: found mon.noname-b 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f4057960 con 0x7fc8f405d1b0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e4002dd0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 5 monclient: authenticate success, global_id 4865 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: dump: 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.004 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8e4002fd0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 1 -- 10.20.193.106:0/2777189879 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e40033e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 4 set_mon_vals no callback set 2026-02-17T05:35:50.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8f947f640 10 monclient: dump: 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 10 monclient: shutdown 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2777189879 >> v1:10.20.193.106:6790/0 conn(0x7fc8f405d1b0 legacy=0x7fc8f405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2777189879 shutdown_connections 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2777189879 >> 10.20.193.106:0/2777189879 conn(0x7fc8f40915f0 msgr2=0x7fc8f40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2777189879 shutdown_connections 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.991+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2777189879 wait complete. 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient: build_initial_monmap 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient: monmap: 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:50.007 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 1 Processor -- start 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 1 -- start start 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient: init 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-a con 0x7fc8f405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-b con 0x7fc8f405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient(hunting): picked mon.noname-c con 0x7fc8f4182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f410e7f0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f410edb0 con 0x7fc8f405dee0 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f412ad70 con 0x7fc8f4182720 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fc70c640 10 monclient(hunting): authenticate will time out at 1078.621579s 2026-02-17T05:35:50.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fac82640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc8f4182720 0x7fc8f4181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51770/0 (socket says 10.20.193.106:51770) 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fa481640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc8f405d1b0 0x7fc8f4129f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50018/0 (socket says 10.20.193.106:50018) 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8fac82640 1 -- 10.20.193.106:0/2114198747 learned_addr learned my addr 10.20.193.106:0/2114198747 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873875907 0 0) 0x7fc8f410e7f0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): my global_id is 64461 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8c40035e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612216618 0 0) 0x7fc8f412ad70 con 0x7fc8f4182720 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 10 monclient(hunting): my global_id is 4868 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f410e7f0 con 0x7fc8f4182720 2026-02-17T05:35:50.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.992+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 972622574 0 0) 0x7fc8c40035e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f412ad70 con 0x7fc8f405d1b0 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e4002ce0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): dump: 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1909903898 0 0) 0x7fc8f410e7f0 con 0x7fc8f4182720 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8c40035e0 con 0x7fc8f4182720 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8f0005110 con 0x7fc8f4182720 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): dump: 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.011 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808471138 0 0) 0x7fc8f410edb0 con 0x7fc8f405dee0 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient(hunting): my global_id is 94135 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f410e7f0 con 0x7fc8f405dee0 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1140877933 0 0) 0x7fc8f412ad70 con 0x7fc8f405d1b0 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.106:6790/0 conn(0x7fc8f4182720 legacy=0x7fc8f4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6789/0 conn(0x7fc8f405dee0 legacy=0x7fc8f412a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 monclient: found mon.a 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f408a0e0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 5 monclient: authenticate success, global_id 64461 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 10 monclient: _renew_subs 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4089af0 con 0x7fc8f405d1b0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 10 monclient: _renew_subs 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8f410e510 con 0x7fc8f405d1b0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8e4004b50 con 0x7fc8f405d1b0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e4004f30 con 0x7fc8f405d1b0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:50.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8f8c7e640 4 set_mon_vals no callback set 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 10 monclient: dump: 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc8f412df80 con 0x7fc8f410d5b0 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.993+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc8e4005090 con 0x7fc8f405d1b0 2026-02-17T05:35:50.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7fc8e404fe30 con 0x7fc8f405d1b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8fac82640 10 monclient: get_auth_request con 0x7fc8c4040d80 auth_method 0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591086295 0 0) 0x7fc8f412df80 con 0x7fc8f410d5b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient(hunting): my global_id is 94138 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f412ad70 con 0x7fc8f410d5b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2869771822 0 0) 0x7fc8f412ad70 con 0x7fc8f410d5b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f412df80 con 0x7fc8f410d5b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e8002d90 con 0x7fc8f410d5b0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 10 monclient: dump: 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.015 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3713732958 0 0) 0x7fc8f412df80 con 0x7fc8f410d5b0 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.994+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8f4057ca0 con 0x7fc8f410d5b0 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.995+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc8e8005290 con 0x7fc8f410d5b0 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.995+0000 7fc8daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.995+0000 7fc8daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.995+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6789/0 conn(0x7fc8f410d5b0 legacy=0x7fc8f4059040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.995+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6789/0 conn(0x7fc8f410d5b0 legacy=0x7fc8f4059040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8fc70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc8f412d8a0 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580691842 0 0) 0x7fc8f412d8a0 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 10 monclient(hunting): my global_id is 94141 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.998+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f412df80 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2786471130 0 0) 0x7fc8f412df80 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f412d8a0 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc8e8003890 con 0x7fc8f412d4d0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 10 monclient: dump: 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.017 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1497875205 0 0) 0x7fc8f412d8a0 con 0x7fc8f412d4d0 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc8f410e180 con 0x7fc8f412d4d0 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2963801088) 0x7fc8e8004dd0 con 0x7fc8f412d4d0 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6789/0 conn(0x7fc8f412d4d0 legacy=0x7fc8f4059750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8daffd640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6789/0 conn(0x7fc8f412d4d0 legacy=0x7fc8f4059750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 26, 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 2241, 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:35:50.019 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:50.020 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:50.021 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:50.022 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:35:50.023 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:50.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:50.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:35:50.026 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:50.027 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:35:50.028 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.118:6812/703720803 conn(0x7fc8c4040d80 legacy=0x7fc8c4061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 10 monclient: shutdown 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 >> v1:10.20.193.106:6789/0 conn(0x7fc8f405d1b0 legacy=0x7fc8f4129f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fac82640 1 -- 10.20.193.106:0/2114198747 reap_dead start 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 shutdown_connections 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 >> 10.20.193.106:0/2114198747 conn(0x7fc8f40915f0 msgr2=0x7fc8f405bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 shutdown_connections 2026-02-17T05:35:50.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:49.999+0000 7fc8fc70c640 1 -- 10.20.193.106:0/2114198747 wait complete. 2026-02-17T05:35:50.030 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:35:50.030 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:35:50.030 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:35:50.030 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:35:50.030 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2026-02-17T05:35:50.030 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2026-02-17T05:35:50.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.094+0000 7f1c4079d640 10 monclient: get_monmap_and_config 2026-02-17T05:35:50.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.094+0000 7f1c4079d640 10 monclient: build_initial_monmap 2026-02-17T05:35:50.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.094+0000 7f1c4079d640 10 monclient: monmap: 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:50.096173+0000 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:50.096173+0000 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:50.097 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 1 Processor -- start 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 1 -- start start 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient: init 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-a con 0x7f1c3805d300 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-c con 0x7f1c38140420 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-b con 0x7f1c38140860 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3805dde0 con 0x7f1c3805d300 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3808c2a0 con 0x7f1c38140420 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3808d5c0 con 0x7f1c38140860 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c4079d640 10 monclient(hunting): authenticate will time out at 1078.724567s 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3e512640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1c3805d300 0x7f1c3805d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:50026/0 (socket says 10.20.193.106:50026) 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3e512640 1 -- 10.20.193.106:0/2324752120 learned_addr learned my addr 10.20.193.106:0/2324752120 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3ed13640 1 --1- 10.20.193.106:0/2324752120 >> v1:10.20.193.106:6790/0 conn(0x7f1c38140860 0x7f1c381a28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51774/0 (socket says 10.20.193.106:51774) 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213152588 0 0) 0x7f1c3808d5c0 con 0x7f1c38140860 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): my global_id is 4871 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c200035e0 con 0x7f1c38140860 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395976846 0 0) 0x7f1c3805dde0 con 0x7f1c3805d300 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 10 monclient(hunting): my global_id is 64464 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.095+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3808d5c0 con 0x7f1c3805d300 2026-02-17T05:35:50.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3690291615 0 0) 0x7f1c200035e0 con 0x7f1c38140860 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 >> v1:10.20.193.118:6789/0 conn(0x7f1c38140420 legacy=0x7f1c38181190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 >> v1:10.20.193.106:6789/0 conn(0x7f1c3805d300 legacy=0x7f1c3805d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 monclient: found mon.noname-b 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c38057880 con 0x7f1c38140860 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c34003eb0 con 0x7f1c38140860 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 5 monclient: authenticate success, global_id 4871 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: dump: 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.105 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c340040c0 con 0x7f1c38140860 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 1 -- 10.20.193.106:0/2324752120 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c340044d0 con 0x7f1c38140860 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 4 set_mon_vals no callback set 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c3d510640 10 monclient: dump: 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.106 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 10 monclient: shutdown 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 -- 10.20.193.106:0/2324752120 >> v1:10.20.193.106:6790/0 conn(0x7f1c38140860 legacy=0x7f1c381a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 -- 10.20.193.106:0/2324752120 shutdown_connections 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 -- 10.20.193.106:0/2324752120 >> 10.20.193.106:0/2324752120 conn(0x7f1c38054ef0 msgr2=0x7f1c38090ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 -- 10.20.193.106:0/2324752120 shutdown_connections 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 -- 10.20.193.106:0/2324752120 wait complete. 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 10 monclient: build_initial_monmap 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 10 monclient: monmap: 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:50.107 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.096+0000 7f1c4079d640 1 Processor -- start 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- start start 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: init 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-c con 0x7f1c3805d300 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-b con 0x7f1c38140420 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient(hunting): picked mon.noname-a con 0x7f1c38140860 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3805e8c0 con 0x7f1c38140860 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3812d550 con 0x7f1c38140420 2026-02-17T05:35:50.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3812c250 con 0x7f1c3805d300 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient(hunting): authenticate will time out at 1078.726281s 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c3e512640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1c3805d300 0x7f1c38139d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51780/0 (socket says 10.20.193.106:51780) 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c3e512640 1 -- 10.20.193.106:0/3100709302 learned_addr learned my addr 10.20.193.106:0/3100709302 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404356045 0 0) 0x7f1c3805e8c0 con 0x7f1c38140860 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): my global_id is 64467 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c080035e0 con 0x7f1c38140860 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430694362 0 0) 0x7f1c3812c250 con 0x7f1c3805d300 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): my global_id is 4874 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3805e8c0 con 0x7f1c3805d300 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1089735564 0 0) 0x7f1c080035e0 con 0x7f1c38140860 2026-02-17T05:35:50.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c3812c250 con 0x7f1c38140860 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c340043e0 con 0x7f1c38140860 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): dump: 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2491334718 0 0) 0x7f1c3805e8c0 con 0x7f1c3805d300 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c080035e0 con 0x7f1c3805d300 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c28003170 con 0x7f1c3805d300 2026-02-17T05:35:50.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient(hunting): dump: 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 212515377 0 0) 0x7f1c3812c250 con 0x7f1c38140860 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6790/0 conn(0x7f1c3805d300 legacy=0x7f1c38139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.118:6789/0 conn(0x7f1c38140420 legacy=0x7f1c38193870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 monclient: found mon.a 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3813d5e0 con 0x7f1c38140860 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 5 monclient: authenticate success, global_id 64467 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _renew_subs 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3812b4d0 con 0x7f1c38140860 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _renew_subs 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c3813a420 con 0x7f1c38140860 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c340039b0 con 0x7f1c38140860 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c34004580 con 0x7f1c38140860 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c1effd640 10 monclient: dump: 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.112 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.097+0000 7f1c3cd0f640 4 set_mon_vals no callback set 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c4079d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c381528c0 con 0x7f1c381524f0 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1c34012c20 con 0x7f1c38140860 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f1c34050ed0 con 0x7f1c38140860 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879321926 0 0) 0x7f1c381528c0 con 0x7f1c381524f0 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient(hunting): my global_id is 64470 2026-02-17T05:35:50.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3812c250 con 0x7f1c381524f0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4228540255 0 0) 0x7f1c3812c250 con 0x7f1c381524f0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c381528c0 con 0x7f1c381524f0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c280048a0 con 0x7f1c381524f0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient: dump: 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c3dd11640 10 monclient: get_auth_request con 0x7f1c08040bf0 auth_method 0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4087928866 0 0) 0x7f1c381528c0 con 0x7f1c381524f0 2026-02-17T05:35:50.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c3808be60 con 0x7f1c381524f0 2026-02-17T05:35:50.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1c28006a40 con 0x7f1c381524f0 2026-02-17T05:35:50.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.098+0000 7f1c1effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:50.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.099+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6789/0 conn(0x7f1c381524f0 legacy=0x7f1c38087e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.099+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6789/0 conn(0x7f1c381524f0 legacy=0x7f1c38087e70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c4079d640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c3812d0f0 con 0x7f1c38088580 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612432375 0 0) 0x7f1c3812d0f0 con 0x7f1c38088580 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient(hunting): my global_id is 64473 2026-02-17T05:35:50.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c381528c0 con 0x7f1c38088580 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2364615194 0 0) 0x7f1c381528c0 con 0x7f1c38088580 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c3812d0f0 con 0x7f1c38088580 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1c28005100 con 0x7f1c38088580 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.102+0000 7f1c1effd640 10 monclient: dump: 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 156993004 0 0) 0x7f1c3812d0f0 con 0x7f1c38088580 2026-02-17T05:35:50.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f1c380554e0 con 0x7f1c38088580 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f1c28006510 con 0x7f1c38088580 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6789/0 conn(0x7f1c38088580 legacy=0x7f1c381976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c1effd640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6789/0 conn(0x7f1c38088580 legacy=0x7f1c381976c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stdout: "ret": 0, 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-17T05:35:50.118 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:35:50.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.118:6812/703720803 conn(0x7f1c08040bf0 legacy=0x7f1c080610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 10 monclient: shutdown 2026-02-17T05:35:50.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 >> v1:10.20.193.106:6789/0 conn(0x7f1c38140860 legacy=0x7f1c38194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c3ed13640 1 -- 10.20.193.106:0/3100709302 reap_dead start 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c3ed13640 1 -- 10.20.193.106:0/3100709302 reap_dead start 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 shutdown_connections 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 >> 10.20.193.106:0/3100709302 conn(0x7f1c38054ef0 msgr2=0x7f1c3805c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 shutdown_connections 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.103+0000 7f1c4079d640 1 -- 10.20.193.106:0/3100709302 wait complete. 2026-02-17T05:35:50.120 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:35:50.120 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:35:50.120 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:35:50.131 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:35:50.131 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:35:50.131 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:35:50.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 10 monclient: get_monmap_and_config 2026-02-17T05:35:50.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 10 monclient: build_initial_monmap 2026-02-17T05:35:50.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 10 monclient: monmap: 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:50.234695+0000 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:50.234695+0000 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 1 Processor -- start 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 1 -- start start 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.233+0000 7f91cfccc640 10 monclient: init 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-a con 0x7f91c805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-c con 0x7f91c8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c808b060 con 0x7f91c805d1b0 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c805dc90 con 0x7f91c8182720 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cda41640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f91c805d1b0 legacy=0x7f91c805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c808d6a0 con 0x7f91c805dee0 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient(hunting): authenticate will time out at 1078.863101s 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cd240640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f91c805dee0 0x7f91c8181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51804/0 (socket says 10.20.193.106:51804) 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cd240640 1 -- 10.20.193.106:0/3159089794 learned_addr learned my addr 10.20.193.106:0/3159089794 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883445410 0 0) 0x7f91c808d6a0 con 0x7f91c805dee0 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient(hunting): my global_id is 4877 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b00035e0 con 0x7f91c805dee0 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1683396023 0 0) 0x7f91b00035e0 con 0x7f91c805dee0 2026-02-17T05:35:50.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 >> v1:10.20.193.118:6789/0 conn(0x7f91c8182720 legacy=0x7f91c81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 >> v1:10.20.193.106:6789/0 conn(0x7f91c805d1b0 legacy=0x7f91c805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 monclient: found mon.noname-b 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8057960 con 0x7f91c805dee0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91bc002dd0 con 0x7f91c805dee0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:50.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: dump: 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 5 monclient: authenticate success, global_id 4877 2026-02-17T05:35:50.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91bc003090 con 0x7f91c805dee0 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 1 -- 10.20.193.106:0/3159089794 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91bc0034a0 con 0x7f91c805dee0 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cca3f640 10 monclient: dump: 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.248 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 4 set_mon_vals no callback set 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 10 monclient: shutdown 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- 10.20.193.106:0/3159089794 >> v1:10.20.193.106:6790/0 conn(0x7f91c805dee0 legacy=0x7f91c8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- 10.20.193.106:0/3159089794 shutdown_connections 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- 10.20.193.106:0/3159089794 >> 10.20.193.106:0/3159089794 conn(0x7f91c80915f0 msgr2=0x7f91c80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- 10.20.193.106:0/3159089794 shutdown_connections 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.234+0000 7f91cfccc640 1 -- 10.20.193.106:0/3159089794 wait complete. 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient: build_initial_monmap 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient: monmap: 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:50.250 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 1 Processor -- start 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 1 -- start start 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient: init 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-a con 0x7f91c805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-c con 0x7f91c805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c805e950 con 0x7f91c805d1b0 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c810ca00 con 0x7f91c8182720 2026-02-17T05:35:50.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c812bf20 con 0x7f91c805dee0 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cfccc640 10 monclient(hunting): authenticate will time out at 1078.864862s 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cda41640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f91c805d1b0 legacy=0x7f91c812b100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cd240640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f91c805dee0 0x7f91c812b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51812/0 (socket says 10.20.193.106:51812) 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.235+0000 7f91cd240640 1 -- 10.20.193.106:0/2849179521 learned_addr learned my addr 10.20.193.106:0/2849179521 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246715517 0 0) 0x7f91c812bf20 con 0x7f91c805dee0 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): my global_id is 4880 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91980035e0 con 0x7f91c805dee0 2026-02-17T05:35:50.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2057442596 0 0) 0x7f91980035e0 con 0x7f91c805dee0 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91c812bf20 con 0x7f91c805dee0 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91bc0033b0 con 0x7f91c805dee0 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): dump: 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.253 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 779943157 0 0) 0x7f91c812bf20 con 0x7f91c805dee0 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 >> v1:10.20.193.118:6789/0 conn(0x7f91c8182720 legacy=0x7f91c8181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 >> v1:10.20.193.106:6789/0 conn(0x7f91c805d1b0 legacy=0x7f91c812b100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: _finish_hunting 0 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 monclient: found mon.c 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c810bb90 con 0x7f91c805dee0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: _finish_auth 0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: _check_auth_tickets 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 5 monclient: authenticate success, global_id 4880 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _renew_subs 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91c810a6a0 con 0x7f91c805dee0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _renew_subs 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f91c810c160 con 0x7f91c805dee0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91bc004cb0 con 0x7f91c805dee0 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:50.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91bc004fd0 con 0x7f91c805dee0 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 10 monclient: dump: 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:50.256 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b7fff640 4 set_mon_vals no callback set 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c810c5f0 con 0x7f91c805dee0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.236+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f91bc011f70 con 0x7f91c805dee0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.237+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f91bc04ffe0 con 0x7f91c805dee0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.237+0000 7f91cda41640 10 monclient: get_auth_request con 0x7f9198040550 auth_method 0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.239+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f91c810c5f0 con 0x7f91c805dee0 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.239+0000 7f91b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:50.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.239+0000 7f91b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:50.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.384+0000 7f91cfccc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:35:50.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.384+0000 7f91cfccc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:50.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.384+0000 7f91cfccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:50.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.384+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f91c8057ca0 con 0x7f91c805dee0 2026-02-17T05:35:50.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.385+0000 7f91b67fc640 1 -- 10.20.193.106:0/2849179521 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3960156776) 0x7f91bc0176e0 con 0x7f91c805dee0 2026-02-17T05:35:50.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.385+0000 7f91b67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:50.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.385+0000 7f91b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:50.387 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 >> v1:10.20.193.118:6812/703720803 conn(0x7f9198040550 legacy=0x7f9198060a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 10 monclient: shutdown 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 >> v1:10.20.193.106:6790/0 conn(0x7f91c805dee0 legacy=0x7f91c812b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 shutdown_connections 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 >> 10.20.193.106:0/2849179521 conn(0x7f91c80915f0 msgr2=0x7f91c808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 shutdown_connections 2026-02-17T05:35:50.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:50.386+0000 7f91cfccc640 1 -- 10.20.193.106:0/2849179521 wait complete. 2026-02-17T05:35:53.396 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:35:53.474 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 10 monclient: get_monmap_and_config 2026-02-17T05:35:53.475 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 10 monclient: build_initial_monmap 2026-02-17T05:35:53.475 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 10 monclient: monmap: 2026-02-17T05:35:53.475 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:53.475 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:53.475 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:53.461775+0000 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:53.461775+0000 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:53.476 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 1 Processor -- start 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 1 -- start start 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.460+0000 7f3b647a5640 10 monclient: init 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:53.477 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b5c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-b con 0x7f3b5c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b5c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c08b060 con 0x7f3b5c182720 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c05dc90 con 0x7f3b5c05d1b0 2026-02-17T05:35:53.478 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c08d6a0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient(hunting): authenticate will time out at 1082.090138s 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b62d1b640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3b5c182720 legacy=0x7f3b5c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61d19640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3b5c05dee0 0x7f3b5c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51828/0 (socket says 10.20.193.106:51828) 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61d19640 1 -- 10.20.193.106:0/2530154902 learned_addr learned my addr 10.20.193.106:0/2530154902 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:53.479 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666892338 0 0) 0x7f3b5c08d6a0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient(hunting): _negotiate 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient(hunting): my global_id is 4883 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b440035e0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.480 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420158046 0 0) 0x7f3b440035e0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 >> v1:10.20.193.118:6789/0 conn(0x7f3b5c05d1b0 legacy=0x7f3b5c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 >> v1:10.20.193.106:6789/0 conn(0x7f3b5c182720 legacy=0x7f3b5c1a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: _finish_hunting 0 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 monclient: found mon.noname-b 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:53.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c057960 con 0x7f3b5c05dee0 2026-02-17T05:35:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: _finish_auth 0 2026-02-17T05:35:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: _check_auth_tickets 2026-02-17T05:35:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3b50002dd0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 5 monclient: authenticate success, global_id 4883 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: dump: 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:53.483 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:53.484 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b50003090 con 0x7f3b5c05dee0 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient: get_monmap_and_config success 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 1 -- 10.20.193.106:0/2530154902 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3b500034a0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 4 set_mon_vals no callback set 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b61518640 10 monclient: dump: 2026-02-17T05:35:53.486 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:53.487 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 10 monclient: shutdown 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- 10.20.193.106:0/2530154902 >> v1:10.20.193.106:6790/0 conn(0x7f3b5c05dee0 legacy=0x7f3b5c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- 10.20.193.106:0/2530154902 shutdown_connections 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- 10.20.193.106:0/2530154902 >> 10.20.193.106:0/2530154902 conn(0x7f3b5c0915f0 msgr2=0x7f3b5c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- 10.20.193.106:0/2530154902 shutdown_connections 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.461+0000 7f3b647a5640 1 -- 10.20.193.106:0/2530154902 wait complete. 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient: build_initial_monmap 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient: monmap: 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:35:53.489 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 1 Processor -- start 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 1 -- start start 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient: init 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b5c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-b con 0x7f3b5c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b5c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c10a710 con 0x7f3b5c05d1b0 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c10a9f0 con 0x7f3b5c05dee0 2026-02-17T05:35:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c05cdb0 con 0x7f3b5c182720 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b647a5640 10 monclient(hunting): authenticate will time out at 1082.091752s 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b6251a640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3b5c05d1b0 legacy=0x7f3b5c132160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b62d1b640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3b5c182720 0x7f3b5c133170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:51840/0 (socket says 10.20.193.106:51840) 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b62d1b640 1 -- 10.20.193.106:0/1898826823 learned_addr learned my addr 10.20.193.106:0/1898826823 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658194952 0 0) 0x7f3b5c05cdb0 con 0x7f3b5c182720 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 10 monclient(hunting): my global_id is 4886 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.462+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2c0035e0 con 0x7f3b5c182720 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3772378100 0 0) 0x7f3b2c0035e0 con 0x7f3b5c182720 2026-02-17T05:35:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b5c05cdb0 con 0x7f3b5c182720 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3b580051c0 con 0x7f3b5c182720 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient(hunting): dump: 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:53.493 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2349324961 0 0) 0x7f3b5c05cdb0 con 0x7f3b5c182720 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 >> v1:10.20.193.118:6789/0 conn(0x7f3b5c05dee0 legacy=0x7f3b5c180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 >> v1:10.20.193.106:6789/0 conn(0x7f3b5c05d1b0 legacy=0x7f3b5c132160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 monclient: found mon.c 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c13f210 con 0x7f3b5c182720 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: _finish_auth 0 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:35:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 5 monclient: authenticate success, global_id 4886 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _renew_subs 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c05e8e0 con 0x7f3b5c182720 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _renew_subs 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b5c108f70 con 0x7f3b5c182720 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b58005400 con 0x7f3b5c182720 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3b580057e0 con 0x7f3b5c182720 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 10 monclient: dump: 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:35:53.495 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b60d17640 4 set_mon_vals no callback set 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c057ca0 con 0x7f3b5c182720 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.463+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3b58005940 con 0x7f3b5c182720 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.464+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(406..406 src has 224..406) ==== 3979+0+0 (unknown 1448219507 0 0) 0x7f3b58050d50 con 0x7f3b5c182720 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.464+0000 7f3b6251a640 10 monclient: get_auth_request con 0x7f3b2c040740 auth_method 0 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.466+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f3b580183f0 con 0x7f3b5c182720 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.466+0000 7f3b42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:35:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.466+0000 7f3b42ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b647a5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b647a5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b647a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b5c055570 con 0x7f3b5c182720 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b42ffd640 1 -- 10.20.193.106:0/1898826823 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2321832776) 0x7f3b58016380 con 0x7f3b5c182720 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b42ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.611+0000 7f3b42ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:35:53.613 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 >> v1:10.20.193.118:6812/703720803 conn(0x7f3b2c040740 legacy=0x7f3b2c060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 10 monclient: shutdown 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 >> v1:10.20.193.106:6790/0 conn(0x7f3b5c182720 legacy=0x7f3b5c133170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 shutdown_connections 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 >> 10.20.193.106:0/1898826823 conn(0x7f3b5c0915f0 msgr2=0x7f3b5c1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 shutdown_connections 2026-02-17T05:35:53.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:53.612+0000 7f3b647a5640 1 -- 10.20.193.106:0/1898826823 wait complete. 2026-02-17T05:35:56.622 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:35:56.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: get_monmap_and_config 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: build_initial_monmap 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: monmap: 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:35:56.687586+0000 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:35:56.687586+0000 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:35:56.690 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 1 Processor -- start 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 1 -- start start 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: init 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fb78c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-a con 0x7fb78c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fb78c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c08b060 con 0x7fb78c05dee0 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c05dc90 con 0x7fb78c182720 2026-02-17T05:35:56.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c08d6a0 con 0x7fb78c05d1b0 2026-02-17T05:35:56.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:56.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb792a5b640 10 monclient(hunting): authenticate will time out at 1085.315972s 2026-02-17T05:35:56.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.686+0000 7fb78b7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:56.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.687+0000 7fb78bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 0x7fb78c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:35896/0 (socket says 10.20.193.106:35896) 2026-02-17T05:35:56.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.687+0000 7fb78bfff640 1 -- 10.20.193.106:0/1475220052 learned_addr learned my addr 10.20.193.106:0/1475220052 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:35:56.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:56.888+0000 7fb78b7fe640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:57.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:57.289+0000 7fb78b7fe640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:58.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:58.090+0000 7fb78b7fe640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 10 monclient(hunting): tick 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 1 monclient(hunting): continuing hunt 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 legacy=0x7fb78c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.118:6789/0 conn(0x7fb78c182720 legacy=0x7fb78c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.687+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fb78c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fb78c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fb78c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c057960 con 0x7fb78c05dee0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb78bfff640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c08b060 con 0x7fb78c182720 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb768069f80 con 0x7fb78c05d1b0 2026-02-17T05:35:59.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.688+0000 7fb789ffb640 10 monclient(hunting): _renew_subs 2026-02-17T05:35:59.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:35:59.889+0000 7fb78bfff640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:00.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:00.290+0000 7fb78bfff640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:01.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:01.091+0000 7fb78bfff640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:02.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): tick 2026-02-17T05:36:02.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:36:02.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 monclient(hunting): continuing hunt 2026-02-17T05:36:02.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:36:02.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 legacy=0x7fb768066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:02.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.118:6789/0 conn(0x7fb78c182720 legacy=0x7fb768044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fb78c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fb78c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fb78c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76806b1e0 con 0x7fb78c05dee0 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c057960 con 0x7fb78c182720 2026-02-17T05:36:02.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb768069070 con 0x7fb78c05d1b0 2026-02-17T05:36:02.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb789ffb640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:02.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.688+0000 7fb790fd1640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:02.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:02.889+0000 7fb790fd1640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:03.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:03.290+0000 7fb790fd1640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.091+0000 7fb790fd1640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295336260 0 0) 0x7fb78c057960 con 0x7fb78c182720 2026-02-17T05:36:04.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 10 monclient(hunting): my global_id is 94153 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.360+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7700035e0 con 0x7fb78c182720 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2424735554 0 0) 0x7fb7700035e0 con 0x7fb78c182720 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 legacy=0x7fb7680666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.106:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb768023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 monclient: found mon.noname-c 2026-02-17T05:36:04.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7680692c0 con 0x7fb78c182720 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb77c004220 con 0x7fb78c182720 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: dump: 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.363 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 5 monclient: authenticate success, global_id 94153 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb77c0043f0 con 0x7fb78c182720 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 1 -- 10.20.193.106:0/1475220052 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb77c004790 con 0x7fb78c182720 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb78affd640 10 monclient: dump: 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 4 set_mon_vals no callback set 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 10 monclient: shutdown 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 1 -- 10.20.193.106:0/1475220052 >> v1:10.20.193.118:6789/0 conn(0x7fb78c182720 legacy=0x7fb768044ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 1 -- 10.20.193.106:0/1475220052 shutdown_connections 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 1 -- 10.20.193.106:0/1475220052 >> 10.20.193.106:0/1475220052 conn(0x7fb78c0915f0 msgr2=0x7fb78c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 1 -- 10.20.193.106:0/1475220052 shutdown_connections 2026-02-17T05:36:04.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.361+0000 7fb792a5b640 1 -- 10.20.193.106:0/1475220052 wait complete. 2026-02-17T05:36:04.367 INFO:tasks.rados.rados.0.trial118.stdout:1866: done (1 left) 2026-02-17T05:36:04.367 INFO:tasks.rados.rados.0.trial118.stdout:1867: snap_remove snap 195 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.362+0000 7fb792a5b640 10 monclient: build_initial_monmap 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.362+0000 7fb792a5b640 10 monclient: monmap: 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:36:04.372 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.362+0000 7fb792a5b640 1 Processor -- start 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.362+0000 7fb792a5b640 1 -- start start 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.362+0000 7fb792a5b640 10 monclient: init 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:36:04.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fb78c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fb78c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient(hunting): picked mon.noname-a con 0x7fb78c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c12e2d0 con 0x7fb78c182720 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c05cd90 con 0x7fb78c05dee0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c05e8e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb792a5b640 10 monclient(hunting): authenticate will time out at 1092.991340s 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb790fd1640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fb78c182720 legacy=0x7fb78c1729d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb78bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 0x7fb78c14fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41682/0 (socket says 10.20.193.106:41682) 2026-02-17T05:36:04.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb78bfff640 1 -- 10.20.193.106:0/405494372 learned_addr learned my addr 10.20.193.106:0/405494372 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741047304 0 0) 0x7fb78c05e8e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 10 monclient(hunting): my global_id is 4889 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.363+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb75c0035e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1403536789 0 0) 0x7fb75c0035e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb78c05e8e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb778003000 con 0x7fb78c05d1b0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:36:04.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient(hunting): dump: 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.376 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1616913289 0 0) 0x7fb78c05e8e0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 >> v1:10.20.193.118:6789/0 conn(0x7fb78c05dee0 legacy=0x7fb78c1712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 >> v1:10.20.193.106:6789/0 conn(0x7fb78c182720 legacy=0x7fb78c1729d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 monclient: found mon.c 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c12bf70 con 0x7fb78c05d1b0 2026-02-17T05:36:04.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 5 monclient: authenticate success, global_id 4889 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 10 monclient: _renew_subs 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c13d890 con 0x7fb78c05d1b0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 10 monclient: _renew_subs 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb78c12cad0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7780031d0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb778004b10 con 0x7fb78c05d1b0 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb78a7fc640 4 set_mon_vals no callback set 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.364+0000 7fb788ff9640 10 monclient: dump: 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.379 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb792a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb792a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb792a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c12db30 con 0x7fb78c05d1b0 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb778004c70 con 0x7fb78c05d1b0 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(407..407 src has 224..407) ==== 4051+0+0 (unknown 2014247949 0 0) 0x7fb77804fe10 con 0x7fb78c05d1b0 2026-02-17T05:36:04.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.365+0000 7fb78b7fe640 10 monclient: get_auth_request con 0x7fb75c040770 auth_method 0 2026-02-17T05:36:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.368+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb778016d90 con 0x7fb78c05d1b0 2026-02-17T05:36:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.368+0000 7fb788ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.368+0000 7fb788ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb792a5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb792a5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb792a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb78c055570 con 0x7fb78c05d1b0 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb788ff9640 1 -- 10.20.193.106:0/405494372 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1112844889) 0x7fb778016bb0 con 0x7fb78c05d1b0 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb788ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.520+0000 7fb788ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:36:04.521 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 >> v1:10.20.193.118:6812/703720803 conn(0x7fb75c040770 legacy=0x7fb75c060c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 10 monclient: shutdown 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 >> v1:10.20.193.106:6790/0 conn(0x7fb78c05d1b0 legacy=0x7fb78c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 shutdown_connections 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 >> 10.20.193.106:0/405494372 conn(0x7fb78c0915f0 msgr2=0x7fb78c058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 shutdown_connections 2026-02-17T05:36:04.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.521+0000 7fb792a5b640 1 -- 10.20.193.106:0/405494372 wait complete. 2026-02-17T05:36:04.530 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:36:04.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:36:04.531 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 10 monclient: get_monmap_and_config 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 10 monclient: build_initial_monmap 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 10 monclient: monmap: 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:36:04.596713+0000 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:36:04.596713+0000 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:36:04.597 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 1 Processor -- start 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 1 -- start start 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.596+0000 7f356a77e640 10 monclient: init 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient: _reopen_session rank -1 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-b con 0x7f356405d710 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-a con 0x7f356405bab0 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-c con 0x7f356413f310 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356408d0d0 con 0x7f356405bab0 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356405df30 con 0x7f356413f310 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356405c9c0 con 0x7f356405d710 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient(hunting): authenticate will time out at 1093.225117s 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3568f7b640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f356405bab0 legacy=0x7f3564183030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356977c640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f356405d710 0x7f356413ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41684/0 (socket says 10.20.193.106:41684) 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356977c640 1 -- 10.20.193.106:0/254603850 learned_addr learned my addr 10.20.193.106:0/254603850 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962450420 0 0) 0x7f356405c9c0 con 0x7f356405d710 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient(hunting): my global_id is 4892 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f354c0035e0 con 0x7f356405d710 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1631540980 0 0) 0x7f354c0035e0 con 0x7f356405d710 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 >> v1:10.20.193.118:6789/0 conn(0x7f356413f310 legacy=0x7f35641a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 >> v1:10.20.193.106:6789/0 conn(0x7f356405bab0 legacy=0x7f3564183030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 monclient: found mon.noname-b 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356405cca0 con 0x7f356405d710 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3554002dd0 con 0x7f356405d710 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: dump: 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 5 monclient: authenticate success, global_id 4892 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3554003090 con 0x7f356405d710 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 1 -- 10.20.193.106:0/254603850 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f35540034a0 con 0x7f356405d710 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient: get_monmap_and_config success 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 4 set_mon_vals no callback set 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f3553fff640 10 monclient: dump: 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 10 monclient: shutdown 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- 10.20.193.106:0/254603850 >> v1:10.20.193.106:6790/0 conn(0x7f356405d710 legacy=0x7f356413ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- 10.20.193.106:0/254603850 shutdown_connections 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.597+0000 7f356a77e640 1 -- 10.20.193.106:0/254603850 >> 10.20.193.106:0/254603850 conn(0x7f3564054d80 msgr2=0x7f3564090ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- 10.20.193.106:0/254603850 shutdown_connections 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- 10.20.193.106:0/254603850 wait complete. 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient: build_initial_monmap 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient: monmap: 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:36:04.601 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 Processor -- start 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- start start 2026-02-17T05:36:04.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient: init 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient: _reopen_session rank -1 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-c con 0x7f356405d710 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-b con 0x7f356413f310 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient(hunting): picked mon.noname-a con 0x7f3564122ac0 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3564089c40 con 0x7f3564122ac0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356405e6e0 con 0x7f356413f310 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356412cf40 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356a77e640 10 monclient(hunting): authenticate will time out at 1093.226830s 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f3569f7d640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3564122ac0 legacy=0x7f3564129f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356977c640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f356405d710 0x7f3564129120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41688/0 (socket says 10.20.193.106:41688) 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.598+0000 7f356977c640 1 -- 10.20.193.106:0/1240631334 learned_addr learned my addr 10.20.193.106:0/1240631334 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033666900 0 0) 0x7f356412cf40 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): my global_id is 4895 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35340035e0 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1457993507 0 0) 0x7f35340035e0 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f356412cf40 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f35540033b0 con 0x7f356405d710 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): dump: 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.604 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1401226782 0 0) 0x7f356412cf40 con 0x7f356405d710 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.118:6789/0 conn(0x7f356413f310 legacy=0x7f3564129830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6789/0 conn(0x7f3564122ac0 legacy=0x7f3564129f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 monclient: found mon.c 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356412abe0 con 0x7f356405d710 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 5 monclient: authenticate success, global_id 4895 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 10 monclient: _renew_subs 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f356412c6a0 con 0x7f356405d710 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 10 monclient: _renew_subs 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3564116d00 con 0x7f356405d710 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3554002980 con 0x7f356405d710 2026-02-17T05:36:04.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3554004e60 con 0x7f356405d710 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient: dump: 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f35537fe640 4 set_mon_vals no callback set 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3564090010 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196719769 0 0) 0x7f3564090010 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 10 monclient(hunting): my global_id is 4898 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.599+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f356412cf40 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3554011e00 con 0x7f356405d710 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(407..407 src has 224..407) ==== 4051+0+0 (unknown 2014247949 0 0) 0x7f355404ff70 con 0x7f356405d710 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4222126737 0 0) 0x7f356412cf40 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3564090010 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3558003ee0 con 0x7f356405bab0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 10 monclient: dump: 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3569f7d640 10 monclient: get_auth_request con 0x7f35340406c0 auth_method 0 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2639928294 0 0) 0x7f3564090010 con 0x7f356405bab0 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f356408eda0 con 0x7f356405bab0 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3558005500 con 0x7f356405bab0 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6790/0 conn(0x7f356405bab0 legacy=0x7f3564124040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.600+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6790/0 conn(0x7f356405bab0 legacy=0x7f3564124040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.603+0000 7f356a77e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.603+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3564055410 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580661747 0 0) 0x7f3564055410 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient(hunting): my global_id is 4901 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3564090010 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2308461234 0 0) 0x7f3564090010 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3564055410 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f35580045e0 con 0x7f3564124750 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient: dump: 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.608 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3753991821 0 0) 0x7f3564055410 con 0x7f3564124750 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3564133bd0 con 0x7f3564124750 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 3003803906) 0x7f35580049e0 con 0x7f3564124750 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6790/0 conn(0x7f3564124750 legacy=0x7f35641314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3551ffb640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6790/0 conn(0x7f3564124750 legacy=0x7f35641314a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 30, 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 489365, 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.609 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:36:04.610 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:36:04.611 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.612 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.613 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:36:04.614 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.118:6812/703720803 conn(0x7f35340406c0 legacy=0x7f3534060b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 10 monclient: shutdown 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f3569f7d640 1 -- 10.20.193.106:0/1240631334 reap_dead start 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 >> v1:10.20.193.106:6790/0 conn(0x7f356405d710 legacy=0x7f3564129120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 shutdown_connections 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 >> 10.20.193.106:0/1240631334 conn(0x7f3564054d80 msgr2=0x7f3564088660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 shutdown_connections 2026-02-17T05:36:04.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.604+0000 7f356a77e640 1 -- 10.20.193.106:0/1240631334 wait complete. 2026-02-17T05:36:04.616 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:36:04.616 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:36:04.616 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:36:04.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.679+0000 7f59e1b0c640 10 monclient: get_monmap_and_config 2026-02-17T05:36:04.680 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.679+0000 7f59e1b0c640 10 monclient: build_initial_monmap 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.679+0000 7f59e1b0c640 10 monclient: monmap: 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:36:04.680109+0000 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:36:04.680109+0000 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:36:04.681 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 1 Processor -- start 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 1 -- start start 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient: init 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:36:04.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f59dc05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f59dc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f59dc182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc08b060 con 0x7f59dc05dee0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc05dc90 con 0x7f59dc05d1b0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc08d6a0 con 0x7f59dc182720 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59e1b0c640 10 monclient(hunting): authenticate will time out at 1093.308749s 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59daffd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f59dc05dee0 legacy=0x7f59dc181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59dbfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f59dc182720 0x7f59dc1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41728/0 (socket says 10.20.193.106:41728) 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.680+0000 7f59dbfff640 1 -- 10.20.193.106:0/3394286742 learned_addr learned my addr 10.20.193.106:0/3394286742 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614165189 0 0) 0x7f59dc08d6a0 con 0x7f59dc182720 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): my global_id is 4904 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c00035e0 con 0x7f59dc182720 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953695598 0 0) 0x7f59dc05dc90 con 0x7f59dc05d1b0 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient(hunting): my global_id is 94162 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc08d6a0 con 0x7f59dc05d1b0 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3887824162 0 0) 0x7f59c00035e0 con 0x7f59dc182720 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 >> v1:10.20.193.118:6789/0 conn(0x7f59dc05d1b0 legacy=0x7f59dc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 >> v1:10.20.193.106:6789/0 conn(0x7f59dc05dee0 legacy=0x7f59dc181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 monclient: found mon.noname-b 2026-02-17T05:36:04.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc057960 con 0x7f59dc182720 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59d0003eb0 con 0x7f59dc182720 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: dump: 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.693 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 5 monclient: authenticate success, global_id 4904 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59d0004170 con 0x7f59dc182720 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 1 -- 10.20.193.106:0/3394286742 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59d0004580 con 0x7f59dc182720 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59da7fc640 10 monclient: dump: 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.694 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 4 set_mon_vals no callback set 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 10 monclient: shutdown 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 1 -- 10.20.193.106:0/3394286742 >> v1:10.20.193.106:6790/0 conn(0x7f59dc182720 legacy=0x7f59dc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 1 -- 10.20.193.106:0/3394286742 shutdown_connections 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 1 -- 10.20.193.106:0/3394286742 >> 10.20.193.106:0/3394286742 conn(0x7f59dc0915f0 msgr2=0x7f59dc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 1 -- 10.20.193.106:0/3394286742 shutdown_connections 2026-02-17T05:36:04.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.681+0000 7f59e1b0c640 1 -- 10.20.193.106:0/3394286742 wait complete. 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient: build_initial_monmap 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient: monmap: 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 1 Processor -- start 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 1 -- start start 2026-02-17T05:36:04.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient: init 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f59dc05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f59dc05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f59dc182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc13d8e0 con 0x7f59dc05d1b0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc05e8e0 con 0x7f59dc182720 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc05ce40 con 0x7f59dc05dee0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59e1b0c640 10 monclient(hunting): authenticate will time out at 1093.310594s 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59db7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f59dc05d1b0 legacy=0x7f59dc13cac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59daffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f59dc05dee0 0x7f59dc13d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:41730/0 (socket says 10.20.193.106:41730) 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59daffd640 1 -- 10.20.193.106:0/4245918316 learned_addr learned my addr 10.20.193.106:0/4245918316 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336555418 0 0) 0x7f59dc05ce40 con 0x7f59dc05dee0 2026-02-17T05:36:04.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 10 monclient(hunting): my global_id is 4907 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59ac0035e0 con 0x7f59dc05dee0 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1177169258 0 0) 0x7f59ac0035e0 con 0x7f59dc05dee0 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59dc05ce40 con 0x7f59dc05dee0 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59cc0041c0 con 0x7f59dc05dee0 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.682+0000 7f59b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient(hunting): dump: 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.698 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2291622212 0 0) 0x7f59dc05ce40 con 0x7f59dc05dee0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6789/0 conn(0x7f59dc182720 legacy=0x7f59dc181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.106:6789/0 conn(0x7f59dc05d1b0 legacy=0x7f59dc13cac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 monclient: found mon.c 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc08a040 con 0x7f59dc05dee0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: _finish_auth 0 2026-02-17T05:36:04.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 5 monclient: authenticate success, global_id 4907 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 10 monclient: _renew_subs 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc10e780 con 0x7f59dc05dee0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 10 monclient: _renew_subs 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59dc10d4a0 con 0x7f59dc05dee0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59cc004390 con 0x7f59dc05dee0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59cc004770 con 0x7f59dc05dee0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59d9ffb640 4 set_mon_vals no callback set 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 10 monclient: dump: 2026-02-17T05:36:04.700 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59dc057ca0 con 0x7f59dc12d680 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.683+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f59cc0048d0 con 0x7f59dc05dee0 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(407..407 src has 224..407) ==== 4051+0+0 (unknown 2014247949 0 0) 0x7f59cc04fde0 con 0x7f59dc05dee0 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321418387 0 0) 0x7f59dc057ca0 con 0x7f59dc12d680 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient(hunting): my global_id is 94168 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc05ce40 con 0x7f59dc12d680 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59dbfff640 10 monclient: get_auth_request con 0x7f59ac040740 auth_method 0 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3297394223 0 0) 0x7f59dc05ce40 con 0x7f59dc12d680 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59dc057ca0 con 0x7f59dc12d680 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59c8002ef0 con 0x7f59dc12d680 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 10 monclient: dump: 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.702 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2587461066 0 0) 0x7f59dc057ca0 con 0x7f59dc12d680 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.684+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59dc12da50 con 0x7f59dc12d680 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.685+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f59c8003450 con 0x7f59dc12d680 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.685+0000 7f59b7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.685+0000 7f59b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.685+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6789/0 conn(0x7f59dc12d680 legacy=0x7f59dc059f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.685+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6789/0 conn(0x7f59dc12d680 legacy=0x7f59dc059f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59e1b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59dc055570 con 0x7f59dc04d200 2026-02-17T05:36:04.703 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101162179 0 0) 0x7f59dc055570 con 0x7f59dc04d200 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient(hunting): my global_id is 94171 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc057ca0 con 0x7f59dc04d200 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 594590842 0 0) 0x7f59dc057ca0 con 0x7f59dc04d200 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59dc055570 con 0x7f59dc04d200 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f59c8003af0 con 0x7f59dc04d200 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 10 monclient: dump: 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:36:04.704 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 185612190 0 0) 0x7f59dc055570 con 0x7f59dc04d200 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.688+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59dc08e3d0 con 0x7f59dc04d200 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 660717328) 0x7f59c8005880 con 0x7f59dc04d200 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59b7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6789/0 conn(0x7f59dc04d200 legacy=0x7f59dc11b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59b7fff640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6789/0 conn(0x7f59dc04d200 legacy=0x7f59dc11b580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 30, 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 16930, 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:36:04.706 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.707 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.708 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:36:04.709 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:36:04.710 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:36:04.711 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.712 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.713 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:36:04.714 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:36:04.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.118:6812/703720803 conn(0x7f59ac040740 legacy=0x7f59ac060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 10 monclient: shutdown 2026-02-17T05:36:04.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 >> v1:10.20.193.106:6790/0 conn(0x7f59dc05dee0 legacy=0x7f59dc13d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59dbfff640 1 -- 10.20.193.106:0/4245918316 reap_dead start 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59dbfff640 1 -- 10.20.193.106:0/4245918316 reap_dead start 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 shutdown_connections 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 >> 10.20.193.106:0/4245918316 conn(0x7f59dc0915f0 msgr2=0x7f59dc1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 shutdown_connections 2026-02-17T05:36:04.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:36:04.689+0000 7f59e1b0c640 1 -- 10.20.193.106:0/4245918316 wait complete. 2026-02-17T05:36:04.716 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:36:04.716 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:36:05.365 INFO:tasks.rados.rados.0.trial118.stdout:1867: done (1 left) 2026-02-17T05:36:05.365 INFO:tasks.rados.rados.0.trial118.stdout:1868: read oid 25 snap 166 2026-02-17T05:36:05.365 INFO:tasks.rados.rados.0.trial118.stdout:1868: expect (ObjNum 454 snap 118 seq_num 454) 2026-02-17T05:36:05.365 INFO:tasks.rados.rados.0.trial118.stdout:1869: read oid 11 snap -1 2026-02-17T05:36:05.365 INFO:tasks.rados.rados.0.trial118.stdout:1869: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:05.366 INFO:tasks.rados.rados.0.trial118.stdout:1870: snap_remove snap 182 2026-02-17T05:36:06.369 INFO:tasks.rados.rados.0.trial118.stdout:1870: done (3 left) 2026-02-17T05:36:06.369 INFO:tasks.rados.rados.0.trial118.stdout:1871: write (excl) oid 17 current snap is 196 2026-02-17T05:36:06.369 INFO:tasks.rados.rados.0.trial118.stdout:1871: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2026-02-17T05:36:06.373 INFO:tasks.rados.rados.0.trial118.stdout:1871: writing trial11845692-17 from 527918 to 1084808 tid 1 2026-02-17T05:36:06.379 INFO:tasks.rados.rados.0.trial118.stdout:1871: writing trial11845692-17 from 1657687 to 2436256 tid 2 2026-02-17T05:36:06.383 INFO:tasks.rados.rados.0.trial118.stdout:1871: writing trial11845692-17 from 3225803 to 3327918 tid 3 2026-02-17T05:36:06.383 INFO:tasks.rados.rados.0.trial118.stdout:1872: rollback oid 16 current snap is 196 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 193 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: finishing write tid 2 to trial11845692-15 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: finishing write tid 3 to trial11845692-15 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: finishing write tid 4 to trial11845692-15 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: finishing write tid 5 to trial11845692-15 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: oid 15 updating version 0 to 836 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: oid 15 version 836 is already newer than 835 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: oid 15 version 836 is already newer than 834 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: oid 15 version 836 is already newer than 833 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 836 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:36:06.384 INFO:tasks.rados.rados.0.trial118.stdout:1865: left oid 15 (ObjNum 673 snap 196 seq_num 673) 2026-02-17T05:36:06.385 INFO:tasks.rados.rados.0.trial118.stdout:1868: expect (ObjNum 454 snap 118 seq_num 454) 2026-02-17T05:36:06.458 INFO:tasks.rados.rados.0.trial118.stdout:1869: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:06.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1493219 2026-02-17T05:36:06.476 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:06.505 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1296789 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: finishing write tid 1 to trial11845692-17 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: finishing write tid 2 to trial11845692-17 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: finishing write tid 3 to trial11845692-17 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: finishing write tid 4 to trial11845692-17 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: finishing write tid 5 to trial11845692-17 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: oid 17 updating version 0 to 993 2026-02-17T05:36:06.519 INFO:tasks.rados.rados.0.trial118.stdout:1871: oid 17 updating version 993 to 994 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1871: oid 17 updating version 994 to 996 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1871: oid 17 version 996 is already newer than 995 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 996 (ObjNum 674 snap 196 seq_num 674) dirty exists 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1871: left oid 17 (ObjNum 674 snap 196 seq_num 674) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1872: finishing rollback tid 0 to trial11845692-16 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1872: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1865: done (4 left) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1868: done (3 left) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1869: done (2 left) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1871: done (1 left) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1873: read oid 24 snap 193 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1873: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1874: snap_create 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:1872: finishing rollback tid 2 to trial11845692-16 2026-02-17T05:36:06.520 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 890 (ObjNum 638 snap 190 seq_num 638) dirty exists 2026-02-17T05:36:06.524 INFO:tasks.rados.rados.0.trial118.stdout:1873: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:36:06.525 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:06.559 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1872: done (2 left) 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1873: done (1 left) 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1874: done (0 left) 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1875: read oid 35 snap 196 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1875: expect (ObjNum 563 snap 155 seq_num 563) 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1876: read oid 29 snap -1 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1876: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1877: rollback oid 10 current snap is 197 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 188 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1878: write (excl) oid 43 current snap is 197 2026-02-17T05:36:07.371 INFO:tasks.rados.rados.0.trial118.stdout:1878: seq_num 675 ranges {544725=632139,1716169=522227,2736873=512491} 2026-02-17T05:36:07.376 INFO:tasks.rados.rados.0.trial118.stdout:1878: writing trial11845692-43 from 544725 to 1176864 tid 1 2026-02-17T05:36:07.380 INFO:tasks.rados.rados.0.trial118.stdout:1878: writing trial11845692-43 from 1716169 to 2238396 tid 2 2026-02-17T05:36:07.384 INFO:tasks.rados.rados.0.trial118.stdout:1878: writing trial11845692-43 from 2736873 to 3249364 tid 3 2026-02-17T05:36:07.385 INFO:tasks.rados.rados.0.trial118.stdout:1879: snap_remove snap 166 2026-02-17T05:36:08.374 INFO:tasks.rados.rados.0.trial118.stdout:1879: done (4 left) 2026-02-17T05:36:08.374 INFO:tasks.rados.rados.0.trial118.stdout:1880: read oid 49 snap -1 2026-02-17T05:36:08.374 INFO:tasks.rados.rados.0.trial118.stdout:1880: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:36:08.374 INFO:tasks.rados.rados.0.trial118.stdout:1881: write (excl) oid 2 current snap is 197 2026-02-17T05:36:08.374 INFO:tasks.rados.rados.0.trial118.stdout:1881: seq_num 676 ranges {561532=707388,2058298=782238} 2026-02-17T05:36:08.378 INFO:tasks.rados.rados.0.trial118.stdout:1881: writing trial11845692-2 from 561532 to 1268920 tid 1 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:1881: writing trial11845692-2 from 2058298 to 2840536 tid 2 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:1882: read oid 33 snap -1 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:1882: expect deleted 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:1883: rollback oid 5 current snap is 197 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 5 to 163 2026-02-17T05:36:08.385 INFO:tasks.rados.rados.0.trial118.stdout:1876: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:08.403 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:1877: finishing rollback tid 0 to trial11845692-10 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:1877: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:1877: finishing rollback tid 2 to trial11845692-10 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 867 (ObjNum 625 snap 185 seq_num 625) dirty exists 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:1875: expect (ObjNum 563 snap 155 seq_num 563) 2026-02-17T05:36:08.431 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:08.535 INFO:tasks.rados.rados.0.trial118.stdout:1878: finishing write tid 1 to trial11845692-43 2026-02-17T05:36:08.536 INFO:tasks.rados.rados.0.trial118.stdout:1875: done (7 left) 2026-02-17T05:36:08.536 INFO:tasks.rados.rados.0.trial118.stdout:1876: done (6 left) 2026-02-17T05:36:08.536 INFO:tasks.rados.rados.0.trial118.stdout:1877: done (5 left) 2026-02-17T05:36:08.536 INFO:tasks.rados.rados.0.trial118.stdout:1884: write (excl) oid 39 current snap is 197 2026-02-17T05:36:08.536 INFO:tasks.rados.rados.0.trial118.stdout:1884: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2026-02-17T05:36:08.539 INFO:tasks.rados.rados.0.trial118.stdout:1884: writing trial11845692-39 from 578339 to 1077329 tid 1 2026-02-17T05:36:08.544 INFO:tasks.rados.rados.0.trial118.stdout:1884: writing trial11845692-39 from 1833133 to 2359029 tid 2 2026-02-17T05:36:08.549 INFO:tasks.rados.rados.0.trial118.stdout:1884: writing trial11845692-39 from 2791719 to 3378339 tid 3 2026-02-17T05:36:08.549 INFO:tasks.rados.rados.0.trial118.stdout:1885: rollback oid 37 current snap is 197 2026-02-17T05:36:08.549 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 169 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: finishing write tid 2 to trial11845692-43 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: finishing write tid 3 to trial11845692-43 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: finishing write tid 4 to trial11845692-43 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: finishing write tid 5 to trial11845692-43 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: oid 43 updating version 0 to 742 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: oid 43 version 742 is already newer than 740 2026-02-17T05:36:08.550 INFO:tasks.rados.rados.0.trial118.stdout:1878: oid 43 version 742 is already newer than 741 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1878: oid 43 updating version 742 to 743 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 743 (ObjNum 675 snap 197 seq_num 675) dirty exists 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1878: left oid 43 (ObjNum 675 snap 197 seq_num 675) 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1878: done (6 left) 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1886: read oid 40 snap 193 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1886: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1887: read oid 3 snap -1 2026-02-17T05:36:08.551 INFO:tasks.rados.rados.0.trial118.stdout:1887: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:08.552 INFO:tasks.rados.rados.0.trial118.stdout:1888: write (excl) oid 22 current snap is 197 2026-02-17T05:36:08.552 INFO:tasks.rados.rados.0.trial118.stdout:1888: seq_num 678 ranges {595146=574239,1891615=669554,3219142=176004} 2026-02-17T05:36:08.552 INFO:tasks.rados.rados.0.trial118.stdout:1888: writing trial11845692-22 from 595146 to 1169385 tid 1 2026-02-17T05:36:08.557 INFO:tasks.rados.rados.0.trial118.stdout:1888: writing trial11845692-22 from 1891615 to 2561169 tid 2 2026-02-17T05:36:08.561 INFO:tasks.rados.rados.0.trial118.stdout:1888: writing trial11845692-22 from 3219142 to 3395146 tid 3 2026-02-17T05:36:08.561 INFO:tasks.rados.rados.0.trial118.stdout:1889: snap_create 2026-02-17T05:36:08.561 INFO:tasks.rados.rados.0.trial118.stdout:1880: expect (ObjNum 634 snap 188 seq_num 634) 2026-02-17T05:36:08.585 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2589834 2026-02-17T05:36:08.631 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1863748 2026-02-17T05:36:08.651 INFO:tasks.rados.rados.0.trial118.stdout:1881: finishing write tid 1 to trial11845692-2 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:1883: finishing rollback tid 0 to trial11845692-5 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:1881: finishing write tid 2 to trial11845692-2 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:1881: finishing write tid 3 to trial11845692-2 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:1883: finishing rollback tid 1 to trial11845692-5 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 730 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-17T05:36:08.652 INFO:tasks.rados.rados.0.trial118.stdout:1881: finishing write tid 4 to trial11845692-2 2026-02-17T05:36:08.653 INFO:tasks.rados.rados.0.trial118.stdout:1881: oid 2 updating version 0 to 1151 2026-02-17T05:36:08.653 INFO:tasks.rados.rados.0.trial118.stdout:1881: oid 2 updating version 1151 to 1152 2026-02-17T05:36:08.653 INFO:tasks.rados.rados.0.trial118.stdout:1881: oid 2 version 1152 is already newer than 1144 2026-02-17T05:36:08.653 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1152 (ObjNum 676 snap 197 seq_num 676) dirty exists 2026-02-17T05:36:08.653 INFO:tasks.rados.rados.0.trial118.stdout:1881: left oid 2 (ObjNum 676 snap 197 seq_num 676) 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1884: finishing write tid 1 to trial11845692-39 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1884: finishing write tid 2 to trial11845692-39 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1884: finishing write tid 3 to trial11845692-39 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1884: finishing write tid 4 to trial11845692-39 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1885: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:36:08.654 INFO:tasks.rados.rados.0.trial118.stdout:1885: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:36:08.655 INFO:tasks.rados.rados.0.trial118.stdout:1885: finishing rollback tid 2 to trial11845692-37 2026-02-17T05:36:08.655 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 154 (ObjNum 587 snap 161 seq_num 587) dirty exists 2026-02-17T05:36:08.655 INFO:tasks.rados.rados.0.trial118.stdout:1884: finishing write tid 5 to trial11845692-39 2026-02-17T05:36:08.655 INFO:tasks.rados.rados.0.trial118.stdout:1884: oid 39 updating version 0 to 954 2026-02-17T05:36:08.655 INFO:tasks.rados.rados.0.trial118.stdout:1884: oid 39 updating version 954 to 955 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:1884: oid 39 version 955 is already newer than 953 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:1884: oid 39 version 955 is already newer than 952 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 955 (ObjNum 677 snap 197 seq_num 677) dirty exists 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:1884: left oid 39 (ObjNum 677 snap 197 seq_num 677) 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:1888: finishing write tid 1 to trial11845692-22 2026-02-17T05:36:08.656 INFO:tasks.rados.rados.0.trial118.stdout:1887: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:08.714 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:08.745 INFO:tasks.rados.rados.0.trial118.stdout:1886: expect (ObjNum 575 snap 157 seq_num 575) 2026-02-17T05:36:08.819 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 232629 2026-02-17T05:36:08.951 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3243701 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: finishing write tid 2 to trial11845692-22 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: finishing write tid 3 to trial11845692-22 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: finishing write tid 4 to trial11845692-22 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: finishing write tid 5 to trial11845692-22 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: oid 22 updating version 0 to 857 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: oid 22 updating version 857 to 858 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: oid 22 version 858 is already newer than 856 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: oid 22 updating version 858 to 859 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 859 (ObjNum 678 snap 197 seq_num 678) dirty exists 2026-02-17T05:36:08.958 INFO:tasks.rados.rados.0.trial118.stdout:1888: left oid 22 (ObjNum 678 snap 197 seq_num 678) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1880: done (9 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1881: done (8 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1882: done (7 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1883: done (6 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1884: done (5 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1885: done (4 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1886: done (3 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1887: done (2 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1888: done (1 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1889: done (0 left) 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1890: read oid 25 snap -1 2026-02-17T05:36:09.378 INFO:tasks.rados.rados.0.trial118.stdout:1890: expect deleted 2026-02-17T05:36:09.379 INFO:tasks.rados.rados.0.trial118.stdout:1891: copy_from oid 39 from oid 11 current snap is 198 2026-02-17T05:36:09.379 INFO:tasks.rados.rados.0.trial118.stdout:1892: read oid 7 snap 196 2026-02-17T05:36:09.379 INFO:tasks.rados.rados.0.trial118.stdout:1892: expect (ObjNum 642 snap 190 seq_num 642) 2026-02-17T05:36:09.379 INFO:tasks.rados.rados.0.trial118.stdout:1893: write (excl) oid 6 current snap is 198 2026-02-17T05:36:09.379 INFO:tasks.rados.rados.0.trial118.stdout:1893: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2026-02-17T05:36:09.382 INFO:tasks.rados.rados.0.trial118.stdout:1893: writing trial11845692-6 from 611953 to 1261441 tid 1 2026-02-17T05:36:09.387 INFO:tasks.rados.rados.0.trial118.stdout:1893: writing trial11845692-6 from 1950097 to 2479662 tid 2 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1893: writing trial11845692-6 from 3246565 to 3411953 tid 3 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1894: read oid 30 snap -1 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1894: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1895: read oid 31 snap -1 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1895: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:1892: expect (ObjNum 642 snap 190 seq_num 642) 2026-02-17T05:36:09.390 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:09.502 INFO:tasks.rados.rados.0.trial118.stdout:1891: finishing copy_from racing read to trial11845692-39 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1893: finishing write tid 1 to trial11845692-6 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1891: finishing copy_from to trial11845692-39 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 985 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1893: finishing write tid 2 to trial11845692-6 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1890: done (5 left) 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1891: done (4 left) 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1892: done (3 left) 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1896: write (excl) oid 34 current snap is 198 2026-02-17T05:36:09.503 INFO:tasks.rados.rados.0.trial118.stdout:1896: seq_num 680 ranges {628760=724737,1892226=673223,3157635=271125} 2026-02-17T05:36:09.507 INFO:tasks.rados.rados.0.trial118.stdout:1896: writing trial11845692-34 from 628760 to 1353497 tid 1 2026-02-17T05:36:09.512 INFO:tasks.rados.rados.0.trial118.stdout:1896: writing trial11845692-34 from 1892226 to 2565449 tid 2 2026-02-17T05:36:09.516 INFO:tasks.rados.rados.0.trial118.stdout:1896: writing trial11845692-34 from 3157635 to 3428760 tid 3 2026-02-17T05:36:09.516 INFO:tasks.rados.rados.0.trial118.stdout:1897: read oid 8 snap -1 2026-02-17T05:36:09.517 INFO:tasks.rados.rados.0.trial118.stdout:1897: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:36:09.517 INFO:tasks.rados.rados.0.trial118.stdout:1898: delete oid 22 current snap is 198 2026-02-17T05:36:09.517 INFO:tasks.rados.rados.0.trial118.stdout:1895: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:09.568 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:09.596 INFO:tasks.rados.rados.0.trial118.stdout:1893: finishing write tid 3 to trial11845692-6 2026-02-17T05:36:09.596 INFO:tasks.rados.rados.0.trial118.stdout:1895: done (5 left) 2026-02-17T05:36:09.596 INFO:tasks.rados.rados.0.trial118.stdout:1898: done (4 left) 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1899: snap_create 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1893: finishing write tid 4 to trial11845692-6 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1893: finishing write tid 5 to trial11845692-6 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1893: oid 6 updating version 0 to 659 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1893: oid 6 version 659 is already newer than 658 2026-02-17T05:36:09.597 INFO:tasks.rados.rados.0.trial118.stdout:1893: oid 6 updating version 659 to 661 2026-02-17T05:36:09.598 INFO:tasks.rados.rados.0.trial118.stdout:1893: oid 6 version 661 is already newer than 660 2026-02-17T05:36:09.598 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 661 (ObjNum 679 snap 198 seq_num 679) dirty exists 2026-02-17T05:36:09.598 INFO:tasks.rados.rados.0.trial118.stdout:1893: left oid 6 (ObjNum 679 snap 198 seq_num 679) 2026-02-17T05:36:09.598 INFO:tasks.rados.rados.0.trial118.stdout:1894: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:09.600 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2026681 2026-02-17T05:36:09.614 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 128000 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: finishing write tid 1 to trial11845692-34 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: finishing write tid 2 to trial11845692-34 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: finishing write tid 3 to trial11845692-34 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: finishing write tid 4 to trial11845692-34 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: finishing write tid 5 to trial11845692-34 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: oid 34 updating version 0 to 715 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: oid 34 version 715 is already newer than 713 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: oid 34 version 715 is already newer than 714 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: oid 34 version 715 is already newer than 712 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 715 (ObjNum 680 snap 198 seq_num 680) dirty exists 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1896: left oid 34 (ObjNum 680 snap 198 seq_num 680) 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:1897: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:36:09.665 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:09.710 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1893: done (4 left) 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1894: done (3 left) 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1896: done (2 left) 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1897: done (1 left) 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1899: done (0 left) 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1900: rollback oid 17 current snap is 199 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 196 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1901: write oid 44 current snap is 199 2026-02-17T05:36:10.300 INFO:tasks.rados.rados.0.trial118.stdout:1901: seq_num 682 ranges {662374=475235,1609190=676892,2812481=624101} 2026-02-17T05:36:10.305 INFO:tasks.rados.rados.0.trial118.stdout:1901: writing trial11845692-44 from 662374 to 1137609 tid 1 2026-02-17T05:36:10.309 INFO:tasks.rados.rados.0.trial118.stdout:1901: writing trial11845692-44 from 1609190 to 2286082 tid 2 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1901: writing trial11845692-44 from 2812481 to 3436582 tid 3 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1902: snap_create 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1900: finishing rollback tid 0 to trial11845692-17 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1900: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1900: finishing rollback tid 2 to trial11845692-17 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 999 (ObjNum 674 snap 196 seq_num 674) dirty exists 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1901: finishing write tid 1 to trial11845692-44 2026-02-17T05:36:10.314 INFO:tasks.rados.rados.0.trial118.stdout:1901: finishing write tid 2 to trial11845692-44 2026-02-17T05:36:10.315 INFO:tasks.rados.rados.0.trial118.stdout:1901: finishing write tid 3 to trial11845692-44 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: finishing write tid 4 to trial11845692-44 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: finishing write tid 5 to trial11845692-44 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: oid 44 updating version 0 to 867 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: oid 44 version 867 is already newer than 865 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: oid 44 version 867 is already newer than 866 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: oid 44 updating version 867 to 868 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 868 (ObjNum 682 snap 199 seq_num 682) dirty exists 2026-02-17T05:36:10.316 INFO:tasks.rados.rados.0.trial118.stdout:1901: left oid 44 (ObjNum 682 snap 199 seq_num 682) 2026-02-17T05:36:11.300 INFO:tasks.rados.rados.0.trial118.stdout:1900: done (2 left) 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1901: done (1 left) 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1902: done (0 left) 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1903: read oid 5 snap -1 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1903: expect deleted 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1904: rollback oid 16 current snap is 200 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 193 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1905: read oid 3 snap -1 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1905: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:11.301 INFO:tasks.rados.rados.0.trial118.stdout:1906: write (excl) oid 1 current snap is 200 2026-02-17T05:36:11.302 INFO:tasks.rados.rados.0.trial118.stdout:1906: seq_num 683 ranges {679181=550484,1667672=536903,2839904=435373} 2026-02-17T05:36:11.305 INFO:tasks.rados.rados.0.trial118.stdout:1906: writing trial11845692-1 from 679181 to 1229665 tid 1 2026-02-17T05:36:11.309 INFO:tasks.rados.rados.0.trial118.stdout:1906: writing trial11845692-1 from 1667672 to 2204575 tid 2 2026-02-17T05:36:11.313 INFO:tasks.rados.rados.0.trial118.stdout:1906: writing trial11845692-1 from 2839904 to 3275277 tid 3 2026-02-17T05:36:11.313 INFO:tasks.rados.rados.0.trial118.stdout:1907: snap_remove snap 188 2026-02-17T05:36:12.300 INFO:tasks.rados.rados.0.trial118.stdout:1907: done (4 left) 2026-02-17T05:36:12.300 INFO:tasks.rados.rados.0.trial118.stdout:1908: write oid 33 current snap is 200 2026-02-17T05:36:12.301 INFO:tasks.rados.rados.0.trial118.stdout:1908: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2026-02-17T05:36:12.305 INFO:tasks.rados.rados.0.trial118.stdout:1908: writing trial11845692-33 from 695988 to 1321721 tid 1 2026-02-17T05:36:12.310 INFO:tasks.rados.rados.0.trial118.stdout:1908: writing trial11845692-33 from 2009801 to 2690362 tid 2 2026-02-17T05:36:12.313 INFO:tasks.rados.rados.0.trial118.stdout:1908: writing trial11845692-33 from 3150974 to 3495988 tid 3 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1909: read oid 11 snap -1 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1909: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1910: read oid 10 snap 163 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1910: expect (ObjNum 526 snap 144 seq_num 526) 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1911: read oid 6 snap -1 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1911: expect (ObjNum 679 snap 198 seq_num 679) 2026-02-17T05:36:12.314 INFO:tasks.rados.rados.0.trial118.stdout:1912: snap_remove snap 198 2026-02-17T05:36:13.302 INFO:tasks.rados.rados.0.trial118.stdout:1912: done (8 left) 2026-02-17T05:36:13.302 INFO:tasks.rados.rados.0.trial118.stdout:1913: write (excl) oid 38 current snap is 200 2026-02-17T05:36:13.303 INFO:tasks.rados.rados.0.trial118.stdout:1913: seq_num 685 ranges {712795=417335,1784636=540572,2894750=457917} 2026-02-17T05:36:13.307 INFO:tasks.rados.rados.0.trial118.stdout:1913: writing trial11845692-38 from 712795 to 1130130 tid 1 2026-02-17T05:36:13.311 INFO:tasks.rados.rados.0.trial118.stdout:1913: writing trial11845692-38 from 1784636 to 2325208 tid 2 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1913: writing trial11845692-38 from 2894750 to 3352667 tid 3 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1914: copy_from oid 22 from oid 2 current snap is 200 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1904: finishing rollback tid 0 to trial11845692-16 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1904: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1904: finishing rollback tid 2 to trial11845692-16 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 898 (ObjNum 638 snap 190 seq_num 638) dirty exists 2026-02-17T05:36:13.315 INFO:tasks.rados.rados.0.trial118.stdout:1905: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:13.394 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2735174 2026-02-17T05:36:13.402 INFO:tasks.rados.rados.0.trial118.stdout:1906: finishing write tid 1 to trial11845692-1 2026-02-17T05:36:13.402 INFO:tasks.rados.rados.0.trial118.stdout:1906: finishing write tid 2 to trial11845692-1 2026-02-17T05:36:13.402 INFO:tasks.rados.rados.0.trial118.stdout:1903: done (9 left) 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1904: done (8 left) 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1905: done (7 left) 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1915: copy_from oid 46 from oid 5 current snap is 200 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: finishing write tid 3 to trial11845692-1 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: finishing write tid 4 to trial11845692-1 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: finishing write tid 5 to trial11845692-1 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: oid 1 updating version 0 to 1055 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: oid 1 version 1055 is already newer than 1054 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: oid 1 version 1055 is already newer than 1053 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:1906: oid 1 version 1055 is already newer than 1052 2026-02-17T05:36:13.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1055 (ObjNum 683 snap 200 seq_num 683) dirty exists 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1906: left oid 1 (ObjNum 683 snap 200 seq_num 683) 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: finishing write tid 1 to trial11845692-33 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: finishing write tid 2 to trial11845692-33 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: finishing write tid 3 to trial11845692-33 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: finishing write tid 4 to trial11845692-33 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: finishing write tid 5 to trial11845692-33 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: oid 33 updating version 0 to 1065 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: oid 33 version 1065 is already newer than 1064 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: oid 33 updating version 1065 to 1066 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: oid 33 updating version 1066 to 1067 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1067 (ObjNum 684 snap 200 seq_num 684) dirty exists 2026-02-17T05:36:13.404 INFO:tasks.rados.rados.0.trial118.stdout:1908: left oid 33 (ObjNum 684 snap 200 seq_num 684) 2026-02-17T05:36:13.405 INFO:tasks.rados.rados.0.trial118.stdout:1906: done (7 left) 2026-02-17T05:36:13.405 INFO:tasks.rados.rados.0.trial118.stdout:1908: done (6 left) 2026-02-17T05:36:13.405 INFO:tasks.rados.rados.0.trial118.stdout:1916: write (excl) oid 36 current snap is 200 2026-02-17T05:36:13.405 INFO:tasks.rados.rados.0.trial118.stdout:1909: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:13.405 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:13.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1267921 2026-02-17T05:36:13.464 INFO:tasks.rados.rados.0.trial118.stdout:1911: expect (ObjNum 679 snap 198 seq_num 679) 2026-02-17T05:36:13.471 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 814718 2026-02-17T05:36:13.592 INFO:tasks.rados.rados.0.trial118.stdout:1910: expect (ObjNum 526 snap 144 seq_num 526) 2026-02-17T05:36:13.592 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:13.613 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: finishing write tid 1 to trial11845692-38 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: finishing write tid 2 to trial11845692-38 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: finishing write tid 3 to trial11845692-38 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: finishing write tid 4 to trial11845692-38 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: finishing write tid 5 to trial11845692-38 2026-02-17T05:36:13.645 INFO:tasks.rados.rados.0.trial118.stdout:1913: oid 38 updating version 0 to 986 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1913: oid 38 updating version 986 to 987 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1913: oid 38 updating version 987 to 989 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1913: oid 38 version 989 is already newer than 988 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 989 (ObjNum 685 snap 200 seq_num 685) dirty exists 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1913: left oid 38 (ObjNum 685 snap 200 seq_num 685) 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1914: finishing copy_from racing read to trial11845692-22 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1914: finishing copy_from to trial11845692-22 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1152 (ObjNum 676 snap 197 seq_num 676) dirty exists 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1915: finishing copy_from to trial11845692-46 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1915: got expected ENOENT (src dne) 2026-02-17T05:36:13.646 INFO:tasks.rados.rados.0.trial118.stdout:1916: seq_num 686 ranges {729602=492584,1843118=684230,3322173=207429} 2026-02-17T05:36:13.649 INFO:tasks.rados.rados.0.trial118.stdout:1916: writing trial11845692-36 from 729602 to 1222186 tid 1 2026-02-17T05:36:13.654 INFO:tasks.rados.rados.0.trial118.stdout:1916: writing trial11845692-36 from 1843118 to 2527348 tid 2 2026-02-17T05:36:13.658 INFO:tasks.rados.rados.0.trial118.stdout:1916: writing trial11845692-36 from 3322173 to 3529602 tid 3 2026-02-17T05:36:13.658 INFO:tasks.rados.rados.0.trial118.stdout:1909: done (6 left) 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1910: done (5 left) 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1911: done (4 left) 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1913: done (3 left) 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1914: done (2 left) 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1917: write (excl) oid 40 current snap is 200 2026-02-17T05:36:13.659 INFO:tasks.rados.rados.0.trial118.stdout:1917: seq_num 687 ranges {746409=567833,1901600=544241,3065949=480460} 2026-02-17T05:36:13.663 INFO:tasks.rados.rados.0.trial118.stdout:1917: writing trial11845692-40 from 746409 to 1314242 tid 1 2026-02-17T05:36:13.667 INFO:tasks.rados.rados.0.trial118.stdout:1917: writing trial11845692-40 from 1901600 to 2445841 tid 2 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1917: writing trial11845692-40 from 3065949 to 3546409 tid 3 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1918: delete oid 20 current snap is 200 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1915: finishing copy_from racing read to trial11845692-46 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: finishing write tid 1 to trial11845692-36 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: finishing write tid 2 to trial11845692-36 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: finishing write tid 3 to trial11845692-36 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: finishing write tid 4 to trial11845692-36 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: finishing write tid 5 to trial11845692-36 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: oid 36 updating version 0 to 1155 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: oid 36 version 1155 is already newer than 1153 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: oid 36 updating version 1155 to 1156 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: oid 36 version 1156 is already newer than 1154 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1156 (ObjNum 686 snap 200 seq_num 686) dirty exists 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1916: left oid 36 (ObjNum 686 snap 200 seq_num 686) 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1917: finishing write tid 1 to trial11845692-40 2026-02-17T05:36:13.671 INFO:tasks.rados.rados.0.trial118.stdout:1917: finishing write tid 2 to trial11845692-40 2026-02-17T05:36:13.672 INFO:tasks.rados.rados.0.trial118.stdout:1917: finishing write tid 3 to trial11845692-40 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: finishing write tid 4 to trial11845692-40 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: finishing write tid 5 to trial11845692-40 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: oid 40 updating version 0 to 1071 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: oid 40 updating version 1071 to 1072 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: oid 40 updating version 1072 to 1073 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: oid 40 updating version 1073 to 1074 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1074 (ObjNum 687 snap 200 seq_num 687) dirty exists 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: left oid 40 (ObjNum 687 snap 200 seq_num 687) 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1915: done (3 left) 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1916: done (2 left) 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1917: done (1 left) 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1918: done (0 left) 2026-02-17T05:36:13.673 INFO:tasks.rados.rados.0.trial118.stdout:1919: delete oid 18 current snap is 200 2026-02-17T05:36:13.674 INFO:tasks.rados.rados.0.trial118.stdout:1919: done (0 left) 2026-02-17T05:36:13.674 INFO:tasks.rados.rados.0.trial118.stdout:1920: write (excl) oid 49 current snap is 200 2026-02-17T05:36:13.674 INFO:tasks.rados.rados.0.trial118.stdout:1920: seq_num 690 ranges {796830=793580,2360693=691568} 2026-02-17T05:36:13.680 INFO:tasks.rados.rados.0.trial118.stdout:1920: writing trial11845692-49 from 796830 to 1590410 tid 1 2026-02-17T05:36:13.686 INFO:tasks.rados.rados.0.trial118.stdout:1920: writing trial11845692-49 from 2360693 to 3052261 tid 2 2026-02-17T05:36:13.686 INFO:tasks.rados.rados.0.trial118.stdout:1921: copy_from oid 23 from oid 30 current snap is 200 2026-02-17T05:36:13.686 INFO:tasks.rados.rados.0.trial118.stdout:1920: finishing write tid 1 to trial11845692-49 2026-02-17T05:36:13.686 INFO:tasks.rados.rados.0.trial118.stdout:1922: snap_create 2026-02-17T05:36:13.687 INFO:tasks.rados.rados.0.trial118.stdout:1920: finishing write tid 2 to trial11845692-49 2026-02-17T05:36:13.687 INFO:tasks.rados.rados.0.trial118.stdout:1920: finishing write tid 3 to trial11845692-49 2026-02-17T05:36:13.687 INFO:tasks.rados.rados.0.trial118.stdout:1920: finishing write tid 4 to trial11845692-49 2026-02-17T05:36:13.687 INFO:tasks.rados.rados.0.trial118.stdout:1920: oid 49 updating version 0 to 868 2026-02-17T05:36:13.687 INFO:tasks.rados.rados.0.trial118.stdout:1920: oid 49 updating version 868 to 870 2026-02-17T05:36:13.688 INFO:tasks.rados.rados.0.trial118.stdout:1920: oid 49 version 870 is already newer than 869 2026-02-17T05:36:13.688 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 870 (ObjNum 690 snap 200 seq_num 690) dirty exists 2026-02-17T05:36:13.688 INFO:tasks.rados.rados.0.trial118.stdout:1920: left oid 49 (ObjNum 690 snap 200 seq_num 690) 2026-02-17T05:36:13.692 INFO:tasks.rados.rados.0.trial118.stdout:1921: finishing copy_from racing read to trial11845692-23 2026-02-17T05:36:13.694 INFO:tasks.rados.rados.0.trial118.stdout:1921: finishing copy_from to trial11845692-23 2026-02-17T05:36:13.694 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:36:14.308 INFO:tasks.rados.rados.0.trial118.stdout:1920: done (2 left) 2026-02-17T05:36:14.308 INFO:tasks.rados.rados.0.trial118.stdout:1921: done (1 left) 2026-02-17T05:36:14.308 INFO:tasks.rados.rados.0.trial118.stdout:1922: done (0 left) 2026-02-17T05:36:14.308 INFO:tasks.rados.rados.0.trial118.stdout:1923: write oid 40 current snap is 201 2026-02-17T05:36:14.308 INFO:tasks.rados.rados.0.trial118.stdout:1923: seq_num 691 ranges {413637=468829,1619175=435226,2542935=758255} 2026-02-17T05:36:14.311 INFO:tasks.rados.rados.0.trial118.stdout:1923: writing trial11845692-40 from 413637 to 882466 tid 1 2026-02-17T05:36:14.315 INFO:tasks.rados.rados.0.trial118.stdout:1923: writing trial11845692-40 from 1619175 to 2054401 tid 2 2026-02-17T05:36:14.320 INFO:tasks.rados.rados.0.trial118.stdout:1923: writing trial11845692-40 from 2542935 to 3301190 tid 3 2026-02-17T05:36:14.320 INFO:tasks.rados.rados.0.trial118.stdout:1924: rollback oid 15 current snap is 201 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 194 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:1923: finishing write tid 1 to trial11845692-40 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:1923: finishing write tid 2 to trial11845692-40 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:1925: rollback oid 9 current snap is 201 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 163 2026-02-17T05:36:14.321 INFO:tasks.rados.rados.0.trial118.stdout:1926: snap_remove snap 169 2026-02-17T05:36:15.300 INFO:tasks.rados.rados.0.trial118.stdout:1926: done (3 left) 2026-02-17T05:36:15.301 INFO:tasks.rados.rados.0.trial118.stdout:1927: delete oid 42 current snap is 201 2026-02-17T05:36:15.301 INFO:tasks.rados.rados.0.trial118.stdout:1923: finishing write tid 3 to trial11845692-40 2026-02-17T05:36:15.301 INFO:tasks.rados.rados.0.trial118.stdout:1923: finishing write tid 4 to trial11845692-40 2026-02-17T05:36:15.301 INFO:tasks.rados.rados.0.trial118.stdout:1923: finishing write tid 5 to trial11845692-40 2026-02-17T05:36:15.301 INFO:tasks.rados.rados.0.trial118.stdout:1923: oid 40 updating version 0 to 1076 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:1923: oid 40 updating version 1076 to 1078 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:1923: oid 40 version 1078 is already newer than 1077 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:1923: oid 40 updating version 1078 to 1079 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1079 (ObjNum 691 snap 201 seq_num 691) dirty exists 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:1923: left oid 40 (ObjNum 691 snap 201 seq_num 691) 2026-02-17T05:36:15.302 INFO:tasks.rados.rados.0.trial118.stdout:1924: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:36:15.303 INFO:tasks.rados.rados.0.trial118.stdout:1924: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:36:15.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1158 (ObjNum 129 snap 0 seq_num 13226136) dirty dne 2026-02-17T05:36:15.303 INFO:tasks.rados.rados.0.trial118.stdout:1925: finishing rollback tid 0 to trial11845692-9 2026-02-17T05:36:15.303 INFO:tasks.rados.rados.0.trial118.stdout:1925: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:36:15.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 907 (ObjNum 129 snap 0 seq_num 12537024) dirty dne 2026-02-17T05:36:15.304 INFO:tasks.rados.rados.0.trial118.stdout:1923: done (3 left) 2026-02-17T05:36:15.305 INFO:tasks.rados.rados.0.trial118.stdout:1924: done (2 left) 2026-02-17T05:36:15.305 INFO:tasks.rados.rados.0.trial118.stdout:1925: done (1 left) 2026-02-17T05:36:15.305 INFO:tasks.rados.rados.0.trial118.stdout:1927: done (0 left) 2026-02-17T05:36:15.305 INFO:tasks.rados.rados.0.trial118.stdout:1928: snap_remove snap 200 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1928: done (0 left) 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1929: read oid 4 snap -1 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1929: expect deleted 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1930: read oid 48 snap 196 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1930: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1931: read oid 19 snap -1 2026-02-17T05:36:16.304 INFO:tasks.rados.rados.0.trial118.stdout:1931: expect deleted 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1932: read oid 47 snap -1 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1932: expect deleted 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1933: read oid 6 snap -1 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1933: expect (ObjNum 679 snap 198 seq_num 679) 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1934: write oid 25 current snap is 201 2026-02-17T05:36:16.305 INFO:tasks.rados.rados.0.trial118.stdout:1934: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2026-02-17T05:36:16.308 INFO:tasks.rados.rados.0.trial118.stdout:1934: writing trial11845692-25 from 447251 to 1182931 tid 1 2026-02-17T05:36:16.312 INFO:tasks.rados.rados.0.trial118.stdout:1934: writing trial11845692-25 from 1736139 to 2175034 tid 2 2026-02-17T05:36:16.317 INFO:tasks.rados.rados.0.trial118.stdout:1934: writing trial11845692-25 from 2597781 to 3378580 tid 3 2026-02-17T05:36:16.317 INFO:tasks.rados.rados.0.trial118.stdout:1935: read oid 18 snap -1 2026-02-17T05:36:16.317 INFO:tasks.rados.rados.0.trial118.stdout:1935: expect deleted 2026-02-17T05:36:16.317 INFO:tasks.rados.rados.0.trial118.stdout:1936: copy_from oid 17 from oid 44 current snap is 201 2026-02-17T05:36:16.317 INFO:tasks.rados.rados.0.trial118.stdout:1929: done (7 left) 2026-02-17T05:36:16.318 INFO:tasks.rados.rados.0.trial118.stdout:1932: done (6 left) 2026-02-17T05:36:16.318 INFO:tasks.rados.rados.0.trial118.stdout:1937: snap_create 2026-02-17T05:36:16.318 INFO:tasks.rados.rados.0.trial118.stdout:1933: expect (ObjNum 679 snap 198 seq_num 679) 2026-02-17T05:36:16.361 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:16.447 INFO:tasks.rados.rados.0.trial118.stdout:1930: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:16.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:16.474 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:16.523 INFO:tasks.rados.rados.0.trial118.stdout:1934: finishing write tid 1 to trial11845692-25 2026-02-17T05:36:16.523 INFO:tasks.rados.rados.0.trial118.stdout:1934: finishing write tid 2 to trial11845692-25 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: finishing write tid 3 to trial11845692-25 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: finishing write tid 4 to trial11845692-25 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: finishing write tid 5 to trial11845692-25 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: oid 25 updating version 0 to 1092 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: oid 25 updating version 1092 to 1093 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: oid 25 updating version 1093 to 1094 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: oid 25 updating version 1094 to 1095 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1095 (ObjNum 693 snap 201 seq_num 693) dirty exists 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1934: left oid 25 (ObjNum 693 snap 201 seq_num 693) 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1936: finishing copy_from racing read to trial11845692-17 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:1936: finishing copy_from to trial11845692-17 2026-02-17T05:36:16.524 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 868 (ObjNum 682 snap 199 seq_num 682) dirty exists 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1930: done (6 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1931: done (5 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1933: done (4 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1934: done (3 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1935: done (2 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1936: done (1 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1937: done (0 left) 2026-02-17T05:36:17.310 INFO:tasks.rados.rados.0.trial118.stdout:1938: snap_remove snap 196 2026-02-17T05:36:18.313 INFO:tasks.rados.rados.0.trial118.stdout:1938: done (0 left) 2026-02-17T05:36:18.313 INFO:tasks.rados.rados.0.trial118.stdout:1939: read oid 32 snap -1 2026-02-17T05:36:18.314 INFO:tasks.rados.rados.0.trial118.stdout:1939: expect (ObjNum 622 snap 183 seq_num 622) 2026-02-17T05:36:18.314 INFO:tasks.rados.rados.0.trial118.stdout:1940: copy_from oid 48 from oid 8 current snap is 202 2026-02-17T05:36:18.314 INFO:tasks.rados.rados.0.trial118.stdout:1941: write oid 38 current snap is 202 2026-02-17T05:36:18.314 INFO:tasks.rados.rados.0.trial118.stdout:1941: seq_num 694 ranges {464058=410929,1394621=698906,2625204=592071,3656107=7951} 2026-02-17T05:36:18.317 INFO:tasks.rados.rados.0.trial118.stdout:1941: writing trial11845692-38 from 464058 to 874987 tid 1 2026-02-17T05:36:18.321 INFO:tasks.rados.rados.0.trial118.stdout:1941: writing trial11845692-38 from 1394621 to 2093527 tid 2 2026-02-17T05:36:18.325 INFO:tasks.rados.rados.0.trial118.stdout:1941: writing trial11845692-38 from 2625204 to 3217275 tid 3 2026-02-17T05:36:18.327 INFO:tasks.rados.rados.0.trial118.stdout:1941: writing trial11845692-38 from 3656107 to 3664058 tid 4 2026-02-17T05:36:18.328 INFO:tasks.rados.rados.0.trial118.stdout:1942: read oid 16 snap -1 2026-02-17T05:36:18.328 INFO:tasks.rados.rados.0.trial118.stdout:1942: expect (ObjNum 638 snap 190 seq_num 638) 2026-02-17T05:36:18.328 INFO:tasks.rados.rados.0.trial118.stdout:1943: delete oid 2 current snap is 202 2026-02-17T05:36:18.328 INFO:tasks.rados.rados.0.trial118.stdout:1939: expect (ObjNum 622 snap 183 seq_num 622) 2026-02-17T05:36:18.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2216335 2026-02-17T05:36:18.381 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 787301 2026-02-17T05:36:18.406 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 1 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1940: finishing copy_from racing read to trial11845692-48 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1940: finishing copy_from to trial11845692-48 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1086 (ObjNum 618 snap 181 seq_num 618) dirty exists 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 2 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 3 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 4 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 5 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: finishing write tid 6 to trial11845692-38 2026-02-17T05:36:18.407 INFO:tasks.rados.rados.0.trial118.stdout:1941: oid 38 updating version 0 to 992 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1941: oid 38 updating version 992 to 993 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1941: oid 38 updating version 993 to 995 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1941: oid 38 version 995 is already newer than 991 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1941: oid 38 version 995 is already newer than 994 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 995 (ObjNum 694 snap 202 seq_num 694) dirty exists 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1941: left oid 38 (ObjNum 694 snap 202 seq_num 694) 2026-02-17T05:36:18.408 INFO:tasks.rados.rados.0.trial118.stdout:1942: expect (ObjNum 638 snap 190 seq_num 638) 2026-02-17T05:36:18.431 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2602843 2026-02-17T05:36:18.432 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:18.501 INFO:tasks.rados.rados.0.trial118.stdout:1939: done (4 left) 2026-02-17T05:36:18.501 INFO:tasks.rados.rados.0.trial118.stdout:1940: done (3 left) 2026-02-17T05:36:18.501 INFO:tasks.rados.rados.0.trial118.stdout:1941: done (2 left) 2026-02-17T05:36:18.501 INFO:tasks.rados.rados.0.trial118.stdout:1942: done (1 left) 2026-02-17T05:36:18.501 INFO:tasks.rados.rados.0.trial118.stdout:1943: done (0 left) 2026-02-17T05:36:18.502 INFO:tasks.rados.rados.0.trial118.stdout:1944: read oid 22 snap -1 2026-02-17T05:36:18.502 INFO:tasks.rados.rados.0.trial118.stdout:1944: expect (ObjNum 676 snap 197 seq_num 676) 2026-02-17T05:36:18.502 INFO:tasks.rados.rados.0.trial118.stdout:1945: delete oid 32 current snap is 202 2026-02-17T05:36:18.504 INFO:tasks.rados.rados.0.trial118.stdout:1945: done (1 left) 2026-02-17T05:36:18.504 INFO:tasks.rados.rados.0.trial118.stdout:1946: delete oid 42 current snap is 202 2026-02-17T05:36:18.504 INFO:tasks.rados.rados.0.trial118.stdout:1946: done (1 left) 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1947: read oid 36 snap -1 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1947: expect (ObjNum 686 snap 200 seq_num 686) 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1948: copy_from oid 15 from oid 46 current snap is 202 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1949: copy_from oid 43 from oid 3 current snap is 202 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1950: write oid 44 current snap is 202 2026-02-17T05:36:18.505 INFO:tasks.rados.rados.0.trial118.stdout:1950: seq_num 698 ranges {531286=711925,1912196=706244,3018543=712743} 2026-02-17T05:36:18.507 INFO:tasks.rados.rados.0.trial118.stdout:1950: writing trial11845692-44 from 531286 to 1243211 tid 1 2026-02-17T05:36:18.512 INFO:tasks.rados.rados.0.trial118.stdout:1950: writing trial11845692-44 from 1912196 to 2618440 tid 2 2026-02-17T05:36:18.517 INFO:tasks.rados.rados.0.trial118.stdout:1950: writing trial11845692-44 from 3018543 to 3731286 tid 3 2026-02-17T05:36:18.517 INFO:tasks.rados.rados.0.trial118.stdout:1951: read oid 33 snap -1 2026-02-17T05:36:18.517 INFO:tasks.rados.rados.0.trial118.stdout:1951: expect (ObjNum 684 snap 200 seq_num 684) 2026-02-17T05:36:18.517 INFO:tasks.rados.rados.0.trial118.stdout:1952: write oid 6 current snap is 202 2026-02-17T05:36:18.517 INFO:tasks.rados.rados.0.trial118.stdout:1952: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2026-02-17T05:36:18.521 INFO:tasks.rados.rados.0.trial118.stdout:1952: writing trial11845692-6 from 548093 to 1335267 tid 1 2026-02-17T05:36:18.525 INFO:tasks.rados.rados.0.trial118.stdout:1952: writing trial11845692-6 from 1970678 to 2420580 tid 2 2026-02-17T05:36:18.531 INFO:tasks.rados.rados.0.trial118.stdout:1952: writing trial11845692-6 from 3045966 to 3727103 tid 3 2026-02-17T05:36:18.531 INFO:tasks.rados.rados.0.trial118.stdout:1953: write (excl) oid 24 current snap is 202 2026-02-17T05:36:18.531 INFO:tasks.rados.rados.0.trial118.stdout:1953: seq_num 700 ranges {564900=578776,1629160=709913,3073389=492409} 2026-02-17T05:36:18.535 INFO:tasks.rados.rados.0.trial118.stdout:1953: writing trial11845692-24 from 564900 to 1143676 tid 1 2026-02-17T05:36:18.540 INFO:tasks.rados.rados.0.trial118.stdout:1953: writing trial11845692-24 from 1629160 to 2339073 tid 2 2026-02-17T05:36:18.545 INFO:tasks.rados.rados.0.trial118.stdout:1953: writing trial11845692-24 from 3073389 to 3565798 tid 3 2026-02-17T05:36:18.545 INFO:tasks.rados.rados.0.trial118.stdout:1954: copy_from oid 8 from oid 49 current snap is 202 2026-02-17T05:36:18.545 INFO:tasks.rados.rados.0.trial118.stdout:1944: expect (ObjNum 676 snap 197 seq_num 676) 2026-02-17T05:36:18.545 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:18.592 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:18.681 INFO:tasks.rados.rados.0.trial118.stdout:1947: expect (ObjNum 686 snap 200 seq_num 686) 2026-02-17T05:36:18.681 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:18.774 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1948: finishing copy_from to trial11845692-15 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1948: got expected ENOENT (src dne) 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1948: finishing copy_from racing read to trial11845692-15 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1944: done (8 left) 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1947: done (7 left) 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1948: done (6 left) 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1955: write (excl) oid 37 current snap is 202 2026-02-17T05:36:18.820 INFO:tasks.rados.rados.0.trial118.stdout:1955: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2026-02-17T05:36:18.824 INFO:tasks.rados.rados.0.trial118.stdout:1955: writing trial11845692-37 from 581707 to 1235732 tid 1 2026-02-17T05:36:18.828 INFO:tasks.rados.rados.0.trial118.stdout:1955: writing trial11845692-37 from 1687642 to 2141213 tid 2 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1955: writing trial11845692-37 from 2700812 to 3404493 tid 3 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1956: write (excl) oid 18 current snap is 202 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1949: finishing copy_from racing read to trial11845692-43 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: finishing write tid 1 to trial11845692-44 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1949: finishing copy_from to trial11845692-43 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 730 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: finishing write tid 2 to trial11845692-44 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: finishing write tid 3 to trial11845692-44 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: finishing write tid 4 to trial11845692-44 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: finishing write tid 5 to trial11845692-44 2026-02-17T05:36:18.834 INFO:tasks.rados.rados.0.trial118.stdout:1950: oid 44 updating version 0 to 871 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:1950: oid 44 version 871 is already newer than 869 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:1950: oid 44 version 871 is already newer than 870 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:1950: oid 44 updating version 871 to 872 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 872 (ObjNum 698 snap 202 seq_num 698) dirty exists 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:1950: left oid 44 (ObjNum 698 snap 202 seq_num 698) 2026-02-17T05:36:18.835 INFO:tasks.rados.rados.0.trial118.stdout:1951: expect (ObjNum 684 snap 200 seq_num 684) 2026-02-17T05:36:18.886 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2928111 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: finishing write tid 1 to trial11845692-6 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: finishing write tid 2 to trial11845692-6 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: finishing write tid 3 to trial11845692-6 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: finishing write tid 4 to trial11845692-6 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: finishing write tid 5 to trial11845692-6 2026-02-17T05:36:18.893 INFO:tasks.rados.rados.0.trial118.stdout:1952: oid 6 updating version 0 to 662 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1952: oid 6 updating version 662 to 665 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1952: oid 6 version 665 is already newer than 663 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1952: oid 6 version 665 is already newer than 664 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 665 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1952: left oid 6 (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1953: finishing write tid 1 to trial11845692-24 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1953: finishing write tid 2 to trial11845692-24 2026-02-17T05:36:18.894 INFO:tasks.rados.rados.0.trial118.stdout:1956: seq_num 702 ranges {598514=729274,1746124=597229,3128235=514953} 2026-02-17T05:36:18.898 INFO:tasks.rados.rados.0.trial118.stdout:1956: writing trial11845692-18 from 598514 to 1327788 tid 1 2026-02-17T05:36:18.901 INFO:tasks.rados.rados.0.trial118.stdout:1956: writing trial11845692-18 from 1746124 to 2343353 tid 2 2026-02-17T05:36:18.907 INFO:tasks.rados.rados.0.trial118.stdout:1956: writing trial11845692-18 from 3128235 to 3643188 tid 3 2026-02-17T05:36:18.908 INFO:tasks.rados.rados.0.trial118.stdout:1949: done (7 left) 2026-02-17T05:36:18.908 INFO:tasks.rados.rados.0.trial118.stdout:1950: done (6 left) 2026-02-17T05:36:18.908 INFO:tasks.rados.rados.0.trial118.stdout:1951: done (5 left) 2026-02-17T05:36:18.908 INFO:tasks.rados.rados.0.trial118.stdout:1952: done (4 left) 2026-02-17T05:36:18.908 INFO:tasks.rados.rados.0.trial118.stdout:1957: write oid 27 current snap is 202 2026-02-17T05:36:18.909 INFO:tasks.rados.rados.0.trial118.stdout:1957: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2026-02-17T05:36:18.911 INFO:tasks.rados.rados.0.trial118.stdout:1957: writing trial11845692-27 from 615321 to 1019844 tid 1 2026-02-17T05:36:18.915 INFO:tasks.rados.rados.0.trial118.stdout:1957: writing trial11845692-27 from 1804606 to 2261846 tid 2 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1957: writing trial11845692-27 from 2755658 to 3481883 tid 3 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1958: delete oid 33 current snap is 202 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: finishing write tid 3 to trial11845692-24 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: finishing write tid 4 to trial11845692-24 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: finishing write tid 5 to trial11845692-24 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: oid 24 updating version 0 to 873 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: oid 24 updating version 873 to 874 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: oid 24 updating version 874 to 875 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: oid 24 updating version 875 to 876 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 876 (ObjNum 700 snap 202 seq_num 700) dirty exists 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1953: left oid 24 (ObjNum 700 snap 202 seq_num 700) 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1954: finishing copy_from racing read to trial11845692-8 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1954: finishing copy_from to trial11845692-8 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 870 (ObjNum 690 snap 200 seq_num 690) dirty exists 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: finishing write tid 1 to trial11845692-37 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: finishing write tid 2 to trial11845692-37 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: finishing write tid 3 to trial11845692-37 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: finishing write tid 4 to trial11845692-37 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: finishing write tid 5 to trial11845692-37 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: oid 37 updating version 0 to 156 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: oid 37 updating version 156 to 157 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: oid 37 updating version 157 to 158 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: oid 37 version 158 is already newer than 155 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 158 (ObjNum 701 snap 202 seq_num 701) dirty exists 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1955: left oid 37 (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: finishing write tid 1 to trial11845692-18 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: finishing write tid 2 to trial11845692-18 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: finishing write tid 3 to trial11845692-18 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: finishing write tid 4 to trial11845692-18 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: finishing write tid 5 to trial11845692-18 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: oid 18 updating version 0 to 719 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: oid 18 version 719 is already newer than 717 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: oid 18 updating version 719 to 720 2026-02-17T05:36:18.920 INFO:tasks.rados.rados.0.trial118.stdout:1956: oid 18 version 720 is already newer than 718 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 720 (ObjNum 702 snap 202 seq_num 702) dirty exists 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1956: left oid 18 (ObjNum 702 snap 202 seq_num 702) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1957: finishing write tid 1 to trial11845692-27 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1957: finishing write tid 2 to trial11845692-27 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1957: finishing write tid 3 to trial11845692-27 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1953: done (5 left) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1954: done (4 left) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1955: done (3 left) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1956: done (2 left) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1958: done (1 left) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1959: read oid 14 snap -1 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1959: expect (ObjNum 609 snap 177 seq_num 609) 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1960: rollback oid 19 current snap is 202 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 201 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1957: finishing write tid 4 to trial11845692-27 2026-02-17T05:36:18.921 INFO:tasks.rados.rados.0.trial118.stdout:1961: snap_create 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: finishing write tid 5 to trial11845692-27 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: oid 27 updating version 0 to 1184 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: oid 27 updating version 1184 to 1187 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: oid 27 version 1187 is already newer than 1185 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: oid 27 version 1187 is already newer than 1186 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1187 (ObjNum 703 snap 202 seq_num 703) dirty exists 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1957: left oid 27 (ObjNum 703 snap 202 seq_num 703) 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:1960: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:36:18.922 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 726 (ObjNum 12527136 snap 0 seq_num 304) dirty dne 2026-02-17T05:36:18.926 INFO:tasks.rados.rados.0.trial118.stdout:1959: expect (ObjNum 609 snap 177 seq_num 609) 2026-02-17T05:36:18.926 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:19.317 INFO:tasks.rados.rados.0.trial118.stdout:1957: done (3 left) 2026-02-17T05:36:19.318 INFO:tasks.rados.rados.0.trial118.stdout:1959: done (2 left) 2026-02-17T05:36:19.318 INFO:tasks.rados.rados.0.trial118.stdout:1960: done (1 left) 2026-02-17T05:36:19.318 INFO:tasks.rados.rados.0.trial118.stdout:1961: done (0 left) 2026-02-17T05:36:19.318 INFO:tasks.rados.rados.0.trial118.stdout:1962: delete oid 15 current snap is 203 2026-02-17T05:36:19.318 INFO:tasks.rados.rados.0.trial118.stdout:1962: done (0 left) 2026-02-17T05:36:19.319 INFO:tasks.rados.rados.0.trial118.stdout:1963: delete oid 8 current snap is 203 2026-02-17T05:36:19.321 INFO:tasks.rados.rados.0.trial118.stdout:1963: done (0 left) 2026-02-17T05:36:19.321 INFO:tasks.rados.rados.0.trial118.stdout:1964: read oid 23 snap -1 2026-02-17T05:36:19.321 INFO:tasks.rados.rados.0.trial118.stdout:1964: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:19.321 INFO:tasks.rados.rados.0.trial118.stdout:1965: delete oid 25 current snap is 203 2026-02-17T05:36:19.322 INFO:tasks.rados.rados.0.trial118.stdout:1965: done (1 left) 2026-02-17T05:36:19.322 INFO:tasks.rados.rados.0.trial118.stdout:1966: snap_create 2026-02-17T05:36:19.324 INFO:tasks.rados.rados.0.trial118.stdout:1964: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:19.325 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:19.378 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2804280 2026-02-17T05:36:20.299 INFO:tasks.rados.rados.0.trial118.stdout:1964: done (1 left) 2026-02-17T05:36:20.300 INFO:tasks.rados.rados.0.trial118.stdout:1966: done (0 left) 2026-02-17T05:36:20.300 INFO:tasks.rados.rados.0.trial118.stdout:1967: write oid 9 current snap is 204 2026-02-17T05:36:20.300 INFO:tasks.rados.rados.0.trial118.stdout:1967: seq_num 708 ranges {699356=497121,1980663=608236,3176420=415291} 2026-02-17T05:36:20.304 INFO:tasks.rados.rados.0.trial118.stdout:1967: writing trial11845692-9 from 699356 to 1196477 tid 1 2026-02-17T05:36:20.310 INFO:tasks.rados.rados.0.trial118.stdout:1967: writing trial11845692-9 from 1980663 to 2588899 tid 2 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1967: writing trial11845692-9 from 3176420 to 3591711 tid 3 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1968: rollback oid 13 current snap is 204 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 163 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1967: finishing write tid 1 to trial11845692-9 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1967: finishing write tid 2 to trial11845692-9 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1969: read oid 7 snap -1 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1969: expect (ObjNum 642 snap 190 seq_num 642) 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1970: read oid 31 snap -1 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1970: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:20.314 INFO:tasks.rados.rados.0.trial118.stdout:1971: read oid 43 snap -1 2026-02-17T05:36:20.315 INFO:tasks.rados.rados.0.trial118.stdout:1971: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:20.315 INFO:tasks.rados.rados.0.trial118.stdout:1972: write (excl) oid 47 current snap is 204 2026-02-17T05:36:20.315 INFO:tasks.rados.rados.0.trial118.stdout:1972: seq_num 709 ranges {716163=572370,2039145=468247,3203843=626563} 2026-02-17T05:36:20.319 INFO:tasks.rados.rados.0.trial118.stdout:1972: writing trial11845692-47 from 716163 to 1288533 tid 1 2026-02-17T05:36:20.324 INFO:tasks.rados.rados.0.trial118.stdout:1972: writing trial11845692-47 from 2039145 to 2507392 tid 2 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1972: writing trial11845692-47 from 3203843 to 3830406 tid 3 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1973: read oid 11 snap 202 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1973: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1974: read oid 28 snap -1 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1974: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1975: snap_create 2026-02-17T05:36:20.331 INFO:tasks.rados.rados.0.trial118.stdout:1967: finishing write tid 3 to trial11845692-9 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: finishing write tid 4 to trial11845692-9 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: finishing write tid 5 to trial11845692-9 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: oid 9 updating version 0 to 920 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: oid 9 updating version 920 to 921 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: oid 9 version 921 is already newer than 919 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: oid 9 version 921 is already newer than 918 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 921 (ObjNum 708 snap 204 seq_num 708) dirty exists 2026-02-17T05:36:20.332 INFO:tasks.rados.rados.0.trial118.stdout:1967: left oid 9 (ObjNum 708 snap 204 seq_num 708) 2026-02-17T05:36:20.333 INFO:tasks.rados.rados.0.trial118.stdout:1969: expect (ObjNum 642 snap 190 seq_num 642) 2026-02-17T05:36:20.333 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:20.400 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:20.437 INFO:tasks.rados.rados.0.trial118.stdout:1968: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:36:20.437 INFO:tasks.rados.rados.0.trial118.stdout:1968: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:36:20.438 INFO:tasks.rados.rados.0.trial118.stdout:1968: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:36:20.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 733 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-17T05:36:20.438 INFO:tasks.rados.rados.0.trial118.stdout:1970: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:20.471 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1744910 2026-02-17T05:36:20.511 INFO:tasks.rados.rados.0.trial118.stdout:1971: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:20.592 INFO:tasks.rados.rados.0.trial118.stdout:1972: finishing write tid 1 to trial11845692-47 2026-02-17T05:36:20.592 INFO:tasks.rados.rados.0.trial118.stdout:1972: finishing write tid 2 to trial11845692-47 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: finishing write tid 3 to trial11845692-47 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: finishing write tid 4 to trial11845692-47 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: finishing write tid 5 to trial11845692-47 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: oid 47 updating version 0 to 996 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: oid 47 updating version 996 to 998 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: oid 47 version 998 is already newer than 997 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: oid 47 updating version 998 to 999 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 999 (ObjNum 709 snap 204 seq_num 709) dirty exists 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1972: left oid 47 (ObjNum 709 snap 204 seq_num 709) 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:1973: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:20.593 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:20.661 INFO:tasks.rados.rados.0.trial118.stdout:1974: expect (ObjNum 567 snap 155 seq_num 567) 2026-02-17T05:36:20.670 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1441232 2026-02-17T05:36:20.731 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:21.328 INFO:tasks.rados.rados.0.trial118.stdout:1967: done (8 left) 2026-02-17T05:36:21.328 INFO:tasks.rados.rados.0.trial118.stdout:1968: done (7 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1969: done (6 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1970: done (5 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1971: done (4 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1972: done (3 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1973: done (2 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1974: done (1 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1975: done (0 left) 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1976: read oid 8 snap -1 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1976: expect deleted 2026-02-17T05:36:21.329 INFO:tasks.rados.rados.0.trial118.stdout:1977: read oid 31 snap 197 2026-02-17T05:36:21.330 INFO:tasks.rados.rados.0.trial118.stdout:1977: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:21.330 INFO:tasks.rados.rados.0.trial118.stdout:1978: copy_from oid 25 from oid 5 current snap is 205 2026-02-17T05:36:21.330 INFO:tasks.rados.rados.0.trial118.stdout:1979: read oid 6 snap -1 2026-02-17T05:36:21.330 INFO:tasks.rados.rados.0.trial118.stdout:1979: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:36:21.330 INFO:tasks.rados.rados.0.trial118.stdout:1980: delete oid 15 current snap is 205 2026-02-17T05:36:21.331 INFO:tasks.rados.rados.0.trial118.stdout:1978: finishing copy_from to trial11845692-25 2026-02-17T05:36:21.331 INFO:tasks.rados.rados.0.trial118.stdout:1978: got expected ENOENT (src dne) 2026-02-17T05:36:21.331 INFO:tasks.rados.rados.0.trial118.stdout:1978: finishing copy_from racing read to trial11845692-25 2026-02-17T05:36:21.331 INFO:tasks.rados.rados.0.trial118.stdout:1976: done (4 left) 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1978: done (3 left) 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1980: done (2 left) 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1981: read oid 5 snap -1 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1981: expect deleted 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1982: snap_create 2026-02-17T05:36:21.332 INFO:tasks.rados.rados.0.trial118.stdout:1977: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:21.350 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2855943 2026-02-17T05:36:21.352 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 578998 2026-02-17T05:36:21.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 935201 2026-02-17T05:36:21.399 INFO:tasks.rados.rados.0.trial118.stdout:1979: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:36:21.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1671675 2026-02-17T05:36:21.547 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3694385 2026-02-17T05:36:22.330 INFO:tasks.rados.rados.0.trial118.stdout:1977: done (3 left) 2026-02-17T05:36:22.330 INFO:tasks.rados.rados.0.trial118.stdout:1979: done (2 left) 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:1981: done (1 left) 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:1982: done (0 left) 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:1983: rollback oid 25 current snap is 206 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 25 to 201 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:1984: copy_from oid 13 from oid 40 current snap is 206 2026-02-17T05:36:22.331 INFO:tasks.rados.rados.0.trial118.stdout:1985: snap_create 2026-02-17T05:36:22.335 INFO:tasks.rados.rados.0.trial118.stdout:1983: finishing rollback tid 1 to trial11845692-25 2026-02-17T05:36:22.335 INFO:tasks.rados.rados.0.trial118.stdout:1983: finishing rollback tid 2 to trial11845692-25 2026-02-17T05:36:22.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1105 (ObjNum 693 snap 201 seq_num 693) dirty exists 2026-02-17T05:36:22.341 INFO:tasks.rados.rados.0.trial118.stdout:1984: finishing copy_from racing read to trial11845692-13 2026-02-17T05:36:22.342 INFO:tasks.rados.rados.0.trial118.stdout:1984: finishing copy_from to trial11845692-13 2026-02-17T05:36:22.342 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1079 (ObjNum 691 snap 201 seq_num 691) dirty exists 2026-02-17T05:36:23.332 INFO:tasks.rados.rados.0.trial118.stdout:1983: done (2 left) 2026-02-17T05:36:23.332 INFO:tasks.rados.rados.0.trial118.stdout:1984: done (1 left) 2026-02-17T05:36:23.332 INFO:tasks.rados.rados.0.trial118.stdout:1985: done (0 left) 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:1986: rollback oid 48 current snap is 207 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 205 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:1987: rollback oid 15 current snap is 207 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 197 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:1988: rollback oid 3 current snap is 207 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 199 2026-02-17T05:36:23.333 INFO:tasks.rados.rados.0.trial118.stdout:1989: snap_remove snap 202 2026-02-17T05:36:24.337 INFO:tasks.rados.rados.0.trial118.stdout:1989: done (3 left) 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1990: snap_create 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1988: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1988: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1988: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1082 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1986: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1986: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:1986: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:36:24.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1161 (ObjNum 618 snap 181 seq_num 618) dirty exists 2026-02-17T05:36:24.339 INFO:tasks.rados.rados.0.trial118.stdout:1987: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:36:24.339 INFO:tasks.rados.rados.0.trial118.stdout:1987: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:36:24.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1163 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1986: done (3 left) 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1987: done (2 left) 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1988: done (1 left) 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1990: done (0 left) 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1991: copy_from oid 24 from oid 14 current snap is 208 2026-02-17T05:36:25.301 INFO:tasks.rados.rados.0.trial118.stdout:1992: delete oid 47 current snap is 208 2026-02-17T05:36:25.304 INFO:tasks.rados.rados.0.trial118.stdout:1992: done (1 left) 2026-02-17T05:36:25.305 INFO:tasks.rados.rados.0.trial118.stdout:1993: write oid 5 current snap is 208 2026-02-17T05:36:25.305 INFO:tasks.rados.rados.0.trial118.stdout:1993: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2026-02-17T05:36:25.311 INFO:tasks.rados.rados.0.trial118.stdout:1993: writing trial11845692-5 from 766584 to 1564701 tid 1 2026-02-17T05:36:25.316 INFO:tasks.rados.rados.0.trial118.stdout:1993: writing trial11845692-5 from 2098238 to 2713812 tid 2 2026-02-17T05:36:25.319 INFO:tasks.rados.rados.0.trial118.stdout:1993: writing trial11845692-5 from 3169759 to 3630138 tid 3 2026-02-17T05:36:25.319 INFO:tasks.rados.rados.0.trial118.stdout:1994: snap_remove snap 194 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1994: done (2 left) 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1995: snap_create 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1991: finishing copy_from racing read to trial11845692-24 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1991: finishing copy_from to trial11845692-24 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 728 (ObjNum 609 snap 177 seq_num 609) dirty exists 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: finishing write tid 1 to trial11845692-5 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: finishing write tid 2 to trial11845692-5 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: finishing write tid 3 to trial11845692-5 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: finishing write tid 4 to trial11845692-5 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: finishing write tid 5 to trial11845692-5 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: oid 5 updating version 0 to 733 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: oid 5 version 733 is already newer than 732 2026-02-17T05:36:26.303 INFO:tasks.rados.rados.0.trial118.stdout:1993: oid 5 version 733 is already newer than 731 2026-02-17T05:36:26.304 INFO:tasks.rados.rados.0.trial118.stdout:1993: oid 5 updating version 733 to 734 2026-02-17T05:36:26.304 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 734 (ObjNum 712 snap 208 seq_num 712) dirty exists 2026-02-17T05:36:26.304 INFO:tasks.rados.rados.0.trial118.stdout:1993: left oid 5 (ObjNum 712 snap 208 seq_num 712) 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1991: done (2 left) 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1993: done (1 left) 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1995: done (0 left) 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1996: read oid 29 snap -1 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1996: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:27.304 INFO:tasks.rados.rados.0.trial118.stdout:1997: rollback oid 15 current snap is 209 2026-02-17T05:36:27.305 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 208 2026-02-17T05:36:27.305 INFO:tasks.rados.rados.0.trial118.stdout:1998: write oid 28 current snap is 209 2026-02-17T05:36:27.305 INFO:tasks.rados.rados.0.trial118.stdout:1998: seq_num 713 ranges {783391=473366,1756720=475585,2797182=788004} 2026-02-17T05:36:27.309 INFO:tasks.rados.rados.0.trial118.stdout:1998: writing trial11845692-28 from 783391 to 1256757 tid 1 2026-02-17T05:36:27.312 INFO:tasks.rados.rados.0.trial118.stdout:1998: writing trial11845692-28 from 1756720 to 2232305 tid 2 2026-02-17T05:36:27.318 INFO:tasks.rados.rados.0.trial118.stdout:1998: writing trial11845692-28 from 2797182 to 3585186 tid 3 2026-02-17T05:36:27.318 INFO:tasks.rados.rados.0.trial118.stdout:1999: delete oid 9 current snap is 209 2026-02-17T05:36:27.318 INFO:tasks.rados.rados.0.trial118.stdout:1997: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:36:27.318 INFO:tasks.rados.rados.0.trial118.stdout:1997: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:36:27.319 INFO:tasks.rados.rados.0.trial118.stdout:1997: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:36:27.319 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1166 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:36:27.319 INFO:tasks.rados.rados.0.trial118.stdout:1996: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:27.336 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 179794 2026-02-17T05:36:27.359 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1926767 2026-02-17T05:36:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1998: finishing write tid 1 to trial11845692-28 2026-02-17T05:36:27.363 INFO:tasks.rados.rados.0.trial118.stdout:1998: finishing write tid 2 to trial11845692-28 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1996: done (3 left) 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1997: done (2 left) 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1999: done (1 left) 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:2000: read oid 33 snap -1 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:2000: expect deleted 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:2001: delete oid 40 current snap is 209 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1998: finishing write tid 3 to trial11845692-28 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1998: finishing write tid 4 to trial11845692-28 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1998: finishing write tid 5 to trial11845692-28 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1998: oid 28 updating version 0 to 723 2026-02-17T05:36:27.364 INFO:tasks.rados.rados.0.trial118.stdout:1998: oid 28 version 723 is already newer than 721 2026-02-17T05:36:27.365 INFO:tasks.rados.rados.0.trial118.stdout:1998: oid 28 updating version 723 to 724 2026-02-17T05:36:27.365 INFO:tasks.rados.rados.0.trial118.stdout:1998: oid 28 version 724 is already newer than 722 2026-02-17T05:36:27.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 724 (ObjNum 713 snap 209 seq_num 713) dirty exists 2026-02-17T05:36:27.365 INFO:tasks.rados.rados.0.trial118.stdout:1998: left oid 28 (ObjNum 713 snap 209 seq_num 713) 2026-02-17T05:36:27.365 INFO:tasks.rados.rados.0.trial118.stdout:1998: done (2 left) 2026-02-17T05:36:27.366 INFO:tasks.rados.rados.0.trial118.stdout:2000: done (1 left) 2026-02-17T05:36:27.366 INFO:tasks.rados.rados.0.trial118.stdout:2001: done (0 left) 2026-02-17T05:36:27.366 INFO:tasks.rados.rados.0.trial118.stdout:2002: delete oid 19 current snap is 209 2026-02-17T05:36:27.366 INFO:tasks.rados.rados.0.trial118.stdout:2002: done (0 left) 2026-02-17T05:36:27.366 INFO:tasks.rados.rados.0.trial118.stdout:2003: snap_remove snap 205 2026-02-17T05:36:28.308 INFO:tasks.rados.rados.0.trial118.stdout:2003: done (0 left) 2026-02-17T05:36:28.308 INFO:tasks.rados.rados.0.trial118.stdout:2004: copy_from oid 40 from oid 15 current snap is 209 2026-02-17T05:36:28.308 INFO:tasks.rados.rados.0.trial118.stdout:2005: rollback oid 23 current snap is 209 2026-02-17T05:36:28.308 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 23 to 193 2026-02-17T05:36:28.308 INFO:tasks.rados.rados.0.trial118.stdout:2006: delete oid 36 current snap is 209 2026-02-17T05:36:28.311 INFO:tasks.rados.rados.0.trial118.stdout:2005: finishing rollback tid 0 to trial11845692-23 2026-02-17T05:36:28.312 INFO:tasks.rados.rados.0.trial118.stdout:2005: finishing rollback tid 1 to trial11845692-23 2026-02-17T05:36:28.312 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 667 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:36:28.313 INFO:tasks.rados.rados.0.trial118.stdout:2005: done (2 left) 2026-02-17T05:36:28.314 INFO:tasks.rados.rados.0.trial118.stdout:2006: done (1 left) 2026-02-17T05:36:28.314 INFO:tasks.rados.rados.0.trial118.stdout:2007: delete oid 22 current snap is 209 2026-02-17T05:36:28.315 INFO:tasks.rados.rados.0.trial118.stdout:2007: done (1 left) 2026-02-17T05:36:28.315 INFO:tasks.rados.rados.0.trial118.stdout:2008: snap_create 2026-02-17T05:36:28.319 INFO:tasks.rados.rados.0.trial118.stdout:2004: finishing copy_from racing read to trial11845692-40 2026-02-17T05:36:28.320 INFO:tasks.rados.rados.0.trial118.stdout:2004: finishing copy_from to trial11845692-40 2026-02-17T05:36:28.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1166 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:36:29.311 INFO:tasks.rados.rados.0.trial118.stdout:2004: done (1 left) 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2008: done (0 left) 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2009: read oid 8 snap -1 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2009: expect deleted 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2010: copy_from oid 36 from oid 37 current snap is 210 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2011: read oid 47 snap -1 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2011: expect deleted 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2012: read oid 3 snap -1 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2012: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2013: read oid 22 snap 204 2026-02-17T05:36:29.312 INFO:tasks.rados.rados.0.trial118.stdout:2013: expect (ObjNum 676 snap 197 seq_num 676) 2026-02-17T05:36:29.313 INFO:tasks.rados.rados.0.trial118.stdout:2014: write oid 18 current snap is 210 2026-02-17T05:36:29.313 INFO:tasks.rados.rados.0.trial118.stdout:2014: seq_num 719 ranges {484233=641213,1707612=376621} 2026-02-17T05:36:29.315 INFO:tasks.rados.rados.0.trial118.stdout:2014: writing trial11845692-18 from 484233 to 1125446 tid 1 2026-02-17T05:36:29.320 INFO:tasks.rados.rados.0.trial118.stdout:2014: writing trial11845692-18 from 1707612 to 2084233 tid 2 2026-02-17T05:36:29.320 INFO:tasks.rados.rados.0.trial118.stdout:2015: read oid 25 snap -1 2026-02-17T05:36:29.320 INFO:tasks.rados.rados.0.trial118.stdout:2015: expect (ObjNum 693 snap 201 seq_num 693) 2026-02-17T05:36:29.320 INFO:tasks.rados.rados.0.trial118.stdout:2016: snap_create 2026-02-17T05:36:29.320 INFO:tasks.rados.rados.0.trial118.stdout:2012: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:29.354 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1236132 2026-02-17T05:36:29.407 INFO:tasks.rados.rados.0.trial118.stdout:2013: expect (ObjNum 676 snap 197 seq_num 676) 2026-02-17T05:36:29.496 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:29.542 INFO:tasks.rados.rados.0.trial118.stdout:2014: finishing write tid 1 to trial11845692-18 2026-02-17T05:36:29.542 INFO:tasks.rados.rados.0.trial118.stdout:2010: finishing copy_from racing read to trial11845692-36 2026-02-17T05:36:29.542 INFO:tasks.rados.rados.0.trial118.stdout:2014: finishing write tid 2 to trial11845692-18 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: finishing write tid 3 to trial11845692-18 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: finishing write tid 4 to trial11845692-18 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: oid 18 updating version 0 to 727 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: oid 18 version 727 is already newer than 726 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: oid 18 version 727 is already newer than 725 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 727 (ObjNum 719 snap 210 seq_num 719) dirty exists 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2014: left oid 18 (ObjNum 719 snap 210 seq_num 719) 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2010: finishing copy_from to trial11845692-36 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 158 (ObjNum 701 snap 202 seq_num 701) dirty exists 2026-02-17T05:36:29.543 INFO:tasks.rados.rados.0.trial118.stdout:2015: expect (ObjNum 693 snap 201 seq_num 693) 2026-02-17T05:36:29.577 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:30.302 INFO:tasks.rados.rados.0.trial118.stdout:2009: done (7 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2010: done (6 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2011: done (5 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2012: done (4 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2013: done (3 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2014: done (2 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2015: done (1 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2016: done (0 left) 2026-02-17T05:36:30.303 INFO:tasks.rados.rados.0.trial118.stdout:2017: delete oid 14 current snap is 211 2026-02-17T05:36:30.305 INFO:tasks.rados.rados.0.trial118.stdout:2017: done (0 left) 2026-02-17T05:36:30.305 INFO:tasks.rados.rados.0.trial118.stdout:2018: read oid 50 snap -1 2026-02-17T05:36:30.305 INFO:tasks.rados.rados.0.trial118.stdout:2018: expect (ObjNum 669 snap 195 seq_num 669) 2026-02-17T05:36:30.305 INFO:tasks.rados.rados.0.trial118.stdout:2019: write (excl) oid 3 current snap is 211 2026-02-17T05:36:30.305 INFO:tasks.rados.rados.0.trial118.stdout:2019: seq_num 721 ranges {517847=791711,2108223=9624} 2026-02-17T05:36:30.311 INFO:tasks.rados.rados.0.trial118.stdout:2019: writing trial11845692-3 from 517847 to 1309558 tid 1 2026-02-17T05:36:30.314 INFO:tasks.rados.rados.0.trial118.stdout:2019: writing trial11845692-3 from 2108223 to 2117847 tid 2 2026-02-17T05:36:30.314 INFO:tasks.rados.rados.0.trial118.stdout:2020: write oid 2 current snap is 211 2026-02-17T05:36:30.314 INFO:tasks.rados.rados.0.trial118.stdout:2020: seq_num 722 ranges {534654=466960,1766705=367949} 2026-02-17T05:36:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2020: writing trial11845692-2 from 534654 to 1001614 tid 1 2026-02-17T05:36:30.322 INFO:tasks.rados.rados.0.trial118.stdout:2020: writing trial11845692-2 from 1766705 to 2134654 tid 2 2026-02-17T05:36:30.322 INFO:tasks.rados.rados.0.trial118.stdout:2021: write oid 14 current snap is 211 2026-02-17T05:36:30.322 INFO:tasks.rados.rados.0.trial118.stdout:2021: seq_num 723 ranges {551461=658562,1941540=209921} 2026-02-17T05:36:30.326 INFO:tasks.rados.rados.0.trial118.stdout:2021: writing trial11845692-14 from 551461 to 1210023 tid 1 2026-02-17T05:36:30.330 INFO:tasks.rados.rados.0.trial118.stdout:2021: writing trial11845692-14 from 1941540 to 2151461 tid 2 2026-02-17T05:36:30.330 INFO:tasks.rados.rados.0.trial118.stdout:2022: write (excl) oid 12 current snap is 211 2026-02-17T05:36:30.330 INFO:tasks.rados.rados.0.trial118.stdout:2022: seq_num 724 ranges {568268=733811,2000022=168246} 2026-02-17T05:36:30.335 INFO:tasks.rados.rados.0.trial118.stdout:2022: writing trial11845692-12 from 568268 to 1302079 tid 1 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2022: writing trial11845692-12 from 2000022 to 2168268 tid 2 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2023: read oid 42 snap -1 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2023: expect deleted 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2024: read oid 4 snap -1 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2024: expect deleted 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2025: rollback oid 27 current snap is 211 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 27 to 208 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:2018: expect (ObjNum 669 snap 195 seq_num 669) 2026-02-17T05:36:30.338 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:30.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:30.426 INFO:tasks.rados.rados.0.trial118.stdout:2019: finishing write tid 1 to trial11845692-3 2026-02-17T05:36:30.426 INFO:tasks.rados.rados.0.trial118.stdout:2019: finishing write tid 2 to trial11845692-3 2026-02-17T05:36:30.426 INFO:tasks.rados.rados.0.trial118.stdout:2019: finishing write tid 3 to trial11845692-3 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: finishing write tid 4 to trial11845692-3 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: oid 3 updating version 0 to 1085 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: oid 3 version 1085 is already newer than 1084 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: oid 3 version 1085 is already newer than 1083 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1085 (ObjNum 721 snap 211 seq_num 721) dirty exists 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: left oid 3 (ObjNum 721 snap 211 seq_num 721) 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2020: finishing write tid 1 to trial11845692-2 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2018: done (7 left) 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2019: done (6 left) 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2026: snap_create 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2020: finishing write tid 2 to trial11845692-2 2026-02-17T05:36:30.427 INFO:tasks.rados.rados.0.trial118.stdout:2020: finishing write tid 3 to trial11845692-2 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2020: finishing write tid 4 to trial11845692-2 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2020: oid 2 updating version 0 to 1202 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2020: oid 2 version 1202 is already newer than 1200 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2020: oid 2 version 1202 is already newer than 1201 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1202 (ObjNum 722 snap 211 seq_num 722) dirty exists 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2020: left oid 2 (ObjNum 722 snap 211 seq_num 722) 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: finishing write tid 1 to trial11845692-14 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: finishing write tid 2 to trial11845692-14 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: finishing write tid 3 to trial11845692-14 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: finishing write tid 4 to trial11845692-14 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: oid 14 updating version 0 to 737 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: oid 14 updating version 737 to 738 2026-02-17T05:36:30.428 INFO:tasks.rados.rados.0.trial118.stdout:2021: oid 14 version 738 is already newer than 736 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 738 (ObjNum 723 snap 211 seq_num 723) dirty exists 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2021: left oid 14 (ObjNum 723 snap 211 seq_num 723) 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: finishing write tid 1 to trial11845692-12 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: finishing write tid 2 to trial11845692-12 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: finishing write tid 3 to trial11845692-12 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: finishing write tid 4 to trial11845692-12 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: oid 12 updating version 0 to 745 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: oid 12 updating version 745 to 746 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: oid 12 version 746 is already newer than 744 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 746 (ObjNum 724 snap 211 seq_num 724) dirty exists 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2022: left oid 12 (ObjNum 724 snap 211 seq_num 724) 2026-02-17T05:36:30.429 INFO:tasks.rados.rados.0.trial118.stdout:2025: finishing rollback tid 0 to trial11845692-27 2026-02-17T05:36:30.430 INFO:tasks.rados.rados.0.trial118.stdout:2025: finishing rollback tid 1 to trial11845692-27 2026-02-17T05:36:30.430 INFO:tasks.rados.rados.0.trial118.stdout:2025: finishing rollback tid 2 to trial11845692-27 2026-02-17T05:36:30.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1206 (ObjNum 703 snap 202 seq_num 703) dirty exists 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2020: done (6 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2021: done (5 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2022: done (4 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2023: done (3 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2024: done (2 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2025: done (1 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2026: done (0 left) 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2027: write oid 41 current snap is 212 2026-02-17T05:36:31.317 INFO:tasks.rados.rados.0.trial118.stdout:2027: seq_num 725 ranges {585075=409060,1542151=642924} 2026-02-17T05:36:31.321 INFO:tasks.rados.rados.0.trial118.stdout:2027: writing trial11845692-41 from 585075 to 994135 tid 1 2026-02-17T05:36:31.326 INFO:tasks.rados.rados.0.trial118.stdout:2027: writing trial11845692-41 from 1542151 to 2185075 tid 2 2026-02-17T05:36:31.326 INFO:tasks.rados.rados.0.trial118.stdout:2028: write (excl) oid 50 current snap is 212 2026-02-17T05:36:31.326 INFO:tasks.rados.rados.0.trial118.stdout:2027: finishing write tid 1 to trial11845692-41 2026-02-17T05:36:31.326 INFO:tasks.rados.rados.0.trial118.stdout:2028: seq_num 726 ranges {601882=484309,1600633=524904} 2026-02-17T05:36:31.330 INFO:tasks.rados.rados.0.trial118.stdout:2028: writing trial11845692-50 from 601882 to 1086191 tid 1 2026-02-17T05:36:31.335 INFO:tasks.rados.rados.0.trial118.stdout:2028: writing trial11845692-50 from 1600633 to 2125537 tid 2 2026-02-17T05:36:31.335 INFO:tasks.rados.rados.0.trial118.stdout:2029: copy_from oid 12 from oid 44 current snap is 212 2026-02-17T05:36:31.335 INFO:tasks.rados.rados.0.trial118.stdout:2027: finishing write tid 2 to trial11845692-41 2026-02-17T05:36:31.335 INFO:tasks.rados.rados.0.trial118.stdout:2030: snap_remove snap 203 2026-02-17T05:36:32.321 INFO:tasks.rados.rados.0.trial118.stdout:2030: done (3 left) 2026-02-17T05:36:32.322 INFO:tasks.rados.rados.0.trial118.stdout:2031: write oid 24 current snap is 212 2026-02-17T05:36:32.322 INFO:tasks.rados.rados.0.trial118.stdout:2031: seq_num 727 ranges {618689=559558,1659115=559574} 2026-02-17T05:36:32.326 INFO:tasks.rados.rados.0.trial118.stdout:2031: writing trial11845692-24 from 618689 to 1178247 tid 1 2026-02-17T05:36:32.331 INFO:tasks.rados.rados.0.trial118.stdout:2031: writing trial11845692-24 from 1659115 to 2218689 tid 2 2026-02-17T05:36:32.331 INFO:tasks.rados.rados.0.trial118.stdout:2032: snap_create 2026-02-17T05:36:32.331 INFO:tasks.rados.rados.0.trial118.stdout:2027: finishing write tid 3 to trial11845692-41 2026-02-17T05:36:32.331 INFO:tasks.rados.rados.0.trial118.stdout:2027: finishing write tid 4 to trial11845692-41 2026-02-17T05:36:32.331 INFO:tasks.rados.rados.0.trial118.stdout:2027: oid 41 updating version 0 to 933 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2027: oid 41 version 933 is already newer than 932 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2027: oid 41 version 933 is already newer than 931 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 933 (ObjNum 725 snap 212 seq_num 725) dirty exists 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2027: left oid 41 (ObjNum 725 snap 212 seq_num 725) 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: finishing write tid 1 to trial11845692-50 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: finishing write tid 2 to trial11845692-50 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: finishing write tid 3 to trial11845692-50 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: finishing write tid 4 to trial11845692-50 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: oid 50 updating version 0 to 747 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: oid 50 updating version 747 to 749 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:2028: oid 50 version 749 is already newer than 748 2026-02-17T05:36:32.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 749 (ObjNum 726 snap 212 seq_num 726) dirty exists 2026-02-17T05:36:32.333 INFO:tasks.rados.rados.0.trial118.stdout:2028: left oid 50 (ObjNum 726 snap 212 seq_num 726) 2026-02-17T05:36:32.333 INFO:tasks.rados.rados.0.trial118.stdout:2029: finishing copy_from racing read to trial11845692-12 2026-02-17T05:36:32.333 INFO:tasks.rados.rados.0.trial118.stdout:2029: finishing copy_from to trial11845692-12 2026-02-17T05:36:32.333 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 872 (ObjNum 698 snap 202 seq_num 698) dirty exists 2026-02-17T05:36:32.333 INFO:tasks.rados.rados.0.trial118.stdout:2031: finishing write tid 1 to trial11845692-24 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: finishing write tid 2 to trial11845692-24 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: finishing write tid 3 to trial11845692-24 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: finishing write tid 4 to trial11845692-24 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: oid 24 updating version 0 to 877 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: oid 24 updating version 877 to 878 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: oid 24 updating version 878 to 879 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 879 (ObjNum 727 snap 212 seq_num 727) dirty exists 2026-02-17T05:36:32.334 INFO:tasks.rados.rados.0.trial118.stdout:2031: left oid 24 (ObjNum 727 snap 212 seq_num 727) 2026-02-17T05:36:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2027: done (4 left) 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2028: done (3 left) 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2029: done (2 left) 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2031: done (1 left) 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2032: done (0 left) 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2033: copy_from oid 19 from oid 11 current snap is 213 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2034: copy_from oid 17 from oid 14 current snap is 213 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2035: write (excl) oid 18 current snap is 213 2026-02-17T05:36:33.324 INFO:tasks.rados.rados.0.trial118.stdout:2035: seq_num 728 ranges {635496=634807,1717597=517899} 2026-02-17T05:36:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2035: writing trial11845692-18 from 635496 to 1270303 tid 1 2026-02-17T05:36:33.332 INFO:tasks.rados.rados.0.trial118.stdout:2035: writing trial11845692-18 from 1717597 to 2235496 tid 2 2026-02-17T05:36:33.332 INFO:tasks.rados.rados.0.trial118.stdout:2036: read oid 29 snap -1 2026-02-17T05:36:33.332 INFO:tasks.rados.rados.0.trial118.stdout:2036: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:33.332 INFO:tasks.rados.rados.0.trial118.stdout:2037: snap_remove snap 192 2026-02-17T05:36:34.327 INFO:tasks.rados.rados.0.trial118.stdout:2037: done (4 left) 2026-02-17T05:36:34.327 INFO:tasks.rados.rados.0.trial118.stdout:2038: copy_from oid 42 from oid 40 current snap is 213 2026-02-17T05:36:34.327 INFO:tasks.rados.rados.0.trial118.stdout:2034: finishing copy_from racing read to trial11845692-17 2026-02-17T05:36:34.327 INFO:tasks.rados.rados.0.trial118.stdout:2036: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:34.351 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1959478 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2033: finishing copy_from racing read to trial11845692-19 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2034: finishing copy_from to trial11845692-17 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 738 (ObjNum 723 snap 211 seq_num 723) dirty exists 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2033: finishing copy_from to trial11845692-19 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 985 (ObjNum 543 snap 153 seq_num 543) dirty exists 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: finishing write tid 1 to trial11845692-18 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: finishing write tid 2 to trial11845692-18 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2033: done (4 left) 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2034: done (3 left) 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2036: done (2 left) 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2039: read oid 14 snap 206 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2039: expect (ObjNum 609 snap 177 seq_num 609) 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2040: snap_create 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: finishing write tid 3 to trial11845692-18 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: finishing write tid 4 to trial11845692-18 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: oid 18 updating version 0 to 728 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: oid 18 updating version 728 to 730 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: oid 18 version 730 is already newer than 729 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 730 (ObjNum 728 snap 213 seq_num 728) dirty exists 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2035: left oid 18 (ObjNum 728 snap 213 seq_num 728) 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2038: finishing copy_from racing read to trial11845692-42 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:2038: finishing copy_from to trial11845692-42 2026-02-17T05:36:34.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1166 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:36:34.370 INFO:tasks.rados.rados.0.trial118.stdout:2039: expect (ObjNum 609 snap 177 seq_num 609) 2026-02-17T05:36:34.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 977848 2026-02-17T05:36:34.396 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:35.303 INFO:tasks.rados.rados.0.trial118.stdout:2035: done (3 left) 2026-02-17T05:36:35.304 INFO:tasks.rados.rados.0.trial118.stdout:2038: done (2 left) 2026-02-17T05:36:35.304 INFO:tasks.rados.rados.0.trial118.stdout:2039: done (1 left) 2026-02-17T05:36:35.304 INFO:tasks.rados.rados.0.trial118.stdout:2040: done (0 left) 2026-02-17T05:36:35.304 INFO:tasks.rados.rados.0.trial118.stdout:2041: snap_remove snap 207 2026-02-17T05:36:36.306 INFO:tasks.rados.rados.0.trial118.stdout:2041: done (0 left) 2026-02-17T05:36:36.306 INFO:tasks.rados.rados.0.trial118.stdout:2042: read oid 24 snap -1 2026-02-17T05:36:36.306 INFO:tasks.rados.rados.0.trial118.stdout:2042: expect (ObjNum 727 snap 212 seq_num 727) 2026-02-17T05:36:36.306 INFO:tasks.rados.rados.0.trial118.stdout:2043: write (excl) oid 49 current snap is 214 2026-02-17T05:36:36.306 INFO:tasks.rados.rados.0.trial118.stdout:2043: seq_num 729 ranges {652303=710056,2059726=192577} 2026-02-17T05:36:36.311 INFO:tasks.rados.rados.0.trial118.stdout:2043: writing trial11845692-49 from 652303 to 1362359 tid 1 2026-02-17T05:36:36.315 INFO:tasks.rados.rados.0.trial118.stdout:2043: writing trial11845692-49 from 2059726 to 2252303 tid 2 2026-02-17T05:36:36.315 INFO:tasks.rados.rados.0.trial118.stdout:2044: read oid 39 snap -1 2026-02-17T05:36:36.315 INFO:tasks.rados.rados.0.trial118.stdout:2044: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:36.315 INFO:tasks.rados.rados.0.trial118.stdout:2045: write oid 31 current snap is 214 2026-02-17T05:36:36.315 INFO:tasks.rados.rados.0.trial118.stdout:2045: seq_num 730 ranges {669110=501658,1834561=434549} 2026-02-17T05:36:36.319 INFO:tasks.rados.rados.0.trial118.stdout:2045: writing trial11845692-31 from 669110 to 1170768 tid 1 2026-02-17T05:36:36.323 INFO:tasks.rados.rados.0.trial118.stdout:2045: writing trial11845692-31 from 1834561 to 2269110 tid 2 2026-02-17T05:36:36.323 INFO:tasks.rados.rados.0.trial118.stdout:2046: copy_from oid 20 from oid 9 current snap is 214 2026-02-17T05:36:36.323 INFO:tasks.rados.rados.0.trial118.stdout:2042: expect (ObjNum 727 snap 212 seq_num 727) 2026-02-17T05:36:36.335 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1375715 2026-02-17T05:36:36.376 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:36.405 INFO:tasks.rados.rados.0.trial118.stdout:2043: finishing write tid 1 to trial11845692-49 2026-02-17T05:36:36.405 INFO:tasks.rados.rados.0.trial118.stdout:2043: finishing write tid 2 to trial11845692-49 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: finishing write tid 3 to trial11845692-49 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: finishing write tid 4 to trial11845692-49 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: oid 49 updating version 0 to 874 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: oid 49 version 874 is already newer than 873 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: oid 49 version 874 is already newer than 872 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 874 (ObjNum 729 snap 214 seq_num 729) dirty exists 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2043: left oid 49 (ObjNum 729 snap 214 seq_num 729) 2026-02-17T05:36:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2044: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: finishing write tid 1 to trial11845692-31 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: finishing write tid 2 to trial11845692-31 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: finishing write tid 3 to trial11845692-31 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2042: done (4 left) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2043: done (3 left) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2044: done (2 left) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2047: write oid 10 current snap is 214 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: finishing write tid 4 to trial11845692-31 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: oid 31 updating version 0 to 1220 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: oid 31 updating version 1220 to 1222 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: oid 31 version 1222 is already newer than 1221 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1222 (ObjNum 730 snap 214 seq_num 730) dirty exists 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2045: left oid 31 (ObjNum 730 snap 214 seq_num 730) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2046: finishing copy_from to trial11845692-20 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2046: got expected ENOENT (src dne) 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2046: finishing copy_from racing read to trial11845692-20 2026-02-17T05:36:36.462 INFO:tasks.rados.rados.0.trial118.stdout:2047: seq_num 731 ranges {685917=576907,1893043=392874} 2026-02-17T05:36:36.466 INFO:tasks.rados.rados.0.trial118.stdout:2047: writing trial11845692-10 from 685917 to 1262824 tid 1 2026-02-17T05:36:36.470 INFO:tasks.rados.rados.0.trial118.stdout:2047: writing trial11845692-10 from 1893043 to 2285917 tid 2 2026-02-17T05:36:36.470 INFO:tasks.rados.rados.0.trial118.stdout:2045: done (2 left) 2026-02-17T05:36:36.470 INFO:tasks.rados.rados.0.trial118.stdout:2046: done (1 left) 2026-02-17T05:36:36.470 INFO:tasks.rados.rados.0.trial118.stdout:2048: write oid 4 current snap is 214 2026-02-17T05:36:36.470 INFO:tasks.rados.rados.0.trial118.stdout:2048: seq_num 732 ranges {702724=652156,1951525=351199} 2026-02-17T05:36:36.475 INFO:tasks.rados.rados.0.trial118.stdout:2048: writing trial11845692-4 from 702724 to 1354880 tid 1 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2048: writing trial11845692-4 from 1951525 to 2302724 tid 2 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2049: snap_create 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: finishing write tid 1 to trial11845692-10 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: finishing write tid 2 to trial11845692-10 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: finishing write tid 3 to trial11845692-10 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: finishing write tid 4 to trial11845692-10 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: oid 10 updating version 0 to 875 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: oid 10 updating version 875 to 876 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:2047: oid 10 updating version 876 to 877 2026-02-17T05:36:36.479 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 877 (ObjNum 731 snap 214 seq_num 731) dirty exists 2026-02-17T05:36:36.480 INFO:tasks.rados.rados.0.trial118.stdout:2047: left oid 10 (ObjNum 731 snap 214 seq_num 731) 2026-02-17T05:36:36.480 INFO:tasks.rados.rados.0.trial118.stdout:2048: finishing write tid 1 to trial11845692-4 2026-02-17T05:36:36.480 INFO:tasks.rados.rados.0.trial118.stdout:2048: finishing write tid 2 to trial11845692-4 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: finishing write tid 3 to trial11845692-4 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: finishing write tid 4 to trial11845692-4 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: oid 4 updating version 0 to 944 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: oid 4 updating version 944 to 946 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: oid 4 version 946 is already newer than 945 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 946 (ObjNum 732 snap 214 seq_num 732) dirty exists 2026-02-17T05:36:36.481 INFO:tasks.rados.rados.0.trial118.stdout:2048: left oid 4 (ObjNum 732 snap 214 seq_num 732) 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:2047: done (2 left) 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:2048: done (1 left) 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:2049: done (0 left) 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:2050: rollback oid 48 current snap is 215 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 193 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:2051: rollback oid 4 current snap is 215 2026-02-17T05:36:37.331 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 206 2026-02-17T05:36:37.332 INFO:tasks.rados.rados.0.trial118.stdout:2052: snap_remove snap 214 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2052: done (2 left) 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2053: read oid 5 snap -1 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2053: expect (ObjNum 712 snap 208 seq_num 712) 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2054: copy_from oid 9 from oid 31 current snap is 215 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2051: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:36:38.334 INFO:tasks.rados.rados.0.trial118.stdout:2055: delete oid 15 current snap is 215 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2051: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 949 (ObjNum 129 snap 0 seq_num 13003416) dirty dne 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2050: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2050: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2050: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:36:38.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1171 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:36:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2050: done (4 left) 2026-02-17T05:36:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2051: done (3 left) 2026-02-17T05:36:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2055: done (2 left) 2026-02-17T05:36:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2056: write (excl) oid 40 current snap is 215 2026-02-17T05:36:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2056: seq_num 734 ranges {736338=402654,1552136=539580} 2026-02-17T05:36:38.341 INFO:tasks.rados.rados.0.trial118.stdout:2056: writing trial11845692-40 from 736338 to 1138992 tid 1 2026-02-17T05:36:38.345 INFO:tasks.rados.rados.0.trial118.stdout:2056: writing trial11845692-40 from 1552136 to 2091716 tid 2 2026-02-17T05:36:38.345 INFO:tasks.rados.rados.0.trial118.stdout:2057: write (excl) oid 26 current snap is 215 2026-02-17T05:36:38.345 INFO:tasks.rados.rados.0.trial118.stdout:2057: seq_num 735 ranges {753145=477903,2010618=342527} 2026-02-17T05:36:38.349 INFO:tasks.rados.rados.0.trial118.stdout:2057: writing trial11845692-26 from 753145 to 1231048 tid 1 2026-02-17T05:36:38.354 INFO:tasks.rados.rados.0.trial118.stdout:2057: writing trial11845692-26 from 2010618 to 2353145 tid 2 2026-02-17T05:36:38.354 INFO:tasks.rados.rados.0.trial118.stdout:2058: snap_create 2026-02-17T05:36:38.354 INFO:tasks.rados.rados.0.trial118.stdout:2054: finishing copy_from racing read to trial11845692-9 2026-02-17T05:36:38.354 INFO:tasks.rados.rados.0.trial118.stdout:2053: expect (ObjNum 712 snap 208 seq_num 712) 2026-02-17T05:36:38.360 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1536936 2026-02-17T05:36:38.425 INFO:tasks.rados.rados.0.trial118.stdout:2054: finishing copy_from to trial11845692-9 2026-02-17T05:36:38.425 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1222 (ObjNum 730 snap 214 seq_num 730) dirty exists 2026-02-17T05:36:38.425 INFO:tasks.rados.rados.0.trial118.stdout:2056: finishing write tid 1 to trial11845692-40 2026-02-17T05:36:38.425 INFO:tasks.rados.rados.0.trial118.stdout:2056: finishing write tid 2 to trial11845692-40 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: finishing write tid 3 to trial11845692-40 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: finishing write tid 4 to trial11845692-40 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: oid 40 updating version 0 to 1169 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: oid 40 version 1169 is already newer than 1168 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: oid 40 version 1169 is already newer than 1167 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1169 (ObjNum 734 snap 215 seq_num 734) dirty exists 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2056: left oid 40 (ObjNum 734 snap 215 seq_num 734) 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2057: finishing write tid 1 to trial11845692-26 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2057: finishing write tid 2 to trial11845692-26 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2057: finishing write tid 3 to trial11845692-26 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2057: finishing write tid 4 to trial11845692-26 2026-02-17T05:36:38.426 INFO:tasks.rados.rados.0.trial118.stdout:2057: oid 26 updating version 0 to 768 2026-02-17T05:36:38.427 INFO:tasks.rados.rados.0.trial118.stdout:2057: oid 26 updating version 768 to 769 2026-02-17T05:36:38.427 INFO:tasks.rados.rados.0.trial118.stdout:2057: oid 26 version 769 is already newer than 767 2026-02-17T05:36:38.427 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 769 (ObjNum 735 snap 215 seq_num 735) dirty exists 2026-02-17T05:36:38.427 INFO:tasks.rados.rados.0.trial118.stdout:2057: left oid 26 (ObjNum 735 snap 215 seq_num 735) 2026-02-17T05:36:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2053: done (4 left) 2026-02-17T05:36:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2054: done (3 left) 2026-02-17T05:36:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2056: done (2 left) 2026-02-17T05:36:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2057: done (1 left) 2026-02-17T05:36:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2058: done (0 left) 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:2059: rollback oid 25 current snap is 216 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 25 to 197 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:2060: delete oid 32 current snap is 216 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:2060: done (1 left) 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:2061: write oid 44 current snap is 216 2026-02-17T05:36:39.339 INFO:tasks.rados.rados.0.trial118.stdout:2061: seq_num 737 ranges {786759=628401,2011229=375530} 2026-02-17T05:36:39.343 INFO:tasks.rados.rados.0.trial118.stdout:2061: writing trial11845692-44 from 786759 to 1415160 tid 1 2026-02-17T05:36:39.347 INFO:tasks.rados.rados.0.trial118.stdout:2061: writing trial11845692-44 from 2011229 to 2386759 tid 2 2026-02-17T05:36:39.347 INFO:tasks.rados.rados.0.trial118.stdout:2062: read oid 19 snap -1 2026-02-17T05:36:39.347 INFO:tasks.rados.rados.0.trial118.stdout:2062: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:39.348 INFO:tasks.rados.rados.0.trial118.stdout:2063: read oid 38 snap -1 2026-02-17T05:36:39.348 INFO:tasks.rados.rados.0.trial118.stdout:2063: expect (ObjNum 694 snap 202 seq_num 694) 2026-02-17T05:36:39.348 INFO:tasks.rados.rados.0.trial118.stdout:2064: snap_remove snap 209 2026-02-17T05:36:40.304 INFO:tasks.rados.rados.0.trial118.stdout:2064: done (4 left) 2026-02-17T05:36:40.305 INFO:tasks.rados.rados.0.trial118.stdout:2065: write (excl) oid 42 current snap is 216 2026-02-17T05:36:40.305 INFO:tasks.rados.rados.0.trial118.stdout:2065: seq_num 738 ranges {403566=420003,1386064=546918} 2026-02-17T05:36:40.308 INFO:tasks.rados.rados.0.trial118.stdout:2065: writing trial11845692-42 from 403566 to 823569 tid 1 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2065: writing trial11845692-42 from 1386064 to 1932982 tid 2 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2066: copy_from oid 20 from oid 10 current snap is 216 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2059: finishing rollback tid 0 to trial11845692-25 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2059: finishing rollback tid 1 to trial11845692-25 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1171 (ObjNum 129 snap 0 seq_num 12636200) dirty dne 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2061: finishing write tid 1 to trial11845692-44 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2061: finishing write tid 2 to trial11845692-44 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2061: finishing write tid 3 to trial11845692-44 2026-02-17T05:36:40.313 INFO:tasks.rados.rados.0.trial118.stdout:2061: finishing write tid 4 to trial11845692-44 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:2061: oid 44 updating version 0 to 881 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:2061: oid 44 version 881 is already newer than 880 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:2061: oid 44 updating version 881 to 882 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 882 (ObjNum 737 snap 216 seq_num 737) dirty exists 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:2061: left oid 44 (ObjNum 737 snap 216 seq_num 737) 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:2062: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:36:40.314 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:40.339 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1629842 2026-02-17T05:36:40.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 204758 2026-02-17T05:36:40.375 INFO:tasks.rados.rados.0.trial118.stdout:2063: expect (ObjNum 694 snap 202 seq_num 694) 2026-02-17T05:36:40.375 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2065: finishing write tid 1 to trial11845692-42 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2059: done (5 left) 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2061: done (4 left) 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2062: done (3 left) 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2063: done (2 left) 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2067: copy_from oid 5 from oid 3 current snap is 216 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2065: finishing write tid 2 to trial11845692-42 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2065: finishing write tid 3 to trial11845692-42 2026-02-17T05:36:40.541 INFO:tasks.rados.rados.0.trial118.stdout:2065: finishing write tid 4 to trial11845692-42 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2065: oid 42 updating version 0 to 1169 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2065: oid 42 version 1169 is already newer than 1168 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2065: oid 42 version 1169 is already newer than 1167 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1169 (ObjNum 738 snap 216 seq_num 738) dirty exists 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2065: left oid 42 (ObjNum 738 snap 216 seq_num 738) 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2066: finishing copy_from racing read to trial11845692-20 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2066: finishing copy_from to trial11845692-20 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 877 (ObjNum 731 snap 214 seq_num 731) dirty exists 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2065: done (2 left) 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2066: done (1 left) 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2068: rollback oid 12 current snap is 216 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 212 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2069: write (excl) oid 19 current snap is 216 2026-02-17T05:36:40.542 INFO:tasks.rados.rados.0.trial118.stdout:2069: seq_num 739 ranges {420373=495252,1444546=690576} 2026-02-17T05:36:40.544 INFO:tasks.rados.rados.0.trial118.stdout:2069: writing trial11845692-19 from 420373 to 915625 tid 1 2026-02-17T05:36:40.549 INFO:tasks.rados.rados.0.trial118.stdout:2069: writing trial11845692-19 from 1444546 to 2135122 tid 2 2026-02-17T05:36:40.549 INFO:tasks.rados.rados.0.trial118.stdout:2070: write oid 45 current snap is 216 2026-02-17T05:36:40.549 INFO:tasks.rados.rados.0.trial118.stdout:2070: seq_num 740 ranges {437180=570501,1503028=550587} 2026-02-17T05:36:40.552 INFO:tasks.rados.rados.0.trial118.stdout:2070: writing trial11845692-45 from 437180 to 1007681 tid 1 2026-02-17T05:36:40.556 INFO:tasks.rados.rados.0.trial118.stdout:2070: writing trial11845692-45 from 1503028 to 2053615 tid 2 2026-02-17T05:36:40.556 INFO:tasks.rados.rados.0.trial118.stdout:2071: write (excl) oid 38 current snap is 216 2026-02-17T05:36:40.556 INFO:tasks.rados.rados.0.trial118.stdout:2071: seq_num 741 ranges {453987=645750,1845157=608830} 2026-02-17T05:36:40.560 INFO:tasks.rados.rados.0.trial118.stdout:2071: writing trial11845692-38 from 453987 to 1099737 tid 1 2026-02-17T05:36:40.565 INFO:tasks.rados.rados.0.trial118.stdout:2071: writing trial11845692-38 from 1845157 to 2453987 tid 2 2026-02-17T05:36:40.566 INFO:tasks.rados.rados.0.trial118.stdout:2072: write (excl) oid 29 current snap is 216 2026-02-17T05:36:40.566 INFO:tasks.rados.rados.0.trial118.stdout:2072: seq_num 742 ranges {470794=720999,1903639=554256} 2026-02-17T05:36:40.570 INFO:tasks.rados.rados.0.trial118.stdout:2072: writing trial11845692-29 from 470794 to 1191793 tid 1 2026-02-17T05:36:40.575 INFO:tasks.rados.rados.0.trial118.stdout:2072: writing trial11845692-29 from 1903639 to 2457895 tid 2 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2073: read oid 30 snap -1 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2073: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2074: snap_create 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2068: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2068: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2068: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 875 (ObjNum 698 snap 202 seq_num 698) dirty exists 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2067: finishing copy_from racing read to trial11845692-5 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: finishing write tid 1 to trial11845692-19 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2067: finishing copy_from to trial11845692-5 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1085 (ObjNum 721 snap 211 seq_num 721) dirty exists 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: finishing write tid 2 to trial11845692-19 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: finishing write tid 3 to trial11845692-19 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: finishing write tid 4 to trial11845692-19 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: oid 19 updating version 0 to 1087 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: oid 19 version 1087 is already newer than 1086 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:2069: oid 19 updating version 1087 to 1088 2026-02-17T05:36:40.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1088 (ObjNum 739 snap 216 seq_num 739) dirty exists 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2069: left oid 19 (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: finishing write tid 1 to trial11845692-45 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: finishing write tid 2 to trial11845692-45 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: finishing write tid 3 to trial11845692-45 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: finishing write tid 4 to trial11845692-45 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: oid 45 updating version 0 to 1173 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: oid 45 updating version 1173 to 1174 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: oid 45 updating version 1174 to 1175 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1175 (ObjNum 740 snap 216 seq_num 740) dirty exists 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2070: left oid 45 (ObjNum 740 snap 216 seq_num 740) 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: finishing write tid 1 to trial11845692-38 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: finishing write tid 2 to trial11845692-38 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: finishing write tid 3 to trial11845692-38 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: finishing write tid 4 to trial11845692-38 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: oid 38 updating version 0 to 1171 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: oid 38 updating version 1171 to 1172 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: oid 38 version 1172 is already newer than 1170 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1172 (ObjNum 741 snap 216 seq_num 741) dirty exists 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2071: left oid 38 (ObjNum 741 snap 216 seq_num 741) 2026-02-17T05:36:40.577 INFO:tasks.rados.rados.0.trial118.stdout:2072: finishing write tid 1 to trial11845692-29 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: finishing write tid 2 to trial11845692-29 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: finishing write tid 3 to trial11845692-29 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: finishing write tid 4 to trial11845692-29 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: oid 29 updating version 0 to 1225 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: oid 29 version 1225 is already newer than 1224 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: oid 29 version 1225 is already newer than 1223 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1225 (ObjNum 742 snap 216 seq_num 742) dirty exists 2026-02-17T05:36:40.578 INFO:tasks.rados.rados.0.trial118.stdout:2072: left oid 29 (ObjNum 742 snap 216 seq_num 742) 2026-02-17T05:36:40.580 INFO:tasks.rados.rados.0.trial118.stdout:2073: expect (ObjNum 579 snap 161 seq_num 579) 2026-02-17T05:36:40.607 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 961013 2026-02-17T05:36:40.628 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 491877 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2067: done (7 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2068: done (6 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2069: done (5 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2070: done (4 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2071: done (3 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2072: done (2 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2073: done (1 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2074: done (0 left) 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2075: read oid 29 snap 211 2026-02-17T05:36:41.342 INFO:tasks.rados.rados.0.trial118.stdout:2075: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:41.343 INFO:tasks.rados.rados.0.trial118.stdout:2076: snap_remove snap 216 2026-02-17T05:36:42.343 INFO:tasks.rados.rados.0.trial118.stdout:2076: done (1 left) 2026-02-17T05:36:42.344 INFO:tasks.rados.rados.0.trial118.stdout:2077: snap_create 2026-02-17T05:36:42.344 INFO:tasks.rados.rados.0.trial118.stdout:2075: expect (ObjNum 623 snap 184 seq_num 623) 2026-02-17T05:36:42.344 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:43.347 INFO:tasks.rados.rados.0.trial118.stdout:2075: done (1 left) 2026-02-17T05:36:43.347 INFO:tasks.rados.rados.0.trial118.stdout:2077: done (0 left) 2026-02-17T05:36:43.347 INFO:tasks.rados.rados.0.trial118.stdout:2078: read oid 50 snap -1 2026-02-17T05:36:43.347 INFO:tasks.rados.rados.0.trial118.stdout:2078: expect (ObjNum 726 snap 212 seq_num 726) 2026-02-17T05:36:43.347 INFO:tasks.rados.rados.0.trial118.stdout:2079: snap_remove snap 206 2026-02-17T05:36:44.350 INFO:tasks.rados.rados.0.trial118.stdout:2079: done (1 left) 2026-02-17T05:36:44.350 INFO:tasks.rados.rados.0.trial118.stdout:2080: copy_from oid 24 from oid 19 current snap is 218 2026-02-17T05:36:44.350 INFO:tasks.rados.rados.0.trial118.stdout:2078: expect (ObjNum 726 snap 212 seq_num 726) 2026-02-17T05:36:44.430 INFO:tasks.rados.rados.0.trial118.stdout:2080: finishing copy_from racing read to trial11845692-24 2026-02-17T05:36:44.431 INFO:tasks.rados.rados.0.trial118.stdout:2080: finishing copy_from to trial11845692-24 2026-02-17T05:36:44.431 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1088 (ObjNum 739 snap 216 seq_num 739) dirty exists 2026-02-17T05:36:44.431 INFO:tasks.rados.rados.0.trial118.stdout:2078: done (1 left) 2026-02-17T05:36:44.431 INFO:tasks.rados.rados.0.trial118.stdout:2080: done (0 left) 2026-02-17T05:36:44.431 INFO:tasks.rados.rados.0.trial118.stdout:2081: delete oid 28 current snap is 218 2026-02-17T05:36:44.432 INFO:tasks.rados.rados.0.trial118.stdout:2081: done (0 left) 2026-02-17T05:36:44.432 INFO:tasks.rados.rados.0.trial118.stdout:2082: rollback oid 31 current snap is 218 2026-02-17T05:36:44.432 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 211 2026-02-17T05:36:44.432 INFO:tasks.rados.rados.0.trial118.stdout:2083: snap_create 2026-02-17T05:36:44.434 INFO:tasks.rados.rados.0.trial118.stdout:2082: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:36:44.434 INFO:tasks.rados.rados.0.trial118.stdout:2082: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:36:44.434 INFO:tasks.rados.rados.0.trial118.stdout:2082: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:36:44.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1235 (ObjNum 650 snap 191 seq_num 650) dirty exists 2026-02-17T05:36:45.351 INFO:tasks.rados.rados.0.trial118.stdout:2082: done (1 left) 2026-02-17T05:36:45.351 INFO:tasks.rados.rados.0.trial118.stdout:2083: done (0 left) 2026-02-17T05:36:45.351 INFO:tasks.rados.rados.0.trial118.stdout:2084: write (excl) oid 34 current snap is 219 2026-02-17T05:36:45.351 INFO:tasks.rados.rados.0.trial118.stdout:2084: seq_num 744 ranges {504408=471497,1620603=557925} 2026-02-17T05:36:45.355 INFO:tasks.rados.rados.0.trial118.stdout:2084: writing trial11845692-34 from 504408 to 975905 tid 1 2026-02-17T05:36:45.359 INFO:tasks.rados.rados.0.trial118.stdout:2084: writing trial11845692-34 from 1620603 to 2178528 tid 2 2026-02-17T05:36:45.359 INFO:tasks.rados.rados.0.trial118.stdout:2085: delete oid 28 current snap is 219 2026-02-17T05:36:45.359 INFO:tasks.rados.rados.0.trial118.stdout:2084: finishing write tid 1 to trial11845692-34 2026-02-17T05:36:45.361 INFO:tasks.rados.rados.0.trial118.stdout:2084: finishing write tid 2 to trial11845692-34 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: finishing write tid 3 to trial11845692-34 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: finishing write tid 4 to trial11845692-34 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: oid 34 updating version 0 to 732 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: oid 34 updating version 732 to 734 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: oid 34 version 734 is already newer than 733 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 734 (ObjNum 744 snap 219 seq_num 744) dirty exists 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: left oid 34 (ObjNum 744 snap 219 seq_num 744) 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2084: done (1 left) 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2085: done (0 left) 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2086: write (excl) oid 42 current snap is 219 2026-02-17T05:36:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2086: seq_num 746 ranges {538022=738348,1737567=561594} 2026-02-17T05:36:45.367 INFO:tasks.rados.rados.0.trial118.stdout:2086: writing trial11845692-42 from 538022 to 1276370 tid 1 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2086: writing trial11845692-42 from 1737567 to 2299161 tid 2 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2087: copy_from oid 49 from oid 40 current snap is 219 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2088: read oid 13 snap -1 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2088: expect (ObjNum 691 snap 201 seq_num 691) 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2089: write (excl) oid 35 current snap is 219 2026-02-17T05:36:45.371 INFO:tasks.rados.rados.0.trial118.stdout:2089: seq_num 747 ranges {554829=413597,1396049=705252} 2026-02-17T05:36:45.375 INFO:tasks.rados.rados.0.trial118.stdout:2089: writing trial11845692-35 from 554829 to 968426 tid 1 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2089: writing trial11845692-35 from 1396049 to 2101301 tid 2 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2090: read oid 1 snap -1 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2090: expect (ObjNum 683 snap 200 seq_num 683) 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2091: delete oid 16 current snap is 219 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: finishing write tid 1 to trial11845692-42 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: finishing write tid 2 to trial11845692-42 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: finishing write tid 3 to trial11845692-42 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: finishing write tid 4 to trial11845692-42 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: oid 42 updating version 0 to 1174 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: oid 42 version 1174 is already newer than 1173 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: oid 42 updating version 1174 to 1175 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1175 (ObjNum 746 snap 219 seq_num 746) dirty exists 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2086: left oid 42 (ObjNum 746 snap 219 seq_num 746) 2026-02-17T05:36:45.379 INFO:tasks.rados.rados.0.trial118.stdout:2089: finishing write tid 1 to trial11845692-35 2026-02-17T05:36:45.380 INFO:tasks.rados.rados.0.trial118.stdout:2087: finishing copy_from racing read to trial11845692-49 2026-02-17T05:36:45.380 INFO:tasks.rados.rados.0.trial118.stdout:2088: expect (ObjNum 691 snap 201 seq_num 691) 2026-02-17T05:36:45.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:45.433 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:45.537 INFO:tasks.rados.rados.0.trial118.stdout:2087: finishing copy_from to trial11845692-49 2026-02-17T05:36:45.537 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1169 (ObjNum 734 snap 215 seq_num 734) dirty exists 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: finishing write tid 2 to trial11845692-35 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: finishing write tid 3 to trial11845692-35 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2086: done (5 left) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2087: done (4 left) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2088: done (3 left) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2091: done (2 left) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2092: copy_from oid 18 from oid 6 current snap is 219 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: finishing write tid 4 to trial11845692-35 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: oid 35 updating version 0 to 1090 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: oid 35 updating version 1090 to 1091 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: oid 35 version 1091 is already newer than 1089 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1091 (ObjNum 747 snap 219 seq_num 747) dirty exists 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2089: left oid 35 (ObjNum 747 snap 219 seq_num 747) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:2090: expect (ObjNum 683 snap 200 seq_num 683) 2026-02-17T05:36:45.538 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 403339 2026-02-17T05:36:45.624 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:45.669 INFO:tasks.rados.rados.0.trial118.stdout:2092: finishing copy_from racing read to trial11845692-18 2026-02-17T05:36:45.669 INFO:tasks.rados.rados.0.trial118.stdout:2092: finishing copy_from to trial11845692-18 2026-02-17T05:36:45.669 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 665 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2089: done (2 left) 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2090: done (1 left) 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2092: done (0 left) 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2093: read oid 4 snap -1 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2093: expect deleted 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2094: copy_from oid 46 from oid 28 current snap is 219 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2095: copy_from oid 50 from oid 19 current snap is 219 2026-02-17T05:36:45.670 INFO:tasks.rados.rados.0.trial118.stdout:2096: snap_remove snap 217 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2096: done (3 left) 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2097: snap_create 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2094: finishing copy_from to trial11845692-46 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2094: got expected ENOENT (src dne) 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2094: finishing copy_from racing read to trial11845692-46 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2095: finishing copy_from racing read to trial11845692-50 2026-02-17T05:36:46.357 INFO:tasks.rados.rados.0.trial118.stdout:2095: finishing copy_from to trial11845692-50 2026-02-17T05:36:46.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1088 (ObjNum 739 snap 216 seq_num 739) dirty exists 2026-02-17T05:36:47.357 INFO:tasks.rados.rados.0.trial118.stdout:2093: done (3 left) 2026-02-17T05:36:47.357 INFO:tasks.rados.rados.0.trial118.stdout:2094: done (2 left) 2026-02-17T05:36:47.357 INFO:tasks.rados.rados.0.trial118.stdout:2095: done (1 left) 2026-02-17T05:36:47.357 INFO:tasks.rados.rados.0.trial118.stdout:2097: done (0 left) 2026-02-17T05:36:47.357 INFO:tasks.rados.rados.0.trial118.stdout:2098: snap_remove snap 163 2026-02-17T05:36:48.360 INFO:tasks.rados.rados.0.trial118.stdout:2098: done (0 left) 2026-02-17T05:36:48.360 INFO:tasks.rados.rados.0.trial118.stdout:2099: write oid 37 current snap is 220 2026-02-17T05:36:48.360 INFO:tasks.rados.rados.0.trial118.stdout:2099: seq_num 749 ranges {588443=564095,1796660=708921} 2026-02-17T05:36:48.364 INFO:tasks.rados.rados.0.trial118.stdout:2099: writing trial11845692-37 from 588443 to 1152538 tid 1 2026-02-17T05:36:48.370 INFO:tasks.rados.rados.0.trial118.stdout:2099: writing trial11845692-37 from 1796660 to 2505581 tid 2 2026-02-17T05:36:48.370 INFO:tasks.rados.rados.0.trial118.stdout:2100: snap_create 2026-02-17T05:36:48.370 INFO:tasks.rados.rados.0.trial118.stdout:2099: finishing write tid 1 to trial11845692-37 2026-02-17T05:36:48.372 INFO:tasks.rados.rados.0.trial118.stdout:2099: finishing write tid 2 to trial11845692-37 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: finishing write tid 3 to trial11845692-37 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: finishing write tid 4 to trial11845692-37 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: oid 37 updating version 0 to 159 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: oid 37 updating version 159 to 161 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: oid 37 version 161 is already newer than 160 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 161 (ObjNum 749 snap 220 seq_num 749) dirty exists 2026-02-17T05:36:48.373 INFO:tasks.rados.rados.0.trial118.stdout:2099: left oid 37 (ObjNum 749 snap 220 seq_num 749) 2026-02-17T05:36:49.363 INFO:tasks.rados.rados.0.trial118.stdout:2099: done (1 left) 2026-02-17T05:36:49.363 INFO:tasks.rados.rados.0.trial118.stdout:2100: done (0 left) 2026-02-17T05:36:49.363 INFO:tasks.rados.rados.0.trial118.stdout:2101: write (excl) oid 5 current snap is 221 2026-02-17T05:36:49.364 INFO:tasks.rados.rados.0.trial118.stdout:2101: seq_num 750 ranges {605250=639344,1855142=452579} 2026-02-17T05:36:49.368 INFO:tasks.rados.rados.0.trial118.stdout:2101: writing trial11845692-5 from 605250 to 1244594 tid 1 2026-02-17T05:36:49.372 INFO:tasks.rados.rados.0.trial118.stdout:2101: writing trial11845692-5 from 1855142 to 2307721 tid 2 2026-02-17T05:36:49.372 INFO:tasks.rados.rados.0.trial118.stdout:2102: rollback oid 1 current snap is 221 2026-02-17T05:36:49.372 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 197 2026-02-17T05:36:49.372 INFO:tasks.rados.rados.0.trial118.stdout:2101: finishing write tid 1 to trial11845692-5 2026-02-17T05:36:49.372 INFO:tasks.rados.rados.0.trial118.stdout:2103: read oid 37 snap 210 2026-02-17T05:36:49.373 INFO:tasks.rados.rados.0.trial118.stdout:2103: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:36:49.373 INFO:tasks.rados.rados.0.trial118.stdout:2104: write oid 16 current snap is 221 2026-02-17T05:36:49.373 INFO:tasks.rados.rados.0.trial118.stdout:2104: seq_num 751 ranges {622057=714593,1913624=708433} 2026-02-17T05:36:49.377 INFO:tasks.rados.rados.0.trial118.stdout:2104: writing trial11845692-16 from 622057 to 1336650 tid 1 2026-02-17T05:36:49.382 INFO:tasks.rados.rados.0.trial118.stdout:2104: writing trial11845692-16 from 1913624 to 2622057 tid 2 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2105: snap_create 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: finishing write tid 2 to trial11845692-5 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: finishing write tid 3 to trial11845692-5 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: finishing write tid 4 to trial11845692-5 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: oid 5 updating version 0 to 1088 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: oid 5 version 1088 is already newer than 1086 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: oid 5 version 1088 is already newer than 1087 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1088 (ObjNum 750 snap 221 seq_num 750) dirty exists 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2101: left oid 5 (ObjNum 750 snap 221 seq_num 750) 2026-02-17T05:36:49.383 INFO:tasks.rados.rados.0.trial118.stdout:2102: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:36:49.384 INFO:tasks.rados.rados.0.trial118.stdout:2102: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:36:49.384 INFO:tasks.rados.rados.0.trial118.stdout:2102: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:36:49.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1174 (ObjNum 654 snap 192 seq_num 654) dirty exists 2026-02-17T05:36:49.384 INFO:tasks.rados.rados.0.trial118.stdout:2103: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:36:49.384 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:49.534 INFO:tasks.rados.rados.0.trial118.stdout:2104: finishing write tid 1 to trial11845692-16 2026-02-17T05:36:49.534 INFO:tasks.rados.rados.0.trial118.stdout:2104: finishing write tid 2 to trial11845692-16 2026-02-17T05:36:49.534 INFO:tasks.rados.rados.0.trial118.stdout:2104: finishing write tid 3 to trial11845692-16 2026-02-17T05:36:49.534 INFO:tasks.rados.rados.0.trial118.stdout:2104: finishing write tid 4 to trial11845692-16 2026-02-17T05:36:49.535 INFO:tasks.rados.rados.0.trial118.stdout:2104: oid 16 updating version 0 to 1228 2026-02-17T05:36:49.535 INFO:tasks.rados.rados.0.trial118.stdout:2104: oid 16 updating version 1228 to 1229 2026-02-17T05:36:49.535 INFO:tasks.rados.rados.0.trial118.stdout:2104: oid 16 version 1229 is already newer than 1227 2026-02-17T05:36:49.535 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1229 (ObjNum 751 snap 221 seq_num 751) dirty exists 2026-02-17T05:36:49.535 INFO:tasks.rados.rados.0.trial118.stdout:2104: left oid 16 (ObjNum 751 snap 221 seq_num 751) 2026-02-17T05:36:50.305 INFO:tasks.rados.rados.0.trial118.stdout:2101: done (4 left) 2026-02-17T05:36:50.306 INFO:tasks.rados.rados.0.trial118.stdout:2102: done (3 left) 2026-02-17T05:36:50.306 INFO:tasks.rados.rados.0.trial118.stdout:2103: done (2 left) 2026-02-17T05:36:50.306 INFO:tasks.rados.rados.0.trial118.stdout:2104: done (1 left) 2026-02-17T05:36:50.306 INFO:tasks.rados.rados.0.trial118.stdout:2105: done (0 left) 2026-02-17T05:36:50.306 INFO:tasks.rados.rados.0.trial118.stdout:2106: delete oid 26 current snap is 222 2026-02-17T05:36:50.309 INFO:tasks.rados.rados.0.trial118.stdout:2106: done (0 left) 2026-02-17T05:36:50.309 INFO:tasks.rados.rados.0.trial118.stdout:2107: write (excl) oid 35 current snap is 222 2026-02-17T05:36:50.309 INFO:tasks.rados.rados.0.trial118.stdout:2107: seq_num 753 ranges {655671=581444,2030588=625083} 2026-02-17T05:36:50.314 INFO:tasks.rados.rados.0.trial118.stdout:2107: writing trial11845692-35 from 655671 to 1237115 tid 1 2026-02-17T05:36:50.319 INFO:tasks.rados.rados.0.trial118.stdout:2107: writing trial11845692-35 from 2030588 to 2655671 tid 2 2026-02-17T05:36:50.320 INFO:tasks.rados.rados.0.trial118.stdout:2108: copy_from oid 37 from oid 40 current snap is 222 2026-02-17T05:36:50.320 INFO:tasks.rados.rados.0.trial118.stdout:2107: finishing write tid 1 to trial11845692-35 2026-02-17T05:36:50.320 INFO:tasks.rados.rados.0.trial118.stdout:2109: snap_create 2026-02-17T05:36:50.321 INFO:tasks.rados.rados.0.trial118.stdout:2107: finishing write tid 2 to trial11845692-35 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: finishing write tid 3 to trial11845692-35 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: finishing write tid 4 to trial11845692-35 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: oid 35 updating version 0 to 1094 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: oid 35 version 1094 is already newer than 1092 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: oid 35 version 1094 is already newer than 1093 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1094 (ObjNum 753 snap 222 seq_num 753) dirty exists 2026-02-17T05:36:50.322 INFO:tasks.rados.rados.0.trial118.stdout:2107: left oid 35 (ObjNum 753 snap 222 seq_num 753) 2026-02-17T05:36:50.326 INFO:tasks.rados.rados.0.trial118.stdout:2108: finishing copy_from racing read to trial11845692-37 2026-02-17T05:36:50.327 INFO:tasks.rados.rados.0.trial118.stdout:2108: finishing copy_from to trial11845692-37 2026-02-17T05:36:50.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1169 (ObjNum 734 snap 215 seq_num 734) dirty exists 2026-02-17T05:36:51.305 INFO:tasks.rados.rados.0.trial118.stdout:2107: done (2 left) 2026-02-17T05:36:51.305 INFO:tasks.rados.rados.0.trial118.stdout:2108: done (1 left) 2026-02-17T05:36:51.306 INFO:tasks.rados.rados.0.trial118.stdout:2109: done (0 left) 2026-02-17T05:36:51.306 INFO:tasks.rados.rados.0.trial118.stdout:2110: snap_remove snap 221 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2110: done (0 left) 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2111: read oid 10 snap 220 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2111: expect (ObjNum 731 snap 214 seq_num 731) 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2112: copy_from oid 28 from oid 22 current snap is 223 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2113: write oid 42 current snap is 223 2026-02-17T05:36:52.306 INFO:tasks.rados.rados.0.trial118.stdout:2113: seq_num 754 ranges {672478=656693,2089070=459917} 2026-02-17T05:36:52.312 INFO:tasks.rados.rados.0.trial118.stdout:2113: writing trial11845692-42 from 672478 to 1329171 tid 1 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2113: writing trial11845692-42 from 2089070 to 2548987 tid 2 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2114: read oid 40 snap -1 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2114: expect (ObjNum 734 snap 215 seq_num 734) 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2115: copy_from oid 48 from oid 1 current snap is 223 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2112: finishing copy_from to trial11845692-28 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2112: got expected ENOENT (src dne) 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2112: finishing copy_from racing read to trial11845692-28 2026-02-17T05:36:52.316 INFO:tasks.rados.rados.0.trial118.stdout:2111: expect (ObjNum 731 snap 214 seq_num 731) 2026-02-17T05:36:52.344 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:2113: finishing write tid 1 to trial11845692-42 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:2111: done (4 left) 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:2112: done (3 left) 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:2116: rollback oid 45 current snap is 223 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 220 2026-02-17T05:36:52.393 INFO:tasks.rados.rados.0.trial118.stdout:2113: finishing write tid 2 to trial11845692-42 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: finishing write tid 3 to trial11845692-42 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: finishing write tid 4 to trial11845692-42 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: oid 42 updating version 0 to 1178 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: oid 42 version 1178 is already newer than 1177 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: oid 42 version 1178 is already newer than 1176 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1178 (ObjNum 754 snap 223 seq_num 754) dirty exists 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2113: left oid 42 (ObjNum 754 snap 223 seq_num 754) 2026-02-17T05:36:52.394 INFO:tasks.rados.rados.0.trial118.stdout:2114: expect (ObjNum 734 snap 215 seq_num 734) 2026-02-17T05:36:52.405 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2199348 2026-02-17T05:36:52.434 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1054221 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2115: finishing copy_from racing read to trial11845692-48 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2115: finishing copy_from to trial11845692-48 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1174 (ObjNum 654 snap 192 seq_num 654) dirty exists 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2116: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2116: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2113: done (3 left) 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2114: done (2 left) 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2115: done (1 left) 2026-02-17T05:36:52.450 INFO:tasks.rados.rados.0.trial118.stdout:2117: rollback oid 18 current snap is 223 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 220 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2116: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1178 (ObjNum 740 snap 216 seq_num 740) dirty exists 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2116: done (1 left) 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2118: read oid 16 snap -1 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2118: expect (ObjNum 751 snap 221 seq_num 751) 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2119: write oid 14 current snap is 223 2026-02-17T05:36:52.451 INFO:tasks.rados.rados.0.trial118.stdout:2119: seq_num 755 ranges {689285=731942,2147552=541733} 2026-02-17T05:36:52.455 INFO:tasks.rados.rados.0.trial118.stdout:2119: writing trial11845692-14 from 689285 to 1421227 tid 1 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2119: writing trial11845692-14 from 2147552 to 2689285 tid 2 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2120: write (excl) oid 15 current snap is 223 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2117: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2117: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2117: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 737 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:36:52.460 INFO:tasks.rados.rados.0.trial118.stdout:2118: expect (ObjNum 751 snap 221 seq_num 751) 2026-02-17T05:36:52.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:52.507 INFO:tasks.rados.rados.0.trial118.stdout:2119: finishing write tid 1 to trial11845692-14 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: finishing write tid 2 to trial11845692-14 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: finishing write tid 3 to trial11845692-14 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: finishing write tid 4 to trial11845692-14 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: oid 14 updating version 0 to 1090 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: oid 14 version 1090 is already newer than 1089 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: oid 14 updating version 1090 to 1091 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1091 (ObjNum 755 snap 223 seq_num 755) dirty exists 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2119: left oid 14 (ObjNum 755 snap 223 seq_num 755) 2026-02-17T05:36:52.508 INFO:tasks.rados.rados.0.trial118.stdout:2120: seq_num 756 ranges {706092=407191,1806034=463586} 2026-02-17T05:36:52.512 INFO:tasks.rados.rados.0.trial118.stdout:2120: writing trial11845692-15 from 706092 to 1113283 tid 1 2026-02-17T05:36:52.517 INFO:tasks.rados.rados.0.trial118.stdout:2120: writing trial11845692-15 from 1806034 to 2269620 tid 2 2026-02-17T05:36:52.517 INFO:tasks.rados.rados.0.trial118.stdout:2117: done (3 left) 2026-02-17T05:36:52.517 INFO:tasks.rados.rados.0.trial118.stdout:2118: done (2 left) 2026-02-17T05:36:52.517 INFO:tasks.rados.rados.0.trial118.stdout:2119: done (1 left) 2026-02-17T05:36:52.517 INFO:tasks.rados.rados.0.trial118.stdout:2121: read oid 17 snap -1 2026-02-17T05:36:52.518 INFO:tasks.rados.rados.0.trial118.stdout:2121: expect (ObjNum 723 snap 211 seq_num 723) 2026-02-17T05:36:52.518 INFO:tasks.rados.rados.0.trial118.stdout:2122: snap_create 2026-02-17T05:36:52.518 INFO:tasks.rados.rados.0.trial118.stdout:2120: finishing write tid 1 to trial11845692-15 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: finishing write tid 2 to trial11845692-15 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: finishing write tid 3 to trial11845692-15 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: finishing write tid 4 to trial11845692-15 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: oid 15 updating version 0 to 1179 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: oid 15 updating version 1179 to 1181 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: oid 15 version 1181 is already newer than 1180 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1181 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-17T05:36:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2120: left oid 15 (ObjNum 756 snap 223 seq_num 756) 2026-02-17T05:36:52.522 INFO:tasks.rados.rados.0.trial118.stdout:2121: expect (ObjNum 723 snap 211 seq_num 723) 2026-02-17T05:36:52.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1274377 2026-02-17T05:36:52.535 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:52.551 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 345504 2026-02-17T05:36:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2120: done (2 left) 2026-02-17T05:36:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2121: done (1 left) 2026-02-17T05:36:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2122: done (0 left) 2026-02-17T05:36:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2123: write oid 10 current snap is 224 2026-02-17T05:36:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2123: seq_num 757 ranges {722899=482440,1748163=723597} 2026-02-17T05:36:53.372 INFO:tasks.rados.rados.0.trial118.stdout:2123: writing trial11845692-10 from 722899 to 1205339 tid 1 2026-02-17T05:36:53.378 INFO:tasks.rados.rados.0.trial118.stdout:2123: writing trial11845692-10 from 1748163 to 2471760 tid 2 2026-02-17T05:36:53.378 INFO:tasks.rados.rados.0.trial118.stdout:2124: copy_from oid 23 from oid 30 current snap is 224 2026-02-17T05:36:53.379 INFO:tasks.rados.rados.0.trial118.stdout:2123: finishing write tid 1 to trial11845692-10 2026-02-17T05:36:53.379 INFO:tasks.rados.rados.0.trial118.stdout:2125: snap_remove snap 220 2026-02-17T05:36:54.371 INFO:tasks.rados.rados.0.trial118.stdout:2125: done (2 left) 2026-02-17T05:36:54.371 INFO:tasks.rados.rados.0.trial118.stdout:2126: write oid 49 current snap is 224 2026-02-17T05:36:54.371 INFO:tasks.rados.rados.0.trial118.stdout:2126: seq_num 758 ranges {739706=557689,1806645=467255} 2026-02-17T05:36:54.376 INFO:tasks.rados.rados.0.trial118.stdout:2126: writing trial11845692-49 from 739706 to 1297395 tid 1 2026-02-17T05:36:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2126: writing trial11845692-49 from 1806645 to 2273900 tid 2 2026-02-17T05:36:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2127: write (excl) oid 1 current snap is 224 2026-02-17T05:36:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2127: seq_num 759 ranges {756513=632938,1865127=727266} 2026-02-17T05:36:54.385 INFO:tasks.rados.rados.0.trial118.stdout:2127: writing trial11845692-1 from 756513 to 1389451 tid 1 2026-02-17T05:36:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2127: writing trial11845692-1 from 1865127 to 2592393 tid 2 2026-02-17T05:36:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2123: finishing write tid 2 to trial11845692-10 2026-02-17T05:36:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2123: finishing write tid 3 to trial11845692-10 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2123: finishing write tid 4 to trial11845692-10 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2123: oid 10 updating version 0 to 1172 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2123: oid 10 version 1172 is already newer than 1171 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2123: oid 10 version 1172 is already newer than 1170 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1172 (ObjNum 757 snap 224 seq_num 757) dirty exists 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2123: left oid 10 (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2124: finishing copy_from racing read to trial11845692-23 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2124: finishing copy_from to trial11845692-23 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 648 (ObjNum 579 snap 161 seq_num 579) dirty exists 2026-02-17T05:36:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2126: finishing write tid 1 to trial11845692-49 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: finishing write tid 2 to trial11845692-49 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: finishing write tid 3 to trial11845692-49 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: finishing write tid 4 to trial11845692-49 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: oid 49 updating version 0 to 1174 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: oid 49 updating version 1174 to 1175 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: oid 49 version 1175 is already newer than 1173 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1175 (ObjNum 758 snap 224 seq_num 758) dirty exists 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2126: left oid 49 (ObjNum 758 snap 224 seq_num 758) 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2127: finishing write tid 1 to trial11845692-1 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2128: read oid 34 snap -1 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2128: expect (ObjNum 744 snap 219 seq_num 744) 2026-02-17T05:36:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2123: done (4 left) 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2124: done (3 left) 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2126: done (2 left) 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2129: read oid 18 snap 213 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2129: expect (ObjNum 728 snap 213 seq_num 728) 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2130: read oid 12 snap 219 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2130: expect (ObjNum 698 snap 202 seq_num 698) 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2131: write oid 27 current snap is 224 2026-02-17T05:36:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2131: seq_num 760 ranges {773320=708187,1923609=470924} 2026-02-17T05:36:54.396 INFO:tasks.rados.rados.0.trial118.stdout:2131: writing trial11845692-27 from 773320 to 1481507 tid 1 2026-02-17T05:36:54.399 INFO:tasks.rados.rados.0.trial118.stdout:2131: writing trial11845692-27 from 1923609 to 2394533 tid 2 2026-02-17T05:36:54.400 INFO:tasks.rados.rados.0.trial118.stdout:2132: snap_remove snap 222 2026-02-17T05:36:55.306 INFO:tasks.rados.rados.0.trial118.stdout:2132: done (5 left) 2026-02-17T05:36:55.306 INFO:tasks.rados.rados.0.trial118.stdout:2133: write (excl) oid 8 current snap is 224 2026-02-17T05:36:55.306 INFO:tasks.rados.rados.0.trial118.stdout:2133: seq_num 761 ranges {790127=499789,1698444=730935} 2026-02-17T05:36:55.311 INFO:tasks.rados.rados.0.trial118.stdout:2133: writing trial11845692-8 from 790127 to 1289916 tid 1 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2133: writing trial11845692-8 from 1698444 to 2429379 tid 2 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2134: read oid 22 snap -1 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2134: expect deleted 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2135: snap_create 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: finishing write tid 2 to trial11845692-1 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: finishing write tid 3 to trial11845692-1 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: finishing write tid 4 to trial11845692-1 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: oid 1 updating version 0 to 1177 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: oid 1 version 1177 is already newer than 1176 2026-02-17T05:36:55.316 INFO:tasks.rados.rados.0.trial118.stdout:2127: oid 1 version 1177 is already newer than 1175 2026-02-17T05:36:55.317 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1177 (ObjNum 759 snap 224 seq_num 759) dirty exists 2026-02-17T05:36:55.317 INFO:tasks.rados.rados.0.trial118.stdout:2127: left oid 1 (ObjNum 759 snap 224 seq_num 759) 2026-02-17T05:36:55.317 INFO:tasks.rados.rados.0.trial118.stdout:2130: expect (ObjNum 698 snap 202 seq_num 698) 2026-02-17T05:36:55.364 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:55.456 INFO:tasks.rados.rados.0.trial118.stdout:2128: expect (ObjNum 744 snap 219 seq_num 744) 2026-02-17T05:36:55.483 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:55.545 INFO:tasks.rados.rados.0.trial118.stdout:2129: expect (ObjNum 728 snap 213 seq_num 728) 2026-02-17T05:36:55.595 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 190343 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: finishing write tid 1 to trial11845692-27 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: finishing write tid 2 to trial11845692-27 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: finishing write tid 3 to trial11845692-27 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: finishing write tid 4 to trial11845692-27 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: oid 27 updating version 0 to 1252 2026-02-17T05:36:55.621 INFO:tasks.rados.rados.0.trial118.stdout:2131: oid 27 updating version 1252 to 1253 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2131: oid 27 version 1253 is already newer than 1251 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1253 (ObjNum 760 snap 224 seq_num 760) dirty exists 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2131: left oid 27 (ObjNum 760 snap 224 seq_num 760) 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: finishing write tid 1 to trial11845692-8 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: finishing write tid 2 to trial11845692-8 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: finishing write tid 3 to trial11845692-8 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: finishing write tid 4 to trial11845692-8 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: oid 8 updating version 0 to 1258 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: oid 8 version 1258 is already newer than 1254 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: oid 8 version 1258 is already newer than 1257 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1258 (ObjNum 761 snap 224 seq_num 761) dirty exists 2026-02-17T05:36:55.622 INFO:tasks.rados.rados.0.trial118.stdout:2133: left oid 8 (ObjNum 761 snap 224 seq_num 761) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2127: done (7 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2128: done (6 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2129: done (5 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2130: done (4 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2131: done (3 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2133: done (2 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2134: done (1 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2135: done (0 left) 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2136: write (excl) oid 41 current snap is 225 2026-02-17T05:36:56.308 INFO:tasks.rados.rados.0.trial118.stdout:2136: seq_num 762 ranges {406934=575038,1640573=474593,2642791=164143} 2026-02-17T05:36:56.312 INFO:tasks.rados.rados.0.trial118.stdout:2136: writing trial11845692-41 from 406934 to 981972 tid 1 2026-02-17T05:36:56.316 INFO:tasks.rados.rados.0.trial118.stdout:2136: writing trial11845692-41 from 1640573 to 2115166 tid 2 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2136: writing trial11845692-41 from 2642791 to 2806934 tid 3 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2137: rollback oid 21 current snap is 225 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 204 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2136: finishing write tid 1 to trial11845692-41 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2136: finishing write tid 2 to trial11845692-41 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2138: read oid 43 snap -1 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2138: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:56.319 INFO:tasks.rados.rados.0.trial118.stdout:2139: snap_create 2026-02-17T05:36:56.320 INFO:tasks.rados.rados.0.trial118.stdout:2136: finishing write tid 3 to trial11845692-41 2026-02-17T05:36:56.320 INFO:tasks.rados.rados.0.trial118.stdout:2136: finishing write tid 4 to trial11845692-41 2026-02-17T05:36:56.320 INFO:tasks.rados.rados.0.trial118.stdout:2137: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:36:56.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 0 (ObjNum 289 snap 0 seq_num 3070) dirty dne 2026-02-17T05:36:56.320 INFO:tasks.rados.rados.0.trial118.stdout:2136: finishing write tid 5 to trial11845692-41 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:2136: oid 41 updating version 0 to 1233 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:2136: oid 41 version 1233 is already newer than 1232 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:2136: oid 41 version 1233 is already newer than 1231 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:2136: oid 41 version 1233 is already newer than 1230 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1233 (ObjNum 762 snap 225 seq_num 762) dirty exists 2026-02-17T05:36:56.321 INFO:tasks.rados.rados.0.trial118.stdout:2136: left oid 41 (ObjNum 762 snap 225 seq_num 762) 2026-02-17T05:36:56.322 INFO:tasks.rados.rados.0.trial118.stdout:2138: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:56.344 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3167249 2026-02-17T05:36:56.345 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 261861 2026-02-17T05:36:57.311 INFO:tasks.rados.rados.0.trial118.stdout:2136: done (3 left) 2026-02-17T05:36:57.311 INFO:tasks.rados.rados.0.trial118.stdout:2137: done (2 left) 2026-02-17T05:36:57.311 INFO:tasks.rados.rados.0.trial118.stdout:2138: done (1 left) 2026-02-17T05:36:57.311 INFO:tasks.rados.rados.0.trial118.stdout:2139: done (0 left) 2026-02-17T05:36:57.311 INFO:tasks.rados.rados.0.trial118.stdout:2140: snap_create 2026-02-17T05:36:58.313 INFO:tasks.rados.rados.0.trial118.stdout:2140: done (0 left) 2026-02-17T05:36:58.313 INFO:tasks.rados.rados.0.trial118.stdout:2141: read oid 35 snap -1 2026-02-17T05:36:58.313 INFO:tasks.rados.rados.0.trial118.stdout:2141: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-17T05:36:58.313 INFO:tasks.rados.rados.0.trial118.stdout:2142: write oid 45 current snap is 227 2026-02-17T05:36:58.314 INFO:tasks.rados.rados.0.trial118.stdout:2142: seq_num 763 ranges {423741=650287,1699055=618251} 2026-02-17T05:36:58.317 INFO:tasks.rados.rados.0.trial118.stdout:2142: writing trial11845692-45 from 423741 to 1074028 tid 1 2026-02-17T05:36:58.322 INFO:tasks.rados.rados.0.trial118.stdout:2142: writing trial11845692-45 from 1699055 to 2317306 tid 2 2026-02-17T05:36:58.322 INFO:tasks.rados.rados.0.trial118.stdout:2143: copy_from oid 14 from oid 50 current snap is 227 2026-02-17T05:36:58.322 INFO:tasks.rados.rados.0.trial118.stdout:2141: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: finishing write tid 1 to trial11845692-45 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: finishing write tid 2 to trial11845692-45 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: finishing write tid 3 to trial11845692-45 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: finishing write tid 4 to trial11845692-45 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: oid 45 updating version 0 to 1182 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: oid 45 updating version 1182 to 1183 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: oid 45 updating version 1183 to 1184 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1184 (ObjNum 763 snap 227 seq_num 763) dirty exists 2026-02-17T05:36:58.405 INFO:tasks.rados.rados.0.trial118.stdout:2142: left oid 45 (ObjNum 763 snap 227 seq_num 763) 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2143: finishing copy_from racing read to trial11845692-14 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2143: finishing copy_from to trial11845692-14 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1088 (ObjNum 739 snap 216 seq_num 739) dirty exists 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2141: done (2 left) 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2142: done (1 left) 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2143: done (0 left) 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2144: write oid 17 current snap is 227 2026-02-17T05:36:58.406 INFO:tasks.rados.rados.0.trial118.stdout:2144: seq_num 764 ranges {440548=725536,1757537=478262,2813990=26558} 2026-02-17T05:36:58.408 INFO:tasks.rados.rados.0.trial118.stdout:2144: writing trial11845692-17 from 440548 to 1166084 tid 1 2026-02-17T05:36:58.412 INFO:tasks.rados.rados.0.trial118.stdout:2144: writing trial11845692-17 from 1757537 to 2235799 tid 2 2026-02-17T05:36:58.415 INFO:tasks.rados.rados.0.trial118.stdout:2144: writing trial11845692-17 from 2813990 to 2840548 tid 3 2026-02-17T05:36:58.415 INFO:tasks.rados.rados.0.trial118.stdout:2145: read oid 13 snap -1 2026-02-17T05:36:58.415 INFO:tasks.rados.rados.0.trial118.stdout:2145: expect (ObjNum 691 snap 201 seq_num 691) 2026-02-17T05:36:58.415 INFO:tasks.rados.rados.0.trial118.stdout:2146: delete oid 26 current snap is 227 2026-02-17T05:36:58.415 INFO:tasks.rados.rados.0.trial118.stdout:2144: finishing write tid 1 to trial11845692-17 2026-02-17T05:36:58.416 INFO:tasks.rados.rados.0.trial118.stdout:2144: finishing write tid 2 to trial11845692-17 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: finishing write tid 3 to trial11845692-17 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: finishing write tid 4 to trial11845692-17 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: finishing write tid 5 to trial11845692-17 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: oid 17 updating version 0 to 1003 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: oid 17 version 1003 is already newer than 1001 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: oid 17 version 1003 is already newer than 1002 2026-02-17T05:36:58.417 INFO:tasks.rados.rados.0.trial118.stdout:2144: oid 17 version 1003 is already newer than 1000 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1003 (ObjNum 764 snap 227 seq_num 764) dirty exists 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2144: left oid 17 (ObjNum 764 snap 227 seq_num 764) 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2144: done (2 left) 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2146: done (1 left) 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2147: copy_from oid 7 from oid 43 current snap is 227 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2148: write oid 15 current snap is 227 2026-02-17T05:36:58.418 INFO:tasks.rados.rados.0.trial118.stdout:2148: seq_num 766 ranges {474162=476034,1358148=481931,2352483=465303} 2026-02-17T05:36:58.419 INFO:tasks.rados.rados.0.trial118.stdout:2148: writing trial11845692-15 from 474162 to 950196 tid 1 2026-02-17T05:36:58.423 INFO:tasks.rados.rados.0.trial118.stdout:2148: writing trial11845692-15 from 1358148 to 1840079 tid 2 2026-02-17T05:36:58.427 INFO:tasks.rados.rados.0.trial118.stdout:2148: writing trial11845692-15 from 2352483 to 2817786 tid 3 2026-02-17T05:36:58.427 INFO:tasks.rados.rados.0.trial118.stdout:2149: read oid 6 snap -1 2026-02-17T05:36:58.427 INFO:tasks.rados.rados.0.trial118.stdout:2149: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:36:58.427 INFO:tasks.rados.rados.0.trial118.stdout:2150: write (excl) oid 35 current snap is 227 2026-02-17T05:36:58.427 INFO:tasks.rados.rados.0.trial118.stdout:2145: expect (ObjNum 691 snap 201 seq_num 691) 2026-02-17T05:36:58.475 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:2148: finishing write tid 1 to trial11845692-15 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:2147: finishing copy_from racing read to trial11845692-7 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:2147: finishing copy_from to trial11845692-7 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 730 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:2148: finishing write tid 2 to trial11845692-15 2026-02-17T05:36:58.584 INFO:tasks.rados.rados.0.trial118.stdout:2150: seq_num 767 ranges {490969=551283,1816630=625589} 2026-02-17T05:36:58.588 INFO:tasks.rados.rados.0.trial118.stdout:2150: writing trial11845692-35 from 490969 to 1042252 tid 1 2026-02-17T05:36:58.593 INFO:tasks.rados.rados.0.trial118.stdout:2150: writing trial11845692-35 from 1816630 to 2442219 tid 2 2026-02-17T05:36:58.594 INFO:tasks.rados.rados.0.trial118.stdout:2145: done (4 left) 2026-02-17T05:36:58.594 INFO:tasks.rados.rados.0.trial118.stdout:2147: done (3 left) 2026-02-17T05:36:58.594 INFO:tasks.rados.rados.0.trial118.stdout:2151: read oid 45 snap -1 2026-02-17T05:36:58.594 INFO:tasks.rados.rados.0.trial118.stdout:2151: expect (ObjNum 763 snap 227 seq_num 763) 2026-02-17T05:36:58.594 INFO:tasks.rados.rados.0.trial118.stdout:2152: snap_remove snap 225 2026-02-17T05:36:59.317 INFO:tasks.rados.rados.0.trial118.stdout:2152: done (4 left) 2026-02-17T05:36:59.317 INFO:tasks.rados.rados.0.trial118.stdout:2153: write (excl) oid 22 current snap is 227 2026-02-17T05:36:59.317 INFO:tasks.rados.rados.0.trial118.stdout:2153: seq_num 768 ranges {507776=742885,1991465=485600} 2026-02-17T05:36:59.322 INFO:tasks.rados.rados.0.trial118.stdout:2153: writing trial11845692-22 from 507776 to 1250661 tid 1 2026-02-17T05:36:59.327 INFO:tasks.rados.rados.0.trial118.stdout:2153: writing trial11845692-22 from 1991465 to 2477065 tid 2 2026-02-17T05:36:59.327 INFO:tasks.rados.rados.0.trial118.stdout:2154: write (excl) oid 24 current snap is 227 2026-02-17T05:36:59.327 INFO:tasks.rados.rados.0.trial118.stdout:2148: finishing write tid 3 to trial11845692-15 2026-02-17T05:36:59.327 INFO:tasks.rados.rados.0.trial118.stdout:2154: seq_num 769 ranges {524583=418134,1649947=629258,2834752=89831} 2026-02-17T05:36:59.330 INFO:tasks.rados.rados.0.trial118.stdout:2154: writing trial11845692-24 from 524583 to 942717 tid 1 2026-02-17T05:36:59.335 INFO:tasks.rados.rados.0.trial118.stdout:2154: writing trial11845692-24 from 1649947 to 2279205 tid 2 2026-02-17T05:36:59.338 INFO:tasks.rados.rados.0.trial118.stdout:2154: writing trial11845692-24 from 2834752 to 2924583 tid 3 2026-02-17T05:36:59.338 INFO:tasks.rados.rados.0.trial118.stdout:2155: read oid 43 snap -1 2026-02-17T05:36:59.338 INFO:tasks.rados.rados.0.trial118.stdout:2155: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:36:59.338 INFO:tasks.rados.rados.0.trial118.stdout:2156: read oid 31 snap 224 2026-02-17T05:36:59.339 INFO:tasks.rados.rados.0.trial118.stdout:2156: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:36:59.339 INFO:tasks.rados.rados.0.trial118.stdout:2157: write oid 17 current snap is 227 2026-02-17T05:36:59.339 INFO:tasks.rados.rados.0.trial118.stdout:2157: seq_num 770 ranges {541390=493383,1592076=489269,2862175=79215} 2026-02-17T05:36:59.342 INFO:tasks.rados.rados.0.trial118.stdout:2157: writing trial11845692-17 from 541390 to 1034773 tid 1 2026-02-17T05:36:59.346 INFO:tasks.rados.rados.0.trial118.stdout:2157: writing trial11845692-17 from 1592076 to 2081345 tid 2 2026-02-17T05:36:59.349 INFO:tasks.rados.rados.0.trial118.stdout:2157: writing trial11845692-17 from 2862175 to 2941390 tid 3 2026-02-17T05:36:59.350 INFO:tasks.rados.rados.0.trial118.stdout:2158: snap_remove snap 201 2026-02-17T05:37:00.307 INFO:tasks.rados.rados.0.trial118.stdout:2158: done (9 left) 2026-02-17T05:37:00.307 INFO:tasks.rados.rados.0.trial118.stdout:2159: write oid 4 current snap is 227 2026-02-17T05:37:00.307 INFO:tasks.rados.rados.0.trial118.stdout:2159: seq_num 771 ranges {558197=568632,1650558=632927,2773245=184952} 2026-02-17T05:37:00.311 INFO:tasks.rados.rados.0.trial118.stdout:2159: writing trial11845692-4 from 558197 to 1126829 tid 1 2026-02-17T05:37:00.315 INFO:tasks.rados.rados.0.trial118.stdout:2159: writing trial11845692-4 from 1650558 to 2283485 tid 2 2026-02-17T05:37:00.318 INFO:tasks.rados.rados.0.trial118.stdout:2159: writing trial11845692-4 from 2773245 to 2958197 tid 3 2026-02-17T05:37:00.319 INFO:tasks.rados.rados.0.trial118.stdout:2160: write (excl) oid 38 current snap is 227 2026-02-17T05:37:00.319 INFO:tasks.rados.rados.0.trial118.stdout:2160: seq_num 772 ranges {575004=643881,1709040=492938,2917021=57983} 2026-02-17T05:37:00.323 INFO:tasks.rados.rados.0.trial118.stdout:2160: writing trial11845692-38 from 575004 to 1218885 tid 1 2026-02-17T05:37:00.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: writing trial11845692-38 from 1709040 to 2201978 tid 2 2026-02-17T05:37:00.330 INFO:tasks.rados.rados.0.trial118.stdout:2160: writing trial11845692-38 from 2917021 to 2975004 tid 3 2026-02-17T05:37:00.330 INFO:tasks.rados.rados.0.trial118.stdout:2161: write oid 32 current snap is 227 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: finishing write tid 4 to trial11845692-15 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: finishing write tid 5 to trial11845692-15 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: oid 15 updating version 0 to 1188 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: oid 15 version 1188 is already newer than 1186 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: oid 15 version 1188 is already newer than 1187 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: oid 15 version 1188 is already newer than 1185 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1188 (ObjNum 766 snap 227 seq_num 766) dirty exists 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2148: left oid 15 (ObjNum 766 snap 227 seq_num 766) 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2149: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:37:00.331 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:00.498 INFO:tasks.rados.rados.0.trial118.stdout:2150: finishing write tid 1 to trial11845692-35 2026-02-17T05:37:00.499 INFO:tasks.rados.rados.0.trial118.stdout:2151: expect (ObjNum 763 snap 227 seq_num 763) 2026-02-17T05:37:00.543 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2722628 2026-02-17T05:37:00.577 INFO:tasks.rados.rados.0.trial118.stdout:2150: finishing write tid 2 to trial11845692-35 2026-02-17T05:37:00.577 INFO:tasks.rados.rados.0.trial118.stdout:2150: finishing write tid 3 to trial11845692-35 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2150: finishing write tid 4 to trial11845692-35 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2150: oid 35 updating version 0 to 1095 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2150: oid 35 updating version 1095 to 1096 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2150: oid 35 updating version 1096 to 1097 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2150: left oid 35 (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: finishing write tid 1 to trial11845692-22 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: finishing write tid 2 to trial11845692-22 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: finishing write tid 3 to trial11845692-22 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: finishing write tid 4 to trial11845692-22 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: oid 22 updating version 0 to 1190 2026-02-17T05:37:00.578 INFO:tasks.rados.rados.0.trial118.stdout:2153: oid 22 updating version 1190 to 1191 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:2153: oid 22 version 1191 is already newer than 1189 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1191 (ObjNum 768 snap 227 seq_num 768) dirty exists 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:2153: left oid 22 (ObjNum 768 snap 227 seq_num 768) 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:2154: finishing write tid 1 to trial11845692-24 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:2154: finishing write tid 2 to trial11845692-24 2026-02-17T05:37:00.579 INFO:tasks.rados.rados.0.trial118.stdout:2154: finishing write tid 3 to trial11845692-24 2026-02-17T05:37:00.580 INFO:tasks.rados.rados.0.trial118.stdout:2161: seq_num 773 ranges {591811=719130,1767522=636596,2828091=163720} 2026-02-17T05:37:00.582 INFO:tasks.rados.rados.0.trial118.stdout:2161: writing trial11845692-32 from 591811 to 1310941 tid 1 2026-02-17T05:37:00.586 INFO:tasks.rados.rados.0.trial118.stdout:2161: writing trial11845692-32 from 1767522 to 2404118 tid 2 2026-02-17T05:37:00.589 INFO:tasks.rados.rados.0.trial118.stdout:2161: writing trial11845692-32 from 2828091 to 2991811 tid 3 2026-02-17T05:37:00.589 INFO:tasks.rados.rados.0.trial118.stdout:2148: done (11 left) 2026-02-17T05:37:00.589 INFO:tasks.rados.rados.0.trial118.stdout:2149: done (10 left) 2026-02-17T05:37:00.589 INFO:tasks.rados.rados.0.trial118.stdout:2150: done (9 left) 2026-02-17T05:37:00.590 INFO:tasks.rados.rados.0.trial118.stdout:2151: done (8 left) 2026-02-17T05:37:00.590 INFO:tasks.rados.rados.0.trial118.stdout:2153: done (7 left) 2026-02-17T05:37:00.590 INFO:tasks.rados.rados.0.trial118.stdout:2162: write (excl) oid 12 current snap is 227 2026-02-17T05:37:00.590 INFO:tasks.rados.rados.0.trial118.stdout:2162: seq_num 774 ranges {608618=794379,2109651=780254} 2026-02-17T05:37:00.594 INFO:tasks.rados.rados.0.trial118.stdout:2162: writing trial11845692-12 from 608618 to 1402997 tid 1 2026-02-17T05:37:00.600 INFO:tasks.rados.rados.0.trial118.stdout:2162: writing trial11845692-12 from 2109651 to 2889905 tid 2 2026-02-17T05:37:00.600 INFO:tasks.rados.rados.0.trial118.stdout:2163: write (excl) oid 34 current snap is 227 2026-02-17T05:37:00.600 INFO:tasks.rados.rados.0.trial118.stdout:2154: finishing write tid 4 to trial11845692-24 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: finishing write tid 5 to trial11845692-24 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: oid 24 updating version 0 to 1098 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: oid 24 updating version 1098 to 1101 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: oid 24 version 1101 is already newer than 1099 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: oid 24 version 1101 is already newer than 1100 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1101 (ObjNum 769 snap 227 seq_num 769) dirty exists 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2154: left oid 24 (ObjNum 769 snap 227 seq_num 769) 2026-02-17T05:37:00.601 INFO:tasks.rados.rados.0.trial118.stdout:2155: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:37:00.676 INFO:tasks.rados.rados.0.trial118.stdout:2156: expect (ObjNum 650 snap 191 seq_num 650) 2026-02-17T05:37:00.730 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:00.757 INFO:tasks.rados.rados.0.trial118.stdout:2157: finishing write tid 1 to trial11845692-17 2026-02-17T05:37:00.758 INFO:tasks.rados.rados.0.trial118.stdout:2157: finishing write tid 2 to trial11845692-17 2026-02-17T05:37:00.758 INFO:tasks.rados.rados.0.trial118.stdout:2157: finishing write tid 3 to trial11845692-17 2026-02-17T05:37:00.758 INFO:tasks.rados.rados.0.trial118.stdout:2157: finishing write tid 4 to trial11845692-17 2026-02-17T05:37:00.758 INFO:tasks.rados.rados.0.trial118.stdout:2163: seq_num 775 ranges {625425=469628,1768133=640265} 2026-02-17T05:37:00.762 INFO:tasks.rados.rados.0.trial118.stdout:2163: writing trial11845692-34 from 625425 to 1095053 tid 1 2026-02-17T05:37:00.767 INFO:tasks.rados.rados.0.trial118.stdout:2163: writing trial11845692-34 from 1768133 to 2408398 tid 2 2026-02-17T05:37:00.767 INFO:tasks.rados.rados.0.trial118.stdout:2154: done (8 left) 2026-02-17T05:37:00.768 INFO:tasks.rados.rados.0.trial118.stdout:2155: done (7 left) 2026-02-17T05:37:00.768 INFO:tasks.rados.rados.0.trial118.stdout:2156: done (6 left) 2026-02-17T05:37:00.768 INFO:tasks.rados.rados.0.trial118.stdout:2164: snap_remove snap 215 2026-02-17T05:37:01.323 INFO:tasks.rados.rados.0.trial118.stdout:2164: done (6 left) 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2165: delete oid 1 current snap is 227 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2157: finishing write tid 5 to trial11845692-17 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2157: oid 17 updating version 0 to 1004 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2157: oid 17 updating version 1004 to 1006 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2157: oid 17 version 1006 is already newer than 1005 2026-02-17T05:37:01.324 INFO:tasks.rados.rados.0.trial118.stdout:2157: oid 17 updating version 1006 to 1007 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1007 (ObjNum 770 snap 227 seq_num 770) dirty exists 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:2157: left oid 17 (ObjNum 770 snap 227 seq_num 770) 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:2159: finishing write tid 1 to trial11845692-4 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:2159: finishing write tid 2 to trial11845692-4 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:2159: finishing write tid 3 to trial11845692-4 2026-02-17T05:37:01.325 INFO:tasks.rados.rados.0.trial118.stdout:2159: finishing write tid 4 to trial11845692-4 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: finishing write tid 5 to trial11845692-4 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: oid 4 updating version 0 to 1236 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: oid 4 version 1236 is already newer than 1234 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: oid 4 updating version 1236 to 1237 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: oid 4 version 1237 is already newer than 1235 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1237 (ObjNum 771 snap 227 seq_num 771) dirty exists 2026-02-17T05:37:01.326 INFO:tasks.rados.rados.0.trial118.stdout:2159: left oid 4 (ObjNum 771 snap 227 seq_num 771) 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: finishing write tid 1 to trial11845692-38 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: finishing write tid 2 to trial11845692-38 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: finishing write tid 3 to trial11845692-38 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: finishing write tid 4 to trial11845692-38 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: finishing write tid 5 to trial11845692-38 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: oid 38 updating version 0 to 1181 2026-02-17T05:37:01.327 INFO:tasks.rados.rados.0.trial118.stdout:2160: oid 38 version 1181 is already newer than 1179 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2160: oid 38 version 1181 is already newer than 1180 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2160: oid 38 updating version 1181 to 1182 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1182 (ObjNum 772 snap 227 seq_num 772) dirty exists 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2160: left oid 38 (ObjNum 772 snap 227 seq_num 772) 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2161: finishing write tid 1 to trial11845692-32 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2161: finishing write tid 2 to trial11845692-32 2026-02-17T05:37:01.328 INFO:tasks.rados.rados.0.trial118.stdout:2161: finishing write tid 3 to trial11845692-32 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: finishing write tid 4 to trial11845692-32 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: finishing write tid 5 to trial11845692-32 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: oid 32 updating version 0 to 1177 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: oid 32 updating version 1177 to 1178 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: oid 32 version 1178 is already newer than 1176 2026-02-17T05:37:01.329 INFO:tasks.rados.rados.0.trial118.stdout:2161: oid 32 updating version 1178 to 1179 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1179 (ObjNum 773 snap 227 seq_num 773) dirty exists 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2161: left oid 32 (ObjNum 773 snap 227 seq_num 773) 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2162: finishing write tid 1 to trial11845692-12 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2162: finishing write tid 2 to trial11845692-12 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2162: finishing write tid 3 to trial11845692-12 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2162: finishing write tid 4 to trial11845692-12 2026-02-17T05:37:01.330 INFO:tasks.rados.rados.0.trial118.stdout:2162: oid 12 updating version 0 to 1090 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2162: oid 12 updating version 1090 to 1091 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2162: oid 12 version 1091 is already newer than 1089 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1091 (ObjNum 774 snap 227 seq_num 774) dirty exists 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2162: left oid 12 (ObjNum 774 snap 227 seq_num 774) 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2163: finishing write tid 1 to trial11845692-34 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2163: finishing write tid 2 to trial11845692-34 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2163: finishing write tid 3 to trial11845692-34 2026-02-17T05:37:01.331 INFO:tasks.rados.rados.0.trial118.stdout:2163: finishing write tid 4 to trial11845692-34 2026-02-17T05:37:01.332 INFO:tasks.rados.rados.0.trial118.stdout:2163: oid 34 updating version 0 to 740 2026-02-17T05:37:01.332 INFO:tasks.rados.rados.0.trial118.stdout:2163: oid 34 version 740 is already newer than 739 2026-02-17T05:37:01.332 INFO:tasks.rados.rados.0.trial118.stdout:2163: oid 34 version 740 is already newer than 738 2026-02-17T05:37:01.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 740 (ObjNum 775 snap 227 seq_num 775) dirty exists 2026-02-17T05:37:01.332 INFO:tasks.rados.rados.0.trial118.stdout:2163: left oid 34 (ObjNum 775 snap 227 seq_num 775) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2157: done (6 left) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2159: done (5 left) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2160: done (4 left) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2161: done (3 left) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2162: done (2 left) 2026-02-17T05:37:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2163: done (1 left) 2026-02-17T05:37:01.335 INFO:tasks.rados.rados.0.trial118.stdout:2165: done (0 left) 2026-02-17T05:37:01.335 INFO:tasks.rados.rados.0.trial118.stdout:2166: read oid 12 snap -1 2026-02-17T05:37:01.335 INFO:tasks.rados.rados.0.trial118.stdout:2166: expect (ObjNum 774 snap 227 seq_num 774) 2026-02-17T05:37:01.335 INFO:tasks.rados.rados.0.trial118.stdout:2167: snap_remove snap 199 2026-02-17T05:37:02.325 INFO:tasks.rados.rados.0.trial118.stdout:2167: done (1 left) 2026-02-17T05:37:02.325 INFO:tasks.rados.rados.0.trial118.stdout:2168: rollback oid 33 current snap is 227 2026-02-17T05:37:02.325 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 212 2026-02-17T05:37:02.325 INFO:tasks.rados.rados.0.trial118.stdout:2166: expect (ObjNum 774 snap 227 seq_num 774) 2026-02-17T05:37:02.329 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 563779 2026-02-17T05:37:02.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1368038 2026-02-17T05:37:02.452 INFO:tasks.rados.rados.0.trial118.stdout:2168: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:37:02.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 0 (ObjNum 49 snap 0 seq_num 4556848) dirty dne 2026-02-17T05:37:02.453 INFO:tasks.rados.rados.0.trial118.stdout:2166: done (1 left) 2026-02-17T05:37:02.453 INFO:tasks.rados.rados.0.trial118.stdout:2168: done (0 left) 2026-02-17T05:37:02.453 INFO:tasks.rados.rados.0.trial118.stdout:2169: write (excl) oid 21 current snap is 227 2026-02-17T05:37:02.453 INFO:tasks.rados.rados.0.trial118.stdout:2169: seq_num 777 ranges {659039=736479,2001450=643934} 2026-02-17T05:37:02.457 INFO:tasks.rados.rados.0.trial118.stdout:2169: writing trial11845692-21 from 659039 to 1395518 tid 1 2026-02-17T05:37:02.462 INFO:tasks.rados.rados.0.trial118.stdout:2169: writing trial11845692-21 from 2001450 to 2645384 tid 2 2026-02-17T05:37:02.463 INFO:tasks.rados.rados.0.trial118.stdout:2170: read oid 15 snap 218 2026-02-17T05:37:02.463 INFO:tasks.rados.rados.0.trial118.stdout:2170: expect deleted 2026-02-17T05:37:02.463 INFO:tasks.rados.rados.0.trial118.stdout:2171: write oid 42 current snap is 227 2026-02-17T05:37:02.463 INFO:tasks.rados.rados.0.trial118.stdout:2171: seq_num 778 ranges {675846=411728,1543579=787592,2848853=226993} 2026-02-17T05:37:02.466 INFO:tasks.rados.rados.0.trial118.stdout:2171: writing trial11845692-42 from 675846 to 1087574 tid 1 2026-02-17T05:37:02.471 INFO:tasks.rados.rados.0.trial118.stdout:2171: writing trial11845692-42 from 1543579 to 2331171 tid 2 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2171: writing trial11845692-42 from 2848853 to 3075846 tid 3 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2172: copy_from oid 37 from oid 26 current snap is 227 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: finishing write tid 1 to trial11845692-21 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: finishing write tid 2 to trial11845692-21 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: finishing write tid 3 to trial11845692-21 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: finishing write tid 4 to trial11845692-21 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: oid 21 updating version 0 to 1186 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: oid 21 version 1186 is already newer than 1184 2026-02-17T05:37:02.475 INFO:tasks.rados.rados.0.trial118.stdout:2169: oid 21 version 1186 is already newer than 1185 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1186 (ObjNum 777 snap 227 seq_num 777) dirty exists 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:2169: left oid 21 (ObjNum 777 snap 227 seq_num 777) 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:2171: finishing write tid 1 to trial11845692-42 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:2169: done (3 left) 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:2170: done (2 left) 2026-02-17T05:37:02.476 INFO:tasks.rados.rados.0.trial118.stdout:2173: snap_remove snap 213 2026-02-17T05:37:03.329 INFO:tasks.rados.rados.0.trial118.stdout:2173: done (2 left) 2026-02-17T05:37:03.329 INFO:tasks.rados.rados.0.trial118.stdout:2174: read oid 20 snap -1 2026-02-17T05:37:03.330 INFO:tasks.rados.rados.0.trial118.stdout:2174: expect (ObjNum 731 snap 214 seq_num 731) 2026-02-17T05:37:03.330 INFO:tasks.rados.rados.0.trial118.stdout:2175: snap_remove snap 223 2026-02-17T05:37:04.331 INFO:tasks.rados.rados.0.trial118.stdout:2175: done (3 left) 2026-02-17T05:37:04.331 INFO:tasks.rados.rados.0.trial118.stdout:2176: copy_from oid 41 from oid 10 current snap is 227 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: finishing write tid 2 to trial11845692-42 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2172: finishing copy_from to trial11845692-37 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2172: got expected ENOENT (src dne) 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2172: finishing copy_from racing read to trial11845692-37 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: finishing write tid 3 to trial11845692-42 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: finishing write tid 4 to trial11845692-42 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: finishing write tid 5 to trial11845692-42 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: oid 42 updating version 0 to 1183 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: oid 42 updating version 1183 to 1186 2026-02-17T05:37:04.332 INFO:tasks.rados.rados.0.trial118.stdout:2171: oid 42 version 1186 is already newer than 1184 2026-02-17T05:37:04.333 INFO:tasks.rados.rados.0.trial118.stdout:2171: oid 42 version 1186 is already newer than 1185 2026-02-17T05:37:04.333 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1186 (ObjNum 778 snap 227 seq_num 778) dirty exists 2026-02-17T05:37:04.333 INFO:tasks.rados.rados.0.trial118.stdout:2171: left oid 42 (ObjNum 778 snap 227 seq_num 778) 2026-02-17T05:37:04.333 INFO:tasks.rados.rados.0.trial118.stdout:2174: expect (ObjNum 731 snap 214 seq_num 731) 2026-02-17T05:37:04.333 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:04.391 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1196575 2026-02-17T05:37:04.406 INFO:tasks.rados.rados.0.trial118.stdout:2176: finishing copy_from racing read to trial11845692-41 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2176: finishing copy_from to trial11845692-41 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1172 (ObjNum 757 snap 224 seq_num 757) dirty exists 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2171: done (3 left) 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2172: done (2 left) 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2174: done (1 left) 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2176: done (0 left) 2026-02-17T05:37:04.407 INFO:tasks.rados.rados.0.trial118.stdout:2177: snap_create 2026-02-17T05:37:05.307 INFO:tasks.rados.rados.0.trial118.stdout:2177: done (0 left) 2026-02-17T05:37:05.308 INFO:tasks.rados.rados.0.trial118.stdout:2178: copy_from oid 30 from oid 9 current snap is 228 2026-02-17T05:37:05.308 INFO:tasks.rados.rados.0.trial118.stdout:2179: delete oid 3 current snap is 228 2026-02-17T05:37:05.312 INFO:tasks.rados.rados.0.trial118.stdout:2179: done (1 left) 2026-02-17T05:37:05.313 INFO:tasks.rados.rados.0.trial118.stdout:2180: read oid 38 snap -1 2026-02-17T05:37:05.313 INFO:tasks.rados.rados.0.trial118.stdout:2180: expect (ObjNum 772 snap 227 seq_num 772) 2026-02-17T05:37:05.313 INFO:tasks.rados.rados.0.trial118.stdout:2181: snap_remove snap 226 2026-02-17T05:37:06.309 INFO:tasks.rados.rados.0.trial118.stdout:2181: done (2 left) 2026-02-17T05:37:06.310 INFO:tasks.rados.rados.0.trial118.stdout:2182: write (excl) oid 41 current snap is 228 2026-02-17T05:37:06.310 INFO:tasks.rados.rados.0.trial118.stdout:2182: seq_num 780 ranges {709460=562226,2060543=791261} 2026-02-17T05:37:06.315 INFO:tasks.rados.rados.0.trial118.stdout:2182: writing trial11845692-41 from 709460 to 1271686 tid 1 2026-02-17T05:37:06.321 INFO:tasks.rados.rados.0.trial118.stdout:2182: writing trial11845692-41 from 2060543 to 2851804 tid 2 2026-02-17T05:37:06.321 INFO:tasks.rados.rados.0.trial118.stdout:2183: delete oid 37 current snap is 228 2026-02-17T05:37:06.321 INFO:tasks.rados.rados.0.trial118.stdout:2180: expect (ObjNum 772 snap 227 seq_num 772) 2026-02-17T05:37:06.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1264046 2026-02-17T05:37:06.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2779001 2026-02-17T05:37:06.421 INFO:tasks.rados.rados.0.trial118.stdout:2178: finishing copy_from racing read to trial11845692-30 2026-02-17T05:37:06.421 INFO:tasks.rados.rados.0.trial118.stdout:2178: finishing copy_from to trial11845692-30 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1222 (ObjNum 730 snap 214 seq_num 730) dirty exists 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: finishing write tid 1 to trial11845692-41 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: finishing write tid 2 to trial11845692-41 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: finishing write tid 3 to trial11845692-41 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: finishing write tid 4 to trial11845692-41 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: oid 41 updating version 0 to 1238 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: oid 41 updating version 1238 to 1239 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: oid 41 updating version 1239 to 1240 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1240 (ObjNum 780 snap 228 seq_num 780) dirty exists 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: left oid 41 (ObjNum 780 snap 228 seq_num 780) 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2178: done (3 left) 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2180: done (2 left) 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2182: done (1 left) 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2183: done (0 left) 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2184: copy_from oid 50 from oid 35 current snap is 228 2026-02-17T05:37:06.422 INFO:tasks.rados.rados.0.trial118.stdout:2185: snap_create 2026-02-17T05:37:06.428 INFO:tasks.rados.rados.0.trial118.stdout:2184: finishing copy_from racing read to trial11845692-50 2026-02-17T05:37:06.430 INFO:tasks.rados.rados.0.trial118.stdout:2184: finishing copy_from to trial11845692-50 2026-02-17T05:37:06.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:07.332 INFO:tasks.rados.rados.0.trial118.stdout:2184: done (1 left) 2026-02-17T05:37:07.332 INFO:tasks.rados.rados.0.trial118.stdout:2185: done (0 left) 2026-02-17T05:37:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2186: read oid 16 snap -1 2026-02-17T05:37:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2186: expect (ObjNum 751 snap 221 seq_num 751) 2026-02-17T05:37:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2187: write oid 34 current snap is 229 2026-02-17T05:37:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2187: seq_num 782 ranges {743074=712724,2061154=794930} 2026-02-17T05:37:07.337 INFO:tasks.rados.rados.0.trial118.stdout:2187: writing trial11845692-34 from 743074 to 1455798 tid 1 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2187: writing trial11845692-34 from 2061154 to 2856084 tid 2 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2188: read oid 41 snap -1 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2188: expect (ObjNum 780 snap 228 seq_num 780) 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2189: read oid 35 snap -1 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2189: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:37:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2190: snap_remove snap 208 2026-02-17T05:37:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2190: done (4 left) 2026-02-17T05:37:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2191: rollback oid 1 current snap is 229 2026-02-17T05:37:08.334 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 193 2026-02-17T05:37:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2186: expect (ObjNum 751 snap 221 seq_num 751) 2026-02-17T05:37:08.369 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 494532 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2187: finishing write tid 1 to trial11845692-34 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2186: done (4 left) 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2192: write oid 15 current snap is 229 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2187: finishing write tid 2 to trial11845692-34 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2187: finishing write tid 3 to trial11845692-34 2026-02-17T05:37:08.385 INFO:tasks.rados.rados.0.trial118.stdout:2187: finishing write tid 4 to trial11845692-34 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:2187: oid 34 updating version 0 to 742 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:2187: oid 34 updating version 742 to 743 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:2187: oid 34 version 743 is already newer than 741 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 743 (ObjNum 782 snap 229 seq_num 782) dirty exists 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:2187: left oid 34 (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:37:08.386 INFO:tasks.rados.rados.0.trial118.stdout:2189: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:37:08.464 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1317849 2026-02-17T05:37:08.489 INFO:tasks.rados.rados.0.trial118.stdout:2188: expect (ObjNum 780 snap 228 seq_num 780) 2026-02-17T05:37:08.534 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 678599 2026-02-17T05:37:08.572 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:08.616 INFO:tasks.rados.rados.0.trial118.stdout:2191: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:37:08.616 INFO:tasks.rados.rados.0.trial118.stdout:2191: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:37:08.616 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1224 (ObjNum 654 snap 192 seq_num 654) dirty exists 2026-02-17T05:37:08.616 INFO:tasks.rados.rados.0.trial118.stdout:2192: seq_num 783 ranges {759881=787973,2119636=654941} 2026-02-17T05:37:08.622 INFO:tasks.rados.rados.0.trial118.stdout:2192: writing trial11845692-15 from 759881 to 1547854 tid 1 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2192: writing trial11845692-15 from 2119636 to 2774577 tid 2 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2187: done (4 left) 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2188: done (3 left) 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2189: done (2 left) 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2191: done (1 left) 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2193: snap_create 2026-02-17T05:37:08.627 INFO:tasks.rados.rados.0.trial118.stdout:2192: finishing write tid 1 to trial11845692-15 2026-02-17T05:37:08.629 INFO:tasks.rados.rados.0.trial118.stdout:2192: finishing write tid 2 to trial11845692-15 2026-02-17T05:37:08.629 INFO:tasks.rados.rados.0.trial118.stdout:2192: finishing write tid 3 to trial11845692-15 2026-02-17T05:37:08.629 INFO:tasks.rados.rados.0.trial118.stdout:2192: finishing write tid 4 to trial11845692-15 2026-02-17T05:37:08.629 INFO:tasks.rados.rados.0.trial118.stdout:2192: oid 15 updating version 0 to 1193 2026-02-17T05:37:08.630 INFO:tasks.rados.rados.0.trial118.stdout:2192: oid 15 updating version 1193 to 1194 2026-02-17T05:37:08.630 INFO:tasks.rados.rados.0.trial118.stdout:2192: oid 15 version 1194 is already newer than 1192 2026-02-17T05:37:08.630 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1194 (ObjNum 783 snap 229 seq_num 783) dirty exists 2026-02-17T05:37:08.630 INFO:tasks.rados.rados.0.trial118.stdout:2192: left oid 15 (ObjNum 783 snap 229 seq_num 783) 2026-02-17T05:37:09.336 INFO:tasks.rados.rados.0.trial118.stdout:2192: done (1 left) 2026-02-17T05:37:09.336 INFO:tasks.rados.rados.0.trial118.stdout:2193: done (0 left) 2026-02-17T05:37:09.336 INFO:tasks.rados.rados.0.trial118.stdout:2194: write oid 9 current snap is 230 2026-02-17T05:37:09.336 INFO:tasks.rados.rados.0.trial118.stdout:2194: seq_num 784 ranges {776688=579575,1894471=798599} 2026-02-17T05:37:09.341 INFO:tasks.rados.rados.0.trial118.stdout:2194: writing trial11845692-9 from 776688 to 1356263 tid 1 2026-02-17T05:37:09.346 INFO:tasks.rados.rados.0.trial118.stdout:2194: writing trial11845692-9 from 1894471 to 2693070 tid 2 2026-02-17T05:37:09.346 INFO:tasks.rados.rados.0.trial118.stdout:2195: write (excl) oid 46 current snap is 230 2026-02-17T05:37:09.346 INFO:tasks.rados.rados.0.trial118.stdout:2194: finishing write tid 1 to trial11845692-9 2026-02-17T05:37:09.346 INFO:tasks.rados.rados.0.trial118.stdout:2195: seq_num 785 ranges {793495=654824,1952953=658610,3157167=36328} 2026-02-17T05:37:09.351 INFO:tasks.rados.rados.0.trial118.stdout:2195: writing trial11845692-46 from 793495 to 1448319 tid 1 2026-02-17T05:37:09.355 INFO:tasks.rados.rados.0.trial118.stdout:2195: writing trial11845692-46 from 1952953 to 2611563 tid 2 2026-02-17T05:37:09.357 INFO:tasks.rados.rados.0.trial118.stdout:2195: writing trial11845692-46 from 3157167 to 3193495 tid 3 2026-02-17T05:37:09.357 INFO:tasks.rados.rados.0.trial118.stdout:2196: snap_remove snap 193 2026-02-17T05:37:10.307 INFO:tasks.rados.rados.0.trial118.stdout:2196: done (2 left) 2026-02-17T05:37:10.307 INFO:tasks.rados.rados.0.trial118.stdout:2197: snap_remove snap 219 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2197: done (2 left) 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2198: delete oid 41 current snap is 230 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: finishing write tid 2 to trial11845692-9 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: finishing write tid 3 to trial11845692-9 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: finishing write tid 4 to trial11845692-9 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: oid 9 updating version 0 to 1243 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: oid 9 version 1243 is already newer than 1242 2026-02-17T05:37:11.309 INFO:tasks.rados.rados.0.trial118.stdout:2194: oid 9 version 1243 is already newer than 1241 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1243 (ObjNum 784 snap 230 seq_num 784) dirty exists 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2194: left oid 9 (ObjNum 784 snap 230 seq_num 784) 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: finishing write tid 1 to trial11845692-46 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: finishing write tid 2 to trial11845692-46 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: finishing write tid 3 to trial11845692-46 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: finishing write tid 4 to trial11845692-46 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: finishing write tid 5 to trial11845692-46 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: oid 46 updating version 0 to 1011 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: oid 46 version 1011 is already newer than 1010 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: oid 46 version 1011 is already newer than 1008 2026-02-17T05:37:11.310 INFO:tasks.rados.rados.0.trial118.stdout:2195: oid 46 version 1011 is already newer than 1009 2026-02-17T05:37:11.311 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1011 (ObjNum 785 snap 230 seq_num 785) dirty exists 2026-02-17T05:37:11.311 INFO:tasks.rados.rados.0.trial118.stdout:2195: left oid 46 (ObjNum 785 snap 230 seq_num 785) 2026-02-17T05:37:11.312 INFO:tasks.rados.rados.0.trial118.stdout:2194: done (2 left) 2026-02-17T05:37:11.312 INFO:tasks.rados.rados.0.trial118.stdout:2195: done (1 left) 2026-02-17T05:37:11.312 INFO:tasks.rados.rados.0.trial118.stdout:2198: done (0 left) 2026-02-17T05:37:11.312 INFO:tasks.rados.rados.0.trial118.stdout:2199: snap_create 2026-02-17T05:37:12.310 INFO:tasks.rados.rados.0.trial118.stdout:2199: done (0 left) 2026-02-17T05:37:12.311 INFO:tasks.rados.rados.0.trial118.stdout:2200: read oid 36 snap -1 2026-02-17T05:37:12.311 INFO:tasks.rados.rados.0.trial118.stdout:2200: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:37:12.311 INFO:tasks.rados.rados.0.trial118.stdout:2201: copy_from oid 24 from oid 50 current snap is 231 2026-02-17T05:37:12.311 INFO:tasks.rados.rados.0.trial118.stdout:2202: read oid 34 snap -1 2026-02-17T05:37:12.311 INFO:tasks.rados.rados.0.trial118.stdout:2202: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:37:12.312 INFO:tasks.rados.rados.0.trial118.stdout:2203: delete oid 9 current snap is 231 2026-02-17T05:37:12.312 INFO:tasks.rados.rados.0.trial118.stdout:2203: done (3 left) 2026-02-17T05:37:12.313 INFO:tasks.rados.rados.0.trial118.stdout:2204: snap_create 2026-02-17T05:37:12.316 INFO:tasks.rados.rados.0.trial118.stdout:2200: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:37:12.405 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:12.456 INFO:tasks.rados.rados.0.trial118.stdout:2202: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:37:12.465 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1053084 2026-02-17T05:37:12.500 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 474737 2026-02-17T05:37:12.592 INFO:tasks.rados.rados.0.trial118.stdout:2201: finishing copy_from racing read to trial11845692-24 2026-02-17T05:37:12.592 INFO:tasks.rados.rados.0.trial118.stdout:2201: finishing copy_from to trial11845692-24 2026-02-17T05:37:12.592 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:13.312 INFO:tasks.rados.rados.0.trial118.stdout:2200: done (3 left) 2026-02-17T05:37:13.312 INFO:tasks.rados.rados.0.trial118.stdout:2201: done (2 left) 2026-02-17T05:37:13.312 INFO:tasks.rados.rados.0.trial118.stdout:2202: done (1 left) 2026-02-17T05:37:13.313 INFO:tasks.rados.rados.0.trial118.stdout:2204: done (0 left) 2026-02-17T05:37:13.313 INFO:tasks.rados.rados.0.trial118.stdout:2205: delete oid 35 current snap is 232 2026-02-17T05:37:13.314 INFO:tasks.rados.rados.0.trial118.stdout:2205: done (0 left) 2026-02-17T05:37:13.314 INFO:tasks.rados.rados.0.trial118.stdout:2206: write oid 22 current snap is 232 2026-02-17T05:37:13.314 INFO:tasks.rados.rados.0.trial118.stdout:2206: seq_num 789 ranges {460723=555820,1670528=549595,2634153=626570} 2026-02-17T05:37:13.318 INFO:tasks.rados.rados.0.trial118.stdout:2206: writing trial11845692-22 from 460723 to 1016543 tid 1 2026-02-17T05:37:13.322 INFO:tasks.rados.rados.0.trial118.stdout:2206: writing trial11845692-22 from 1670528 to 2220123 tid 2 2026-02-17T05:37:13.326 INFO:tasks.rados.rados.0.trial118.stdout:2206: writing trial11845692-22 from 2634153 to 3260723 tid 3 2026-02-17T05:37:13.326 INFO:tasks.rados.rados.0.trial118.stdout:2207: read oid 27 snap -1 2026-02-17T05:37:13.327 INFO:tasks.rados.rados.0.trial118.stdout:2207: expect (ObjNum 760 snap 224 seq_num 760) 2026-02-17T05:37:13.327 INFO:tasks.rados.rados.0.trial118.stdout:2208: copy_from oid 31 from oid 1 current snap is 232 2026-02-17T05:37:13.327 INFO:tasks.rados.rados.0.trial118.stdout:2206: finishing write tid 1 to trial11845692-22 2026-02-17T05:37:13.327 INFO:tasks.rados.rados.0.trial118.stdout:2209: snap_remove snap 218 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:2209: done (3 left) 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:2210: rollback oid 6 current snap is 232 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 197 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:2206: finishing write tid 2 to trial11845692-22 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:2206: finishing write tid 3 to trial11845692-22 2026-02-17T05:37:14.316 INFO:tasks.rados.rados.0.trial118.stdout:2206: finishing write tid 4 to trial11845692-22 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: finishing write tid 5 to trial11845692-22 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: oid 22 updating version 0 to 1196 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: oid 22 version 1196 is already newer than 1195 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: oid 22 updating version 1196 to 1197 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: oid 22 updating version 1197 to 1198 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1198 (ObjNum 789 snap 232 seq_num 789) dirty exists 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2206: left oid 22 (ObjNum 789 snap 232 seq_num 789) 2026-02-17T05:37:14.317 INFO:tasks.rados.rados.0.trial118.stdout:2207: expect (ObjNum 760 snap 224 seq_num 760) 2026-02-17T05:37:14.370 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1820160 2026-02-17T05:37:14.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2680871 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2208: finishing copy_from racing read to trial11845692-31 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2208: finishing copy_from to trial11845692-31 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1224 (ObjNum 654 snap 192 seq_num 654) dirty exists 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2210: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2206: done (3 left) 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2207: done (2 left) 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2208: done (1 left) 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2211: snap_create 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2210: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:2210: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:37:14.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 670 (ObjNum 651 snap 191 seq_num 651) dirty exists 2026-02-17T05:37:15.318 INFO:tasks.rados.rados.0.trial118.stdout:2210: done (1 left) 2026-02-17T05:37:15.318 INFO:tasks.rados.rados.0.trial118.stdout:2211: done (0 left) 2026-02-17T05:37:15.318 INFO:tasks.rados.rados.0.trial118.stdout:2212: rollback oid 46 current snap is 233 2026-02-17T05:37:15.318 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 211 2026-02-17T05:37:15.318 INFO:tasks.rados.rados.0.trial118.stdout:2213: delete oid 45 current snap is 233 2026-02-17T05:37:15.319 INFO:tasks.rados.rados.0.trial118.stdout:2213: done (1 left) 2026-02-17T05:37:15.319 INFO:tasks.rados.rados.0.trial118.stdout:2214: snap_remove snap 230 2026-02-17T05:37:16.319 INFO:tasks.rados.rados.0.trial118.stdout:2214: done (1 left) 2026-02-17T05:37:16.320 INFO:tasks.rados.rados.0.trial118.stdout:2215: snap_create 2026-02-17T05:37:16.320 INFO:tasks.rados.rados.0.trial118.stdout:2212: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:37:16.320 INFO:tasks.rados.rados.0.trial118.stdout:2212: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:37:16.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1013 (ObjNum 129 snap 0 seq_num 12904944) dirty dne 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2212: done (1 left) 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2215: done (0 left) 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2216: copy_from oid 23 from oid 50 current snap is 234 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2217: read oid 1 snap -1 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2217: expect (ObjNum 654 snap 192 seq_num 654) 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2218: copy_from oid 26 from oid 8 current snap is 234 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2219: copy_from oid 22 from oid 35 current snap is 234 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2220: read oid 39 snap 232 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2220: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2221: read oid 41 snap -1 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2221: expect deleted 2026-02-17T05:37:17.320 INFO:tasks.rados.rados.0.trial118.stdout:2222: snap_create 2026-02-17T05:37:17.322 INFO:tasks.rados.rados.0.trial118.stdout:2220: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:37:17.366 INFO:tasks.rados.rados.0.trial118.stdout:2219: finishing copy_from to trial11845692-22 2026-02-17T05:37:17.366 INFO:tasks.rados.rados.0.trial118.stdout:2219: got expected ENOENT (src dne) 2026-02-17T05:37:17.366 INFO:tasks.rados.rados.0.trial118.stdout:2219: finishing copy_from racing read to trial11845692-22 2026-02-17T05:37:17.366 INFO:tasks.rados.rados.0.trial118.stdout:2217: expect (ObjNum 654 snap 192 seq_num 654) 2026-02-17T05:37:17.366 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 307091 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:2216: finishing copy_from racing read to trial11845692-23 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:2218: finishing copy_from racing read to trial11845692-26 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:2216: finishing copy_from to trial11845692-23 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:2218: finishing copy_from to trial11845692-26 2026-02-17T05:37:17.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1258 (ObjNum 761 snap 224 seq_num 761) dirty exists 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2216: done (6 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2217: done (5 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2218: done (4 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2219: done (3 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2220: done (2 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2221: done (1 left) 2026-02-17T05:37:18.326 INFO:tasks.rados.rados.0.trial118.stdout:2222: done (0 left) 2026-02-17T05:37:18.327 INFO:tasks.rados.rados.0.trial118.stdout:2223: snap_remove snap 212 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2223: done (0 left) 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2224: read oid 32 snap -1 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2224: expect (ObjNum 773 snap 227 seq_num 773) 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2225: rollback oid 40 current snap is 235 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 211 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2226: read oid 48 snap -1 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2226: expect (ObjNum 654 snap 192 seq_num 654) 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2227: rollback oid 38 current snap is 235 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 211 2026-02-17T05:37:19.327 INFO:tasks.rados.rados.0.trial118.stdout:2228: snap_create 2026-02-17T05:37:19.331 INFO:tasks.rados.rados.0.trial118.stdout:2224: expect (ObjNum 773 snap 227 seq_num 773) 2026-02-17T05:37:19.384 INFO:tasks.rados.rados.0.trial118.stdout:2227: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:37:19.384 INFO:tasks.rados.rados.0.trial118.stdout:2227: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:2227: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1189 (ObjNum 694 snap 202 seq_num 694) dirty exists 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:2225: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:2225: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:2225: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1230 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:37:19.385 INFO:tasks.rados.rados.0.trial118.stdout:2226: expect (ObjNum 654 snap 192 seq_num 654) 2026-02-17T05:37:19.391 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1429167 2026-02-17T05:37:19.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1008593 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2224: done (4 left) 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2225: done (3 left) 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2226: done (2 left) 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2227: done (1 left) 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2228: done (0 left) 2026-02-17T05:37:20.310 INFO:tasks.rados.rados.0.trial118.stdout:2229: snap_create 2026-02-17T05:37:21.310 INFO:tasks.rados.rados.0.trial118.stdout:2229: done (0 left) 2026-02-17T05:37:21.310 INFO:tasks.rados.rados.0.trial118.stdout:2230: copy_from oid 35 from oid 22 current snap is 237 2026-02-17T05:37:21.310 INFO:tasks.rados.rados.0.trial118.stdout:2231: write oid 9 current snap is 237 2026-02-17T05:37:21.310 INFO:tasks.rados.rados.0.trial118.stdout:2231: seq_num 791 ranges {494337=422671,1387492=553264,2688999=445221} 2026-02-17T05:37:21.313 INFO:tasks.rados.rados.0.trial118.stdout:2231: writing trial11845692-9 from 494337 to 917008 tid 1 2026-02-17T05:37:21.317 INFO:tasks.rados.rados.0.trial118.stdout:2231: writing trial11845692-9 from 1387492 to 1940756 tid 2 2026-02-17T05:37:21.322 INFO:tasks.rados.rados.0.trial118.stdout:2231: writing trial11845692-9 from 2688999 to 3134220 tid 3 2026-02-17T05:37:21.322 INFO:tasks.rados.rados.0.trial118.stdout:2231: finishing write tid 1 to trial11845692-9 2026-02-17T05:37:21.322 INFO:tasks.rados.rados.0.trial118.stdout:2231: finishing write tid 2 to trial11845692-9 2026-02-17T05:37:21.322 INFO:tasks.rados.rados.0.trial118.stdout:2230: finishing copy_from racing read to trial11845692-35 2026-02-17T05:37:21.322 INFO:tasks.rados.rados.0.trial118.stdout:2230: finishing copy_from to trial11845692-35 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1198 (ObjNum 789 snap 232 seq_num 789) dirty exists 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2232: read oid 39 snap -1 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2232: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2230: done (2 left) 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2233: read oid 4 snap 236 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2233: expect (ObjNum 771 snap 227 seq_num 771) 2026-02-17T05:37:21.323 INFO:tasks.rados.rados.0.trial118.stdout:2234: snap_create 2026-02-17T05:37:21.325 INFO:tasks.rados.rados.0.trial118.stdout:2232: expect (ObjNum 543 snap 153 seq_num 543) 2026-02-17T05:37:21.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 894892 2026-02-17T05:37:21.348 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1065132 2026-02-17T05:37:21.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1657669 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: finishing write tid 3 to trial11845692-9 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: finishing write tid 4 to trial11845692-9 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: finishing write tid 5 to trial11845692-9 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: oid 9 updating version 0 to 1249 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: oid 9 version 1249 is already newer than 1248 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: oid 9 version 1249 is already newer than 1246 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:2231: oid 9 version 1249 is already newer than 1247 2026-02-17T05:37:21.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1249 (ObjNum 791 snap 237 seq_num 791) dirty exists 2026-02-17T05:37:21.381 INFO:tasks.rados.rados.0.trial118.stdout:2231: left oid 9 (ObjNum 791 snap 237 seq_num 791) 2026-02-17T05:37:21.381 INFO:tasks.rados.rados.0.trial118.stdout:2233: expect (ObjNum 771 snap 227 seq_num 771) 2026-02-17T05:37:21.391 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:22.311 INFO:tasks.rados.rados.0.trial118.stdout:2231: done (3 left) 2026-02-17T05:37:22.311 INFO:tasks.rados.rados.0.trial118.stdout:2232: done (2 left) 2026-02-17T05:37:22.312 INFO:tasks.rados.rados.0.trial118.stdout:2233: done (1 left) 2026-02-17T05:37:22.312 INFO:tasks.rados.rados.0.trial118.stdout:2234: done (0 left) 2026-02-17T05:37:22.312 INFO:tasks.rados.rados.0.trial118.stdout:2235: snap_create 2026-02-17T05:37:23.312 INFO:tasks.rados.rados.0.trial118.stdout:2235: done (0 left) 2026-02-17T05:37:23.312 INFO:tasks.rados.rados.0.trial118.stdout:2236: read oid 2 snap -1 2026-02-17T05:37:23.313 INFO:tasks.rados.rados.0.trial118.stdout:2236: expect (ObjNum 722 snap 211 seq_num 722) 2026-02-17T05:37:23.313 INFO:tasks.rados.rados.0.trial118.stdout:2237: snap_remove snap 234 2026-02-17T05:37:24.315 INFO:tasks.rados.rados.0.trial118.stdout:2237: done (1 left) 2026-02-17T05:37:24.315 INFO:tasks.rados.rados.0.trial118.stdout:2238: write oid 1 current snap is 239 2026-02-17T05:37:24.315 INFO:tasks.rados.rados.0.trial118.stdout:2238: seq_num 792 ranges {511144=497920,1445974=413275,2316422=656493} 2026-02-17T05:37:24.319 INFO:tasks.rados.rados.0.trial118.stdout:2238: writing trial11845692-1 from 511144 to 1009064 tid 1 2026-02-17T05:37:24.322 INFO:tasks.rados.rados.0.trial118.stdout:2238: writing trial11845692-1 from 1445974 to 1859249 tid 2 2026-02-17T05:37:24.327 INFO:tasks.rados.rados.0.trial118.stdout:2238: writing trial11845692-1 from 2316422 to 2972915 tid 3 2026-02-17T05:37:24.327 INFO:tasks.rados.rados.0.trial118.stdout:2239: write (excl) oid 5 current snap is 239 2026-02-17T05:37:24.327 INFO:tasks.rados.rados.0.trial118.stdout:2239: seq_num 793 ranges {527951=573169,1504456=556933,2743845=467765} 2026-02-17T05:37:24.331 INFO:tasks.rados.rados.0.trial118.stdout:2239: writing trial11845692-5 from 527951 to 1101120 tid 1 2026-02-17T05:37:24.334 INFO:tasks.rados.rados.0.trial118.stdout:2239: writing trial11845692-5 from 1504456 to 2061389 tid 2 2026-02-17T05:37:24.339 INFO:tasks.rados.rados.0.trial118.stdout:2239: writing trial11845692-5 from 2743845 to 3211610 tid 3 2026-02-17T05:37:24.339 INFO:tasks.rados.rados.0.trial118.stdout:2240: rollback oid 29 current snap is 239 2026-02-17T05:37:24.339 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 238 2026-02-17T05:37:24.339 INFO:tasks.rados.rados.0.trial118.stdout:2236: expect (ObjNum 722 snap 211 seq_num 722) 2026-02-17T05:37:24.341 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1378831 2026-02-17T05:37:24.382 INFO:tasks.rados.rados.0.trial118.stdout:2238: finishing write tid 1 to trial11845692-1 2026-02-17T05:37:24.382 INFO:tasks.rados.rados.0.trial118.stdout:2236: done (3 left) 2026-02-17T05:37:24.382 INFO:tasks.rados.rados.0.trial118.stdout:2241: snap_create 2026-02-17T05:37:24.382 INFO:tasks.rados.rados.0.trial118.stdout:2238: finishing write tid 2 to trial11845692-1 2026-02-17T05:37:24.382 INFO:tasks.rados.rados.0.trial118.stdout:2238: finishing write tid 3 to trial11845692-1 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: finishing write tid 4 to trial11845692-1 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: finishing write tid 5 to trial11845692-1 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: oid 1 updating version 0 to 1244 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: oid 1 updating version 1244 to 1245 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: oid 1 version 1245 is already newer than 1240 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: oid 1 version 1245 is already newer than 1241 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1245 (ObjNum 792 snap 239 seq_num 792) dirty exists 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2238: left oid 1 (ObjNum 792 snap 239 seq_num 792) 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2239: finishing write tid 1 to trial11845692-5 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2239: finishing write tid 2 to trial11845692-5 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2239: finishing write tid 3 to trial11845692-5 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2239: finishing write tid 4 to trial11845692-5 2026-02-17T05:37:24.383 INFO:tasks.rados.rados.0.trial118.stdout:2239: finishing write tid 5 to trial11845692-5 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2239: oid 5 updating version 0 to 1094 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2239: oid 5 version 1094 is already newer than 1092 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2239: oid 5 updating version 1094 to 1095 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2239: oid 5 version 1095 is already newer than 1093 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1095 (ObjNum 793 snap 239 seq_num 793) dirty exists 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2239: left oid 5 (ObjNum 793 snap 239 seq_num 793) 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2240: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2240: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:2240: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:37:24.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1252 (ObjNum 742 snap 216 seq_num 742) dirty exists 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2238: done (3 left) 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2239: done (2 left) 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2240: done (1 left) 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2241: done (0 left) 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2242: write (excl) oid 38 current snap is 240 2026-02-17T05:37:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2242: seq_num 794 ranges {544758=648418,1846585=416944,2771268=573490} 2026-02-17T05:37:25.323 INFO:tasks.rados.rados.0.trial118.stdout:2242: writing trial11845692-38 from 544758 to 1193176 tid 1 2026-02-17T05:37:25.327 INFO:tasks.rados.rados.0.trial118.stdout:2242: writing trial11845692-38 from 1846585 to 2263529 tid 2 2026-02-17T05:37:25.331 INFO:tasks.rados.rados.0.trial118.stdout:2242: writing trial11845692-38 from 2771268 to 3344758 tid 3 2026-02-17T05:37:25.331 INFO:tasks.rados.rados.0.trial118.stdout:2243: write oid 31 current snap is 240 2026-02-17T05:37:25.331 INFO:tasks.rados.rados.0.trial118.stdout:2243: seq_num 795 ranges {561565=723667,1905067=560602,3082338=279227} 2026-02-17T05:37:25.336 INFO:tasks.rados.rados.0.trial118.stdout:2243: writing trial11845692-31 from 561565 to 1285232 tid 1 2026-02-17T05:37:25.341 INFO:tasks.rados.rados.0.trial118.stdout:2243: writing trial11845692-31 from 1905067 to 2465669 tid 2 2026-02-17T05:37:25.345 INFO:tasks.rados.rados.0.trial118.stdout:2243: writing trial11845692-31 from 3082338 to 3361565 tid 3 2026-02-17T05:37:25.345 INFO:tasks.rados.rados.0.trial118.stdout:2244: write (excl) oid 4 current snap is 240 2026-02-17T05:37:25.345 INFO:tasks.rados.rados.0.trial118.stdout:2242: finishing write tid 1 to trial11845692-38 2026-02-17T05:37:25.345 INFO:tasks.rados.rados.0.trial118.stdout:2242: finishing write tid 2 to trial11845692-38 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: finishing write tid 3 to trial11845692-38 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: finishing write tid 4 to trial11845692-38 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: finishing write tid 5 to trial11845692-38 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: oid 38 updating version 0 to 1191 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: oid 38 version 1191 is already newer than 1190 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: oid 38 updating version 1191 to 1192 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: oid 38 updating version 1192 to 1193 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1193 (ObjNum 794 snap 240 seq_num 794) dirty exists 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2242: left oid 38 (ObjNum 794 snap 240 seq_num 794) 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2243: finishing write tid 1 to trial11845692-31 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2243: finishing write tid 2 to trial11845692-31 2026-02-17T05:37:25.346 INFO:tasks.rados.rados.0.trial118.stdout:2244: seq_num 796 ranges {578372=798916,1963549=420613,2826114=417934} 2026-02-17T05:37:25.351 INFO:tasks.rados.rados.0.trial118.stdout:2244: writing trial11845692-4 from 578372 to 1377288 tid 1 2026-02-17T05:37:25.354 INFO:tasks.rados.rados.0.trial118.stdout:2244: writing trial11845692-4 from 1963549 to 2384162 tid 2 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2244: writing trial11845692-4 from 2826114 to 3244048 tid 3 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2242: done (2 left) 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2245: snap_remove snap 231 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2243: finishing write tid 3 to trial11845692-31 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2243: finishing write tid 4 to trial11845692-31 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2243: finishing write tid 5 to trial11845692-31 2026-02-17T05:37:25.358 INFO:tasks.rados.rados.0.trial118.stdout:2243: oid 31 updating version 0 to 1319 2026-02-17T05:37:25.359 INFO:tasks.rados.rados.0.trial118.stdout:2243: oid 31 version 1319 is already newer than 1316 2026-02-17T05:37:25.359 INFO:tasks.rados.rados.0.trial118.stdout:2243: oid 31 version 1319 is already newer than 1317 2026-02-17T05:37:25.359 INFO:tasks.rados.rados.0.trial118.stdout:2243: oid 31 version 1319 is already newer than 1318 2026-02-17T05:37:25.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1319 (ObjNum 795 snap 240 seq_num 795) dirty exists 2026-02-17T05:37:25.359 INFO:tasks.rados.rados.0.trial118.stdout:2243: left oid 31 (ObjNum 795 snap 240 seq_num 795) 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2243: done (2 left) 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2245: done (1 left) 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2246: snap_create 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: finishing write tid 1 to trial11845692-4 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: finishing write tid 2 to trial11845692-4 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: finishing write tid 3 to trial11845692-4 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: finishing write tid 4 to trial11845692-4 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: finishing write tid 5 to trial11845692-4 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: oid 4 updating version 0 to 1256 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: oid 4 version 1256 is already newer than 1255 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: oid 4 version 1256 is already newer than 1253 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:2244: oid 4 version 1256 is already newer than 1254 2026-02-17T05:37:26.321 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1256 (ObjNum 796 snap 240 seq_num 796) dirty exists 2026-02-17T05:37:26.322 INFO:tasks.rados.rados.0.trial118.stdout:2244: left oid 4 (ObjNum 796 snap 240 seq_num 796) 2026-02-17T05:37:27.322 INFO:tasks.rados.rados.0.trial118.stdout:2244: done (1 left) 2026-02-17T05:37:27.322 INFO:tasks.rados.rados.0.trial118.stdout:2246: done (0 left) 2026-02-17T05:37:27.322 INFO:tasks.rados.rados.0.trial118.stdout:2247: write oid 40 current snap is 241 2026-02-17T05:37:27.322 INFO:tasks.rados.rados.0.trial118.stdout:2247: seq_num 797 ranges {595179=474165,1622031=564271,2737184=629206} 2026-02-17T05:37:27.326 INFO:tasks.rados.rados.0.trial118.stdout:2247: writing trial11845692-40 from 595179 to 1069344 tid 1 2026-02-17T05:37:27.330 INFO:tasks.rados.rados.0.trial118.stdout:2247: writing trial11845692-40 from 1622031 to 2186302 tid 2 2026-02-17T05:37:27.335 INFO:tasks.rados.rados.0.trial118.stdout:2247: writing trial11845692-40 from 2737184 to 3366390 tid 3 2026-02-17T05:37:27.335 INFO:tasks.rados.rados.0.trial118.stdout:2248: copy_from oid 48 from oid 18 current snap is 241 2026-02-17T05:37:27.335 INFO:tasks.rados.rados.0.trial118.stdout:2247: finishing write tid 1 to trial11845692-40 2026-02-17T05:37:27.335 INFO:tasks.rados.rados.0.trial118.stdout:2247: finishing write tid 2 to trial11845692-40 2026-02-17T05:37:27.335 INFO:tasks.rados.rados.0.trial118.stdout:2249: delete oid 11 current snap is 241 2026-02-17T05:37:27.337 INFO:tasks.rados.rados.0.trial118.stdout:2249: done (2 left) 2026-02-17T05:37:27.337 INFO:tasks.rados.rados.0.trial118.stdout:2250: read oid 25 snap -1 2026-02-17T05:37:27.337 INFO:tasks.rados.rados.0.trial118.stdout:2250: expect deleted 2026-02-17T05:37:27.337 INFO:tasks.rados.rados.0.trial118.stdout:2251: write oid 26 current snap is 241 2026-02-17T05:37:27.337 INFO:tasks.rados.rados.0.trial118.stdout:2251: seq_num 799 ranges {628793=741016,2138995=567940,3192030=236763} 2026-02-17T05:37:27.341 INFO:tasks.rados.rados.0.trial118.stdout:2251: writing trial11845692-26 from 628793 to 1369809 tid 1 2026-02-17T05:37:27.346 INFO:tasks.rados.rados.0.trial118.stdout:2251: writing trial11845692-26 from 2138995 to 2706935 tid 2 2026-02-17T05:37:27.349 INFO:tasks.rados.rados.0.trial118.stdout:2251: writing trial11845692-26 from 3192030 to 3428793 tid 3 2026-02-17T05:37:27.349 INFO:tasks.rados.rados.0.trial118.stdout:2252: snap_remove snap 227 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2252: done (4 left) 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2253: copy_from oid 14 from oid 11 current snap is 241 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: finishing write tid 3 to trial11845692-40 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: finishing write tid 4 to trial11845692-40 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: finishing write tid 5 to trial11845692-40 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: oid 40 updating version 0 to 1254 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: oid 40 version 1254 is already newer than 1251 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: oid 40 version 1254 is already newer than 1252 2026-02-17T05:37:28.328 INFO:tasks.rados.rados.0.trial118.stdout:2247: oid 40 version 1254 is already newer than 1253 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1254 (ObjNum 797 snap 241 seq_num 797) dirty exists 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2247: left oid 40 (ObjNum 797 snap 241 seq_num 797) 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2251: finishing write tid 1 to trial11845692-26 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2248: finishing copy_from racing read to trial11845692-48 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2248: finishing copy_from to trial11845692-48 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 737 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2251: finishing write tid 2 to trial11845692-26 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2247: done (4 left) 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2248: done (3 left) 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2250: done (2 left) 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2254: copy_from oid 29 from oid 43 current snap is 241 2026-02-17T05:37:28.329 INFO:tasks.rados.rados.0.trial118.stdout:2251: finishing write tid 3 to trial11845692-26 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: finishing write tid 4 to trial11845692-26 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: finishing write tid 5 to trial11845692-26 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: oid 26 updating version 0 to 1260 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: oid 26 updating version 1260 to 1261 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: oid 26 version 1261 is already newer than 1259 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: oid 26 updating version 1261 to 1262 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1262 (ObjNum 799 snap 241 seq_num 799) dirty exists 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: left oid 26 (ObjNum 799 snap 241 seq_num 799) 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2251: done (2 left) 2026-02-17T05:37:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2255: snap_create 2026-02-17T05:37:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2253: finishing copy_from to trial11845692-14 2026-02-17T05:37:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2253: got expected ENOENT (src dne) 2026-02-17T05:37:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2253: finishing copy_from racing read to trial11845692-14 2026-02-17T05:37:28.335 INFO:tasks.rados.rados.0.trial118.stdout:2254: finishing copy_from racing read to trial11845692-29 2026-02-17T05:37:28.336 INFO:tasks.rados.rados.0.trial118.stdout:2254: finishing copy_from to trial11845692-29 2026-02-17T05:37:28.336 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 730 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2253: done (2 left) 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2254: done (1 left) 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2255: done (0 left) 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2256: read oid 46 snap -1 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2256: expect deleted 2026-02-17T05:37:29.329 INFO:tasks.rados.rados.0.trial118.stdout:2257: delete oid 3 current snap is 242 2026-02-17T05:37:29.330 INFO:tasks.rados.rados.0.trial118.stdout:2256: done (1 left) 2026-02-17T05:37:29.330 INFO:tasks.rados.rados.0.trial118.stdout:2257: done (0 left) 2026-02-17T05:37:29.330 INFO:tasks.rados.rados.0.trial118.stdout:2258: write oid 15 current snap is 242 2026-02-17T05:37:29.330 INFO:tasks.rados.rados.0.trial118.stdout:2258: seq_num 801 ranges {662407=491514,1855959=571609,2846876=615531} 2026-02-17T05:37:29.334 INFO:tasks.rados.rados.0.trial118.stdout:2258: writing trial11845692-15 from 662407 to 1153921 tid 1 2026-02-17T05:37:29.339 INFO:tasks.rados.rados.0.trial118.stdout:2258: writing trial11845692-15 from 1855959 to 2427568 tid 2 2026-02-17T05:37:29.343 INFO:tasks.rados.rados.0.trial118.stdout:2258: writing trial11845692-15 from 2846876 to 3462407 tid 3 2026-02-17T05:37:29.343 INFO:tasks.rados.rados.0.trial118.stdout:2259: snap_remove snap 237 2026-02-17T05:37:30.310 INFO:tasks.rados.rados.0.trial118.stdout:2259: done (1 left) 2026-02-17T05:37:30.310 INFO:tasks.rados.rados.0.trial118.stdout:2260: snap_remove snap 211 2026-02-17T05:37:31.311 INFO:tasks.rados.rados.0.trial118.stdout:2260: done (1 left) 2026-02-17T05:37:31.311 INFO:tasks.rados.rados.0.trial118.stdout:2261: read oid 45 snap 204 2026-02-17T05:37:31.311 INFO:tasks.rados.rados.0.trial118.stdout:2261: expect deleted 2026-02-17T05:37:31.311 INFO:tasks.rados.rados.0.trial118.stdout:2262: snap_remove snap 210 2026-02-17T05:37:32.312 INFO:tasks.rados.rados.0.trial118.stdout:2262: done (2 left) 2026-02-17T05:37:32.312 INFO:tasks.rados.rados.0.trial118.stdout:2263: snap_remove snap 240 2026-02-17T05:37:33.312 INFO:tasks.rados.rados.0.trial118.stdout:2263: done (2 left) 2026-02-17T05:37:33.312 INFO:tasks.rados.rados.0.trial118.stdout:2264: write (excl) oid 38 current snap is 242 2026-02-17T05:37:33.312 INFO:tasks.rados.rados.0.trial118.stdout:2264: seq_num 802 ranges {679214=566763,1798088=715267,3157946=321268} 2026-02-17T05:37:33.318 INFO:tasks.rados.rados.0.trial118.stdout:2264: writing trial11845692-38 from 679214 to 1245977 tid 1 2026-02-17T05:37:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2264: writing trial11845692-38 from 1798088 to 2513355 tid 2 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2264: writing trial11845692-38 from 3157946 to 3479214 tid 3 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2265: copy_from oid 14 from oid 35 current snap is 242 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2258: finishing write tid 1 to trial11845692-15 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2266: snap_create 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2258: finishing write tid 2 to trial11845692-15 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2258: finishing write tid 3 to trial11845692-15 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2258: finishing write tid 4 to trial11845692-15 2026-02-17T05:37:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2258: finishing write tid 5 to trial11845692-15 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2258: oid 15 updating version 0 to 1203 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2258: oid 15 version 1203 is already newer than 1200 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2258: oid 15 version 1203 is already newer than 1201 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2258: oid 15 version 1203 is already newer than 1202 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1203 (ObjNum 801 snap 242 seq_num 801) dirty exists 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2258: left oid 15 (ObjNum 801 snap 242 seq_num 801) 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2264: finishing write tid 1 to trial11845692-38 2026-02-17T05:37:33.328 INFO:tasks.rados.rados.0.trial118.stdout:2264: finishing write tid 2 to trial11845692-38 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: finishing write tid 3 to trial11845692-38 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: finishing write tid 4 to trial11845692-38 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: finishing write tid 5 to trial11845692-38 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: oid 38 updating version 0 to 1194 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: oid 38 updating version 1194 to 1197 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: oid 38 version 1197 is already newer than 1195 2026-02-17T05:37:33.329 INFO:tasks.rados.rados.0.trial118.stdout:2264: oid 38 version 1197 is already newer than 1196 2026-02-17T05:37:33.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1197 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:37:33.330 INFO:tasks.rados.rados.0.trial118.stdout:2264: left oid 38 (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:37:33.334 INFO:tasks.rados.rados.0.trial118.stdout:2265: finishing copy_from racing read to trial11845692-14 2026-02-17T05:37:33.335 INFO:tasks.rados.rados.0.trial118.stdout:2265: finishing copy_from to trial11845692-14 2026-02-17T05:37:33.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1198 (ObjNum 789 snap 232 seq_num 789) dirty exists 2026-02-17T05:37:34.318 INFO:tasks.rados.rados.0.trial118.stdout:2258: done (4 left) 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2261: done (3 left) 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2264: done (2 left) 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2265: done (1 left) 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2266: done (0 left) 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2267: rollback oid 17 current snap is 243 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 17 to 232 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2268: write oid 8 current snap is 243 2026-02-17T05:37:34.319 INFO:tasks.rados.rados.0.trial118.stdout:2268: seq_num 803 ranges {696021=642012,1856570=575278,3185369=310652} 2026-02-17T05:37:34.323 INFO:tasks.rados.rados.0.trial118.stdout:2268: writing trial11845692-8 from 696021 to 1338033 tid 1 2026-02-17T05:37:34.327 INFO:tasks.rados.rados.0.trial118.stdout:2268: writing trial11845692-8 from 1856570 to 2431848 tid 2 2026-02-17T05:37:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2268: writing trial11845692-8 from 3185369 to 3496021 tid 3 2026-02-17T05:37:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2269: read oid 10 snap -1 2026-02-17T05:37:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2269: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2270: snap_remove snap 235 2026-02-17T05:37:34.717 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:37:34.717 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:37:34.717 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:37:34.717 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:37:34.731 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:37:34.731 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:37:34.732 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:37:34.796 INFO:tasks.ceph.mon.a.trial106.stderr:2026-02-17T05:37:34.794+0000 7f42e7250c00 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 360 -> 0 (sync_force? mon rebuild?) 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.797+0000 7f9bade07640 10 monclient: get_monmap_and_config 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.797+0000 7f9bade07640 10 monclient: build_initial_monmap 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.797+0000 7f9bade07640 10 monclient: monmap: 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:34.799336+0000 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:34.799336+0000 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:34.800 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.801 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:34.801 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:34.801 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:34.801 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 1 Processor -- start 2026-02-17T05:37:34.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 1 -- start start 2026-02-17T05:37:34.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient: init 2026-02-17T05:37:34.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:34.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:34.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-b con 0x7f9ba805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-c con 0x7f9ba805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-a con 0x7f9ba8182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba808b060 con 0x7f9ba8182720 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba805dc90 con 0x7f9ba805dee0 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba808d6a0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:34.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9bade07640 10 monclient(hunting): authenticate will time out at 1183.427723s 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9ba77fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9ba805d1b0 0x7f9ba805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60380/0 (socket says 10.20.193.106:60380) 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.798+0000 7f9ba77fe640 1 -- 10.20.193.106:0/2999320240 learned_addr learned my addr 10.20.193.106:0/2999320240 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901957545 0 0) 0x7f9ba808d6a0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:34.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient(hunting): my global_id is 4910 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b8c0035e0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3311189572 0 0) 0x7f9b8c0035e0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 >> v1:10.20.193.118:6789/0 conn(0x7f9ba805dee0 legacy=0x7f9ba8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 >> v1:10.20.193.106:6789/0 conn(0x7f9ba8182720 legacy=0x7f9ba81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: _finish_hunting 0 2026-02-17T05:37:34.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 monclient: found mon.noname-b 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba8057960 con 0x7f9ba805d1b0 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: _finish_auth 0 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: _check_auth_tickets 2026-02-17T05:37:34.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9b94002dd0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: dump: 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.815 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:34.816 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 5 monclient: authenticate success, global_id 4910 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b94003010 con 0x7f9ba805d1b0 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 1 -- 10.20.193.106:0/2999320240 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9b94003420 con 0x7f9ba805d1b0 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:34.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9ba67fc640 10 monclient: dump: 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:34.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 4 set_mon_vals no callback set 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 10 monclient: shutdown 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 1 -- 10.20.193.106:0/2999320240 >> v1:10.20.193.106:6790/0 conn(0x7f9ba805d1b0 legacy=0x7f9ba805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 1 -- 10.20.193.106:0/2999320240 shutdown_connections 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 1 -- 10.20.193.106:0/2999320240 >> 10.20.193.106:0/2999320240 conn(0x7f9ba80915f0 msgr2=0x7f9ba80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 1 -- 10.20.193.106:0/2999320240 shutdown_connections 2026-02-17T05:37:34.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.799+0000 7f9bade07640 1 -- 10.20.193.106:0/2999320240 wait complete. 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient: build_initial_monmap 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient: monmap: 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:34.820 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 1 Processor -- start 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 1 -- start start 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient: init 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-c con 0x7f9ba805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-a con 0x7f9ba805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:34.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient(hunting): picked mon.noname-b con 0x7f9ba8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba81093a0 con 0x7f9ba805dee0 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba810a8c0 con 0x7f9ba8182720 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba810aba0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9bade07640 10 monclient(hunting): authenticate will time out at 1183.429836s 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9ba77fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9ba805d1b0 0x7f9ba81322a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60382/0 (socket says 10.20.193.106:60382) 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.800+0000 7f9ba77fe640 1 -- 10.20.193.106:0/2213207447 learned_addr learned my addr 10.20.193.106:0/2213207447 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835468494 0 0) 0x7f9ba810a8c0 con 0x7f9ba8182720 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:34.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): my global_id is 94177 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b780035e0 con 0x7f9ba8182720 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165648260 0 0) 0x7f9ba810aba0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): my global_id is 4913 2026-02-17T05:37:34.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ba810a8c0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1628061990 0 0) 0x7f9ba810a8c0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ba810aba0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9b94002ce0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): dump: 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:34.824 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3409045777 0 0) 0x7f9b780035e0 con 0x7f9ba8182720 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ba810a8c0 con 0x7f9ba8182720 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9b9c0040d0 con 0x7f9ba8182720 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:34.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient(hunting): dump: 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:34.826 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2066446079 0 0) 0x7f9ba810aba0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 >> v1:10.20.193.118:6789/0 conn(0x7f9ba8182720 legacy=0x7f9ba8133340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 >> v1:10.20.193.106:6789/0 conn(0x7f9ba805dee0 legacy=0x7f9ba8180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: _finish_hunting 0 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 monclient: found mon.c 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba813f460 con 0x7f9ba805d1b0 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: _finish_auth 0 2026-02-17T05:37:34.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: _check_auth_tickets 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 5 monclient: authenticate success, global_id 4913 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 10 monclient: _renew_subs 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba805cf00 con 0x7f9ba805d1b0 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 10 monclient: _renew_subs 2026-02-17T05:37:34.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ba810a5e0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b94004b50 con 0x7f9ba805d1b0 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9b94004f30 con 0x7f9ba805d1b0 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:34.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9b83fff640 10 monclient: dump: 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:34.831 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.801+0000 7f9ba5ffb640 4 set_mon_vals no callback set 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9bade07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9bade07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:34.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9bade07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba810cab0 con 0x7f9ba805d1b0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9b94005090 con 0x7f9ba805d1b0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(497..497 src has 264..497) ==== 3979+0+0 (unknown 731368666 0 0) 0x7f9b9404ff60 con 0x7f9ba805d1b0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.802+0000 7f9ba6ffd640 10 monclient: get_auth_request con 0x7f9b78040bb0 auth_method 0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.804+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9b94017660 con 0x7f9ba805d1b0 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.804+0000 7f9b83fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:34.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.804+0000 7f9b83fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:34.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.948+0000 7f9bade07640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:37:34.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.948+0000 7f9bade07640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:34.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.948+0000 7f9bade07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:34.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.948+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ba8055570 con 0x7f9ba805d1b0 2026-02-17T05:37:34.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.949+0000 7f9b83fff640 1 -- 10.20.193.106:0/2213207447 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 4285933608) 0x7f9b94016e10 con 0x7f9ba805d1b0 2026-02-17T05:37:34.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.949+0000 7f9b83fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:34.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.949+0000 7f9b83fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:34.952 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:37:34.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 >> v1:10.20.193.118:6812/703720803 conn(0x7f9b78040bb0 legacy=0x7f9b78061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 10 monclient: shutdown 2026-02-17T05:37:34.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:34.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 >> v1:10.20.193.106:6790/0 conn(0x7f9ba805d1b0 legacy=0x7f9ba81322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:34.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 shutdown_connections 2026-02-17T05:37:34.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 >> 10.20.193.106:0/2213207447 conn(0x7f9ba80915f0 msgr2=0x7f9ba808c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:34.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 shutdown_connections 2026-02-17T05:37:34.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:34.950+0000 7f9bade07640 1 -- 10.20.193.106:0/2213207447 wait complete. 2026-02-17T05:37:34.960 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:37:34.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:37:34.960 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:37:35.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: get_monmap_and_config 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: monmap: 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:35.024567+0000 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:35.024567+0000 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.035 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 1 Processor -- start 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 1 -- start start 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: init 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-a con 0x7fd77c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-b con 0x7fd77c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-c con 0x7fd77c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c08b060 con 0x7fd77c05d1b0 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c05dc90 con 0x7fd77c182720 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c08d6a0 con 0x7fd77c05dee0 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.023+0000 7fd78285b640 10 monclient(hunting): authenticate will time out at 1183.652958s 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77bfff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd77c05d1b0 0x7fd77c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55528/0 (socket says 10.20.193.106:55528) 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77bfff640 1 -- 10.20.193.106:0/3285956353 learned_addr learned my addr 10.20.193.106:0/3285956353 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880252455 0 0) 0x7fd77c08d6a0 con 0x7fd77c05dee0 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): my global_id is 4916 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7600035e0 con 0x7fd77c05dee0 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502687390 0 0) 0x7fd77c05dc90 con 0x7fd77c182720 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient(hunting): my global_id is 94180 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c08d6a0 con 0x7fd77c182720 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3900838398 0 0) 0x7fd77c08d6a0 con 0x7fd77c182720 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 >> v1:10.20.193.106:6790/0 conn(0x7fd77c05dee0 legacy=0x7fd77c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 >> v1:10.20.193.106:6789/0 conn(0x7fd77c05d1b0 legacy=0x7fd77c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 monclient: found mon.noname-c 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c057960 con 0x7fd77c182720 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd770003eb0 con 0x7fd77c182720 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd78285b640 5 monclient: authenticate success, global_id 94180 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd78285b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:35.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd77affd640 10 monclient: dump: 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.024+0000 7fd78285b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7700040f0 con 0x7fd77c182720 2026-02-17T05:37:35.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 1 -- 10.20.193.106:0/3285956353 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd7700044c0 con 0x7fd77c182720 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd77affd640 10 monclient: dump: 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.041 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 4 set_mon_vals no callback set 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 10 monclient: shutdown 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- 10.20.193.106:0/3285956353 >> v1:10.20.193.118:6789/0 conn(0x7fd77c182720 legacy=0x7fd77c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- 10.20.193.106:0/3285956353 shutdown_connections 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- 10.20.193.106:0/3285956353 >> 10.20.193.106:0/3285956353 conn(0x7fd77c0915f0 msgr2=0x7fd77c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- 10.20.193.106:0/3285956353 shutdown_connections 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- 10.20.193.106:0/3285956353 wait complete. 2026-02-17T05:37:35.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 10 monclient: monmap: 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 Processor -- start 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 1 -- start start 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.025+0000 7fd78285b640 10 monclient: init 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-c con 0x7fd77c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-a con 0x7fd77c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient(hunting): picked mon.noname-b con 0x7fd77c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c12c170 con 0x7fd77c05dee0 2026-02-17T05:37:35.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c05e8e0 con 0x7fd77c182720 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c10bde0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient(hunting): authenticate will time out at 1183.655292s 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd77bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd77c05d1b0 0x7fd77c12b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60402/0 (socket says 10.20.193.106:60402) 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd77bfff640 1 -- 10.20.193.106:0/3254989920 learned_addr learned my addr 10.20.193.106:0/3254989920 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165283630 0 0) 0x7fd77c10bde0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): my global_id is 4919 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd74c0035e0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371954104 0 0) 0x7fd77c12c170 con 0x7fd77c05dee0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): my global_id is 104097 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c10bde0 con 0x7fd77c05dee0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1965938058 0 0) 0x7fd74c0035e0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77c12c170 con 0x7fd77c05d1b0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd768002ff0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): dump: 2026-02-17T05:37:35.046 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 500343226 0 0) 0x7fd77c10bde0 con 0x7fd77c05dee0 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd74c0035e0 con 0x7fd77c05dee0 2026-02-17T05:37:35.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd76c002f90 con 0x7fd77c05dee0 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient(hunting): dump: 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.048 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2297023250 0 0) 0x7fd77c12c170 con 0x7fd77c05d1b0 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.118:6789/0 conn(0x7fd77c182720 legacy=0x7fd77c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6789/0 conn(0x7fd77c05dee0 legacy=0x7fd77c12ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 monclient: found mon.c 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c10a8f0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd778ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 5 monclient: authenticate success, global_id 4919 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient: _renew_subs 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.026+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c1824f0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd78285b640 10 monclient: _renew_subs 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd78285b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd77c10b680 con 0x7fd77c05d1b0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7680031c0 con 0x7fd77c05d1b0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd768004b10 con 0x7fd77c05d1b0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient: dump: 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd77a7fc640 4 set_mon_vals no callback set 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd78285b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd768004c70 con 0x7fd77c05d1b0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd77c128680 con 0x7fd77c1282b0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(497..497 src has 264..497) ==== 3979+0+0 (unknown 731368666 0 0) 0x7fd76804fe30 con 0x7fd77c05d1b0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd780dd1640 10 monclient: get_auth_request con 0x7fd74c040bf0 auth_method 0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486395029 0 0) 0x7fd77c128680 con 0x7fd77c1282b0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 10 monclient(hunting): my global_id is 104100 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.027+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c12c170 con 0x7fd77c1282b0 2026-02-17T05:37:35.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1909164625 0 0) 0x7fd77c12c170 con 0x7fd77c1282b0 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77c128680 con 0x7fd77c1282b0 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd76c003550 con 0x7fd77c1282b0 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 10 monclient: dump: 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.053 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2454340887 0 0) 0x7fd77c128680 con 0x7fd77c1282b0 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd77c057cd0 con 0x7fd77c1282b0 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd76c005890 con 0x7fd77c1282b0 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6789/0 conn(0x7fd77c1282b0 legacy=0x7fd77c059ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.028+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6789/0 conn(0x7fd77c1282b0 legacy=0x7fd77c059ea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd78285b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd77c10c8d0 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331376236 0 0) 0x7fd77c10c8d0 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 10 monclient(hunting): my global_id is 104103 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.031+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c128680 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2940769222 0 0) 0x7fd77c128680 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77c10c8d0 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd76c003e60 con 0x7fd77c109ee0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 10 monclient: dump: 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1094320464 0 0) 0x7fd77c10c8d0 con 0x7fd77c109ee0 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd77c055570 con 0x7fd77c109ee0 2026-02-17T05:37:35.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 1569799928) 0x7fd76c004270 con 0x7fd77c109ee0 2026-02-17T05:37:35.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:35.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:35.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6789/0 conn(0x7fd77c109ee0 legacy=0x7fd77c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd778ff9640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6789/0 conn(0x7fd77c109ee0 legacy=0x7fd77c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.057 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 242, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.058 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.059 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.060 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:35.061 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.062 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.063 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.064 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.065 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.066 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:35.067 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:35.068 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:35.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.118:6812/703720803 conn(0x7fd74c040bf0 legacy=0x7fd74c0610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 10 monclient: shutdown 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 >> v1:10.20.193.106:6790/0 conn(0x7fd77c05d1b0 legacy=0x7fd77c12b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd780dd1640 1 -- 10.20.193.106:0/3254989920 reap_dead start 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 shutdown_connections 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 >> 10.20.193.106:0/3254989920 conn(0x7fd77c0915f0 msgr2=0x7fd77c08c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 shutdown_connections 2026-02-17T05:37:35.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.032+0000 7fd78285b640 1 -- 10.20.193.106:0/3254989920 wait complete. 2026-02-17T05:37:35.070 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:35.070 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:37:35.071 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:37:35.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.134+0000 7fda732af640 10 monclient: get_monmap_and_config 2026-02-17T05:37:35.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.134+0000 7fda732af640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.134+0000 7fda732af640 10 monclient: monmap: 2026-02-17T05:37:35.142 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:35.136115+0000 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:35.136115+0000 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 1 Processor -- start 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 1 -- start start 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient: init 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:35.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient(hunting): picked mon.noname-b con 0x7fda6c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient(hunting): picked mon.noname-c con 0x7fda6c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient(hunting): picked mon.noname-a con 0x7fda6c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c08b060 con 0x7fda6c182720 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c05dc90 con 0x7fda6c05dee0 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c08d6a0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 10 monclient(hunting): authenticate will time out at 1183.764499s 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda71024640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fda6c05d1b0 0x7fda6c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60416/0 (socket says 10.20.193.106:60416) 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda71024640 1 -- 10.20.193.106:0/831167324 learned_addr learned my addr 10.20.193.106:0/831167324 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda71825640 1 --1- 10.20.193.106:0/831167324 >> v1:10.20.193.106:6789/0 conn(0x7fda6c182720 0x7fda6c1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55574/0 (socket says 10.20.193.106:55574) 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44170291 0 0) 0x7fda6c08b060 con 0x7fda6c182720 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): my global_id is 104106 2026-02-17T05:37:35.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda540035e0 con 0x7fda6c182720 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780979872 0 0) 0x7fda6c08d6a0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient(hunting): my global_id is 4922 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c08b060 con 0x7fda6c05d1b0 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1137524027 0 0) 0x7fda540035e0 con 0x7fda6c182720 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 >> v1:10.20.193.106:6790/0 conn(0x7fda6c05d1b0 legacy=0x7fda6c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 >> v1:10.20.193.118:6789/0 conn(0x7fda6c05dee0 legacy=0x7fda6c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 monclient: found mon.noname-a 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c057960 con 0x7fda6c182720 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 5 monclient: authenticate success, global_id 104106 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda68003eb0 con 0x7fda6c182720 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda732af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.135+0000 7fda5bfff640 10 monclient: dump: 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda68004170 con 0x7fda6c182720 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 1 -- 10.20.193.106:0/831167324 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda68004580 con 0x7fda6c182720 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 4 set_mon_vals no callback set 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda5bfff640 10 monclient: dump: 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.147 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 10 monclient: shutdown 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- 10.20.193.106:0/831167324 >> v1:10.20.193.106:6789/0 conn(0x7fda6c182720 legacy=0x7fda6c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- 10.20.193.106:0/831167324 shutdown_connections 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- 10.20.193.106:0/831167324 >> 10.20.193.106:0/831167324 conn(0x7fda6c0915f0 msgr2=0x7fda6c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- 10.20.193.106:0/831167324 shutdown_connections 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- 10.20.193.106:0/831167324 wait complete. 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 10 monclient: monmap: 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:35.148 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 Processor -- start 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 1 -- start start 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.136+0000 7fda732af640 10 monclient: init 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient(hunting): picked mon.noname-a con 0x7fda6c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient(hunting): picked mon.noname-b con 0x7fda6c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient(hunting): picked mon.noname-c con 0x7fda6c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c12c2d0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.149 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c13d8b0 con 0x7fda6c05dee0 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c05ce90 con 0x7fda6c182720 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient(hunting): authenticate will time out at 1183.766212s 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda71024640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fda6c05d1b0 0x7fda6c1a3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55584/0 (socket says 10.20.193.106:55584) 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda71024640 1 -- 10.20.193.106:0/2443391716 learned_addr learned my addr 10.20.193.106:0/2443391716 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda71825640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fda6c182720 0x7fda6c12e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60430/0 (socket says 10.20.193.106:60430) 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643596339 0 0) 0x7fda6c05ce90 con 0x7fda6c182720 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): my global_id is 4925 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda3c0035e0 con 0x7fda6c182720 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199216310 0 0) 0x7fda6c12c2d0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.150 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): my global_id is 104109 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c05ce90 con 0x7fda6c05d1b0 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2485679116 0 0) 0x7fda6c05ce90 con 0x7fda6c05d1b0 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda6c12c2d0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3213331221 0 0) 0x7fda3c0035e0 con 0x7fda6c182720 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda6c05ce90 con 0x7fda6c182720 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda5c003090 con 0x7fda6c05d1b0 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.151 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda68004490 con 0x7fda6c182720 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.152 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909566903 0 0) 0x7fda6c13d8b0 con 0x7fda6c05dee0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient(hunting): my global_id is 94189 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda3c0035e0 con 0x7fda6c05dee0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3059334452 0 0) 0x7fda6c12c2d0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6790/0 conn(0x7fda6c182720 legacy=0x7fda6c12e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.118:6789/0 conn(0x7fda6c05dee0 legacy=0x7fda6c180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 monclient: found mon.a 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c05e8e0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.153 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 5 monclient: authenticate success, global_id 104109 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _renew_subs 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c129f70 con 0x7fda6c05d1b0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _renew_subs 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda6c12bff0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda5c0048a0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda5c004cb0 con 0x7fda6c05d1b0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda59ffb640 10 monclient: dump: 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.154 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.137+0000 7fda5b7fe640 4 set_mon_vals no callback set 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda732af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda6c12bdf0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fda5c004e10 con 0x7fda6c05d1b0 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736376309 0 0) 0x7fda6c12bdf0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient(hunting): my global_id is 4928 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c12c2d0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(497..497 src has 264..497) ==== 3979+0+0 (unknown 731368666 0 0) 0x7fda5c04fe20 con 0x7fda6c05d1b0 2026-02-17T05:37:35.155 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda71825640 10 monclient: get_auth_request con 0x7fda3c040d50 auth_method 0 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2328728159 0 0) 0x7fda6c12c2d0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda6c12bdf0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda60002e80 con 0x7fda6c1a3d10 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 10 monclient: dump: 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.156 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3943494058 0 0) 0x7fda6c12bdf0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.138+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda6c057cd0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.139+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fda600051a0 con 0x7fda6c1a3d10 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.139+0000 7fda59ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.139+0000 7fda59ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.139+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6790/0 conn(0x7fda6c1a3d10 legacy=0x7fda6c089600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.157 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.139+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6790/0 conn(0x7fda6c1a3d10 legacy=0x7fda6c089600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:35.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda6c129890 con 0x7fda6c1294c0 2026-02-17T05:37:35.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336206865 0 0) 0x7fda6c129890 con 0x7fda6c1294c0 2026-02-17T05:37:35.158 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient(hunting): my global_id is 4931 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c12bdf0 con 0x7fda6c1294c0 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2580237842 0 0) 0x7fda6c12bdf0 con 0x7fda6c1294c0 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda6c129890 con 0x7fda6c1294c0 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda60003860 con 0x7fda6c1294c0 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient: dump: 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.159 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 380622154 0 0) 0x7fda6c129890 con 0x7fda6c1294c0 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda6c12aad0 con 0x7fda6c1294c0 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 3832227563) 0x7fda60004dc0 con 0x7fda6c1294c0 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6790/0 conn(0x7fda6c1294c0 legacy=0x7fda6c089d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda59ffb640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6790/0 conn(0x7fda6c1294c0 legacy=0x7fda6c089d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:35.160 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 579904, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.161 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.162 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:35.163 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.164 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:35.165 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.166 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:35.167 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.168 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:35.169 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:35.170 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.118:6812/703720803 conn(0x7fda3c040d50 legacy=0x7fda3c061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 10 monclient: shutdown 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 >> v1:10.20.193.106:6789/0 conn(0x7fda6c05d1b0 legacy=0x7fda6c1a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda71825640 1 -- 10.20.193.106:0/2443391716 reap_dead start 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda71825640 1 -- 10.20.193.106:0/2443391716 reap_dead start 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 shutdown_connections 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 >> 10.20.193.106:0/2443391716 conn(0x7fda6c0915f0 msgr2=0x7fda6c05c410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.142+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 shutdown_connections 2026-02-17T05:37:35.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.143+0000 7fda732af640 1 -- 10.20.193.106:0/2443391716 wait complete. 2026-02-17T05:37:35.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:35.173 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:37:35.173 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.236+0000 7ffb93cc3640 10 monclient: get_monmap_and_config 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.236+0000 7ffb93cc3640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.236+0000 7ffb93cc3640 10 monclient: monmap: 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:35.238282+0000 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:35.238282+0000 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:35.239 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:35.240 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 1 Processor -- start 2026-02-17T05:37:35.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 1 -- start start 2026-02-17T05:37:35.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient: init 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-a con 0x7ffb8c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-b con 0x7ffb8c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-c con 0x7ffb8c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08b060 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c05dc90 con 0x7ffb8c182720 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08d6a0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb93cc3640 10 monclient(hunting): authenticate will time out at 1183.866657s 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb91a38640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ffb8c05d1b0 0x7ffb8c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55596/0 (socket says 10.20.193.106:55596) 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb91a38640 1 -- 10.20.193.106:0/2310589596 learned_addr learned my addr 10.20.193.106:0/2310589596 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb91237640 1 --1- 10.20.193.106:0/2310589596 >> v1:10.20.193.106:6790/0 conn(0x7ffb8c05dee0 0x7ffb8c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60466/0 (socket says 10.20.193.106:60466) 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362776572 0 0) 0x7ffb8c08b060 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): my global_id is 104112 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb740035e0 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208421488 0 0) 0x7ffb8c08d6a0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 10 monclient(hunting): my global_id is 4934 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.237+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c08b060 con 0x7ffb8c05dee0 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230686225 0 0) 0x7ffb8c05dc90 con 0x7ffb8c182720 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient(hunting): my global_id is 94192 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c08d6a0 con 0x7ffb8c182720 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2663421057 0 0) 0x7ffb740035e0 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 >> v1:10.20.193.106:6790/0 conn(0x7ffb8c05dee0 legacy=0x7ffb8c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c182720 legacy=0x7ffb8c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 monclient: found mon.noname-a 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c057960 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb7c002dd0 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: dump: 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 5 monclient: authenticate success, global_id 104112 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb7c002fa0 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 1 -- 10.20.193.106:0/2310589596 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb7c003370 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb90a36640 10 monclient: dump: 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 4 set_mon_vals no callback set 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 10 monclient: shutdown 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 1 -- 10.20.193.106:0/2310589596 >> v1:10.20.193.106:6789/0 conn(0x7ffb8c05d1b0 legacy=0x7ffb8c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 1 -- 10.20.193.106:0/2310589596 shutdown_connections 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 1 -- 10.20.193.106:0/2310589596 >> 10.20.193.106:0/2310589596 conn(0x7ffb8c0915f0 msgr2=0x7ffb8c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 1 -- 10.20.193.106:0/2310589596 shutdown_connections 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 1 -- 10.20.193.106:0/2310589596 wait complete. 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.238+0000 7ffb93cc3640 10 monclient: monmap: 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 1 Processor -- start 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 1 -- start start 2026-02-17T05:37:35.251 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient: init 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-b con 0x7ffb8c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-c con 0x7ffb8c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient(hunting): picked mon.noname-a con 0x7ffb8c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c05e950 con 0x7ffb8c182720 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c10ef30 con 0x7ffb8c05d1b0 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c12e450 con 0x7ffb8c05dee0 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb93cc3640 10 monclient(hunting): authenticate will time out at 1183.868484s 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb92239640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ffb8c182720 0x7ffb8c181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55602/0 (socket says 10.20.193.106:55602) 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb92239640 1 -- 10.20.193.106:0/3462687955 learned_addr learned my addr 10.20.193.106:0/3462687955 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb91237640 1 --1- 10.20.193.106:0/3462687955 >> v1:10.20.193.106:6790/0 conn(0x7ffb8c05dee0 0x7ffb8c12dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60476/0 (socket says 10.20.193.106:60476) 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355615281 0 0) 0x7ffb8c08d6a0 con 0x7ffb8c182720 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): my global_id is 104115 2026-02-17T05:37:35.252 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb5c0035e0 con 0x7ffb8c182720 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040117268 0 0) 0x7ffb8c12e450 con 0x7ffb8c05dee0 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): my global_id is 4937 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c08d6a0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1088467759 0 0) 0x7ffb5c0035e0 con 0x7ffb8c182720 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb8c12e450 con 0x7ffb8c182720 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb880041b0 con 0x7ffb8c182720 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): dump: 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.253 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 313038881 0 0) 0x7ffb8c08d6a0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb5c0035e0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb800030f0 con 0x7ffb8c05dee0 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient(hunting): dump: 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.254 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1576037962 0 0) 0x7ffb8c12e450 con 0x7ffb8c182720 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.106:6790/0 conn(0x7ffb8c05dee0 legacy=0x7ffb8c12dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c05d1b0 legacy=0x7ffb8c12d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 1 monclient: found mon.a 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.239+0000 7ffb7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c10e0c0 con 0x7ffb8c182720 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 5 monclient: authenticate success, global_id 104115 2026-02-17T05:37:35.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 10 monclient: _renew_subs 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c10cbd0 con 0x7ffb8c182720 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 10 monclient: _renew_subs 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb8c10c4c0 con 0x7ffb8c182720 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb88004520 con 0x7ffb8c182720 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb88004c10 con 0x7ffb8c182720 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7bfff640 4 set_mon_vals no callback set 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 10 monclient: dump: 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.256 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb8c10eb00 con 0x7ffb8c10d730 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ffb88004d70 con 0x7ffb8c182720 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(497..497 src has 264..497) ==== 3979+0+0 (unknown 731368666 0 0) 0x7ffb88050d20 con 0x7ffb8c182720 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.240+0000 7ffb91237640 10 monclient: get_auth_request con 0x7ffb5c040b10 auth_method 0 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122777111 0 0) 0x7ffb8c10eb00 con 0x7ffb8c10d730 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient(hunting): my global_id is 94198 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c12e450 con 0x7ffb8c10d730 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1359900952 0 0) 0x7ffb8c12e450 con 0x7ffb8c10d730 2026-02-17T05:37:35.257 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb8c10eb00 con 0x7ffb8c10d730 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb7c002b40 con 0x7ffb8c10d730 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient: dump: 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1076904969 0 0) 0x7ffb8c10eb00 con 0x7ffb8c10d730 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb8c057ca0 con 0x7ffb8c10d730 2026-02-17T05:37:35.258 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffb7c0048a0 con 0x7ffb8c10d730 2026-02-17T05:37:35.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:35.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c10d730 legacy=0x7ffb8c1076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.241+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c10d730 legacy=0x7ffb8c1076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.244+0000 7ffb93cc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.244+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb8c05e950 con 0x7ffb8c12a550 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281001089 0 0) 0x7ffb8c10ef30 con 0x7ffb8c12a550 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient(hunting): my global_id is 94201 2026-02-17T05:37:35.260 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c10eb00 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2103429228 0 0) 0x7ffb8c10eb00 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb8c10ef30 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ffb7c004db0 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 10 monclient: dump: 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2432638737 0 0) 0x7ffb8c10ef30 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.245+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffb8c10db00 con 0x7ffb8c12a550 2026-02-17T05:37:35.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2896267064) 0x7ffb7c0061b0 con 0x7ffb8c12a550 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb7a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb7a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c12a550 legacy=0x7ffb8c107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb7a7fc640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6789/0 conn(0x7ffb8c12a550 legacy=0x7ffb8c107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 107489, 2026-02-17T05:37:35.262 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.263 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.264 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:35.265 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:35.266 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.267 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.268 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:35.269 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:35.270 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:35.271 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:35.272 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:35.272 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:35.272 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:35.272 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.118:6812/703720803 conn(0x7ffb5c040b10 legacy=0x7ffb5c060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 10 monclient: shutdown 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 >> v1:10.20.193.106:6789/0 conn(0x7ffb8c182720 legacy=0x7ffb8c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb92239640 1 -- 10.20.193.106:0/3462687955 reap_dead start 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb92239640 1 -- 10.20.193.106:0/3462687955 reap_dead start 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 shutdown_connections 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 >> 10.20.193.106:0/3462687955 conn(0x7ffb8c0915f0 msgr2=0x7ffb8c0889b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 shutdown_connections 2026-02-17T05:37:35.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.246+0000 7ffb93cc3640 1 -- 10.20.193.106:0/3462687955 wait complete. 2026-02-17T05:37:35.274 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:35.274 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:37:35.274 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:37:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2270: done (3 left) 2026-02-17T05:37:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2271: read oid 37 snap -1 2026-02-17T05:37:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2271: expect deleted 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2272: read oid 40 snap 242 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2272: expect (ObjNum 797 snap 241 seq_num 797) 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2273: copy_from oid 42 from oid 29 current snap is 243 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2267: finishing rollback tid 0 to trial11845692-17 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2267: finishing rollback tid 1 to trial11845692-17 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2267: finishing rollback tid 2 to trial11845692-17 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1016 (ObjNum 770 snap 227 seq_num 770) dirty exists 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: finishing write tid 1 to trial11845692-8 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: finishing write tid 2 to trial11845692-8 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2267: done (5 left) 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2274: snap_create 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: finishing write tid 3 to trial11845692-8 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: finishing write tid 4 to trial11845692-8 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: finishing write tid 5 to trial11845692-8 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: oid 8 updating version 0 to 1349 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: oid 8 updating version 1349 to 1350 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: oid 8 version 1350 is already newer than 1347 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: oid 8 version 1350 is already newer than 1348 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1350 (ObjNum 803 snap 243 seq_num 803) dirty exists 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2268: left oid 8 (ObjNum 803 snap 243 seq_num 803) 2026-02-17T05:37:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2269: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:35.328 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 893557 2026-02-17T05:37:35.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: get_monmap_and_config 2026-02-17T05:37:35.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.353 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: monmap: 2026-02-17T05:37:35.353 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.353 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:35.343416+0000 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:35.343416+0000 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 1 Processor -- start 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 1 -- start start 2026-02-17T05:37:35.354 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: init 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fad2005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fad2005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fad20182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2008b060 con 0x7fad2005d1b0 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2005dc90 con 0x7fad2005dee0 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2008d6a0 con 0x7fad20182720 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad24ecc640 10 monclient(hunting): authenticate will time out at 1183.971792s 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad1e575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fad2005d1b0 0x7fad2005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55608/0 (socket says 10.20.193.106:55608) 2026-02-17T05:37:35.355 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.342+0000 7fad1e575640 1 -- 10.20.193.106:0/3812103041 learned_addr learned my addr 10.20.193.106:0/3812103041 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586496415 0 0) 0x7fad2008b060 con 0x7fad2005d1b0 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): my global_id is 104118 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad0c0035e0 con 0x7fad2005d1b0 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562832201 0 0) 0x7fad2008d6a0 con 0x7fad20182720 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient(hunting): my global_id is 4940 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2008b060 con 0x7fad20182720 2026-02-17T05:37:35.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2279433531 0 0) 0x7fad0c0035e0 con 0x7fad2005d1b0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 >> v1:10.20.193.106:6790/0 conn(0x7fad20182720 legacy=0x7fad201a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 >> v1:10.20.193.118:6789/0 conn(0x7fad2005dee0 legacy=0x7fad20181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 monclient: found mon.noname-a 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad20057960 con 0x7fad2005d1b0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fad14002dd0 con 0x7fad2005d1b0 2026-02-17T05:37:35.357 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: dump: 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 5 monclient: authenticate success, global_id 104118 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad14002fd0 con 0x7fad2005d1b0 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 1 -- 10.20.193.106:0/3812103041 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fad140033e0 con 0x7fad2005d1b0 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad1d573640 10 monclient: dump: 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.359 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 4 set_mon_vals no callback set 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 10 monclient: shutdown 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 1 -- 10.20.193.106:0/3812103041 >> v1:10.20.193.106:6789/0 conn(0x7fad2005d1b0 legacy=0x7fad2005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 1 -- 10.20.193.106:0/3812103041 shutdown_connections 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 1 -- 10.20.193.106:0/3812103041 >> 10.20.193.106:0/3812103041 conn(0x7fad200915f0 msgr2=0x7fad200919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 1 -- 10.20.193.106:0/3812103041 shutdown_connections 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.343+0000 7fad24ecc640 1 -- 10.20.193.106:0/3812103041 wait complete. 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient: build_initial_monmap 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient: monmap: 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:35.361 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 1 Processor -- start 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 1 -- start start 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient: init 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-c con 0x7fad2005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-a con 0x7fad2005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient(hunting): picked mon.noname-b con 0x7fad20182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2013f700 con 0x7fad2005dee0 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2005e8e0 con 0x7fad20182720 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2008a040 con 0x7fad2005d1b0 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad24ecc640 10 monclient(hunting): authenticate will time out at 1183.973654s 2026-02-17T05:37:35.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad1e575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fad2005d1b0 0x7fad2012a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60502/0 (socket says 10.20.193.106:60502) 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad1e575640 1 -- 10.20.193.106:0/2182766142 learned_addr learned my addr 10.20.193.106:0/2182766142 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4190000043 0 0) 0x7fad2013f700 con 0x7fad2005dee0 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): my global_id is 104121 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facec0035e0 con 0x7fad2005dee0 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075825412 0 0) 0x7fad2008a040 con 0x7fad2005d1b0 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 10 monclient(hunting): my global_id is 4943 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.344+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2013f700 con 0x7fad2005d1b0 2026-02-17T05:37:35.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2673647328 0 0) 0x7facec0035e0 con 0x7fad2005dee0 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad2008a040 con 0x7fad2005dee0 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fad08002fa0 con 0x7fad2005dee0 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): dump: 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.364 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 804264596 0 0) 0x7fad2013f700 con 0x7fad2005d1b0 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facec0035e0 con 0x7fad2005d1b0 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fad140032f0 con 0x7fad2005d1b0 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): dump: 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.365 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 532307771 0 0) 0x7fad2008a040 con 0x7fad2005dee0 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6790/0 conn(0x7fad2005d1b0 legacy=0x7fad2012a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.118:6789/0 conn(0x7fad20182720 legacy=0x7fad20181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 monclient: found mon.a 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad201824f0 con 0x7fad2005dee0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 5 monclient: authenticate success, global_id 104121 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 monclient: _renew_subs 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad2010eea0 con 0x7fad2005dee0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 monclient: _renew_subs 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad2010d380 con 0x7fad2005dee0 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad1dd74640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7fad2005dee0 legacy=0x7fad2012a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-17T05:37:35.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad1dd74640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7fad2005dee0 legacy=0x7fad2012a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad1dd74640 1 --1- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7fad2005dee0 0x7fad2012a730 :-1 s=OPENED pgs=223 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad1dd74640 1 --1- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7fad2005dee0 0x7fad2012a730 :-1 s=OPENED pgs=223 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: ms_handle_reset current mon v1:10.20.193.106:6789/0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7fad2005dee0 legacy=0x7fad2012a730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): picked mon.c con 0x7fad2005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): picked mon.b con 0x7fad20182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): picked mon.a con 0x7facec0481e0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad2008a040 con 0x7facec0481e0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7facec0035e0 con 0x7fad20182720 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad2013f700 con 0x7fad2005d1b0 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:35.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304221624 0 0) 0x7fad2008a040 con 0x7facec0481e0 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7facec06c2e0 con 0x7facec0481e0 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518932413 0 0) 0x7fad2013f700 con 0x7fad2005d1b0 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fad2008a040 con 0x7fad2005d1b0 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad24ecc640 10 monclient(hunting): _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1474075300 0 0) 0x7facec06c2e0 con 0x7facec0481e0 2026-02-17T05:37:35.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6790/0 conn(0x7fad2005d1b0 legacy=0x7facec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.118:6789/0 conn(0x7fad20182720 legacy=0x7facec046a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 monclient: found mon.a 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7facec06d530 con 0x7facec0481e0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2010d760 con 0x7facec0481e0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec0035e0 con 0x7facec0481e0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _finish_auth 0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fad10003f50 con 0x7facec0481e0 2026-02-17T05:37:35.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.345+0000 7fad06ffd640 10 monclient: dump: 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad100040b0 con 0x7facec0481e0 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad1cd72640 4 set_mon_vals no callback set 2026-02-17T05:37:35.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fad100042e0 con 0x7facec0481e0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 6 ==== osd_map(498..498 src has 264..498) ==== 4007+0+0 (unknown 775773503 0 0) 0x7fad1004f250 con 0x7facec0481e0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.346+0000 7fad1e575640 10 monclient: get_auth_request con 0x7fad2005dee0 auth_method 0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.348+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fad100168f0 con 0x7facec0481e0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.348+0000 7fad06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.348+0000 7fad06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.349+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fad1004c090 con 0x7facec0481e0 2026-02-17T05:37:35.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.349+0000 7fad06ffd640 10 monclient: handle_mon_command_ack 1 not found 2026-02-17T05:37:35.372 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:35.432 INFO:tasks.rados.rados.0.trial118.stdout:2272: expect (ObjNum 797 snap 241 seq_num 797) 2026-02-17T05:37:35.458 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:35.494 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:35.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.494+0000 7fad24ecc640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:37:35.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.494+0000 7fad24ecc640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:37:35.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.494+0000 7fad24ecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:35.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.494+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fad20055570 con 0x7facec0481e0 2026-02-17T05:37:35.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.495+0000 7fad06ffd640 1 -- 10.20.193.106:0/2182766142 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fad100160a0 con 0x7facec0481e0 2026-02-17T05:37:35.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.495+0000 7fad06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:37:35.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.495+0000 7fad06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=2817688687,config=1618278320,health=235515132,kv=3912199512,logm=2821897631}) 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=10,logm=57} crc {auth=407675738,config=1618278320,health=1281897235,kv=2318243043,logm=1346813493}) 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=2817688687,config=1618278320,health=235515132,kv=3912199512,logm=2821897631}) 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.495+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=10,kv=11,logm=60} crc {auth=1259101007,config=1618278320,health=362896067,kv=675723720,logm=3622122688}) 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1188585079}) 2026-02-17T05:37:35.499 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2475373451}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1188585079}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51048021}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=850159748}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046124346}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=850159748}) 2026-02-17T05:37:35.500 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.496+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=79780683}) 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.118:6812/703720803 conn(0x7fad2005dee0 legacy=0x7facec0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 10 monclient: shutdown 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 >> v1:10.20.193.106:6789/0 conn(0x7facec0481e0 legacy=0x7facec068620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 shutdown_connections 2026-02-17T05:37:35.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 >> 10.20.193.106:0/2182766142 conn(0x7fad200915f0 msgr2=0x7fad2008c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:35.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 shutdown_connections 2026-02-17T05:37:35.502 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:35.496+0000 7fad24ecc640 1 -- 10.20.193.106:0/2182766142 wait complete. 2026-02-17T05:37:35.507 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4127007525}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3222594574}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4127007525}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1819564293}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=33577282}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359544506}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=33577282}) 2026-02-17T05:37:35.508 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.497+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=246076380}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=527196313}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=214448238}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=527196313}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1330956939}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2653665052}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370958976}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2653665052}) 2026-02-17T05:37:35.509 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.498+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2983055523}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1306100596}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3045389992}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1306100596}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3068909848}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3497028999}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3508277198}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3497028999}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1820328707}) 2026-02-17T05:37:35.510 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2883567316}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2424633616}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.499+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2883567316}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3734347172}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2374964987}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518403577}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2374964987}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4144750657}) 2026-02-17T05:37:35.511 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=224394502}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2626066609}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=224394502}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.500+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1433267972}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3484540760}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4231881545}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3484540760}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1376967684}) 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.512 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=269342372}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3760862107}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=269342372}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.501+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3512230948}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=842383114}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2679315233}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=842383114}) 2026-02-17T05:37:35.513 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2508929711}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1142460010}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2995531272}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1142460010}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.502+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3634079757}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1621341722}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2656734680}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1621341722}) 2026-02-17T05:37:35.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=139731407}) 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1208112}) 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1644720299}) 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1208112}) 2026-02-17T05:37:35.515 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.503+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=969746298}) 2026-02-17T05:37:35.516 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:37:35.519 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.519 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=166799544}) 2026-02-17T05:37:35.519 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374121904}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=166799544}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=463217891}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=1656157301,mdsmap=568353036,mgr=1670673817}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=541308070,mdsmap=568353036,mgr=5227952}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=1656157301,mdsmap=568353036,mgr=1670673817}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.504+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=1183179250,mdsmap=568353036,mgr=1739161107}) 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.520 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=64,osdmap=2} crc {mgr=3140514009,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=128385286,mon_config_key=3278655557,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_snap=510873216,osdmap=575780418}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=3,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=64,osdmap=1} crc {mgr=543305786,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2559691349,mon_config_key=3663172034,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=136691628,osd_snap=1864055677,osdmap=2983616568}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=64,osdmap=2} crc {mgr=3140514009,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=128385286,mon_config_key=3278655557,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_snap=510873216,osdmap=575780418}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=3,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=61,osdmap=3} crc {mgr=543305786,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=128385286,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=136691628,osd_snap=2486999909,osdmap=1546543503}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=849163006}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3860428037}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=849163006}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.505+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3873620441}) 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.521 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3780490593}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1739860760}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3780490593}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.506+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=396588229}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3317822741}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=307247289}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3317822741}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.507+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2408509660}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=50} crc {osdmap=2498141070}) 2026-02-17T05:37:35.522 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=50} crc {osdmap=1251941915}) 2026-02-17T05:37:35.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:37:35.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=50} crc {osdmap=2498141070}) 2026-02-17T05:37:35.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:37:35.509+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=48} crc {osdmap=4014731952}) 2026-02-17T05:37:35.530 INFO:tasks.rados.rados.0.trial118.stdout:2273: finishing copy_from racing read to trial11845692-42 2026-02-17T05:37:35.530 INFO:tasks.rados.rados.0.trial118.stdout:2273: finishing copy_from to trial11845692-42 2026-02-17T05:37:35.530 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 730 (ObjNum 668 snap 195 seq_num 668) dirty exists 2026-02-17T05:37:36.327 INFO:tasks.rados.rados.0.trial118.stdout:2268: done (5 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2269: done (4 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2271: done (3 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2272: done (2 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2273: done (1 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2274: done (0 left) 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2275: write (excl) oid 26 current snap is 244 2026-02-17T05:37:36.328 INFO:tasks.rados.rados.0.trial118.stdout:2275: seq_num 804 ranges {712828=717261,1915052=718936,3212792=300036} 2026-02-17T05:37:36.333 INFO:tasks.rados.rados.0.trial118.stdout:2275: writing trial11845692-26 from 712828 to 1430089 tid 1 2026-02-17T05:37:36.337 INFO:tasks.rados.rados.0.trial118.stdout:2275: writing trial11845692-26 from 1915052 to 2633988 tid 2 2026-02-17T05:37:36.341 INFO:tasks.rados.rados.0.trial118.stdout:2275: writing trial11845692-26 from 3212792 to 3512828 tid 3 2026-02-17T05:37:36.341 INFO:tasks.rados.rados.0.trial118.stdout:2276: write oid 41 current snap is 244 2026-02-17T05:37:36.342 INFO:tasks.rados.rados.0.trial118.stdout:2276: seq_num 805 ranges {729635=792510,1973534=578947,3240215=289420} 2026-02-17T05:37:36.347 INFO:tasks.rados.rados.0.trial118.stdout:2276: writing trial11845692-41 from 729635 to 1522145 tid 1 2026-02-17T05:37:36.351 INFO:tasks.rados.rados.0.trial118.stdout:2276: writing trial11845692-41 from 1973534 to 2552481 tid 2 2026-02-17T05:37:36.355 INFO:tasks.rados.rados.0.trial118.stdout:2276: writing trial11845692-41 from 3240215 to 3529635 tid 3 2026-02-17T05:37:36.356 INFO:tasks.rados.rados.0.trial118.stdout:2277: read oid 10 snap 241 2026-02-17T05:37:36.356 INFO:tasks.rados.rados.0.trial118.stdout:2277: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:36.356 INFO:tasks.rados.rados.0.trial118.stdout:2278: write oid 9 current snap is 244 2026-02-17T05:37:36.356 INFO:tasks.rados.rados.0.trial118.stdout:2278: seq_num 806 ranges {746442=584112,1748369=722605,2983991=562451} 2026-02-17T05:37:36.360 INFO:tasks.rados.rados.0.trial118.stdout:2278: writing trial11845692-9 from 746442 to 1330554 tid 1 2026-02-17T05:37:36.365 INFO:tasks.rados.rados.0.trial118.stdout:2278: writing trial11845692-9 from 1748369 to 2470974 tid 2 2026-02-17T05:37:36.370 INFO:tasks.rados.rados.0.trial118.stdout:2278: writing trial11845692-9 from 2983991 to 3546442 tid 3 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2279: rollback oid 20 current snap is 244 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 204 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: finishing write tid 1 to trial11845692-26 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: finishing write tid 2 to trial11845692-26 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: finishing write tid 3 to trial11845692-26 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2280: delete oid 22 current snap is 244 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: finishing write tid 4 to trial11845692-26 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: finishing write tid 5 to trial11845692-26 2026-02-17T05:37:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2275: oid 26 updating version 0 to 1265 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2275: oid 26 version 1265 is already newer than 1263 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2275: oid 26 updating version 1265 to 1266 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2275: oid 26 version 1266 is already newer than 1264 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1266 (ObjNum 804 snap 244 seq_num 804) dirty exists 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2275: left oid 26 (ObjNum 804 snap 244 seq_num 804) 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: finishing write tid 1 to trial11845692-41 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: finishing write tid 2 to trial11845692-41 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: finishing write tid 3 to trial11845692-41 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: finishing write tid 4 to trial11845692-41 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: finishing write tid 5 to trial11845692-41 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: oid 41 updating version 0 to 1259 2026-02-17T05:37:36.372 INFO:tasks.rados.rados.0.trial118.stdout:2276: oid 41 version 1259 is already newer than 1258 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:2276: oid 41 updating version 1259 to 1260 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:2276: oid 41 version 1260 is already newer than 1257 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1260 (ObjNum 805 snap 244 seq_num 805) dirty exists 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:2276: left oid 41 (ObjNum 805 snap 244 seq_num 805) 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:2277: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:36.373 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:36.409 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:36.483 INFO:tasks.rados.rados.0.trial118.stdout:2278: finishing write tid 1 to trial11845692-9 2026-02-17T05:37:36.483 INFO:tasks.rados.rados.0.trial118.stdout:2278: finishing write tid 2 to trial11845692-9 2026-02-17T05:37:36.483 INFO:tasks.rados.rados.0.trial118.stdout:2279: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:37:36.483 INFO:tasks.rados.rados.0.trial118.stdout:2279: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1359 (ObjNum 145 snap 0 seq_num 12587328) dirty dne 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2278: finishing write tid 3 to trial11845692-9 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2278: finishing write tid 4 to trial11845692-9 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2275: done (5 left) 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2276: done (4 left) 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2277: done (3 left) 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2279: done (2 left) 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2280: done (1 left) 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2281: read oid 25 snap 229 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2281: expect deleted 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2282: copy_from oid 7 from oid 5 current snap is 244 2026-02-17T05:37:36.484 INFO:tasks.rados.rados.0.trial118.stdout:2278: finishing write tid 5 to trial11845692-9 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: oid 9 updating version 0 to 1261 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: oid 9 updating version 1261 to 1263 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: oid 9 updating version 1263 to 1264 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: oid 9 version 1264 is already newer than 1262 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1264 (ObjNum 806 snap 244 seq_num 806) dirty exists 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: left oid 9 (ObjNum 806 snap 244 seq_num 806) 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2278: done (2 left) 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2283: write oid 46 current snap is 244 2026-02-17T05:37:36.485 INFO:tasks.rados.rados.0.trial118.stdout:2283: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2026-02-17T05:37:36.488 INFO:tasks.rados.rados.0.trial118.stdout:2283: writing trial11845692-46 from 780056 to 1514666 tid 1 2026-02-17T05:37:36.493 INFO:tasks.rados.rados.0.trial118.stdout:2283: writing trial11845692-46 from 2148980 to 2875254 tid 2 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2283: writing trial11845692-46 from 3322484 to 3580056 tid 3 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2284: rollback oid 3 current snap is 244 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 242 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2283: finishing write tid 1 to trial11845692-46 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2283: finishing write tid 2 to trial11845692-46 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2281: done (3 left) 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2285: read oid 37 snap 236 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2285: expect deleted 2026-02-17T05:37:36.497 INFO:tasks.rados.rados.0.trial118.stdout:2286: read oid 17 snap -1 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:2286: expect (ObjNum 770 snap 227 seq_num 770) 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:2287: delete oid 20 current snap is 244 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:2282: finishing copy_from racing read to trial11845692-7 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:2282: finishing copy_from to trial11845692-7 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1095 (ObjNum 793 snap 239 seq_num 793) dirty exists 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:2284: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:37:36.498 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1089 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:37:36.499 INFO:tasks.rados.rados.0.trial118.stdout:2282: done (5 left) 2026-02-17T05:37:36.499 INFO:tasks.rados.rados.0.trial118.stdout:2284: done (4 left) 2026-02-17T05:37:36.499 INFO:tasks.rados.rados.0.trial118.stdout:2285: done (3 left) 2026-02-17T05:37:36.499 INFO:tasks.rados.rados.0.trial118.stdout:2287: done (2 left) 2026-02-17T05:37:36.499 INFO:tasks.rados.rados.0.trial118.stdout:2288: read oid 4 snap -1 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2288: expect (ObjNum 796 snap 240 seq_num 796) 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2289: delete oid 30 current snap is 244 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2289: done (3 left) 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2290: rollback oid 42 current snap is 244 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 242 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2291: write oid 16 current snap is 244 2026-02-17T05:37:36.500 INFO:tasks.rados.rados.0.trial118.stdout:2291: seq_num 811 ranges {430477=560357,1408073=473601,2488400=736073} 2026-02-17T05:37:36.503 INFO:tasks.rados.rados.0.trial118.stdout:2291: writing trial11845692-16 from 430477 to 990834 tid 1 2026-02-17T05:37:36.506 INFO:tasks.rados.rados.0.trial118.stdout:2291: writing trial11845692-16 from 1408073 to 1881674 tid 2 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2291: writing trial11845692-16 from 2488400 to 3224473 tid 3 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2292: read oid 11 snap -1 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2292: expect deleted 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2293: read oid 45 snap -1 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2293: expect deleted 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2294: read oid 35 snap -1 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2294: expect (ObjNum 789 snap 232 seq_num 789) 2026-02-17T05:37:36.512 INFO:tasks.rados.rados.0.trial118.stdout:2295: snap_create 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: finishing write tid 3 to trial11845692-46 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: finishing write tid 4 to trial11845692-46 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: finishing write tid 5 to trial11845692-46 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: oid 46 updating version 0 to 1017 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: oid 46 updating version 1017 to 1018 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: oid 46 updating version 1018 to 1019 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: oid 46 updating version 1019 to 1020 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1020 (ObjNum 808 snap 244 seq_num 808) dirty exists 2026-02-17T05:37:36.513 INFO:tasks.rados.rados.0.trial118.stdout:2283: left oid 46 (ObjNum 808 snap 244 seq_num 808) 2026-02-17T05:37:36.514 INFO:tasks.rados.rados.0.trial118.stdout:2288: expect (ObjNum 796 snap 240 seq_num 796) 2026-02-17T05:37:36.517 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:37:36.517 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:37:36.546 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:36.592 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.581+0000 7fe68f9b9640 10 monclient: get_monmap_and_config 2026-02-17T05:37:36.592 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.581+0000 7fe68f9b9640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.592 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.581+0000 7fe68f9b9640 10 monclient: monmap: 2026-02-17T05:37:36.592 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.592 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:36.583299+0000 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:36.583299+0000 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 1 Processor -- start 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 1 -- start start 2026-02-17T05:37:36.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient: init 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-b con 0x7fe68805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-c con 0x7fe68805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-a con 0x7fe688182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68808b060 con 0x7fe688182720 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68805dc90 con 0x7fe68805dee0 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68808d6a0 con 0x7fe68805d1b0 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.594 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68f9b9640 10 monclient(hunting): authenticate will time out at 1185.211667s 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68df2f640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe688182720 0x7fe6881a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55640/0 (socket says 10.20.193.106:55640) 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68d72e640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe68805d1b0 0x7fe68805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60530/0 (socket says 10.20.193.106:60530) 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe68df2f640 1 -- 10.20.193.106:0/307838080 learned_addr learned my addr 10.20.193.106:0/307838080 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822271901 0 0) 0x7fe68808b060 con 0x7fe688182720 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe677fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe677fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe677fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.582+0000 7fe677fff640 10 monclient(hunting): my global_id is 104124 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6700035e0 con 0x7fe688182720 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249408424 0 0) 0x7fe68808d6a0 con 0x7fe68805d1b0 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient(hunting): my global_id is 4946 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe68808b060 con 0x7fe68805d1b0 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029767964 0 0) 0x7fe6700035e0 con 0x7fe688182720 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 >> v1:10.20.193.106:6790/0 conn(0x7fe68805d1b0 legacy=0x7fe68805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 >> v1:10.20.193.118:6789/0 conn(0x7fe68805dee0 legacy=0x7fe688181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 monclient: found mon.noname-a 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.596 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe688057960 con 0x7fe688182720 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe684003eb0 con 0x7fe688182720 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 5 monclient: authenticate success, global_id 104124 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: dump: 2026-02-17T05:37:36.597 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:36.598 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe684004170 con 0x7fe688182720 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 1 -- 10.20.193.106:0/307838080 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe684004580 con 0x7fe688182720 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 4 set_mon_vals no callback set 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe677fff640 10 monclient: dump: 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.599 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 10 monclient: shutdown 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.600 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 1 -- 10.20.193.106:0/307838080 >> v1:10.20.193.106:6789/0 conn(0x7fe688182720 legacy=0x7fe6881a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 1 -- 10.20.193.106:0/307838080 shutdown_connections 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 1 -- 10.20.193.106:0/307838080 >> 10.20.193.106:0/307838080 conn(0x7fe6880915f0 msgr2=0x7fe6880919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 1 -- 10.20.193.106:0/307838080 shutdown_connections 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 1 -- 10.20.193.106:0/307838080 wait complete. 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.583+0000 7fe68f9b9640 10 monclient: monmap: 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:36.601 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 1 Processor -- start 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 1 -- start start 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient: init 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.602 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-b con 0x7fe68805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-a con 0x7fe68805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient(hunting): picked mon.noname-c con 0x7fe688182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68812c2c0 con 0x7fe68805dee0 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68805e8e0 con 0x7fe68805d1b0 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6881287a0 con 0x7fe688182720 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68f9b9640 10 monclient(hunting): authenticate will time out at 1185.213422s 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68df2f640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe688182720 0x7fe688181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60538/0 (socket says 10.20.193.106:60538) 2026-02-17T05:37:36.603 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe68df2f640 1 -- 10.20.193.106:0/94115420 learned_addr learned my addr 10.20.193.106:0/94115420 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521109979 0 0) 0x7fe68812c2c0 con 0x7fe68805dee0 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): my global_id is 104127 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6580035e0 con 0x7fe68805dee0 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302967129 0 0) 0x7fe6881287a0 con 0x7fe688182720 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.604 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): my global_id is 4949 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe68812c2c0 con 0x7fe688182720 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 154718955 0 0) 0x7fe6580035e0 con 0x7fe68805dee0 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6881287a0 con 0x7fe68805dee0 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe67c002fa0 con 0x7fe68805dee0 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.605 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159316571 0 0) 0x7fe68805e8e0 con 0x7fe68805d1b0 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.606 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): my global_id is 94213 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6580035e0 con 0x7fe68805d1b0 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3905161473 0 0) 0x7fe68812c2c0 con 0x7fe688182720 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe68805e8e0 con 0x7fe688182720 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe684004490 con 0x7fe688182720 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.607 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3658708787 0 0) 0x7fe6881287a0 con 0x7fe68805dee0 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 >> v1:10.20.193.106:6790/0 conn(0x7fe688182720 legacy=0x7fe688181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 >> v1:10.20.193.118:6789/0 conn(0x7fe68805d1b0 legacy=0x7fe68812b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 monclient: found mon.a 2026-02-17T05:37:36.608 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.584+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68810bf30 con 0x7fe68805dee0 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 5 monclient: authenticate success, global_id 104127 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _renew_subs 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe68810aa40 con 0x7fe68805dee0 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _renew_subs 2026-02-17T05:37:36.609 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe68810cda0 con 0x7fe68805dee0 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe67c0031b0 con 0x7fe68805dee0 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe67c0035c0 con 0x7fe68805dee0 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe6777fe640 4 set_mon_vals no callback set 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 10 monclient: dump: 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.610 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6880008d0 con 0x7fe68805dee0 2026-02-17T05:37:36.611 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe67c003720 con 0x7fe68805dee0 2026-02-17T05:37:36.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.585+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7fe67c04eb70 con 0x7fe68805dee0 2026-02-17T05:37:36.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.586+0000 7fe68d72e640 10 monclient: get_auth_request con 0x7fe658040dd0 auth_method 0 2026-02-17T05:37:36.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.588+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fe67c0161b0 con 0x7fe68805dee0 2026-02-17T05:37:36.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.588+0000 7fe675ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.588+0000 7fe675ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:36.615 INFO:tasks.rados.rados.0.trial118.stdout:2286: expect (ObjNum 770 snap 227 seq_num 770) 2026-02-17T05:37:36.637 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2397477 2026-02-17T05:37:36.688 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:36.727 INFO:tasks.rados.rados.0.trial118.stdout:2290: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:37:36.727 INFO:tasks.rados.rados.0.trial118.stdout:2290: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2290: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1200 (ObjNum 778 snap 227 seq_num 778) dirty exists 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: finishing write tid 1 to trial11845692-16 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: finishing write tid 2 to trial11845692-16 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: finishing write tid 3 to trial11845692-16 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: finishing write tid 4 to trial11845692-16 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: finishing write tid 5 to trial11845692-16 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: oid 16 updating version 0 to 1267 2026-02-17T05:37:36.728 INFO:tasks.rados.rados.0.trial118.stdout:2291: oid 16 version 1267 is already newer than 1266 2026-02-17T05:37:36.729 INFO:tasks.rados.rados.0.trial118.stdout:2291: oid 16 updating version 1267 to 1268 2026-02-17T05:37:36.729 INFO:tasks.rados.rados.0.trial118.stdout:2291: oid 16 version 1268 is already newer than 1265 2026-02-17T05:37:36.729 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1268 (ObjNum 811 snap 244 seq_num 811) dirty exists 2026-02-17T05:37:36.729 INFO:tasks.rados.rados.0.trial118.stdout:2291: left oid 16 (ObjNum 811 snap 244 seq_num 811) 2026-02-17T05:37:36.729 INFO:tasks.rados.rados.0.trial118.stdout:2294: expect (ObjNum 789 snap 232 seq_num 789) 2026-02-17T05:37:36.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe68f9b9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:37:36.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe68f9b9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:36.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe68f9b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe688057ca0 con 0x7fe68805dee0 2026-02-17T05:37:36.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe675ffb640 1 -- 10.20.193.106:0/94115420 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3906228296) 0x7fe67c015960 con 0x7fe68805dee0 2026-02-17T05:37:36.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe675ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:36.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.731+0000 7fe675ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:36.734 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:37:36.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 >> v1:10.20.193.118:6812/703720803 conn(0x7fe658040dd0 legacy=0x7fe658061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 10 monclient: shutdown 2026-02-17T05:37:36.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 >> v1:10.20.193.106:6789/0 conn(0x7fe68805dee0 legacy=0x7fe68812bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 shutdown_connections 2026-02-17T05:37:36.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 >> 10.20.193.106:0/94115420 conn(0x7fe6880915f0 msgr2=0x7fe68808c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 shutdown_connections 2026-02-17T05:37:36.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.732+0000 7fe68f9b9640 1 -- 10.20.193.106:0/94115420 wait complete. 2026-02-17T05:37:36.742 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:37:36.742 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:37:36.742 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:37:36.742 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:37:36.745 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2653420 2026-02-17T05:37:36.778 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:36.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.807+0000 7f101901b640 10 monclient: get_monmap_and_config 2026-02-17T05:37:36.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.807+0000 7f101901b640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.807+0000 7f101901b640 10 monclient: monmap: 2026-02-17T05:37:36.820 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.820 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:36.809053+0000 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:36.809053+0000 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 1 Processor -- start 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 1 -- start start 2026-02-17T05:37:36.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient: init 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient(hunting): picked mon.noname-b con 0x7f101405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient(hunting): picked mon.noname-a con 0x7f101405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient(hunting): picked mon.noname-c con 0x7f1014182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101408b060 con 0x7f101405dee0 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101405dc90 con 0x7f1014182720 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101408d6a0 con 0x7f101405d1b0 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient(hunting): authenticate will time out at 1185.437440s 2026-02-17T05:37:36.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1012d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f101405d1b0 0x7f101405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60540/0 (socket says 10.20.193.106:60540) 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1012d76640 1 -- 10.20.193.106:0/771885006 learned_addr learned my addr 10.20.193.106:0/771885006 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666401825 0 0) 0x7f101408b060 con 0x7f101405dee0 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): my global_id is 104130 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10000035e0 con 0x7f101405dee0 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545264862 0 0) 0x7f101408d6a0 con 0x7f101405d1b0 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient(hunting): my global_id is 4952 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101408b060 con 0x7f101405d1b0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2362153406 0 0) 0x7f10000035e0 con 0x7f101405dee0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 >> v1:10.20.193.106:6790/0 conn(0x7f101405d1b0 legacy=0x7f101405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 >> v1:10.20.193.118:6789/0 conn(0x7f1014182720 legacy=0x7f10141a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 monclient: found mon.noname-a 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014057960 con 0x7f101405dee0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.824 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ffc002dd0 con 0x7f101405dee0 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 5 monclient: authenticate success, global_id 104130 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: dump: 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.825 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ffc003090 con 0x7f101405dee0 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 1 -- 10.20.193.106:0/771885006 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ffc0034a0 con 0x7f101405dee0 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f101901b640 4 set_mon_vals no callback set 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.808+0000 7f1011d74640 10 monclient: dump: 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 10 monclient: shutdown 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- 10.20.193.106:0/771885006 >> v1:10.20.193.106:6789/0 conn(0x7f101405dee0 legacy=0x7f1014181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- 10.20.193.106:0/771885006 shutdown_connections 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- 10.20.193.106:0/771885006 >> 10.20.193.106:0/771885006 conn(0x7f10140915f0 msgr2=0x7f10140919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- 10.20.193.106:0/771885006 shutdown_connections 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- 10.20.193.106:0/771885006 wait complete. 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 10 monclient: monmap: 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:36.828 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 Processor -- start 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 1 -- start start 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.809+0000 7f101901b640 10 monclient: init 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:36.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient(hunting): picked mon.noname-a con 0x7f101405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient(hunting): picked mon.noname-c con 0x7f101405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient(hunting): picked mon.noname-b con 0x7f1014182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101405e950 con 0x7f101405d1b0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1014128a40 con 0x7f1014182720 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101410c160 con 0x7f101405dee0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient(hunting): authenticate will time out at 1185.439089s 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f1012d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f101405d1b0 0x7f101413cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:55672/0 (socket says 10.20.193.106:55672) 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f1012d76640 1 -- 10.20.193.106:0/1765106374 learned_addr learned my addr 10.20.193.106:0/1765106374 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017350347 0 0) 0x7f101408b060 con 0x7f101405d1b0 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): my global_id is 104133 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe00035e0 con 0x7f101405d1b0 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383059714 0 0) 0x7f101410c160 con 0x7f101405dee0 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): my global_id is 4955 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101408b060 con 0x7f101405dee0 2026-02-17T05:37:36.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1964108273 0 0) 0x7f0fe00035e0 con 0x7f101405d1b0 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101410c160 con 0x7f101405d1b0 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1008003090 con 0x7f101405d1b0 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): dump: 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.832 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4078326702 0 0) 0x7f101408b060 con 0x7f101405dee0 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fe00035e0 con 0x7f101405dee0 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ffc0033b0 con 0x7f101405dee0 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient(hunting): dump: 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.833 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3107809046 0 0) 0x7f101410c160 con 0x7f101405d1b0 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6790/0 conn(0x7f101405dee0 legacy=0x7f101413d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.118:6789/0 conn(0x7f1014182720 legacy=0x7f1014181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 monclient: found mon.a 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101410ac70 con 0x7f101405d1b0 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 5 monclient: authenticate success, global_id 104133 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _renew_subs 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1014182550 con 0x7f101405d1b0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _renew_subs 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1014128610 con 0x7f101405d1b0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10080048a0 con 0x7f101405d1b0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1008004bc0 con 0x7f101405d1b0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f1011573640 4 set_mon_vals no callback set 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f0ff37fe640 10 monclient: dump: 2026-02-17T05:37:36.836 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.810+0000 7f101901b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f101408ca50 con 0x7f101410a3f0 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1008011b60 con 0x7f101405d1b0 2026-02-17T05:37:36.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7f100804fc20 con 0x7f101405d1b0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556798934 0 0) 0x7f101408ca50 con 0x7f101410a3f0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient(hunting): my global_id is 104136 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101410c160 con 0x7f101410a3f0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f1013577640 10 monclient: get_auth_request con 0x7f0fe0040bb0 auth_method 0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2812903280 0 0) 0x7f101410c160 con 0x7f101410a3f0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101408ca50 con 0x7f101410a3f0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ffc003770 con 0x7f101410a3f0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 10 monclient: dump: 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 567968564 0 0) 0x7f101408ca50 con 0x7f101410a3f0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.811+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1014057cd0 con 0x7f101410a3f0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.812+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0ffc0059b0 con 0x7f101410a3f0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.812+0000 7f0ff37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.812+0000 7f0ff37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.812+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6789/0 conn(0x7f101410a3f0 legacy=0x7f1014058e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.812+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6789/0 conn(0x7f101410a3f0 legacy=0x7f1014058e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f101901b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f101405e950 con 0x7f101410b7d0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264479676 0 0) 0x7f0fe00035e0 con 0x7f101410b7d0 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient(hunting): my global_id is 104139 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101408ca50 con 0x7f101410b7d0 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2503564439 0 0) 0x7f101408ca50 con 0x7f101410b7d0 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fe00035e0 con 0x7f101410b7d0 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ffc003fe0 con 0x7f101410b7d0 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient: dump: 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.841 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 54838891 0 0) 0x7f0fe00035e0 con 0x7f101410b7d0 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f101410bc00 con 0x7f101410b7d0 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 4257016393) 0x7f0ffc005b20 con 0x7f101410b7d0 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6789/0 conn(0x7f101410b7d0 legacy=0x7f10140595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.815+0000 7f0ff37fe640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6789/0 conn(0x7f101410b7d0 legacy=0x7f10140595a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:36.843 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:36.843 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:36.843 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:36.843 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:37:36.843 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 2025, 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 1, 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.844 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.845 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.846 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:36.847 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.848 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.849 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.850 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.851 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.852 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:36.853 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:36.854 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:36.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.118:6812/703720803 conn(0x7f0fe0040bb0 legacy=0x7f0fe0061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 10 monclient: shutdown 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 >> v1:10.20.193.106:6789/0 conn(0x7f101405d1b0 legacy=0x7f101413cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f1013577640 1 -- 10.20.193.106:0/1765106374 reap_dead start 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f1013577640 1 -- 10.20.193.106:0/1765106374 reap_dead start 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 shutdown_connections 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 >> 10.20.193.106:0/1765106374 conn(0x7f10140915f0 msgr2=0x7f101413f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 shutdown_connections 2026-02-17T05:37:36.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.816+0000 7f101901b640 1 -- 10.20.193.106:0/1765106374 wait complete. 2026-02-17T05:37:36.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:36.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:37:36.857 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.920+0000 7fc0964cc640 10 monclient: get_monmap_and_config 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.920+0000 7fc0964cc640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.920+0000 7fc0964cc640 10 monclient: monmap: 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:36.922317+0000 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:36.922317+0000 2026-02-17T05:37:36.932 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 1 Processor -- start 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 1 -- start start 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient: init 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc09005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc09005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc090182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09008b060 con 0x7fc090182720 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09005dc90 con 0x7fc09005dee0 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09008d6a0 con 0x7fc09005d1b0 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc0964cc640 10 monclient(hunting): authenticate will time out at 1185.550713s 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc08ffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc09005d1b0 0x7fc09005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60558/0 (socket says 10.20.193.106:60558) 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.921+0000 7fc08ffff640 1 -- 10.20.193.106:0/2950802502 learned_addr learned my addr 10.20.193.106:0/2950802502 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684474494 0 0) 0x7fc09008d6a0 con 0x7fc09005d1b0 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): my global_id is 4958 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0740035e0 con 0x7fc09005d1b0 2026-02-17T05:37:36.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204365386 0 0) 0x7fc09008b060 con 0x7fc090182720 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient(hunting): my global_id is 104142 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc09008d6a0 con 0x7fc090182720 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 329302429 0 0) 0x7fc09008d6a0 con 0x7fc090182720 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 >> v1:10.20.193.106:6790/0 conn(0x7fc09005d1b0 legacy=0x7fc09005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 >> v1:10.20.193.118:6789/0 conn(0x7fc09005dee0 legacy=0x7fc090181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 monclient: found mon.noname-a 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc090057960 con 0x7fc090182720 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc084003eb0 con 0x7fc090182720 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 5 monclient: authenticate success, global_id 104142 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: dump: 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.936 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc084004130 con 0x7fc090182720 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 1 -- 10.20.193.106:0/2950802502 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc084004540 con 0x7fc090182720 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc08effd640 10 monclient: dump: 2026-02-17T05:37:36.937 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 4 set_mon_vals no callback set 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 10 monclient: shutdown 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 1 -- 10.20.193.106:0/2950802502 >> v1:10.20.193.106:6789/0 conn(0x7fc090182720 legacy=0x7fc0901a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 1 -- 10.20.193.106:0/2950802502 shutdown_connections 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 1 -- 10.20.193.106:0/2950802502 >> 10.20.193.106:0/2950802502 conn(0x7fc0900915f0 msgr2=0x7fc0900919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 1 -- 10.20.193.106:0/2950802502 shutdown_connections 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.922+0000 7fc0964cc640 1 -- 10.20.193.106:0/2950802502 wait complete. 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: build_initial_monmap 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: monmap: 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:36.939 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 Processor -- start 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 -- start start 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: init 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc09005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc09005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc090182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09012c0e0 con 0x7fc090182720 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09013f720 con 0x7fc09005d1b0 2026-02-17T05:37:36.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc09005e8e0 con 0x7fc09005dee0 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient(hunting): authenticate will time out at 1185.552463s 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc09005dee0 0x7fc090180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60570/0 (socket says 10.20.193.106:60570) 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08f7fe640 1 -- 10.20.193.106:0/1602902275 learned_addr learned my addr 10.20.193.106:0/1602902275 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474939591 0 0) 0x7fc09012c0e0 con 0x7fc090182720 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): my global_id is 104145 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0600035e0 con 0x7fc090182720 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941468832 0 0) 0x7fc09005e8e0 con 0x7fc09005dee0 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): my global_id is 4961 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc09012c0e0 con 0x7fc09005dee0 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220853078 0 0) 0x7fc09013f720 con 0x7fc09005d1b0 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): my global_id is 94225 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc09005e8e0 con 0x7fc09005d1b0 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 607814027 0 0) 0x7fc0600035e0 con 0x7fc090182720 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc09013f720 con 0x7fc090182720 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc0840042a0 con 0x7fc090182720 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:36.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): dump: 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1256441054 0 0) 0x7fc09012c0e0 con 0x7fc09005dee0 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0600035e0 con 0x7fc09005dee0 2026-02-17T05:37:36.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc080003110 con 0x7fc09005dee0 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient(hunting): dump: 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.944 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1002315371 0 0) 0x7fc09013f720 con 0x7fc090182720 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6790/0 conn(0x7fc09005dee0 legacy=0x7fc090180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.118:6789/0 conn(0x7fc09005d1b0 legacy=0x7fc090194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient: _finish_hunting 0 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 monclient: found mon.a 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09013d6c0 con 0x7fc090182720 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient: _finish_auth 0 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 10 monclient: _check_auth_tickets 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc08cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 5 monclient: authenticate success, global_id 104145 2026-02-17T05:37:36.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: _renew_subs 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.923+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0901824f0 con 0x7fc090182720 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc0964cc640 10 monclient: _renew_subs 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc0964cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc09012a8e0 con 0x7fc090182720 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc084004850 con 0x7fc090182720 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc084004b70 con 0x7fc090182720 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: dump: 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.946 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08e7fc640 4 set_mon_vals no callback set 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc0964cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc0901296a0 con 0x7fc0901292d0 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874773371 0 0) 0x7fc0901296a0 con 0x7fc0901292d0 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient(hunting): my global_id is 4964 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc09013f720 con 0x7fc0901292d0 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc084011b10 con 0x7fc090182720 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7fc08404fb50 con 0x7fc090182720 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1001304537 0 0) 0x7fc09013f720 con 0x7fc0901292d0 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0901296a0 con 0x7fc0901292d0 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc07c002fc0 con 0x7fc0901292d0 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.924+0000 7fc08cff9640 10 monclient: dump: 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.948 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08f7fe640 10 monclient: get_auth_request con 0x7fc060040da0 auth_method 0 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3694361433 0 0) 0x7fc0901296a0 con 0x7fc0901292d0 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc090057ca0 con 0x7fc0901292d0 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc07c0033e0 con 0x7fc0901292d0 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:36.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6790/0 conn(0x7fc0901292d0 legacy=0x7fc090058d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.925+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6790/0 conn(0x7fc0901292d0 legacy=0x7fc090058d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc0964cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc09012bc20 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943558789 0 0) 0x7fc09012bc20 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 10 monclient(hunting): my global_id is 4967 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.928+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0901296a0 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1878411052 0 0) 0x7fc0901296a0 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc09012bc20 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc07c004cc0 con 0x7fc090194aa0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:36.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 10 monclient: dump: 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 632125968 0 0) 0x7fc09012bc20 con 0x7fc090194aa0 2026-02-17T05:37:36.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc090055570 con 0x7fc090194aa0 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 2849698293) 0x7fc07c005070 con 0x7fc090194aa0 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6790/0 conn(0x7fc090194aa0 legacy=0x7fc090059450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc08cff9640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6790/0 conn(0x7fc090194aa0 legacy=0x7fc090059450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:36.952 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 581691, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:36.953 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.954 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.955 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:36.956 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:36.957 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.958 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:36.959 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.960 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.961 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:36.962 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:36.963 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.118:6812/703720803 conn(0x7fc060040da0 legacy=0x7fc060061250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 10 monclient: shutdown 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 >> v1:10.20.193.106:6789/0 conn(0x7fc090182720 legacy=0x7fc090195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc094a42640 1 -- 10.20.193.106:0/1602902275 reap_dead start 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc094a42640 1 -- 10.20.193.106:0/1602902275 reap_dead start 2026-02-17T05:37:36.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 shutdown_connections 2026-02-17T05:37:36.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 >> 10.20.193.106:0/1602902275 conn(0x7fc0900915f0 msgr2=0x7fc0900885f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:36.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 shutdown_connections 2026-02-17T05:37:36.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:36.929+0000 7fc0964cc640 1 -- 10.20.193.106:0/1602902275 wait complete. 2026-02-17T05:37:36.965 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:36.965 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:37:36.965 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.028+0000 7fe92f30c640 10 monclient: get_monmap_and_config 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.028+0000 7fe92f30c640 10 monclient: build_initial_monmap 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.028+0000 7fe92f30c640 10 monclient: monmap: 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:37.030045+0000 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:37.030045+0000 2026-02-17T05:37:37.031 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 1 Processor -- start 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 1 -- start start 2026-02-17T05:37:37.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient: init 2026-02-17T05:37:37.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-b con 0x7fe92805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-a con 0x7fe92805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-c con 0x7fe928182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92808b060 con 0x7fe92805dee0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92805dc90 con 0x7fe928182720 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92808d6a0 con 0x7fe92805d1b0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 10 monclient(hunting): authenticate will time out at 1185.658431s 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92d081640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe92805d1b0 0x7fe92805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60600/0 (socket says 10.20.193.106:60600) 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92d081640 1 -- 10.20.193.106:0/1482885878 learned_addr learned my addr 10.20.193.106:0/1482885878 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136872841 0 0) 0x7fe92808b060 con 0x7fe92805dee0 2026-02-17T05:37:37.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): my global_id is 104148 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9100035e0 con 0x7fe92805dee0 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179688236 0 0) 0x7fe92808d6a0 con 0x7fe92805d1b0 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient(hunting): my global_id is 4970 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe92808b060 con 0x7fe92805d1b0 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3343345878 0 0) 0x7fe9100035e0 con 0x7fe92805dee0 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 >> v1:10.20.193.106:6790/0 conn(0x7fe92805d1b0 legacy=0x7fe92805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 >> v1:10.20.193.118:6789/0 conn(0x7fe928182720 legacy=0x7fe9281a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: _finish_hunting 0 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 monclient: found mon.noname-a 2026-02-17T05:37:37.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe928057960 con 0x7fe92805dee0 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: _finish_auth 0 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: _check_auth_tickets 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe91c002dd0 con 0x7fe92805dee0 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe917fff640 10 monclient: dump: 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.042 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 5 monclient: authenticate success, global_id 104148 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.029+0000 7fe92f30c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe91c003010 con 0x7fe92805dee0 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 1 -- 10.20.193.106:0/1482885878 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe91c003420 con 0x7fe92805dee0 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 4 set_mon_vals no callback set 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe917fff640 10 monclient: dump: 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.043 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 10 monclient: shutdown 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- 10.20.193.106:0/1482885878 >> v1:10.20.193.106:6789/0 conn(0x7fe92805dee0 legacy=0x7fe928181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- 10.20.193.106:0/1482885878 shutdown_connections 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- 10.20.193.106:0/1482885878 >> 10.20.193.106:0/1482885878 conn(0x7fe9280915f0 msgr2=0x7fe9280919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- 10.20.193.106:0/1482885878 shutdown_connections 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- 10.20.193.106:0/1482885878 wait complete. 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 10 monclient: build_initial_monmap 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 10 monclient: monmap: 2026-02-17T05:37:37.044 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 Processor -- start 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 1 -- start start 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.030+0000 7fe92f30c640 10 monclient: init 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-b con 0x7fe92805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-c con 0x7fe92805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:37.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient(hunting): picked mon.noname-a con 0x7fe928182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92810ef40 con 0x7fe928182720 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92812ae70 con 0x7fe92805d1b0 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe928089a60 con 0x7fe92805dee0 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient(hunting): authenticate will time out at 1185.660153s 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92c880640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe92805dee0 0x7fe92812a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60606/0 (socket says 10.20.193.106:60606) 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92c880640 1 -- 10.20.193.106:0/2342953627 learned_addr learned my addr 10.20.193.106:0/2342953627 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960928566 0 0) 0x7fe92810ef40 con 0x7fe928182720 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): my global_id is 104151 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f80035e0 con 0x7fe928182720 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145032354 0 0) 0x7fe928089a60 con 0x7fe92805dee0 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): my global_id is 4973 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe92810ef40 con 0x7fe92805dee0 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1823364525 0 0) 0x7fe8f80035e0 con 0x7fe928182720 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe928089a60 con 0x7fe928182720 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe924003d80 con 0x7fe928182720 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.047 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2742796421 0 0) 0x7fe92810ef40 con 0x7fe92805dee0 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8f80035e0 con 0x7fe92805dee0 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe91c002d60 con 0x7fe92805dee0 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient(hunting): dump: 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.048 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4067165413 0 0) 0x7fe928089a60 con 0x7fe928182720 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.106:6790/0 conn(0x7fe92805dee0 legacy=0x7fe92812a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6789/0 conn(0x7fe92805d1b0 legacy=0x7fe92812a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 monclient: found mon.a 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92813f720 con 0x7fe928182720 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: _finish_auth 0 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:37.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 5 monclient: authenticate success, global_id 104151 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _renew_subs 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe92805e8e0 con 0x7fe928182720 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _renew_subs 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9281824f0 con 0x7fe928182720 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9240043c0 con 0x7fe928182720 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe9240045f0 con 0x7fe928182720 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe915ffb640 10 monclient: dump: 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.050 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.031+0000 7fe9177fe640 4 set_mon_vals no callback set 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe92f30c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe92812d9c0 con 0x7fe92812d5f0 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe9240119d0 con 0x7fe928182720 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7fe92404fb20 con 0x7fe928182720 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe92c880640 10 monclient: get_auth_request con 0x7fe8f8040bf0 auth_method 0 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299496041 0 0) 0x7fe92812d9c0 con 0x7fe92812d5f0 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient(hunting): my global_id is 94228 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe928089a60 con 0x7fe92812d5f0 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2488905619 0 0) 0x7fe928089a60 con 0x7fe92812d5f0 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe92812d9c0 con 0x7fe92812d5f0 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe918002e60 con 0x7fe92812d5f0 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.032+0000 7fe915ffb640 10 monclient: dump: 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.052 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1124208710 0 0) 0x7fe92812d9c0 con 0x7fe92812d5f0 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe928057cd0 con 0x7fe92812d5f0 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe9180032e0 con 0x7fe92812d5f0 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6789/0 conn(0x7fe92812d5f0 legacy=0x7fe928059150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.033+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6789/0 conn(0x7fe92812d5f0 legacy=0x7fe928059150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.036+0000 7fe92f30c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.036+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe92810daf0 con 0x7fe928059860 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931705377 0 0) 0x7fe92810daf0 con 0x7fe928059860 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient(hunting): my global_id is 94231 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe92812d9c0 con 0x7fe928059860 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3016098429 0 0) 0x7fe92812d9c0 con 0x7fe928059860 2026-02-17T05:37:37.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe92810daf0 con 0x7fe928059860 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe918004a50 con 0x7fe928059860 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient: dump: 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2025439898 0 0) 0x7fe92810daf0 con 0x7fe928059860 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe928055570 con 0x7fe928059860 2026-02-17T05:37:37.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 1147998932) 0x7fe918005990 con 0x7fe928059860 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6789/0 conn(0x7fe928059860 legacy=0x7fe92811b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.037+0000 7fe915ffb640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6789/0 conn(0x7fe928059860 legacy=0x7fe92811b520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 32, 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 109281, 2026-02-17T05:37:37.055 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:37.056 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:37.057 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:37.058 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:37.059 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:37.060 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:37.061 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:37.062 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.063 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:37.064 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:37.065 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.118:6812/703720803 conn(0x7fe8f8040bf0 legacy=0x7fe8f80610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 10 monclient: shutdown 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 >> v1:10.20.193.106:6789/0 conn(0x7fe928182720 legacy=0x7fe928181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92d882640 1 -- 10.20.193.106:0/2342953627 reap_dead start 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92d882640 1 -- 10.20.193.106:0/2342953627 reap_dead start 2026-02-17T05:37:37.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 shutdown_connections 2026-02-17T05:37:37.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 >> 10.20.193.106:0/2342953627 conn(0x7fe9280915f0 msgr2=0x7fe92808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:37.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 shutdown_connections 2026-02-17T05:37:37.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.038+0000 7fe92f30c640 1 -- 10.20.193.106:0/2342953627 wait complete. 2026-02-17T05:37:37.067 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:37:37.067 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:37:37.067 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:37:37.067 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:37:37.067 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:37:37.067 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:37:37.068 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:37:37.075 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:37:37.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:37:37.075 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:37:37.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 10 monclient: get_monmap_and_config 2026-02-17T05:37:37.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 10 monclient: build_initial_monmap 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 10 monclient: monmap: 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:37.179673+0000 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:37.179673+0000 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:37.190 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 1 Processor -- start 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 1 -- start start 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.178+0000 7fe9fe50c640 10 monclient: init 2026-02-17T05:37:37.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-a con 0x7fe9f805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-c con 0x7fe9f805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-b con 0x7fe9f8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f808b060 con 0x7fe9f805d1b0 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f805dc90 con 0x7fe9f805dee0 2026-02-17T05:37:37.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f7fff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fe9f805d1b0 legacy=0x7fe9f805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f808d6a0 con 0x7fe9f8182720 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient(hunting): authenticate will time out at 1185.808083s 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fca82640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe9f8182720 0x7fe9f81a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60614/0 (socket says 10.20.193.106:60614) 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fca82640 1 -- 10.20.193.106:0/2652866439 learned_addr learned my addr 10.20.193.106:0/2652866439 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023414983 0 0) 0x7fe9f808d6a0 con 0x7fe9f8182720 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient(hunting): my global_id is 4976 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9dc0035e0 con 0x7fe9f8182720 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751410432 0 0) 0x7fe9dc0035e0 con 0x7fe9f8182720 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 >> v1:10.20.193.118:6789/0 conn(0x7fe9f805dee0 legacy=0x7fe9f8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 >> v1:10.20.193.106:6789/0 conn(0x7fe9f805d1b0 legacy=0x7fe9f805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:37.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 monclient: found mon.noname-b 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f8057960 con 0x7fe9f8182720 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: _finish_auth 0 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe9ec003eb0 con 0x7fe9f8182720 2026-02-17T05:37:37.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: dump: 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.196 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 5 monclient: authenticate success, global_id 4976 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9ec004170 con 0x7fe9f8182720 2026-02-17T05:37:37.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 1 -- 10.20.193.106:0/2652866439 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe9ec004580 con 0x7fe9f8182720 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 4 set_mon_vals no callback set 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9f6ffd640 10 monclient: dump: 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.198 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.199 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 10 monclient: shutdown 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- 10.20.193.106:0/2652866439 >> v1:10.20.193.106:6790/0 conn(0x7fe9f8182720 legacy=0x7fe9f81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- 10.20.193.106:0/2652866439 shutdown_connections 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- 10.20.193.106:0/2652866439 >> 10.20.193.106:0/2652866439 conn(0x7fe9f80915f0 msgr2=0x7fe9f80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- 10.20.193.106:0/2652866439 shutdown_connections 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.179+0000 7fe9fe50c640 1 -- 10.20.193.106:0/2652866439 wait complete. 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient: build_initial_monmap 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient: monmap: 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:37.200 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 1 Processor -- start 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 1 -- start start 2026-02-17T05:37:37.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient: init 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-a con 0x7fe9f805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-c con 0x7fe9f805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient(hunting): picked mon.noname-b con 0x7fe9f8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f805ce00 con 0x7fe9f805d1b0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f812c0b0 con 0x7fe9f8182720 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f805e8e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9fe50c640 10 monclient(hunting): authenticate will time out at 1185.809807s 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9f7fff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fe9f805d1b0 legacy=0x7fe9f8194300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9f77fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe9f805dee0 0x7fe9f8180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60622/0 (socket says 10.20.193.106:60622) 2026-02-17T05:37:37.202 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.180+0000 7fe9f77fe640 1 -- 10.20.193.106:0/4161781178 learned_addr learned my addr 10.20.193.106:0/4161781178 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632736931 0 0) 0x7fe9f805e8e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): my global_id is 4979 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9c80035e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 853006396 0 0) 0x7fe9c80035e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9f805e8e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe9e80030c0 con 0x7fe9f805dee0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:37.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): dump: 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:37.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2029988207 0 0) 0x7fe9f805e8e0 con 0x7fe9f805dee0 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 >> v1:10.20.193.118:6789/0 conn(0x7fe9f8182720 legacy=0x7fe9f8195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 >> v1:10.20.193.106:6789/0 conn(0x7fe9f805d1b0 legacy=0x7fe9f8194300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 monclient: found mon.c 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f813d690 con 0x7fe9f805dee0 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: _finish_auth 0 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 5 monclient: authenticate success, global_id 4979 2026-02-17T05:37:37.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 10 monclient: _renew_subs 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f8129d50 con 0x7fe9f805dee0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 10 monclient: _renew_subs 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9f812bdd0 con 0x7fe9f805dee0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9e8003430 con 0x7fe9f805dee0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe9e8003b70 con 0x7fe9f805dee0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f4ff9640 10 monclient: dump: 2026-02-17T05:37:37.206 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.181+0000 7fe9f67fc640 4 set_mon_vals no callback set 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9fe50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9fe50c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:37.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9fe50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f812a910 con 0x7fe9f805dee0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe9e8003cd0 con 0x7fe9f805dee0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7fe9e804fda0 con 0x7fe9f805dee0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.182+0000 7fe9f7fff640 10 monclient: get_auth_request con 0x7fe9c8040740 auth_method 0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.184+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fe9e8003fb0 con 0x7fe9f805dee0 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.184+0000 7fe9f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:37.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.184+0000 7fe9f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:37.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9fe50c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:37:37.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9fe50c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9fe50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9f8055570 con 0x7fe9f805dee0 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9f4ff9640 1 -- 10.20.193.106:0/4161781178 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3492993256) 0x7fe9e8016c50 con 0x7fe9f805dee0 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9f4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.329+0000 7fe9f4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:37.332 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:37:37.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 >> v1:10.20.193.118:6812/703720803 conn(0x7fe9c8040740 legacy=0x7fe9c8060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 10 monclient: shutdown 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 >> v1:10.20.193.106:6790/0 conn(0x7fe9f805dee0 legacy=0x7fe9f8180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 shutdown_connections 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 >> 10.20.193.106:0/4161781178 conn(0x7fe9f80915f0 msgr2=0x7fe9f808c620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 shutdown_connections 2026-02-17T05:37:37.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:37.330+0000 7fe9fe50c640 1 -- 10.20.193.106:0/4161781178 wait complete. 2026-02-17T05:37:40.341 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 10 monclient: get_monmap_and_config 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 10 monclient: build_initial_monmap 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 10 monclient: monmap: 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:40.408941+0000 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:40.408941+0000 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:40.409 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 1 Processor -- start 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 1 -- start start 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.407+0000 7f391decc640 10 monclient: init 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient(hunting): picked mon.noname-a con 0x7f391805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient(hunting): picked mon.noname-b con 0x7f391805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient(hunting): picked mon.noname-c con 0x7f3918182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391808b060 con 0x7f391805d1b0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391805dc90 con 0x7f3918182720 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391808d6a0 con 0x7f391805dee0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient(hunting): authenticate will time out at 1189.037296s 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39177fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f391805d1b0 legacy=0x7f391805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f3916ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f391805dee0 0x7f3918181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60632/0 (socket says 10.20.193.106:60632) 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f3916ffd640 1 -- 10.20.193.106:0/326544346 learned_addr learned my addr 10.20.193.106:0/326544346 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059977160 0 0) 0x7f391808d6a0 con 0x7f391805dee0 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient(hunting): my global_id is 4982 2026-02-17T05:37:40.410 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38fc0035e0 con 0x7f391805dee0 2026-02-17T05:37:40.411 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2155917701 0 0) 0x7f38fc0035e0 con 0x7f391805dee0 2026-02-17T05:37:40.411 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 >> v1:10.20.193.118:6789/0 conn(0x7f3918182720 legacy=0x7f39181a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:40.411 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 >> v1:10.20.193.106:6789/0 conn(0x7f391805d1b0 legacy=0x7f391805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: _finish_hunting 0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 monclient: found mon.noname-b 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918057960 con 0x7f391805dee0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: _finish_auth 0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: _check_auth_tickets 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 5 monclient: authenticate success, global_id 4982 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3908002dd0 con 0x7f391805dee0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: dump: 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3908003010 con 0x7f391805dee0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f391decc640 4 set_mon_vals no callback set 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 1 -- 10.20.193.106:0/326544346 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3908003420 con 0x7f391805dee0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.408+0000 7f39167fc640 10 monclient: dump: 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:40.412 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 10 monclient: shutdown 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- 10.20.193.106:0/326544346 >> v1:10.20.193.106:6790/0 conn(0x7f391805dee0 legacy=0x7f3918181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- 10.20.193.106:0/326544346 shutdown_connections 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- 10.20.193.106:0/326544346 >> 10.20.193.106:0/326544346 conn(0x7f39180915f0 msgr2=0x7f39180919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- 10.20.193.106:0/326544346 shutdown_connections 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- 10.20.193.106:0/326544346 wait complete. 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 10 monclient: build_initial_monmap 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 10 monclient: monmap: 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 Processor -- start 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 1 -- start start 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.409+0000 7f391decc640 10 monclient: init 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient(hunting): picked mon.noname-a con 0x7f391805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient(hunting): picked mon.noname-b con 0x7f391805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient(hunting): picked mon.noname-c con 0x7f3918182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391810c5a0 con 0x7f391805d1b0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391812e3e0 con 0x7f391805dee0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391805e8e0 con 0x7f3918182720 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient(hunting): authenticate will time out at 1189.039084s 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f39177fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f391805d1b0 legacy=0x7f391812d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3917fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3918182720 0x7f3918181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60648/0 (socket says 10.20.193.106:60648) 2026-02-17T05:37:40.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3917fff640 1 -- 10.20.193.106:0/1963616336 learned_addr learned my addr 10.20.193.106:0/1963616336 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:40.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416026004 0 0) 0x7f391805e8e0 con 0x7f3918182720 2026-02-17T05:37:40.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:37:40.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): my global_id is 4985 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e80035e0 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3916ffd640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6789/0 conn(0x7f391805dee0 legacy=0x7f391812dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3916ffd640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6789/0 conn(0x7f391805dee0 legacy=0x7f391812dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3916ffd640 1 --1- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6789/0 conn(0x7f391805dee0 0x7f391812dcd0 :-1 s=OPENED pgs=288 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3916ffd640 1 --1- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6789/0 conn(0x7f391805dee0 0x7f391812dcd0 :-1 s=OPENED pgs=288 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.118:6789/0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1118709027 0 0) 0x7f38e80035e0 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f391805e8e0 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f390c0041d0 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): dump: 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 309344543 0 0) 0x7f391805e8e0 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6789/0 conn(0x7f391805dee0 legacy=0x7f391812dcd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.106:6789/0 conn(0x7f391805d1b0 legacy=0x7f391812d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 monclient: found mon.c 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391810e050 con 0x7f3918182720 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: _finish_auth 0 2026-02-17T05:37:40.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 5 monclient: authenticate success, global_id 4985 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _renew_subs 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f391810cb60 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _renew_subs 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f391810eec0 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f390c004540 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f390c004c10 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f3915ffb640 4 set_mon_vals no callback set 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.410+0000 7f38f3fff640 10 monclient: dump: 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f391decc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f391decc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f391decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391810eb40 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f390c004d70 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7f390c050ef0 con 0x7f3918182720 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.411+0000 7f39177fe640 10 monclient: get_auth_request con 0x7f38e8040530 auth_method 0 2026-02-17T05:37:40.416 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.414+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f390c0053e0 con 0x7f3918182720 2026-02-17T05:37:40.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.414+0000 7f38f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:40.417 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.414+0000 7f38f3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:40.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f391decc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f391decc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f391decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3918057cd0 con 0x7f3918182720 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f38f3fff640 1 -- 10.20.193.106:0/1963616336 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3059593672) 0x7f390c017ce0 con 0x7f3918182720 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f38f3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:40.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.560+0000 7f38f3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:40.564 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:37:40.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.118:6812/703720803 conn(0x7f38e8040530 legacy=0x7f38e80609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:40.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 10 monclient: shutdown 2026-02-17T05:37:40.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:40.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 >> v1:10.20.193.106:6790/0 conn(0x7f3918182720 legacy=0x7f3918181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:40.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 shutdown_connections 2026-02-17T05:37:40.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 >> 10.20.193.106:0/1963616336 conn(0x7f39180915f0 msgr2=0x7f3918088660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:40.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 shutdown_connections 2026-02-17T05:37:40.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:40.561+0000 7f391decc640 1 -- 10.20.193.106:0/1963616336 wait complete. 2026-02-17T05:37:43.572 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: get_monmap_and_config 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: build_initial_monmap 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: monmap: 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:43.638648+0000 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:43.638648+0000 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:43.639 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 1 Processor -- start 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 1 -- start start 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: init 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient(hunting): picked mon.noname-c con 0x7f294c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient(hunting): picked mon.noname-b con 0x7f294c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 10 monclient(hunting): picked mon.noname-a con 0x7f294c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.637+0000 7f295230c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c08b060 con 0x7f294c182720 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f295230c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c05dc90 con 0x7f294c05d1b0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f295230c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c08d6a0 con 0x7f294c05dee0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f295230c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f295230c640 10 monclient(hunting): authenticate will time out at 1192.267018s 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f2950882640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f294c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f294b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f294c05dee0 0x7f294c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60664/0 (socket says 10.20.193.106:60664) 2026-02-17T05:37:43.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.638+0000 7f294b7fe640 1 -- 10.20.193.106:0/1730217229 learned_addr learned my addr 10.20.193.106:0/1730217229 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:43.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:43.839+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f294c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:44.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:44.240+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f294c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:45.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:45.042+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f294c1a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): tick 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 monclient(hunting): continuing hunt 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6790/0 conn(0x7f294c05dee0 legacy=0x7f294c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:46.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.118:6789/0 conn(0x7f294c05d1b0 legacy=0x7f294c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f294c1a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f294c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f294c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f294c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c057960 con 0x7f294c182720 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c08b060 con 0x7f294c05d1b0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2928069f80 con 0x7f294c05dee0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f294b7fe640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:46.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.638+0000 7f2949ffb640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:46.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:46.839+0000 7f294b7fe640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:47.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:47.240+0000 7f294b7fe640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:48.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:48.042+0000 7f294b7fe640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): tick 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 monclient(hunting): continuing hunt 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6790/0 conn(0x7f294c05dee0 legacy=0x7f2928023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.118:6789/0 conn(0x7f294c05d1b0 legacy=0x7f2928066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f294c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:49.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f294c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f294c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292806b1e0 con 0x7f294c182720 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c057960 con 0x7f294c05d1b0 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2928069080 con 0x7f294c05dee0 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2949ffb640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:49.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.639+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:49.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:49.841+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:50.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:50.243+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.044+0000 7f2950882640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759359137 0 0) 0x7f2928069080 con 0x7f294c05dee0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): my global_id is 4988 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29300035e0 con 0x7f294c05dee0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862358847 0 0) 0x7f294c057960 con 0x7f294c05d1b0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient(hunting): my global_id is 94240 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2928069080 con 0x7f294c05d1b0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2969155872 0 0) 0x7f2928069080 con 0x7f294c05d1b0 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6790/0 conn(0x7f294c05dee0 legacy=0x7f2928023750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.106:6789/0 conn(0x7f294c182720 legacy=0x7f2928044ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 monclient: found mon.noname-c 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29280692d0 con 0x7f294c05d1b0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f293c002dc0 con 0x7f294c05d1b0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f295230c640 5 monclient: authenticate success, global_id 94240 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f295230c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: dump: 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f295230c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f293c002fc0 con 0x7f294c05d1b0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f295230c640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 1 -- 10.20.193.106:0/1730217229 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f293c003390 con 0x7f294c05d1b0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f295230c640 4 set_mon_vals no callback set 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.333+0000 7f294affd640 10 monclient: dump: 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.336 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.337 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 10 monclient: shutdown 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- 10.20.193.106:0/1730217229 >> v1:10.20.193.118:6789/0 conn(0x7f294c05d1b0 legacy=0x7f29280666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- 10.20.193.106:0/1730217229 shutdown_connections 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- 10.20.193.106:0/1730217229 >> 10.20.193.106:0/1730217229 conn(0x7f294c0915f0 msgr2=0x7f294c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- 10.20.193.106:0/1730217229 shutdown_connections 2026-02-17T05:37:51.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- 10.20.193.106:0/1730217229 wait complete. 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 10 monclient: build_initial_monmap 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 10 monclient: monmap: 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 Processor -- start 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 1 -- start start 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.334+0000 7f295230c640 10 monclient: init 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient(hunting): picked mon.noname-a con 0x7f294c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient(hunting): picked mon.noname-c con 0x7f294c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient(hunting): picked mon.noname-b con 0x7f294c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c130680 con 0x7f294c05d1b0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c089410 con 0x7f294c182720 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c05ce30 con 0x7f294c05dee0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f295230c640 10 monclient(hunting): authenticate will time out at 1199.964173s 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f294bfff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f294c05d1b0 legacy=0x7f294c0885f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2950882640 1 --1- >> v1:10.20.193.118:6789/0 conn(0x7f294c182720 0x7f294c1742d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.118:6789/0 says I am v1:10.20.193.106:40000/0 (socket says 10.20.193.106:40000) 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2950882640 1 -- 10.20.193.106:0/3214150237 learned_addr learned my addr 10.20.193.106:0/3214150237 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795326728 0 0) 0x7f294c089410 con 0x7f294c182720 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): my global_id is 94243 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f291c0035e0 con 0x7f294c182720 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244838309 0 0) 0x7f294c05ce30 con 0x7f294c05dee0 2026-02-17T05:37:51.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.335+0000 7f2948ff9640 10 monclient(hunting): my global_id is 4991 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c089410 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1613747434 0 0) 0x7f294c089410 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f294c05ce30 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f293c0032e0 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient(hunting): dump: 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3659243160 0 0) 0x7f294c05ce30 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 >> v1:10.20.193.118:6789/0 conn(0x7f294c182720 legacy=0x7f294c1742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 >> v1:10.20.193.106:6789/0 conn(0x7f294c05d1b0 legacy=0x7f294c0885f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 monclient: found mon.c 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c13f210 con 0x7f294c05dee0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 5 monclient: authenticate success, global_id 4991 2026-02-17T05:37:51.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 10 monclient: _renew_subs 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f294c05e8e0 con 0x7f294c05dee0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 10 monclient: _renew_subs 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f294c12eb60 con 0x7f294c05dee0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f293c0028f0 con 0x7f294c05dee0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f293c004d00 con 0x7f294c05dee0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f2948ff9640 10 monclient: dump: 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.336+0000 7f294a7fc640 4 set_mon_vals no callback set 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f295230c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f295230c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f295230c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c0008d0 con 0x7f294c05dee0 2026-02-17T05:37:51.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f293c011ca0 con 0x7f294c05dee0 2026-02-17T05:37:51.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7f293c04fd70 con 0x7f294c05dee0 2026-02-17T05:37:51.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.337+0000 7f294bfff640 10 monclient: get_auth_request con 0x7f291c040750 auth_method 0 2026-02-17T05:37:51.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.340+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f293c0174d0 con 0x7f294c05dee0 2026-02-17T05:37:51.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.340+0000 7f2948ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.340+0000 7f2948ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:51.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f295230c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:37:51.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f295230c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:51.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f295230c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f294c057ca0 con 0x7f294c05dee0 2026-02-17T05:37:51.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f2948ff9640 1 -- 10.20.193.106:0/3214150237 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 449692330) 0x7f293c016c80 con 0x7f294c05dee0 2026-02-17T05:37:51.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f2948ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:37:51.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.487+0000 7f2948ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:51.491 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 >> v1:10.20.193.118:6812/703720803 conn(0x7f291c040750 legacy=0x7f291c060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 10 monclient: shutdown 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 >> v1:10.20.193.106:6790/0 conn(0x7f294c05dee0 legacy=0x7f294c088d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 shutdown_connections 2026-02-17T05:37:51.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 >> 10.20.193.106:0/3214150237 conn(0x7f294c0915f0 msgr2=0x7f294c08b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 shutdown_connections 2026-02-17T05:37:51.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.488+0000 7f295230c640 1 -- 10.20.193.106:0/3214150237 wait complete. 2026-02-17T05:37:51.499 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:37:51.499 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:37:51.499 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:37:51.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: get_monmap_and_config 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: build_initial_monmap 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: monmap: 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:51.566426+0000 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:51.566426+0000 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 1 Processor -- start 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 1 -- start start 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: init 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:37:51.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-b con 0x7f784805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-a con 0x7f784805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-c con 0x7f7848182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784808b060 con 0x7f784805dee0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784805dc90 con 0x7f7848182720 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784808d6a0 con 0x7f784805d1b0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f78500cc640 10 monclient(hunting): authenticate will time out at 1200.194780s 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.565+0000 7f784d640640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f784805dee0 legacy=0x7f7848181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784de41640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f784805d1b0 0x7f784805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53236/0 (socket says 10.20.193.106:53236) 2026-02-17T05:37:51.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784de41640 1 -- 10.20.193.106:0/2760268386 learned_addr learned my addr 10.20.193.106:0/2760268386 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192979125 0 0) 0x7f784808d6a0 con 0x7f784805d1b0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): my global_id is 4994 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78300035e0 con 0x7f784805d1b0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263816016 0 0) 0x7f784805dc90 con 0x7f7848182720 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient(hunting): my global_id is 94246 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f784808d6a0 con 0x7f7848182720 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 625206295 0 0) 0x7f78300035e0 con 0x7f784805d1b0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 >> v1:10.20.193.118:6789/0 conn(0x7f7848182720 legacy=0x7f78481a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 >> v1:10.20.193.106:6789/0 conn(0x7f784805dee0 legacy=0x7f7848181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 monclient: found mon.noname-b 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848057960 con 0x7f784805d1b0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7838002dd0 con 0x7f784805d1b0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 5 monclient: authenticate success, global_id 4994 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: dump: 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.569 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7838003090 con 0x7f784805d1b0 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 1 -- 10.20.193.106:0/2760268386 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f78380034a0 con 0x7f784805d1b0 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 4 set_mon_vals no callback set 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f784ce3f640 10 monclient: dump: 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 10 monclient: shutdown 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 1 -- 10.20.193.106:0/2760268386 >> v1:10.20.193.106:6790/0 conn(0x7f784805d1b0 legacy=0x7f784805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 1 -- 10.20.193.106:0/2760268386 shutdown_connections 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 1 -- 10.20.193.106:0/2760268386 >> 10.20.193.106:0/2760268386 conn(0x7f78480915f0 msgr2=0x7f78480919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 1 -- 10.20.193.106:0/2760268386 shutdown_connections 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.566+0000 7f78500cc640 1 -- 10.20.193.106:0/2760268386 wait complete. 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient: build_initial_monmap 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient: monmap: 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:51.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:51.571 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:51.571 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:51.571 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:51.571 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:51.571 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 1 Processor -- start 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 1 -- start start 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient: init 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-a con 0x7f784805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-b con 0x7f784805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient(hunting): picked mon.noname-c con 0x7f7848182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784805c740 con 0x7f784805d1b0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784812c540 con 0x7f784805dee0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784812bd60 con 0x7f7848182720 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f78500cc640 10 monclient(hunting): authenticate will time out at 1200.196900s 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f784de41640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f784805d1b0 legacy=0x7f7848128220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f784e642640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7848182720 0x7f7848181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53250/0 (socket says 10.20.193.106:53250) 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.567+0000 7f784e642640 1 -- 10.20.193.106:0/3944145346 learned_addr learned my addr 10.20.193.106:0/3944145346 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921682210 0 0) 0x7f784812bd60 con 0x7f7848182720 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): my global_id is 4997 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78180035e0 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1880600000 0 0) 0x7f78180035e0 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f784812bd60 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f78440041b0 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): dump: 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3142838449 0 0) 0x7f784812bd60 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.118:6789/0 conn(0x7f784805dee0 legacy=0x7f7848128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6789/0 conn(0x7f784805d1b0 legacy=0x7f7848128220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 monclient: found mon.c 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848129040 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 5 monclient: authenticate success, global_id 4997 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 10 monclient: _renew_subs 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f784812c040 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 10 monclient: _renew_subs 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f784813f6e0 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7844004520 con 0x7f7848182720 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7844004c50 con 0x7f7848182720 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f78367fc640 10 monclient: dump: 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.568+0000 7f7837fff640 4 set_mon_vals no callback set 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78500cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78481824f0 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803454639 0 0) 0x7f78481824f0 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient(hunting): my global_id is 5000 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f784812bd60 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7844004db0 con 0x7f7848182720 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7f7844050ee0 con 0x7f7848182720 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1519549843 0 0) 0x7f784812bd60 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78481824f0 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f78380029d0 con 0x7f7848058cc0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient: dump: 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f784d640640 10 monclient: get_auth_request con 0x7f7818040710 auth_method 0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4167058047 0 0) 0x7f78481824f0 con 0x7f7848058cc0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7848057cd0 con 0x7f7848058cc0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7838003550 con 0x7f7848058cc0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6790/0 conn(0x7f7848058cc0 legacy=0x7f7848059090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.569+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6790/0 conn(0x7f7848058cc0 legacy=0x7f7848059090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7848059ba0 con 0x7f78480597a0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352116603 0 0) 0x7f7848059ba0 con 0x7f78480597a0 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient(hunting): my global_id is 5003 2026-02-17T05:37:51.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78481824f0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1004133027 0 0) 0x7f78481824f0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7848059ba0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7838004eb0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient: dump: 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1148426357 0 0) 0x7f7848059ba0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f784808e3d0 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 3462711711) 0x7f7838007070 con 0x7f78480597a0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6790/0 conn(0x7f78480597a0 legacy=0x7f7848197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78367fc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6790/0 conn(0x7f78480597a0 legacy=0x7f7848197330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 36, 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 596334, 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:51.576 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:51.577 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.578 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:51.579 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.118:6812/703720803 conn(0x7f7818040710 legacy=0x7f7818060bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 10 monclient: shutdown 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 >> v1:10.20.193.106:6790/0 conn(0x7f7848182720 legacy=0x7f7848181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f784e642640 1 -- 10.20.193.106:0/3944145346 reap_dead start 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.573+0000 7f784e642640 1 -- 10.20.193.106:0/3944145346 reap_dead start 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.574+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 shutdown_connections 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.574+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 >> 10.20.193.106:0/3944145346 conn(0x7f78480915f0 msgr2=0x7f784805bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.574+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 shutdown_connections 2026-02-17T05:37:51.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.574+0000 7f78500cc640 1 -- 10.20.193.106:0/3944145346 wait complete. 2026-02-17T05:37:51.581 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:37:51.581 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:37:51.581 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:37:51.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: get_monmap_and_config 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: build_initial_monmap 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: monmap: 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:37:51.647668+0000 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:37:51.647668+0000 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 1 Processor -- start 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 1 -- start start 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: init 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:51.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-a con 0x7f2f9805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.646+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-b con 0x7f2f9805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-c con 0x7f2f98182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9808b060 con 0x7f2f9805d1b0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9805dc90 con 0x7f2f98182720 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9808d6a0 con 0x7f2f9805dee0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 10 monclient(hunting): authenticate will time out at 1200.276026s 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9e681640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f2f9805d1b0 legacy=0x7f2f9805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9de80640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2f9805dee0 0x7f2f98181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53280/0 (socket says 10.20.193.106:53280) 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9de80640 1 -- 10.20.193.106:0/617367087 learned_addr learned my addr 10.20.193.106:0/617367087 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029555866 0 0) 0x7f2f9808d6a0 con 0x7f2f9805dee0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): my global_id is 5006 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f880035e0 con 0x7f2f9805dee0 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775071114 0 0) 0x7f2f9805dc90 con 0x7f2f98182720 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient(hunting): my global_id is 94252 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f9808d6a0 con 0x7f2f98182720 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 111043336 0 0) 0x7f2f880035e0 con 0x7f2f9805dee0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 >> v1:10.20.193.118:6789/0 conn(0x7f2f98182720 legacy=0x7f2f981a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 >> v1:10.20.193.106:6789/0 conn(0x7f2f9805d1b0 legacy=0x7f2f9805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 monclient: found mon.noname-b 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98057960 con 0x7f2f9805dee0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 5 monclient: authenticate success, global_id 5006 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f84002dd0 con 0x7f2f9805dee0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: dump: 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.655 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f84003090 con 0x7f2f9805dee0 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 1 -- 10.20.193.106:0/617367087 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f840034a0 con 0x7f2f9805dee0 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2f9d67f640 10 monclient: dump: 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 10 monclient: get_monmap_and_config success 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 4 set_mon_vals no callback set 2026-02-17T05:37:51.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 10 monclient: shutdown 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- 10.20.193.106:0/617367087 >> v1:10.20.193.106:6790/0 conn(0x7f2f9805dee0 legacy=0x7f2f98181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- 10.20.193.106:0/617367087 shutdown_connections 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- 10.20.193.106:0/617367087 >> 10.20.193.106:0/617367087 conn(0x7f2f980915f0 msgr2=0x7f2f980919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- 10.20.193.106:0/617367087 shutdown_connections 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.647+0000 7f2fa090c640 1 -- 10.20.193.106:0/617367087 wait complete. 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient: build_initial_monmap 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient: monmap: 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 1 Processor -- start 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 1 -- start start 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient: init 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient: _reopen_session rank -1 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-a con 0x7f2f9805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-c con 0x7f2f9805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:37:51.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient(hunting): picked mon.noname-b con 0x7f2f98182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9805e8e0 con 0x7f2f9805d1b0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9813d680 con 0x7f2f98182720 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9812b800 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient(hunting): _renew_subs 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f9e681640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f2f9805d1b0 legacy=0x7f2f98194390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2fa090c640 10 monclient(hunting): authenticate will time out at 1200.277752s 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f9de80640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2f9805dee0 0x7f2f98180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53296/0 (socket says 10.20.193.106:53296) 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f9de80640 1 -- 10.20.193.106:0/2473068323 learned_addr learned my addr 10.20.193.106:0/2473068323 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695204239 0 0) 0x7f2f9812b800 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 10 monclient(hunting): my global_id is 5009 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.648+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f680035e0 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 980831636 0 0) 0x7f2f680035e0 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f9812b800 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f840033b0 con 0x7f2f9805dee0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient(hunting): dump: 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.658 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2602834834 0 0) 0x7f2f9812b800 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6789/0 conn(0x7f2f98182720 legacy=0x7f2f98195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.106:6789/0 conn(0x7f2f9805d1b0 legacy=0x7f2f98194390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 monclient: found mon.c 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98129d40 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: _finish_auth 0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 5 monclient: authenticate success, global_id 5009 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 10 monclient: _renew_subs 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f98182550 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 10 monclient: _renew_subs 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f9812ca60 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f840028b0 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f84004e60 con 0x7f2f9805dee0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f9ce7e640 4 set_mon_vals no callback set 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 10 monclient: dump: 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.659 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f98129750 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2f84011e00 con 0x7f2f9805dee0 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.649+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(499..499 src has 264..499) ==== 3979+0+0 (unknown 3749755600 0 0) 0x7f2f8404ffa0 con 0x7f2f9805dee0 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f9ee82640 10 monclient: get_auth_request con 0x7f2f68040680 auth_method 0 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701804203 0 0) 0x7f2f98129750 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient(hunting): my global_id is 94255 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f9812b800 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1928437895 0 0) 0x7f2f9812b800 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f98129750 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f90003fd0 con 0x7f2f98129380 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 10 monclient: dump: 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.660 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3120526785 0 0) 0x7f2f98129750 con 0x7f2f98129380 2026-02-17T05:37:51.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.650+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f98057cd0 con 0x7f2f98129380 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.651+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2f90006300 con 0x7f2f98129380 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.651+0000 7f2f82ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.651+0000 7f2f82ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.651+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6789/0 conn(0x7f2f98129380 legacy=0x7f2f98058d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.651+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6789/0 conn(0x7f2f98129380 legacy=0x7f2f98058d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.654+0000 7f2fa090c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.654+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f98055570 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512838258 0 0) 0x7f2f98055570 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient(hunting): my global_id is 94258 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f98129750 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1761065802 0 0) 0x7f2f98129750 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f98055570 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2f90004970 con 0x7f2f98194aa0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient: dump: 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:37:51.662 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2935618968 0 0) 0x7f2f98055570 con 0x7f2f98194aa0 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f98194ea0 con 0x7f2f98194aa0 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4670 (unknown 0 0 3263073647) 0x7f2f90005ed0 con 0x7f2f98194aa0 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6789/0 conn(0x7f2f98194aa0 legacy=0x7f2f980594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.655+0000 7f2f82ffd640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6789/0 conn(0x7f2f98194aa0 legacy=0x7f2f980594a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 36, 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 123899, 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:37:51.663 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.664 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:37:51.665 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.666 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.667 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.668 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:37:51.669 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.118:6812/703720803 conn(0x7f2f68040680 legacy=0x7f2f68060b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 10 monclient: shutdown 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 >> v1:10.20.193.106:6790/0 conn(0x7f2f9805dee0 legacy=0x7f2f98180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2f9ee82640 1 -- 10.20.193.106:0/2473068323 reap_dead start 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2f9ee82640 1 -- 10.20.193.106:0/2473068323 reap_dead start 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 shutdown_connections 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 >> 10.20.193.106:0/2473068323 conn(0x7f2f980915f0 msgr2=0x7f2f9808c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:37:51.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 shutdown_connections 2026-02-17T05:37:51.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:37:51.656+0000 7f2fa090c640 1 -- 10.20.193.106:0/2473068323 wait complete. 2026-02-17T05:37:51.671 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:37:51.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:37:52.336 INFO:tasks.rados.rados.0.trial118.stdout:2283: done (8 left) 2026-02-17T05:37:52.336 INFO:tasks.rados.rados.0.trial118.stdout:2286: done (7 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2288: done (6 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2290: done (5 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2291: done (4 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2292: done (3 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2293: done (2 left) 2026-02-17T05:37:52.337 INFO:tasks.rados.rados.0.trial118.stdout:2294: done (1 left) 2026-02-17T05:37:52.338 INFO:tasks.rados.rados.0.trial118.stdout:2295: done (0 left) 2026-02-17T05:37:52.338 INFO:tasks.rados.rados.0.trial118.stdout:2296: read oid 41 snap -1 2026-02-17T05:37:52.338 INFO:tasks.rados.rados.0.trial118.stdout:2296: expect (ObjNum 805 snap 244 seq_num 805) 2026-02-17T05:37:52.338 INFO:tasks.rados.rados.0.trial118.stdout:2297: write oid 50 current snap is 245 2026-02-17T05:37:52.338 INFO:tasks.rados.rados.0.trial118.stdout:2297: seq_num 812 ranges {447284=635606,1866555=733612,3315823=331461} 2026-02-17T05:37:52.340 INFO:tasks.rados.rados.0.trial118.stdout:2297: writing trial11845692-50 from 447284 to 1082890 tid 1 2026-02-17T05:37:52.345 INFO:tasks.rados.rados.0.trial118.stdout:2297: writing trial11845692-50 from 1866555 to 2600167 tid 2 2026-02-17T05:37:52.349 INFO:tasks.rados.rados.0.trial118.stdout:2297: writing trial11845692-50 from 3315823 to 3647284 tid 3 2026-02-17T05:37:52.350 INFO:tasks.rados.rados.0.trial118.stdout:2298: read oid 49 snap -1 2026-02-17T05:37:52.350 INFO:tasks.rados.rados.0.trial118.stdout:2298: expect (ObjNum 758 snap 224 seq_num 758) 2026-02-17T05:37:52.350 INFO:tasks.rados.rados.0.trial118.stdout:2299: snap_remove snap 232 2026-02-17T05:37:53.340 INFO:tasks.rados.rados.0.trial118.stdout:2299: done (3 left) 2026-02-17T05:37:53.340 INFO:tasks.rados.rados.0.trial118.stdout:2300: delete oid 3 current snap is 245 2026-02-17T05:37:53.340 INFO:tasks.rados.rados.0.trial118.stdout:2296: expect (ObjNum 805 snap 244 seq_num 805) 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: finishing write tid 1 to trial11845692-50 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: finishing write tid 2 to trial11845692-50 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: finishing write tid 3 to trial11845692-50 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: finishing write tid 4 to trial11845692-50 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: finishing write tid 5 to trial11845692-50 2026-02-17T05:37:53.411 INFO:tasks.rados.rados.0.trial118.stdout:2297: oid 50 updating version 0 to 1098 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:2297: oid 50 updating version 1098 to 1099 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:2297: oid 50 updating version 1099 to 1100 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:2297: oid 50 updating version 1100 to 1101 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1101 (ObjNum 812 snap 245 seq_num 812) dirty exists 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:2297: left oid 50 (ObjNum 812 snap 245 seq_num 812) 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:2298: expect (ObjNum 758 snap 224 seq_num 758) 2026-02-17T05:37:53.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2296: done (3 left) 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2297: done (2 left) 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2298: done (1 left) 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2300: done (0 left) 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2301: write (excl) oid 15 current snap is 245 2026-02-17T05:37:53.486 INFO:tasks.rados.rados.0.trial118.stdout:2301: seq_num 814 ranges {480898=502457,1699872=737281,3087022=593876} 2026-02-17T05:37:53.490 INFO:tasks.rados.rados.0.trial118.stdout:2301: writing trial11845692-15 from 480898 to 983355 tid 1 2026-02-17T05:37:53.495 INFO:tasks.rados.rados.0.trial118.stdout:2301: writing trial11845692-15 from 1699872 to 2437153 tid 2 2026-02-17T05:37:53.500 INFO:tasks.rados.rados.0.trial118.stdout:2301: writing trial11845692-15 from 3087022 to 3680898 tid 3 2026-02-17T05:37:53.500 INFO:tasks.rados.rados.0.trial118.stdout:2302: snap_create 2026-02-17T05:37:53.500 INFO:tasks.rados.rados.0.trial118.stdout:2301: finishing write tid 1 to trial11845692-15 2026-02-17T05:37:53.500 INFO:tasks.rados.rados.0.trial118.stdout:2301: finishing write tid 2 to trial11845692-15 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: finishing write tid 3 to trial11845692-15 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: finishing write tid 4 to trial11845692-15 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: finishing write tid 5 to trial11845692-15 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: oid 15 updating version 0 to 1206 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: oid 15 updating version 1206 to 1207 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: oid 15 version 1207 is already newer than 1205 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: oid 15 updating version 1207 to 1208 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1208 (ObjNum 814 snap 245 seq_num 814) dirty exists 2026-02-17T05:37:53.502 INFO:tasks.rados.rados.0.trial118.stdout:2301: left oid 15 (ObjNum 814 snap 245 seq_num 814) 2026-02-17T05:37:54.344 INFO:tasks.rados.rados.0.trial118.stdout:2301: done (1 left) 2026-02-17T05:37:54.344 INFO:tasks.rados.rados.0.trial118.stdout:2302: done (0 left) 2026-02-17T05:37:54.344 INFO:tasks.rados.rados.0.trial118.stdout:2303: snap_create 2026-02-17T05:37:55.313 INFO:tasks.rados.rados.0.trial118.stdout:2303: done (0 left) 2026-02-17T05:37:55.313 INFO:tasks.rados.rados.0.trial118.stdout:2304: write oid 1 current snap is 247 2026-02-17T05:37:55.313 INFO:tasks.rados.rados.0.trial118.stdout:2304: seq_num 815 ranges {497705=577706,1642001=480939,2598092=497514} 2026-02-17T05:37:55.317 INFO:tasks.rados.rados.0.trial118.stdout:2304: writing trial11845692-1 from 497705 to 1075411 tid 1 2026-02-17T05:37:55.321 INFO:tasks.rados.rados.0.trial118.stdout:2304: writing trial11845692-1 from 1642001 to 2122940 tid 2 2026-02-17T05:37:55.325 INFO:tasks.rados.rados.0.trial118.stdout:2304: writing trial11845692-1 from 2598092 to 3095606 tid 3 2026-02-17T05:37:55.325 INFO:tasks.rados.rados.0.trial118.stdout:2305: write (excl) oid 44 current snap is 247 2026-02-17T05:37:55.326 INFO:tasks.rados.rados.0.trial118.stdout:2305: seq_num 816 ranges {514512=652955,1700483=740950,3025515=688997} 2026-02-17T05:37:55.330 INFO:tasks.rados.rados.0.trial118.stdout:2305: writing trial11845692-44 from 514512 to 1167467 tid 1 2026-02-17T05:37:55.334 INFO:tasks.rados.rados.0.trial118.stdout:2305: writing trial11845692-44 from 1700483 to 2441433 tid 2 2026-02-17T05:37:55.339 INFO:tasks.rados.rados.0.trial118.stdout:2305: writing trial11845692-44 from 3025515 to 3714512 tid 3 2026-02-17T05:37:55.339 INFO:tasks.rados.rados.0.trial118.stdout:2306: delete oid 29 current snap is 247 2026-02-17T05:37:55.339 INFO:tasks.rados.rados.0.trial118.stdout:2304: finishing write tid 1 to trial11845692-1 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: finishing write tid 2 to trial11845692-1 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: finishing write tid 3 to trial11845692-1 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: finishing write tid 4 to trial11845692-1 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: finishing write tid 5 to trial11845692-1 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: oid 1 updating version 0 to 1297 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: oid 1 version 1297 is already newer than 1294 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: oid 1 version 1297 is already newer than 1296 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: oid 1 version 1297 is already newer than 1295 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1297 (ObjNum 815 snap 247 seq_num 815) dirty exists 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2304: left oid 1 (ObjNum 815 snap 247 seq_num 815) 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2305: finishing write tid 1 to trial11845692-44 2026-02-17T05:37:55.340 INFO:tasks.rados.rados.0.trial118.stdout:2305: finishing write tid 2 to trial11845692-44 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: finishing write tid 3 to trial11845692-44 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: finishing write tid 4 to trial11845692-44 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: finishing write tid 5 to trial11845692-44 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: oid 44 updating version 0 to 1202 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: oid 44 version 1202 is already newer than 1199 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: oid 44 version 1202 is already newer than 1201 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: oid 44 version 1202 is already newer than 1200 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1202 (ObjNum 816 snap 247 seq_num 816) dirty exists 2026-02-17T05:37:55.341 INFO:tasks.rados.rados.0.trial118.stdout:2305: left oid 44 (ObjNum 816 snap 247 seq_num 816) 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2304: done (2 left) 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2305: done (1 left) 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2306: done (0 left) 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2307: read oid 6 snap -1 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2307: expect (ObjNum 651 snap 191 seq_num 651) 2026-02-17T05:37:55.342 INFO:tasks.rados.rados.0.trial118.stdout:2308: snap_create 2026-02-17T05:37:55.344 INFO:tasks.rados.rados.0.trial118.stdout:2307: expect (ObjNum 651 snap 191 seq_num 651) 2026-02-17T05:37:56.346 INFO:tasks.rados.rados.0.trial118.stdout:2307: done (1 left) 2026-02-17T05:37:56.346 INFO:tasks.rados.rados.0.trial118.stdout:2308: done (0 left) 2026-02-17T05:37:56.347 INFO:tasks.rados.rados.0.trial118.stdout:2309: snap_create 2026-02-17T05:37:57.347 INFO:tasks.rados.rados.0.trial118.stdout:2309: done (0 left) 2026-02-17T05:37:57.347 INFO:tasks.rados.rados.0.trial118.stdout:2310: write (excl) oid 27 current snap is 249 2026-02-17T05:37:57.348 INFO:tasks.rados.rados.0.trial118.stdout:2310: seq_num 818 ranges {548126=403453,1417447=744619,2680361=447683,3680450=67676} 2026-02-17T05:37:57.351 INFO:tasks.rados.rados.0.trial118.stdout:2310: writing trial11845692-27 from 548126 to 951579 tid 1 2026-02-17T05:37:57.356 INFO:tasks.rados.rados.0.trial118.stdout:2310: writing trial11845692-27 from 1417447 to 2162066 tid 2 2026-02-17T05:37:57.359 INFO:tasks.rados.rados.0.trial118.stdout:2310: writing trial11845692-27 from 2680361 to 3128044 tid 3 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2310: writing trial11845692-27 from 3680450 to 3748126 tid 4 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2311: write (excl) oid 20 current snap is 249 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 1 to trial11845692-27 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 2 to trial11845692-27 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 3 to trial11845692-27 2026-02-17T05:37:57.362 INFO:tasks.rados.rados.0.trial118.stdout:2311: seq_num 819 ranges {564933=478702,1759576=488277,2991431=658955} 2026-02-17T05:37:57.365 INFO:tasks.rados.rados.0.trial118.stdout:2311: writing trial11845692-20 from 564933 to 1043635 tid 1 2026-02-17T05:37:57.370 INFO:tasks.rados.rados.0.trial118.stdout:2311: writing trial11845692-20 from 1759576 to 2247853 tid 2 2026-02-17T05:37:57.376 INFO:tasks.rados.rados.0.trial118.stdout:2311: writing trial11845692-20 from 2991431 to 3650386 tid 3 2026-02-17T05:37:57.376 INFO:tasks.rados.rados.0.trial118.stdout:2312: rollback oid 34 current snap is 249 2026-02-17T05:37:57.376 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 247 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 4 to trial11845692-27 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 5 to trial11845692-27 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: finishing write tid 6 to trial11845692-27 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: oid 27 updating version 0 to 1372 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: oid 27 version 1372 is already newer than 1371 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: oid 27 updating version 1372 to 1374 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: oid 27 version 1374 is already newer than 1373 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: oid 27 version 1374 is already newer than 1370 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1374 (ObjNum 818 snap 249 seq_num 818) dirty exists 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: left oid 27 (ObjNum 818 snap 249 seq_num 818) 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2311: finishing write tid 1 to trial11845692-20 2026-02-17T05:37:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2310: done (2 left) 2026-02-17T05:37:57.378 INFO:tasks.rados.rados.0.trial118.stdout:2313: copy_from oid 2 from oid 18 current snap is 249 2026-02-17T05:37:57.378 INFO:tasks.rados.rados.0.trial118.stdout:2311: finishing write tid 2 to trial11845692-20 2026-02-17T05:37:57.378 INFO:tasks.rados.rados.0.trial118.stdout:2314: read oid 24 snap -1 2026-02-17T05:37:57.378 INFO:tasks.rados.rados.0.trial118.stdout:2314: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:37:57.378 INFO:tasks.rados.rados.0.trial118.stdout:2315: snap_create 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: finishing write tid 3 to trial11845692-20 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: finishing write tid 4 to trial11845692-20 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: finishing write tid 5 to trial11845692-20 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: oid 20 updating version 0 to 1376 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: oid 20 version 1376 is already newer than 1375 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: oid 20 updating version 1376 to 1377 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: oid 20 updating version 1377 to 1378 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1378 (ObjNum 819 snap 249 seq_num 819) dirty exists 2026-02-17T05:37:57.379 INFO:tasks.rados.rados.0.trial118.stdout:2311: left oid 20 (ObjNum 819 snap 249 seq_num 819) 2026-02-17T05:37:57.380 INFO:tasks.rados.rados.0.trial118.stdout:2312: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:37:57.380 INFO:tasks.rados.rados.0.trial118.stdout:2312: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:37:57.380 INFO:tasks.rados.rados.0.trial118.stdout:2312: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:37:57.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 746 (ObjNum 782 snap 229 seq_num 782) dirty exists 2026-02-17T05:37:57.385 INFO:tasks.rados.rados.0.trial118.stdout:2314: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:37:57.385 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:57.481 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1836009 2026-02-17T05:37:57.493 INFO:tasks.rados.rados.0.trial118.stdout:2313: finishing copy_from racing read to trial11845692-2 2026-02-17T05:37:57.494 INFO:tasks.rados.rados.0.trial118.stdout:2313: finishing copy_from to trial11845692-2 2026-02-17T05:37:57.494 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 737 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2311: done (4 left) 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2312: done (3 left) 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2313: done (2 left) 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2314: done (1 left) 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2315: done (0 left) 2026-02-17T05:37:58.354 INFO:tasks.rados.rados.0.trial118.stdout:2316: read oid 46 snap -1 2026-02-17T05:37:58.355 INFO:tasks.rados.rados.0.trial118.stdout:2316: expect (ObjNum 808 snap 244 seq_num 808) 2026-02-17T05:37:58.355 INFO:tasks.rados.rados.0.trial118.stdout:2317: write (excl) oid 2 current snap is 250 2026-02-17T05:37:58.355 INFO:tasks.rados.rados.0.trial118.stdout:2317: seq_num 820 ranges {581740=553951,1818058=748288,3018854=470227} 2026-02-17T05:37:58.358 INFO:tasks.rados.rados.0.trial118.stdout:2317: writing trial11845692-2 from 581740 to 1135691 tid 1 2026-02-17T05:37:58.363 INFO:tasks.rados.rados.0.trial118.stdout:2317: writing trial11845692-2 from 1818058 to 2566346 tid 2 2026-02-17T05:37:58.367 INFO:tasks.rados.rados.0.trial118.stdout:2317: writing trial11845692-2 from 3018854 to 3489081 tid 3 2026-02-17T05:37:58.367 INFO:tasks.rados.rados.0.trial118.stdout:2318: delete oid 42 current snap is 250 2026-02-17T05:37:58.367 INFO:tasks.rados.rados.0.trial118.stdout:2316: expect (ObjNum 808 snap 244 seq_num 808) 2026-02-17T05:37:58.431 INFO:tasks.rados.rados.0.trial118.stdout:2317: finishing write tid 1 to trial11845692-2 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2317: finishing write tid 2 to trial11845692-2 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2316: done (2 left) 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2318: done (1 left) 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2319: read oid 44 snap -1 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2319: expect (ObjNum 816 snap 247 seq_num 816) 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2320: read oid 10 snap -1 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2320: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2321: delete oid 30 current snap is 250 2026-02-17T05:37:58.432 INFO:tasks.rados.rados.0.trial118.stdout:2317: finishing write tid 3 to trial11845692-2 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: finishing write tid 4 to trial11845692-2 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: finishing write tid 5 to trial11845692-2 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: oid 2 updating version 0 to 1385 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: oid 2 version 1385 is already newer than 1383 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: oid 2 version 1385 is already newer than 1382 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: oid 2 version 1385 is already newer than 1384 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1385 (ObjNum 820 snap 250 seq_num 820) dirty exists 2026-02-17T05:37:58.433 INFO:tasks.rados.rados.0.trial118.stdout:2317: left oid 2 (ObjNum 820 snap 250 seq_num 820) 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:2317: done (3 left) 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:2321: done (2 left) 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:2322: rollback oid 49 current snap is 250 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 242 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:2323: write oid 17 current snap is 250 2026-02-17T05:37:58.434 INFO:tasks.rados.rados.0.trial118.stdout:2323: seq_num 823 ranges {632161=496051,1593504=495615,2701123=420396,3611645=220516} 2026-02-17T05:37:58.437 INFO:tasks.rados.rados.0.trial118.stdout:2323: writing trial11845692-17 from 632161 to 1128212 tid 1 2026-02-17T05:37:58.440 INFO:tasks.rados.rados.0.trial118.stdout:2323: writing trial11845692-17 from 1593504 to 2089119 tid 2 2026-02-17T05:37:58.444 INFO:tasks.rados.rados.0.trial118.stdout:2323: writing trial11845692-17 from 2701123 to 3121519 tid 3 2026-02-17T05:37:58.447 INFO:tasks.rados.rados.0.trial118.stdout:2323: writing trial11845692-17 from 3611645 to 3832161 tid 4 2026-02-17T05:37:58.447 INFO:tasks.rados.rados.0.trial118.stdout:2324: delete oid 46 current snap is 250 2026-02-17T05:37:58.447 INFO:tasks.rados.rados.0.trial118.stdout:2320: expect (ObjNum 757 snap 224 seq_num 757) 2026-02-17T05:37:58.485 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:58.562 INFO:tasks.rados.rados.0.trial118.stdout:2322: finishing rollback tid 0 to trial11845692-49 2026-02-17T05:37:58.562 INFO:tasks.rados.rados.0.trial118.stdout:2322: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:37:58.562 INFO:tasks.rados.rados.0.trial118.stdout:2322: finishing rollback tid 2 to trial11845692-49 2026-02-17T05:37:58.563 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1182 (ObjNum 758 snap 224 seq_num 758) dirty exists 2026-02-17T05:37:58.563 INFO:tasks.rados.rados.0.trial118.stdout:2319: expect (ObjNum 816 snap 247 seq_num 816) 2026-02-17T05:37:58.678 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2770098 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 1 to trial11845692-17 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 2 to trial11845692-17 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 3 to trial11845692-17 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 4 to trial11845692-17 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2319: done (4 left) 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2320: done (3 left) 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2322: done (2 left) 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2324: done (1 left) 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2325: write (excl) oid 39 current snap is 250 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 5 to trial11845692-17 2026-02-17T05:37:58.688 INFO:tasks.rados.rados.0.trial118.stdout:2325: seq_num 825 ranges {665775=646549,2110468=499284,3155969=442940} 2026-02-17T05:37:58.693 INFO:tasks.rados.rados.0.trial118.stdout:2325: writing trial11845692-39 from 665775 to 1312324 tid 1 2026-02-17T05:37:58.698 INFO:tasks.rados.rados.0.trial118.stdout:2325: writing trial11845692-39 from 2110468 to 2609752 tid 2 2026-02-17T05:37:58.702 INFO:tasks.rados.rados.0.trial118.stdout:2325: writing trial11845692-39 from 3155969 to 3598909 tid 3 2026-02-17T05:37:58.702 INFO:tasks.rados.rados.0.trial118.stdout:2326: write (excl) oid 13 current snap is 250 2026-02-17T05:37:58.702 INFO:tasks.rados.rados.0.trial118.stdout:2326: seq_num 826 ranges {682582=721798,2168950=642942,3583392=299190} 2026-02-17T05:37:58.707 INFO:tasks.rados.rados.0.trial118.stdout:2326: writing trial11845692-13 from 682582 to 1404380 tid 1 2026-02-17T05:37:58.712 INFO:tasks.rados.rados.0.trial118.stdout:2326: writing trial11845692-13 from 2168950 to 2811892 tid 2 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2326: writing trial11845692-13 from 3583392 to 3882582 tid 3 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2327: write oid 3 current snap is 250 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2323: finishing write tid 6 to trial11845692-17 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2323: oid 17 updating version 0 to 1023 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2323: oid 17 updating version 1023 to 1025 2026-02-17T05:37:58.716 INFO:tasks.rados.rados.0.trial118.stdout:2323: oid 17 version 1025 is already newer than 1022 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2323: oid 17 version 1025 is already newer than 1021 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2323: oid 17 version 1025 is already newer than 1024 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1025 (ObjNum 823 snap 250 seq_num 823) dirty exists 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2323: left oid 17 (ObjNum 823 snap 250 seq_num 823) 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: finishing write tid 1 to trial11845692-39 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: finishing write tid 2 to trial11845692-39 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: finishing write tid 3 to trial11845692-39 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: finishing write tid 4 to trial11845692-39 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: finishing write tid 5 to trial11845692-39 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: oid 39 updating version 0 to 1204 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: oid 39 version 1204 is already newer than 1202 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: oid 39 version 1204 is already newer than 1203 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: oid 39 updating version 1204 to 1205 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1205 (ObjNum 825 snap 250 seq_num 825) dirty exists 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2325: left oid 39 (ObjNum 825 snap 250 seq_num 825) 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2326: finishing write tid 1 to trial11845692-13 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2326: finishing write tid 2 to trial11845692-13 2026-02-17T05:37:58.717 INFO:tasks.rados.rados.0.trial118.stdout:2327: seq_num 827 ranges {699389=797047,2111079=502953,3094462=581837} 2026-02-17T05:37:58.722 INFO:tasks.rados.rados.0.trial118.stdout:2327: writing trial11845692-3 from 699389 to 1496436 tid 1 2026-02-17T05:37:58.726 INFO:tasks.rados.rados.0.trial118.stdout:2327: writing trial11845692-3 from 2111079 to 2614032 tid 2 2026-02-17T05:37:58.730 INFO:tasks.rados.rados.0.trial118.stdout:2327: writing trial11845692-3 from 3094462 to 3676299 tid 3 2026-02-17T05:37:58.730 INFO:tasks.rados.rados.0.trial118.stdout:2323: done (3 left) 2026-02-17T05:37:58.730 INFO:tasks.rados.rados.0.trial118.stdout:2325: done (2 left) 2026-02-17T05:37:58.730 INFO:tasks.rados.rados.0.trial118.stdout:2328: write oid 7 current snap is 250 2026-02-17T05:37:58.730 INFO:tasks.rados.rados.0.trial118.stdout:2328: seq_num 828 ranges {716196=472296,1769561=646611,3121885=793109} 2026-02-17T05:37:58.734 INFO:tasks.rados.rados.0.trial118.stdout:2328: writing trial11845692-7 from 716196 to 1188492 tid 1 2026-02-17T05:37:58.739 INFO:tasks.rados.rados.0.trial118.stdout:2328: writing trial11845692-7 from 1769561 to 2416172 tid 2 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2328: writing trial11845692-7 from 3121885 to 3914994 tid 3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2329: rollback oid 35 current snap is 250 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 238 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: finishing write tid 3 to trial11845692-13 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: finishing write tid 4 to trial11845692-13 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: finishing write tid 5 to trial11845692-13 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: oid 13 updating version 0 to 1090 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: oid 13 updating version 1090 to 1093 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: oid 13 version 1093 is already newer than 1091 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: oid 13 version 1093 is already newer than 1092 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1093 (ObjNum 826 snap 250 seq_num 826) dirty exists 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: left oid 13 (ObjNum 826 snap 250 seq_num 826) 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: finishing write tid 1 to trial11845692-3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: finishing write tid 2 to trial11845692-3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: finishing write tid 3 to trial11845692-3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: finishing write tid 4 to trial11845692-3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: finishing write tid 5 to trial11845692-3 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: oid 3 updating version 0 to 1096 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: oid 3 version 1096 is already newer than 1095 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: oid 3 version 1096 is already newer than 1094 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: oid 3 updating version 1096 to 1097 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1097 (ObjNum 827 snap 250 seq_num 827) dirty exists 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: left oid 3 (ObjNum 827 snap 250 seq_num 827) 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2328: finishing write tid 1 to trial11845692-7 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2328: finishing write tid 2 to trial11845692-7 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2326: done (3 left) 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2327: done (2 left) 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2330: write oid 10 current snap is 250 2026-02-17T05:37:58.745 INFO:tasks.rados.rados.0.trial118.stdout:2330: seq_num 829 ranges {733003=663898,1944396=506622,2865661=604381} 2026-02-17T05:37:58.750 INFO:tasks.rados.rados.0.trial118.stdout:2330: writing trial11845692-10 from 733003 to 1396901 tid 1 2026-02-17T05:37:58.753 INFO:tasks.rados.rados.0.trial118.stdout:2330: writing trial11845692-10 from 1944396 to 2451018 tid 2 2026-02-17T05:37:58.757 INFO:tasks.rados.rados.0.trial118.stdout:2330: writing trial11845692-10 from 2865661 to 3470042 tid 3 2026-02-17T05:37:58.757 INFO:tasks.rados.rados.0.trial118.stdout:2331: copy_from oid 1 from oid 25 current snap is 250 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: finishing write tid 3 to trial11845692-7 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2332: delete oid 30 current snap is 250 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: finishing write tid 4 to trial11845692-7 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2329: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: finishing write tid 5 to trial11845692-7 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: oid 7 updating version 0 to 1271 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: oid 7 updating version 1271 to 1272 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: oid 7 updating version 1272 to 1273 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: oid 7 version 1273 is already newer than 1270 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1273 (ObjNum 828 snap 250 seq_num 828) dirty exists 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2328: left oid 7 (ObjNum 828 snap 250 seq_num 828) 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2329: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2329: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1205 (ObjNum 789 snap 232 seq_num 789) dirty exists 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2330: finishing write tid 1 to trial11845692-10 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2330: finishing write tid 2 to trial11845692-10 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2331: finishing copy_from to trial11845692-1 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2331: got expected ENOENT (src dne) 2026-02-17T05:37:58.758 INFO:tasks.rados.rados.0.trial118.stdout:2331: finishing copy_from racing read to trial11845692-1 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2328: done (4 left) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2329: done (3 left) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2331: done (2 left) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2332: done (1 left) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2333: copy_from oid 6 from oid 4 current snap is 250 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2334: copy_from oid 15 from oid 44 current snap is 250 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2335: read oid 34 snap 239 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2335: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2336: read oid 11 snap -1 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2336: expect deleted 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2337: read oid 26 snap -1 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2337: expect (ObjNum 804 snap 244 seq_num 804) 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2338: write oid 3 current snap is 250 2026-02-17T05:37:58.759 INFO:tasks.rados.rados.0.trial118.stdout:2338: seq_num 831 ranges {766617=414396,1945007=510291,3204154=626925} 2026-02-17T05:37:58.763 INFO:tasks.rados.rados.0.trial118.stdout:2338: writing trial11845692-3 from 766617 to 1181013 tid 1 2026-02-17T05:37:58.768 INFO:tasks.rados.rados.0.trial118.stdout:2338: writing trial11845692-3 from 1945007 to 2455298 tid 2 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2338: writing trial11845692-3 from 3204154 to 3831079 tid 3 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2339: copy_from oid 30 from oid 23 current snap is 250 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: finishing write tid 3 to trial11845692-10 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2340: snap_create 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: finishing write tid 4 to trial11845692-10 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: finishing write tid 5 to trial11845692-10 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: oid 10 updating version 0 to 1184 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: oid 10 updating version 1184 to 1186 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: oid 10 version 1186 is already newer than 1185 2026-02-17T05:37:58.774 INFO:tasks.rados.rados.0.trial118.stdout:2330: oid 10 version 1186 is already newer than 1183 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1186 (ObjNum 829 snap 250 seq_num 829) dirty exists 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:2330: left oid 10 (ObjNum 829 snap 250 seq_num 829) 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:2333: finishing copy_from racing read to trial11845692-6 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:2338: finishing write tid 1 to trial11845692-3 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:2333: finishing copy_from to trial11845692-6 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1256 (ObjNum 796 snap 240 seq_num 796) dirty exists 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:2335: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:37:58.775 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:37:58.916 INFO:tasks.rados.rados.0.trial118.stdout:2334: finishing copy_from racing read to trial11845692-15 2026-02-17T05:37:58.916 INFO:tasks.rados.rados.0.trial118.stdout:2337: expect (ObjNum 804 snap 244 seq_num 804) 2026-02-17T05:37:58.979 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2238874 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2334: finishing copy_from to trial11845692-15 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1202 (ObjNum 816 snap 247 seq_num 816) dirty exists 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: finishing write tid 2 to trial11845692-3 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: finishing write tid 3 to trial11845692-3 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: finishing write tid 4 to trial11845692-3 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: finishing write tid 5 to trial11845692-3 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: oid 3 updating version 0 to 1098 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: oid 3 updating version 1098 to 1101 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: oid 3 version 1101 is already newer than 1100 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: oid 3 version 1101 is already newer than 1099 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1101 (ObjNum 831 snap 250 seq_num 831) dirty exists 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2338: left oid 3 (ObjNum 831 snap 250 seq_num 831) 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2339: finishing copy_from racing read to trial11845692-30 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:2339: finishing copy_from to trial11845692-30 2026-02-17T05:37:59.048 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:59.357 INFO:tasks.rados.rados.0.trial118.stdout:2330: done (8 left) 2026-02-17T05:37:59.357 INFO:tasks.rados.rados.0.trial118.stdout:2333: done (7 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2334: done (6 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2335: done (5 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2336: done (4 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2337: done (3 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2338: done (2 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2339: done (1 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2340: done (0 left) 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2341: read oid 47 snap 243 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2341: expect deleted 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2342: copy_from oid 49 from oid 30 current snap is 251 2026-02-17T05:37:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2343: delete oid 10 current snap is 251 2026-02-17T05:37:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2341: done (2 left) 2026-02-17T05:37:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2343: done (1 left) 2026-02-17T05:37:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2344: write (excl) oid 14 current snap is 251 2026-02-17T05:37:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2344: seq_num 833 ranges {400231=564894,1661971=338260} 2026-02-17T05:37:59.363 INFO:tasks.rados.rados.0.trial118.stdout:2344: writing trial11845692-14 from 400231 to 965125 tid 1 2026-02-17T05:37:59.368 INFO:tasks.rados.rados.0.trial118.stdout:2344: writing trial11845692-14 from 1661971 to 2000231 tid 2 2026-02-17T05:37:59.369 INFO:tasks.rados.rados.0.trial118.stdout:2345: copy_from oid 21 from oid 7 current snap is 251 2026-02-17T05:37:59.369 INFO:tasks.rados.rados.0.trial118.stdout:2342: finishing copy_from racing read to trial11845692-49 2026-02-17T05:37:59.369 INFO:tasks.rados.rados.0.trial118.stdout:2344: finishing write tid 1 to trial11845692-14 2026-02-17T05:37:59.369 INFO:tasks.rados.rados.0.trial118.stdout:2342: finishing copy_from to trial11845692-49 2026-02-17T05:37:59.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:37:59.370 INFO:tasks.rados.rados.0.trial118.stdout:2342: done (2 left) 2026-02-17T05:37:59.370 INFO:tasks.rados.rados.0.trial118.stdout:2346: rollback oid 4 current snap is 251 2026-02-17T05:37:59.370 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 249 2026-02-17T05:37:59.370 INFO:tasks.rados.rados.0.trial118.stdout:2347: snap_create 2026-02-17T05:37:59.372 INFO:tasks.rados.rados.0.trial118.stdout:2344: finishing write tid 2 to trial11845692-14 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:2344: finishing write tid 3 to trial11845692-14 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:2344: finishing write tid 4 to trial11845692-14 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:2344: oid 14 updating version 0 to 1201 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:2344: oid 14 version 1201 is already newer than 1199 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:2344: oid 14 version 1201 is already newer than 1200 2026-02-17T05:37:59.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1201 (ObjNum 833 snap 251 seq_num 833) dirty exists 2026-02-17T05:37:59.374 INFO:tasks.rados.rados.0.trial118.stdout:2344: left oid 14 (ObjNum 833 snap 251 seq_num 833) 2026-02-17T05:37:59.374 INFO:tasks.rados.rados.0.trial118.stdout:2346: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:37:59.374 INFO:tasks.rados.rados.0.trial118.stdout:2346: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:37:59.374 INFO:tasks.rados.rados.0.trial118.stdout:2346: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:37:59.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1276 (ObjNum 796 snap 240 seq_num 796) dirty exists 2026-02-17T05:37:59.379 INFO:tasks.rados.rados.0.trial118.stdout:2345: finishing copy_from racing read to trial11845692-21 2026-02-17T05:37:59.380 INFO:tasks.rados.rados.0.trial118.stdout:2345: finishing copy_from to trial11845692-21 2026-02-17T05:37:59.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1273 (ObjNum 828 snap 250 seq_num 828) dirty exists 2026-02-17T05:38:00.358 INFO:tasks.rados.rados.0.trial118.stdout:2344: done (3 left) 2026-02-17T05:38:00.358 INFO:tasks.rados.rados.0.trial118.stdout:2345: done (2 left) 2026-02-17T05:38:00.358 INFO:tasks.rados.rados.0.trial118.stdout:2346: done (1 left) 2026-02-17T05:38:00.359 INFO:tasks.rados.rados.0.trial118.stdout:2347: done (0 left) 2026-02-17T05:38:00.359 INFO:tasks.rados.rados.0.trial118.stdout:2348: snap_create 2026-02-17T05:38:01.360 INFO:tasks.rados.rados.0.trial118.stdout:2348: done (0 left) 2026-02-17T05:38:01.360 INFO:tasks.rados.rados.0.trial118.stdout:2349: delete oid 19 current snap is 253 2026-02-17T05:38:01.364 INFO:tasks.rados.rados.0.trial118.stdout:2349: done (0 left) 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2350: copy_from oid 4 from oid 20 current snap is 253 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2351: read oid 30 snap 247 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2351: expect deleted 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2352: delete oid 37 current snap is 253 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2351: done (2 left) 2026-02-17T05:38:01.365 INFO:tasks.rados.rados.0.trial118.stdout:2352: done (1 left) 2026-02-17T05:38:01.366 INFO:tasks.rados.rados.0.trial118.stdout:2353: snap_remove snap 242 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2353: done (1 left) 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2354: rollback oid 12 current snap is 253 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 250 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2350: finishing copy_from racing read to trial11845692-4 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2350: finishing copy_from to trial11845692-4 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1378 (ObjNum 819 snap 249 seq_num 819) dirty exists 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2350: done (1 left) 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2355: copy_from oid 49 from oid 19 current snap is 253 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2356: read oid 24 snap -1 2026-02-17T05:38:02.364 INFO:tasks.rados.rados.0.trial118.stdout:2356: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:02.365 INFO:tasks.rados.rados.0.trial118.stdout:2357: copy_from oid 31 from oid 4 current snap is 253 2026-02-17T05:38:02.365 INFO:tasks.rados.rados.0.trial118.stdout:2358: write (excl) oid 45 current snap is 253 2026-02-17T05:38:02.365 INFO:tasks.rados.rados.0.trial118.stdout:2358: seq_num 836 ranges {450652=790641,1721064=329588} 2026-02-17T05:38:02.368 INFO:tasks.rados.rados.0.trial118.stdout:2358: writing trial11845692-45 from 450652 to 1241293 tid 1 2026-02-17T05:38:02.371 INFO:tasks.rados.rados.0.trial118.stdout:2358: writing trial11845692-45 from 1721064 to 2050652 tid 2 2026-02-17T05:38:02.371 INFO:tasks.rados.rados.0.trial118.stdout:2359: snap_remove snap 229 2026-02-17T05:38:03.368 INFO:tasks.rados.rados.0.trial118.stdout:2359: done (5 left) 2026-02-17T05:38:03.368 INFO:tasks.rados.rados.0.trial118.stdout:2360: write (excl) oid 14 current snap is 253 2026-02-17T05:38:03.368 INFO:tasks.rados.rados.0.trial118.stdout:2355: finishing copy_from to trial11845692-49 2026-02-17T05:38:03.368 INFO:tasks.rados.rados.0.trial118.stdout:2355: got expected ENOENT (src dne) 2026-02-17T05:38:03.368 INFO:tasks.rados.rados.0.trial118.stdout:2360: seq_num 837 ranges {467459=582243,1495899=404945} 2026-02-17T05:38:03.371 INFO:tasks.rados.rados.0.trial118.stdout:2360: writing trial11845692-14 from 467459 to 1049702 tid 1 2026-02-17T05:38:03.375 INFO:tasks.rados.rados.0.trial118.stdout:2360: writing trial11845692-14 from 1495899 to 1900844 tid 2 2026-02-17T05:38:03.375 INFO:tasks.rados.rados.0.trial118.stdout:2361: snap_remove snap 246 2026-02-17T05:38:04.371 INFO:tasks.rados.rados.0.trial118.stdout:2361: done (6 left) 2026-02-17T05:38:04.371 INFO:tasks.rados.rados.0.trial118.stdout:2362: delete oid 2 current snap is 253 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:2355: finishing copy_from racing read to trial11845692-49 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:2354: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:2354: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:2354: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1104 (ObjNum 774 snap 227 seq_num 774) dirty exists 2026-02-17T05:38:04.372 INFO:tasks.rados.rados.0.trial118.stdout:2356: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:04.413 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 794983 2026-02-17T05:38:04.447 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:04.487 INFO:tasks.rados.rados.0.trial118.stdout:2358: finishing write tid 1 to trial11845692-45 2026-02-17T05:38:04.487 INFO:tasks.rados.rados.0.trial118.stdout:2358: finishing write tid 2 to trial11845692-45 2026-02-17T05:38:04.487 INFO:tasks.rados.rados.0.trial118.stdout:2358: finishing write tid 3 to trial11845692-45 2026-02-17T05:38:04.487 INFO:tasks.rados.rados.0.trial118.stdout:2358: finishing write tid 4 to trial11845692-45 2026-02-17T05:38:04.487 INFO:tasks.rados.rados.0.trial118.stdout:2358: oid 45 updating version 0 to 1209 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:2358: oid 45 updating version 1209 to 1211 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:2358: oid 45 version 1211 is already newer than 1210 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1211 (ObjNum 836 snap 253 seq_num 836) dirty exists 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:2358: left oid 45 (ObjNum 836 snap 253 seq_num 836) 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:2357: finishing copy_from racing read to trial11845692-31 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:2357: finishing copy_from to trial11845692-31 2026-02-17T05:38:04.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1378 (ObjNum 819 snap 249 seq_num 819) dirty exists 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: finishing write tid 1 to trial11845692-14 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: finishing write tid 2 to trial11845692-14 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: finishing write tid 3 to trial11845692-14 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: finishing write tid 4 to trial11845692-14 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: oid 14 updating version 0 to 1203 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: oid 14 version 1203 is already newer than 1202 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: oid 14 updating version 1203 to 1204 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1204 (ObjNum 837 snap 253 seq_num 837) dirty exists 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2360: left oid 14 (ObjNum 837 snap 253 seq_num 837) 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2354: done (6 left) 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2355: done (5 left) 2026-02-17T05:38:04.489 INFO:tasks.rados.rados.0.trial118.stdout:2356: done (4 left) 2026-02-17T05:38:04.490 INFO:tasks.rados.rados.0.trial118.stdout:2357: done (3 left) 2026-02-17T05:38:04.490 INFO:tasks.rados.rados.0.trial118.stdout:2358: done (2 left) 2026-02-17T05:38:04.490 INFO:tasks.rados.rados.0.trial118.stdout:2360: done (1 left) 2026-02-17T05:38:04.490 INFO:tasks.rados.rados.0.trial118.stdout:2362: done (0 left) 2026-02-17T05:38:04.490 INFO:tasks.rados.rados.0.trial118.stdout:2363: snap_create 2026-02-17T05:38:05.315 INFO:tasks.rados.rados.0.trial118.stdout:2363: done (0 left) 2026-02-17T05:38:05.315 INFO:tasks.rados.rados.0.trial118.stdout:2364: read oid 28 snap -1 2026-02-17T05:38:05.315 INFO:tasks.rados.rados.0.trial118.stdout:2364: expect deleted 2026-02-17T05:38:05.315 INFO:tasks.rados.rados.0.trial118.stdout:2365: write oid 20 current snap is 254 2026-02-17T05:38:05.315 INFO:tasks.rados.rados.0.trial118.stdout:2365: seq_num 839 ranges {501073=732741,1896510=204563} 2026-02-17T05:38:05.319 INFO:tasks.rados.rados.0.trial118.stdout:2365: writing trial11845692-20 from 501073 to 1233814 tid 1 2026-02-17T05:38:05.323 INFO:tasks.rados.rados.0.trial118.stdout:2365: writing trial11845692-20 from 1896510 to 2101073 tid 2 2026-02-17T05:38:05.323 INFO:tasks.rados.rados.0.trial118.stdout:2366: read oid 37 snap 236 2026-02-17T05:38:05.323 INFO:tasks.rados.rados.0.trial118.stdout:2366: expect deleted 2026-02-17T05:38:05.323 INFO:tasks.rados.rados.0.trial118.stdout:2367: snap_remove snap 224 2026-02-17T05:38:06.315 INFO:tasks.rados.rados.0.trial118.stdout:2367: done (3 left) 2026-02-17T05:38:06.315 INFO:tasks.rados.rados.0.trial118.stdout:2368: write oid 5 current snap is 254 2026-02-17T05:38:06.315 INFO:tasks.rados.rados.0.trial118.stdout:2368: seq_num 840 ranges {517880=407990,1554992=562888} 2026-02-17T05:38:06.319 INFO:tasks.rados.rados.0.trial118.stdout:2368: writing trial11845692-5 from 517880 to 925870 tid 1 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2368: writing trial11845692-5 from 1554992 to 2117880 tid 2 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2369: delete oid 15 current snap is 254 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: finishing write tid 1 to trial11845692-20 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: finishing write tid 2 to trial11845692-20 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: finishing write tid 3 to trial11845692-20 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: finishing write tid 4 to trial11845692-20 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: oid 20 updating version 0 to 1419 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: oid 20 version 1419 is already newer than 1417 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: oid 20 version 1419 is already newer than 1418 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1419 (ObjNum 839 snap 254 seq_num 839) dirty exists 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2365: left oid 20 (ObjNum 839 snap 254 seq_num 839) 2026-02-17T05:38:06.324 INFO:tasks.rados.rados.0.trial118.stdout:2368: finishing write tid 1 to trial11845692-5 2026-02-17T05:38:06.325 INFO:tasks.rados.rados.0.trial118.stdout:2368: finishing write tid 2 to trial11845692-5 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: finishing write tid 3 to trial11845692-5 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2364: done (4 left) 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2365: done (3 left) 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2366: done (2 left) 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2369: done (1 left) 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2370: snap_create 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: finishing write tid 4 to trial11845692-5 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: oid 5 updating version 0 to 1205 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: oid 5 updating version 1205 to 1207 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: oid 5 version 1207 is already newer than 1206 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1207 (ObjNum 840 snap 254 seq_num 840) dirty exists 2026-02-17T05:38:06.326 INFO:tasks.rados.rados.0.trial118.stdout:2368: left oid 5 (ObjNum 840 snap 254 seq_num 840) 2026-02-17T05:38:07.317 INFO:tasks.rados.rados.0.trial118.stdout:2368: done (1 left) 2026-02-17T05:38:07.317 INFO:tasks.rados.rados.0.trial118.stdout:2370: done (0 left) 2026-02-17T05:38:07.318 INFO:tasks.rados.rados.0.trial118.stdout:2371: snap_remove snap 243 2026-02-17T05:38:08.320 INFO:tasks.rados.rados.0.trial118.stdout:2371: done (0 left) 2026-02-17T05:38:08.320 INFO:tasks.rados.rados.0.trial118.stdout:2372: write oid 33 current snap is 255 2026-02-17T05:38:08.321 INFO:tasks.rados.rados.0.trial118.stdout:2372: seq_num 842 ranges {551494=558488,1671956=479538} 2026-02-17T05:38:08.325 INFO:tasks.rados.rados.0.trial118.stdout:2372: writing trial11845692-33 from 551494 to 1109982 tid 1 2026-02-17T05:38:08.329 INFO:tasks.rados.rados.0.trial118.stdout:2372: writing trial11845692-33 from 1671956 to 2151494 tid 2 2026-02-17T05:38:08.329 INFO:tasks.rados.rados.0.trial118.stdout:2373: rollback oid 21 current snap is 255 2026-02-17T05:38:08.329 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 233 2026-02-17T05:38:08.329 INFO:tasks.rados.rados.0.trial118.stdout:2372: finishing write tid 1 to trial11845692-33 2026-02-17T05:38:08.330 INFO:tasks.rados.rados.0.trial118.stdout:2374: read oid 29 snap -1 2026-02-17T05:38:08.330 INFO:tasks.rados.rados.0.trial118.stdout:2374: expect deleted 2026-02-17T05:38:08.330 INFO:tasks.rados.rados.0.trial118.stdout:2375: write oid 40 current snap is 255 2026-02-17T05:38:08.330 INFO:tasks.rados.rados.0.trial118.stdout:2375: seq_num 843 ranges {568301=633737,1614085=415952} 2026-02-17T05:38:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2375: writing trial11845692-40 from 568301 to 1202038 tid 1 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2375: writing trial11845692-40 from 1614085 to 2030037 tid 2 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2376: copy_from oid 35 from oid 9 current snap is 255 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: finishing write tid 2 to trial11845692-33 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: finishing write tid 3 to trial11845692-33 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: finishing write tid 4 to trial11845692-33 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: oid 33 updating version 0 to 1335 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: oid 33 version 1335 is already newer than 1331 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:2372: oid 33 version 1335 is already newer than 1334 2026-02-17T05:38:08.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1335 (ObjNum 842 snap 255 seq_num 842) dirty exists 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2372: left oid 33 (ObjNum 842 snap 255 seq_num 842) 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2373: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2373: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2373: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1339 (ObjNum 777 snap 227 seq_num 777) dirty exists 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2375: finishing write tid 1 to trial11845692-40 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2372: done (4 left) 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2373: done (3 left) 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2374: done (2 left) 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2377: write (excl) oid 39 current snap is 255 2026-02-17T05:38:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2377: seq_num 844 ranges {585108=425339,1788920=396188} 2026-02-17T05:38:08.341 INFO:tasks.rados.rados.0.trial118.stdout:2377: writing trial11845692-39 from 585108 to 1010447 tid 1 2026-02-17T05:38:08.346 INFO:tasks.rados.rados.0.trial118.stdout:2377: writing trial11845692-39 from 1788920 to 2185108 tid 2 2026-02-17T05:38:08.346 INFO:tasks.rados.rados.0.trial118.stdout:2378: snap_create 2026-02-17T05:38:08.346 INFO:tasks.rados.rados.0.trial118.stdout:2375: finishing write tid 2 to trial11845692-40 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: finishing write tid 3 to trial11845692-40 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: finishing write tid 4 to trial11845692-40 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: oid 40 updating version 0 to 1341 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: oid 40 updating version 1341 to 1342 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: oid 40 updating version 1342 to 1343 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1343 (ObjNum 843 snap 255 seq_num 843) dirty exists 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2375: left oid 40 (ObjNum 843 snap 255 seq_num 843) 2026-02-17T05:38:08.347 INFO:tasks.rados.rados.0.trial118.stdout:2377: finishing write tid 1 to trial11845692-39 2026-02-17T05:38:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2376: finishing copy_from racing read to trial11845692-35 2026-02-17T05:38:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2377: finishing write tid 2 to trial11845692-39 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2376: finishing copy_from to trial11845692-35 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1264 (ObjNum 806 snap 244 seq_num 806) dirty exists 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: finishing write tid 3 to trial11845692-39 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: finishing write tid 4 to trial11845692-39 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: oid 39 updating version 0 to 1208 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: oid 39 version 1208 is already newer than 1207 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: oid 39 version 1208 is already newer than 1206 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1208 (ObjNum 844 snap 255 seq_num 844) dirty exists 2026-02-17T05:38:08.349 INFO:tasks.rados.rados.0.trial118.stdout:2377: left oid 39 (ObjNum 844 snap 255 seq_num 844) 2026-02-17T05:38:09.324 INFO:tasks.rados.rados.0.trial118.stdout:2375: done (3 left) 2026-02-17T05:38:09.324 INFO:tasks.rados.rados.0.trial118.stdout:2376: done (2 left) 2026-02-17T05:38:09.324 INFO:tasks.rados.rados.0.trial118.stdout:2377: done (1 left) 2026-02-17T05:38:09.324 INFO:tasks.rados.rados.0.trial118.stdout:2378: done (0 left) 2026-02-17T05:38:09.324 INFO:tasks.rados.rados.0.trial118.stdout:2379: copy_from oid 19 from oid 11 current snap is 256 2026-02-17T05:38:09.325 INFO:tasks.rados.rados.0.trial118.stdout:2380: copy_from oid 46 from oid 26 current snap is 256 2026-02-17T05:38:09.325 INFO:tasks.rados.rados.0.trial118.stdout:2381: snap_create 2026-02-17T05:38:09.326 INFO:tasks.rados.rados.0.trial118.stdout:2379: finishing copy_from to trial11845692-19 2026-02-17T05:38:09.327 INFO:tasks.rados.rados.0.trial118.stdout:2379: got expected ENOENT (src dne) 2026-02-17T05:38:09.327 INFO:tasks.rados.rados.0.trial118.stdout:2379: finishing copy_from racing read to trial11845692-19 2026-02-17T05:38:09.330 INFO:tasks.rados.rados.0.trial118.stdout:2380: finishing copy_from racing read to trial11845692-46 2026-02-17T05:38:09.331 INFO:tasks.rados.rados.0.trial118.stdout:2380: finishing copy_from to trial11845692-46 2026-02-17T05:38:09.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1266 (ObjNum 804 snap 244 seq_num 804) dirty exists 2026-02-17T05:38:10.315 INFO:tasks.rados.rados.0.trial118.stdout:2379: done (2 left) 2026-02-17T05:38:10.315 INFO:tasks.rados.rados.0.trial118.stdout:2380: done (1 left) 2026-02-17T05:38:10.315 INFO:tasks.rados.rados.0.trial118.stdout:2381: done (0 left) 2026-02-17T05:38:10.315 INFO:tasks.rados.rados.0.trial118.stdout:2382: delete oid 49 current snap is 257 2026-02-17T05:38:10.317 INFO:tasks.rados.rados.0.trial118.stdout:2382: done (0 left) 2026-02-17T05:38:10.317 INFO:tasks.rados.rados.0.trial118.stdout:2383: snap_remove snap 236 2026-02-17T05:38:11.318 INFO:tasks.rados.rados.0.trial118.stdout:2383: done (0 left) 2026-02-17T05:38:11.318 INFO:tasks.rados.rados.0.trial118.stdout:2384: write (excl) oid 17 current snap is 257 2026-02-17T05:38:11.318 INFO:tasks.rados.rados.0.trial118.stdout:2384: seq_num 846 ranges {618722=575837,1905884=312838} 2026-02-17T05:38:11.323 INFO:tasks.rados.rados.0.trial118.stdout:2384: writing trial11845692-17 from 618722 to 1194559 tid 1 2026-02-17T05:38:11.327 INFO:tasks.rados.rados.0.trial118.stdout:2384: writing trial11845692-17 from 1905884 to 2218722 tid 2 2026-02-17T05:38:11.327 INFO:tasks.rados.rados.0.trial118.stdout:2384: finishing write tid 1 to trial11845692-17 2026-02-17T05:38:11.327 INFO:tasks.rados.rados.0.trial118.stdout:2385: read oid 14 snap 251 2026-02-17T05:38:11.327 INFO:tasks.rados.rados.0.trial118.stdout:2385: expect (ObjNum 833 snap 251 seq_num 833) 2026-02-17T05:38:11.327 INFO:tasks.rados.rados.0.trial118.stdout:2386: snap_remove snap 245 2026-02-17T05:38:12.329 INFO:tasks.rados.rados.0.trial118.stdout:2386: done (2 left) 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2387: read oid 31 snap -1 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2387: expect (ObjNum 819 snap 249 seq_num 819) 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2388: delete oid 4 current snap is 257 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: finishing write tid 2 to trial11845692-17 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: finishing write tid 3 to trial11845692-17 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: finishing write tid 4 to trial11845692-17 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: oid 17 updating version 0 to 1267 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: oid 17 updating version 1267 to 1269 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: oid 17 version 1269 is already newer than 1268 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1269 (ObjNum 846 snap 257 seq_num 846) dirty exists 2026-02-17T05:38:12.330 INFO:tasks.rados.rados.0.trial118.stdout:2384: left oid 17 (ObjNum 846 snap 257 seq_num 846) 2026-02-17T05:38:12.331 INFO:tasks.rados.rados.0.trial118.stdout:2385: expect (ObjNum 833 snap 251 seq_num 833) 2026-02-17T05:38:12.384 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1666231 2026-02-17T05:38:12.386 INFO:tasks.rados.rados.0.trial118.stdout:2387: expect (ObjNum 819 snap 249 seq_num 819) 2026-02-17T05:38:12.440 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:12.467 INFO:tasks.rados.rados.0.trial118.stdout:2384: done (3 left) 2026-02-17T05:38:12.467 INFO:tasks.rados.rados.0.trial118.stdout:2385: done (2 left) 2026-02-17T05:38:12.467 INFO:tasks.rados.rados.0.trial118.stdout:2387: done (1 left) 2026-02-17T05:38:12.468 INFO:tasks.rados.rados.0.trial118.stdout:2388: done (0 left) 2026-02-17T05:38:12.468 INFO:tasks.rados.rados.0.trial118.stdout:2389: read oid 2 snap -1 2026-02-17T05:38:12.468 INFO:tasks.rados.rados.0.trial118.stdout:2389: expect deleted 2026-02-17T05:38:12.468 INFO:tasks.rados.rados.0.trial118.stdout:2390: snap_remove snap 204 2026-02-17T05:38:13.331 INFO:tasks.rados.rados.0.trial118.stdout:2390: done (1 left) 2026-02-17T05:38:13.332 INFO:tasks.rados.rados.0.trial118.stdout:2391: copy_from oid 16 from oid 5 current snap is 257 2026-02-17T05:38:13.332 INFO:tasks.rados.rados.0.trial118.stdout:2389: done (1 left) 2026-02-17T05:38:13.332 INFO:tasks.rados.rados.0.trial118.stdout:2392: snap_create 2026-02-17T05:38:13.339 INFO:tasks.rados.rados.0.trial118.stdout:2391: finishing copy_from racing read to trial11845692-16 2026-02-17T05:38:13.340 INFO:tasks.rados.rados.0.trial118.stdout:2391: finishing copy_from to trial11845692-16 2026-02-17T05:38:13.340 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1207 (ObjNum 840 snap 254 seq_num 840) dirty exists 2026-02-17T05:38:14.335 INFO:tasks.rados.rados.0.trial118.stdout:2391: done (1 left) 2026-02-17T05:38:14.335 INFO:tasks.rados.rados.0.trial118.stdout:2392: done (0 left) 2026-02-17T05:38:14.335 INFO:tasks.rados.rados.0.trial118.stdout:2393: snap_remove snap 244 2026-02-17T05:38:15.316 INFO:tasks.rados.rados.0.trial118.stdout:2393: done (0 left) 2026-02-17T05:38:15.316 INFO:tasks.rados.rados.0.trial118.stdout:2394: write oid 6 current snap is 258 2026-02-17T05:38:15.316 INFO:tasks.rados.rados.0.trial118.stdout:2394: seq_num 848 ranges {652336=726335,1906495=345841} 2026-02-17T05:38:15.322 INFO:tasks.rados.rados.0.trial118.stdout:2394: writing trial11845692-6 from 652336 to 1378671 tid 1 2026-02-17T05:38:15.326 INFO:tasks.rados.rados.0.trial118.stdout:2394: writing trial11845692-6 from 1906495 to 2252336 tid 2 2026-02-17T05:38:15.326 INFO:tasks.rados.rados.0.trial118.stdout:2395: read oid 24 snap 257 2026-02-17T05:38:15.326 INFO:tasks.rados.rados.0.trial118.stdout:2395: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:15.326 INFO:tasks.rados.rados.0.trial118.stdout:2396: snap_create 2026-02-17T05:38:15.326 INFO:tasks.rados.rados.0.trial118.stdout:2394: finishing write tid 1 to trial11845692-6 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: finishing write tid 2 to trial11845692-6 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: finishing write tid 3 to trial11845692-6 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: finishing write tid 4 to trial11845692-6 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: oid 6 updating version 0 to 1258 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: oid 6 updating version 1258 to 1259 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: oid 6 version 1259 is already newer than 1257 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1259 (ObjNum 848 snap 258 seq_num 848) dirty exists 2026-02-17T05:38:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2394: left oid 6 (ObjNum 848 snap 258 seq_num 848) 2026-02-17T05:38:15.329 INFO:tasks.rados.rados.0.trial118.stdout:2395: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:15.336 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1186221 2026-02-17T05:38:15.365 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 417659 2026-02-17T05:38:16.317 INFO:tasks.rados.rados.0.trial118.stdout:2394: done (2 left) 2026-02-17T05:38:16.317 INFO:tasks.rados.rados.0.trial118.stdout:2395: done (1 left) 2026-02-17T05:38:16.317 INFO:tasks.rados.rados.0.trial118.stdout:2396: done (0 left) 2026-02-17T05:38:16.317 INFO:tasks.rados.rados.0.trial118.stdout:2397: delete oid 27 current snap is 259 2026-02-17T05:38:16.319 INFO:tasks.rados.rados.0.trial118.stdout:2397: done (0 left) 2026-02-17T05:38:16.319 INFO:tasks.rados.rados.0.trial118.stdout:2398: rollback oid 12 current snap is 259 2026-02-17T05:38:16.319 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 241 2026-02-17T05:38:16.319 INFO:tasks.rados.rados.0.trial118.stdout:2399: write (excl) oid 44 current snap is 259 2026-02-17T05:38:16.319 INFO:tasks.rados.rados.0.trial118.stdout:2399: seq_num 850 ranges {685950=476833,1623459=570617} 2026-02-17T05:38:16.324 INFO:tasks.rados.rados.0.trial118.stdout:2399: writing trial11845692-44 from 685950 to 1162783 tid 1 2026-02-17T05:38:16.328 INFO:tasks.rados.rados.0.trial118.stdout:2399: writing trial11845692-44 from 1623459 to 2194076 tid 2 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2400: read oid 46 snap -1 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2400: expect (ObjNum 804 snap 244 seq_num 804) 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2401: write oid 43 current snap is 259 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2398: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2398: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:2398: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:38:16.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1107 (ObjNum 774 snap 227 seq_num 774) dirty exists 2026-02-17T05:38:16.330 INFO:tasks.rados.rados.0.trial118.stdout:2401: seq_num 851 ranges {702757=552082,1681941=430628} 2026-02-17T05:38:16.332 INFO:tasks.rados.rados.0.trial118.stdout:2401: writing trial11845692-43 from 702757 to 1254839 tid 1 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2401: writing trial11845692-43 from 1681941 to 2112569 tid 2 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2398: done (3 left) 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2402: write oid 33 current snap is 259 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2399: finishing write tid 1 to trial11845692-44 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2399: finishing write tid 2 to trial11845692-44 2026-02-17T05:38:16.336 INFO:tasks.rados.rados.0.trial118.stdout:2402: seq_num 852 ranges {719564=743684,2140423=179141} 2026-02-17T05:38:16.341 INFO:tasks.rados.rados.0.trial118.stdout:2402: writing trial11845692-33 from 719564 to 1463248 tid 1 2026-02-17T05:38:16.344 INFO:tasks.rados.rados.0.trial118.stdout:2402: writing trial11845692-33 from 2140423 to 2319564 tid 2 2026-02-17T05:38:16.344 INFO:tasks.rados.rados.0.trial118.stdout:2403: delete oid 34 current snap is 259 2026-02-17T05:38:16.344 INFO:tasks.rados.rados.0.trial118.stdout:2399: finishing write tid 3 to trial11845692-44 2026-02-17T05:38:16.344 INFO:tasks.rados.rados.0.trial118.stdout:2399: finishing write tid 4 to trial11845692-44 2026-02-17T05:38:16.344 INFO:tasks.rados.rados.0.trial118.stdout:2399: oid 44 updating version 0 to 1266 2026-02-17T05:38:16.345 INFO:tasks.rados.rados.0.trial118.stdout:2399: oid 44 updating version 1266 to 1267 2026-02-17T05:38:16.345 INFO:tasks.rados.rados.0.trial118.stdout:2399: oid 44 version 1267 is already newer than 1265 2026-02-17T05:38:16.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1267 (ObjNum 850 snap 259 seq_num 850) dirty exists 2026-02-17T05:38:16.345 INFO:tasks.rados.rados.0.trial118.stdout:2399: left oid 44 (ObjNum 850 snap 259 seq_num 850) 2026-02-17T05:38:16.345 INFO:tasks.rados.rados.0.trial118.stdout:2400: expect (ObjNum 804 snap 244 seq_num 804) 2026-02-17T05:38:16.390 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: finishing write tid 1 to trial11845692-43 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2399: done (4 left) 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2400: done (3 left) 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2403: done (2 left) 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2404: write (excl) oid 42 current snap is 259 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: finishing write tid 2 to trial11845692-43 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: finishing write tid 3 to trial11845692-43 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: finishing write tid 4 to trial11845692-43 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: oid 43 updating version 0 to 1108 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: oid 43 updating version 1108 to 1110 2026-02-17T05:38:16.478 INFO:tasks.rados.rados.0.trial118.stdout:2401: oid 43 version 1110 is already newer than 1109 2026-02-17T05:38:16.479 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1110 (ObjNum 851 snap 259 seq_num 851) dirty exists 2026-02-17T05:38:16.479 INFO:tasks.rados.rados.0.trial118.stdout:2401: left oid 43 (ObjNum 851 snap 259 seq_num 851) 2026-02-17T05:38:16.479 INFO:tasks.rados.rados.0.trial118.stdout:2402: finishing write tid 1 to trial11845692-33 2026-02-17T05:38:16.479 INFO:tasks.rados.rados.0.trial118.stdout:2402: finishing write tid 2 to trial11845692-33 2026-02-17T05:38:16.479 INFO:tasks.rados.rados.0.trial118.stdout:2404: seq_num 854 ranges {753178=494182,1857387=495791} 2026-02-17T05:38:16.483 INFO:tasks.rados.rados.0.trial118.stdout:2404: writing trial11845692-42 from 753178 to 1247360 tid 1 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2404: writing trial11845692-42 from 1857387 to 2353178 tid 2 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2401: done (2 left) 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2405: read oid 43 snap -1 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2405: expect (ObjNum 851 snap 259 seq_num 851) 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2406: write (excl) oid 2 current snap is 259 2026-02-17T05:38:16.487 INFO:tasks.rados.rados.0.trial118.stdout:2406: seq_num 855 ranges {769985=569431,1915869=437966} 2026-02-17T05:38:16.492 INFO:tasks.rados.rados.0.trial118.stdout:2406: writing trial11845692-2 from 769985 to 1339416 tid 1 2026-02-17T05:38:16.496 INFO:tasks.rados.rados.0.trial118.stdout:2406: writing trial11845692-2 from 1915869 to 2353835 tid 2 2026-02-17T05:38:16.496 INFO:tasks.rados.rados.0.trial118.stdout:2407: delete oid 31 current snap is 259 2026-02-17T05:38:16.496 INFO:tasks.rados.rados.0.trial118.stdout:2402: finishing write tid 3 to trial11845692-33 2026-02-17T05:38:16.496 INFO:tasks.rados.rados.0.trial118.stdout:2402: finishing write tid 4 to trial11845692-33 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2402: oid 33 updating version 0 to 1371 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2402: oid 33 updating version 1371 to 1372 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2402: oid 33 updating version 1372 to 1373 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1373 (ObjNum 852 snap 259 seq_num 852) dirty exists 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2402: left oid 33 (ObjNum 852 snap 259 seq_num 852) 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: finishing write tid 1 to trial11845692-42 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: finishing write tid 2 to trial11845692-42 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: finishing write tid 3 to trial11845692-42 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: finishing write tid 4 to trial11845692-42 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: oid 42 updating version 0 to 1211 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: oid 42 version 1211 is already newer than 1210 2026-02-17T05:38:16.497 INFO:tasks.rados.rados.0.trial118.stdout:2404: oid 42 version 1211 is already newer than 1209 2026-02-17T05:38:16.498 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1211 (ObjNum 854 snap 259 seq_num 854) dirty exists 2026-02-17T05:38:16.498 INFO:tasks.rados.rados.0.trial118.stdout:2404: left oid 42 (ObjNum 854 snap 259 seq_num 854) 2026-02-17T05:38:16.498 INFO:tasks.rados.rados.0.trial118.stdout:2405: expect (ObjNum 851 snap 259 seq_num 851) 2026-02-17T05:38:16.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:16.553 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2406: finishing write tid 1 to trial11845692-2 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2406: finishing write tid 2 to trial11845692-2 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2402: done (4 left) 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2404: done (3 left) 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2405: done (2 left) 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2407: done (1 left) 2026-02-17T05:38:16.581 INFO:tasks.rados.rados.0.trial118.stdout:2408: write (excl) oid 29 current snap is 259 2026-02-17T05:38:16.582 INFO:tasks.rados.rados.0.trial118.stdout:2406: finishing write tid 3 to trial11845692-2 2026-02-17T05:38:16.582 INFO:tasks.rados.rados.0.trial118.stdout:2408: seq_num 857 ranges {403599=719929,1916480=441635} 2026-02-17T05:38:16.586 INFO:tasks.rados.rados.0.trial118.stdout:2408: writing trial11845692-29 from 403599 to 1123528 tid 1 2026-02-17T05:38:16.592 INFO:tasks.rados.rados.0.trial118.stdout:2408: writing trial11845692-29 from 1916480 to 2358115 tid 2 2026-02-17T05:38:16.592 INFO:tasks.rados.rados.0.trial118.stdout:2409: snap_create 2026-02-17T05:38:16.592 INFO:tasks.rados.rados.0.trial118.stdout:2406: finishing write tid 4 to trial11845692-2 2026-02-17T05:38:16.592 INFO:tasks.rados.rados.0.trial118.stdout:2406: oid 2 updating version 0 to 1474 2026-02-17T05:38:16.593 INFO:tasks.rados.rados.0.trial118.stdout:2406: oid 2 version 1474 is already newer than 1472 2026-02-17T05:38:16.593 INFO:tasks.rados.rados.0.trial118.stdout:2406: oid 2 version 1474 is already newer than 1473 2026-02-17T05:38:16.593 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1474 (ObjNum 855 snap 259 seq_num 855) dirty exists 2026-02-17T05:38:16.593 INFO:tasks.rados.rados.0.trial118.stdout:2406: left oid 2 (ObjNum 855 snap 259 seq_num 855) 2026-02-17T05:38:16.593 INFO:tasks.rados.rados.0.trial118.stdout:2408: finishing write tid 1 to trial11845692-29 2026-02-17T05:38:16.596 INFO:tasks.rados.rados.0.trial118.stdout:2408: finishing write tid 2 to trial11845692-29 2026-02-17T05:38:16.597 INFO:tasks.rados.rados.0.trial118.stdout:2408: finishing write tid 3 to trial11845692-29 2026-02-17T05:38:16.597 INFO:tasks.rados.rados.0.trial118.stdout:2408: finishing write tid 4 to trial11845692-29 2026-02-17T05:38:16.597 INFO:tasks.rados.rados.0.trial118.stdout:2408: oid 29 updating version 0 to 1381 2026-02-17T05:38:16.597 INFO:tasks.rados.rados.0.trial118.stdout:2408: oid 29 updating version 1381 to 1382 2026-02-17T05:38:16.598 INFO:tasks.rados.rados.0.trial118.stdout:2408: oid 29 version 1382 is already newer than 1380 2026-02-17T05:38:16.598 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1382 (ObjNum 857 snap 259 seq_num 857) dirty exists 2026-02-17T05:38:16.598 INFO:tasks.rados.rados.0.trial118.stdout:2408: left oid 29 (ObjNum 857 snap 259 seq_num 857) 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2406: done (2 left) 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2408: done (1 left) 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2409: done (0 left) 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2410: read oid 49 snap -1 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2410: expect deleted 2026-02-17T05:38:17.337 INFO:tasks.rados.rados.0.trial118.stdout:2411: delete oid 5 current snap is 260 2026-02-17T05:38:17.339 INFO:tasks.rados.rados.0.trial118.stdout:2410: done (1 left) 2026-02-17T05:38:17.339 INFO:tasks.rados.rados.0.trial118.stdout:2411: done (0 left) 2026-02-17T05:38:17.339 INFO:tasks.rados.rados.0.trial118.stdout:2412: write (excl) oid 36 current snap is 260 2026-02-17T05:38:17.339 INFO:tasks.rados.rados.0.trial118.stdout:2412: seq_num 859 ranges {437213=470427,1633444=728951} 2026-02-17T05:38:17.343 INFO:tasks.rados.rados.0.trial118.stdout:2412: writing trial11845692-36 from 437213 to 907640 tid 1 2026-02-17T05:38:17.349 INFO:tasks.rados.rados.0.trial118.stdout:2412: writing trial11845692-36 from 1633444 to 2362395 tid 2 2026-02-17T05:38:17.349 INFO:tasks.rados.rados.0.trial118.stdout:2413: copy_from oid 34 from oid 41 current snap is 260 2026-02-17T05:38:17.349 INFO:tasks.rados.rados.0.trial118.stdout:2412: finishing write tid 1 to trial11845692-36 2026-02-17T05:38:17.349 INFO:tasks.rados.rados.0.trial118.stdout:2414: write oid 47 current snap is 260 2026-02-17T05:38:17.349 INFO:tasks.rados.rados.0.trial118.stdout:2414: seq_num 860 ranges {454020=662029,1691926=588962} 2026-02-17T05:38:17.353 INFO:tasks.rados.rados.0.trial118.stdout:2414: writing trial11845692-47 from 454020 to 1116049 tid 1 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:2414: writing trial11845692-47 from 1691926 to 2280888 tid 2 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:2415: rollback oid 40 current snap is 260 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 238 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:2412: finishing write tid 2 to trial11845692-36 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:2412: finishing write tid 3 to trial11845692-36 2026-02-17T05:38:17.358 INFO:tasks.rados.rados.0.trial118.stdout:2412: finishing write tid 4 to trial11845692-36 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2412: oid 36 updating version 0 to 1213 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2412: oid 36 updating version 1213 to 1214 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2412: oid 36 updating version 1214 to 1215 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1215 (ObjNum 859 snap 260 seq_num 859) dirty exists 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2412: left oid 36 (ObjNum 859 snap 260 seq_num 859) 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2414: finishing write tid 1 to trial11845692-47 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2412: done (3 left) 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2416: delete oid 31 current snap is 260 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2413: finishing copy_from racing read to trial11845692-34 2026-02-17T05:38:17.359 INFO:tasks.rados.rados.0.trial118.stdout:2413: finishing copy_from to trial11845692-34 2026-02-17T05:38:17.360 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1260 (ObjNum 805 snap 244 seq_num 805) dirty exists 2026-02-17T05:38:17.360 INFO:tasks.rados.rados.0.trial118.stdout:2413: done (3 left) 2026-02-17T05:38:17.360 INFO:tasks.rados.rados.0.trial118.stdout:2416: done (2 left) 2026-02-17T05:38:17.360 INFO:tasks.rados.rados.0.trial118.stdout:2417: copy_from oid 28 from oid 30 current snap is 260 2026-02-17T05:38:17.361 INFO:tasks.rados.rados.0.trial118.stdout:2418: copy_from oid 44 from oid 33 current snap is 260 2026-02-17T05:38:17.361 INFO:tasks.rados.rados.0.trial118.stdout:2419: snap_remove snap 241 2026-02-17T05:38:18.340 INFO:tasks.rados.rados.0.trial118.stdout:2419: done (4 left) 2026-02-17T05:38:18.340 INFO:tasks.rados.rados.0.trial118.stdout:2420: delete oid 39 current snap is 260 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: finishing write tid 2 to trial11845692-47 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: finishing write tid 3 to trial11845692-47 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: finishing write tid 4 to trial11845692-47 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: oid 47 updating version 0 to 1212 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: oid 47 updating version 1212 to 1213 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: oid 47 updating version 1213 to 1214 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1214 (ObjNum 860 snap 260 seq_num 860) dirty exists 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2414: left oid 47 (ObjNum 860 snap 260 seq_num 860) 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2415: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2415: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2415: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1377 (ObjNum 673 snap 196 seq_num 673) dirty exists 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2417: finishing copy_from racing read to trial11845692-28 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2417: finishing copy_from to trial11845692-28 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1097 (ObjNum 767 snap 227 seq_num 767) dirty exists 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2418: finishing copy_from racing read to trial11845692-44 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:2418: finishing copy_from to trial11845692-44 2026-02-17T05:38:18.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1373 (ObjNum 852 snap 259 seq_num 852) dirty exists 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2414: done (4 left) 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2415: done (3 left) 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2417: done (2 left) 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2418: done (1 left) 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2420: done (0 left) 2026-02-17T05:38:18.345 INFO:tasks.rados.rados.0.trial118.stdout:2421: delete oid 25 current snap is 260 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2421: done (0 left) 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2422: read oid 28 snap -1 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2422: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2423: read oid 25 snap -1 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2423: expect deleted 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2424: read oid 39 snap -1 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2424: expect deleted 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2425: rollback oid 3 current snap is 260 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 239 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2426: read oid 10 snap -1 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2426: expect deleted 2026-02-17T05:38:18.347 INFO:tasks.rados.rados.0.trial118.stdout:2427: snap_remove snap 233 2026-02-17T05:38:19.342 INFO:tasks.rados.rados.0.trial118.stdout:2427: done (5 left) 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:2428: copy_from oid 49 from oid 27 current snap is 260 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:2425: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:2425: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1104 (ObjNum 209 snap 0 seq_num 12401427) dirty dne 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:2422: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:19.343 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:19.383 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:19.422 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 486145 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2428: finishing copy_from to trial11845692-49 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2428: got expected ENOENT (src dne) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2428: finishing copy_from racing read to trial11845692-49 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2422: done (5 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2423: done (4 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2424: done (3 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2425: done (2 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2426: done (1 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2428: done (0 left) 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2429: rollback oid 22 current snap is 260 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 252 2026-02-17T05:38:19.459 INFO:tasks.rados.rados.0.trial118.stdout:2430: snap_create 2026-02-17T05:38:19.460 INFO:tasks.rados.rados.0.trial118.stdout:2429: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:38:19.460 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1204 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:2429: done (1 left) 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:2430: done (0 left) 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:2431: rollback oid 26 current snap is 261 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 257 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:2432: rollback oid 45 current snap is 261 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 228 2026-02-17T05:38:20.317 INFO:tasks.rados.rados.0.trial118.stdout:2433: delete oid 19 current snap is 261 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2432: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2432: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2432: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1218 (ObjNum 763 snap 227 seq_num 763) dirty exists 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2432: done (2 left) 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2433: done (1 left) 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2434: write oid 13 current snap is 261 2026-02-17T05:38:20.320 INFO:tasks.rados.rados.0.trial118.stdout:2434: seq_num 865 ranges {538055=638274,1867983=670072} 2026-02-17T05:38:20.324 INFO:tasks.rados.rados.0.trial118.stdout:2434: writing trial11845692-13 from 538055 to 1176329 tid 1 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2434: writing trial11845692-13 from 1867983 to 2538055 tid 2 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2435: delete oid 21 current snap is 261 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2431: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2431: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2431: finishing rollback tid 2 to trial11845692-26 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1269 (ObjNum 804 snap 244 seq_num 804) dirty exists 2026-02-17T05:38:20.330 INFO:tasks.rados.rados.0.trial118.stdout:2434: finishing write tid 1 to trial11845692-13 2026-02-17T05:38:20.332 INFO:tasks.rados.rados.0.trial118.stdout:2431: done (2 left) 2026-02-17T05:38:20.332 INFO:tasks.rados.rados.0.trial118.stdout:2435: done (1 left) 2026-02-17T05:38:20.332 INFO:tasks.rados.rados.0.trial118.stdout:2436: copy_from oid 45 from oid 15 current snap is 261 2026-02-17T05:38:20.332 INFO:tasks.rados.rados.0.trial118.stdout:2437: write oid 17 current snap is 261 2026-02-17T05:38:20.332 INFO:tasks.rados.rados.0.trial118.stdout:2437: seq_num 867 ranges {571669=505125,1701300=743627} 2026-02-17T05:38:20.335 INFO:tasks.rados.rados.0.trial118.stdout:2437: writing trial11845692-17 from 571669 to 1076794 tid 1 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2437: writing trial11845692-17 from 1701300 to 2444927 tid 2 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2438: snap_create 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2436: finishing copy_from to trial11845692-45 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2436: got expected ENOENT (src dne) 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2436: finishing copy_from racing read to trial11845692-45 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: finishing write tid 2 to trial11845692-13 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: finishing write tid 3 to trial11845692-13 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: finishing write tid 4 to trial11845692-13 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: oid 13 updating version 0 to 1106 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: oid 13 version 1106 is already newer than 1105 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: oid 13 updating version 1106 to 1107 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1107 (ObjNum 865 snap 261 seq_num 865) dirty exists 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2434: left oid 13 (ObjNum 865 snap 261 seq_num 865) 2026-02-17T05:38:20.341 INFO:tasks.rados.rados.0.trial118.stdout:2437: finishing write tid 1 to trial11845692-17 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: finishing write tid 2 to trial11845692-17 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: finishing write tid 3 to trial11845692-17 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: finishing write tid 4 to trial11845692-17 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: oid 17 updating version 0 to 1270 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: oid 17 updating version 1270 to 1271 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: oid 17 updating version 1271 to 1272 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1272 (ObjNum 867 snap 261 seq_num 867) dirty exists 2026-02-17T05:38:20.343 INFO:tasks.rados.rados.0.trial118.stdout:2437: left oid 17 (ObjNum 867 snap 261 seq_num 867) 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2434: done (3 left) 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2436: done (2 left) 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2437: done (1 left) 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2438: done (0 left) 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2439: write (excl) oid 18 current snap is 262 2026-02-17T05:38:21.319 INFO:tasks.rados.rados.0.trial118.stdout:2439: seq_num 868 ranges {588476=580374,1643429=603638} 2026-02-17T05:38:21.324 INFO:tasks.rados.rados.0.trial118.stdout:2439: writing trial11845692-18 from 588476 to 1168850 tid 1 2026-02-17T05:38:21.328 INFO:tasks.rados.rados.0.trial118.stdout:2439: writing trial11845692-18 from 1643429 to 2247067 tid 2 2026-02-17T05:38:21.328 INFO:tasks.rados.rados.0.trial118.stdout:2440: snap_remove snap 258 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2440: done (1 left) 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2441: delete oid 50 current snap is 262 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: finishing write tid 1 to trial11845692-18 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: finishing write tid 2 to trial11845692-18 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: finishing write tid 3 to trial11845692-18 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: finishing write tid 4 to trial11845692-18 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: oid 18 updating version 0 to 1263 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: oid 18 version 1263 is already newer than 1262 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: oid 18 version 1263 is already newer than 1261 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1263 (ObjNum 868 snap 262 seq_num 868) dirty exists 2026-02-17T05:38:22.320 INFO:tasks.rados.rados.0.trial118.stdout:2439: left oid 18 (ObjNum 868 snap 262 seq_num 868) 2026-02-17T05:38:22.323 INFO:tasks.rados.rados.0.trial118.stdout:2439: done (1 left) 2026-02-17T05:38:22.323 INFO:tasks.rados.rados.0.trial118.stdout:2441: done (0 left) 2026-02-17T05:38:22.323 INFO:tasks.rados.rados.0.trial118.stdout:2442: delete oid 28 current snap is 262 2026-02-17T05:38:22.326 INFO:tasks.rados.rados.0.trial118.stdout:2442: done (0 left) 2026-02-17T05:38:22.326 INFO:tasks.rados.rados.0.trial118.stdout:2443: write (excl) oid 25 current snap is 262 2026-02-17T05:38:22.326 INFO:tasks.rados.rados.0.trial118.stdout:2443: seq_num 871 ranges {638897=406121,1818875=750965} 2026-02-17T05:38:22.330 INFO:tasks.rados.rados.0.trial118.stdout:2443: writing trial11845692-25 from 638897 to 1045018 tid 1 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2443: writing trial11845692-25 from 1818875 to 2569840 tid 2 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2444: rollback oid 31 current snap is 262 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 254 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2443: finishing write tid 1 to trial11845692-25 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2445: read oid 7 snap 254 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2445: expect (ObjNum 828 snap 250 seq_num 828) 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2446: read oid 38 snap -1 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2446: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2447: write (excl) oid 15 current snap is 262 2026-02-17T05:38:22.336 INFO:tasks.rados.rados.0.trial118.stdout:2447: seq_num 872 ranges {655704=481370,1761004=494623} 2026-02-17T05:38:22.340 INFO:tasks.rados.rados.0.trial118.stdout:2447: writing trial11845692-15 from 655704 to 1137074 tid 1 2026-02-17T05:38:22.345 INFO:tasks.rados.rados.0.trial118.stdout:2447: writing trial11845692-15 from 1761004 to 2255627 tid 2 2026-02-17T05:38:22.345 INFO:tasks.rados.rados.0.trial118.stdout:2448: snap_remove snap 228 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2448: done (5 left) 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2449: copy_from oid 9 from oid 13 current snap is 262 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2444: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2444: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1505 (ObjNum 819 snap 249 seq_num 819) dirty exists 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2443: finishing write tid 2 to trial11845692-25 2026-02-17T05:38:23.322 INFO:tasks.rados.rados.0.trial118.stdout:2443: finishing write tid 3 to trial11845692-25 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2443: finishing write tid 4 to trial11845692-25 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2443: oid 25 updating version 0 to 1405 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2443: oid 25 version 1405 is already newer than 1404 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2443: oid 25 version 1405 is already newer than 1403 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1405 (ObjNum 871 snap 262 seq_num 871) dirty exists 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2443: left oid 25 (ObjNum 871 snap 262 seq_num 871) 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2447: finishing write tid 1 to trial11845692-15 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:2445: expect (ObjNum 828 snap 250 seq_num 828) 2026-02-17T05:38:23.323 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:23.442 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 218053 2026-02-17T05:38:23.500 INFO:tasks.rados.rados.0.trial118.stdout:2446: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:23.642 INFO:tasks.rados.rados.0.trial118.stdout:2447: finishing write tid 2 to trial11845692-15 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2447: finishing write tid 3 to trial11845692-15 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2443: done (5 left) 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2444: done (4 left) 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2445: done (3 left) 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2446: done (2 left) 2026-02-17T05:38:23.643 INFO:tasks.rados.rados.0.trial118.stdout:2450: snap_remove snap 261 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:2450: done (2 left) 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:2451: rollback oid 1 current snap is 262 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 251 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:2447: finishing write tid 4 to trial11845692-15 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:2447: oid 15 updating version 0 to 1219 2026-02-17T05:38:24.328 INFO:tasks.rados.rados.0.trial118.stdout:2447: oid 15 updating version 1219 to 1220 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2447: oid 15 updating version 1220 to 1221 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1221 (ObjNum 872 snap 262 seq_num 872) dirty exists 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2447: left oid 15 (ObjNum 872 snap 262 seq_num 872) 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2449: finishing copy_from racing read to trial11845692-9 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2449: finishing copy_from to trial11845692-9 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1107 (ObjNum 865 snap 261 seq_num 865) dirty exists 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2447: done (2 left) 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2449: done (1 left) 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2452: read oid 50 snap -1 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2452: expect deleted 2026-02-17T05:38:24.329 INFO:tasks.rados.rados.0.trial118.stdout:2453: snap_create 2026-02-17T05:38:24.330 INFO:tasks.rados.rados.0.trial118.stdout:2451: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:38:24.331 INFO:tasks.rados.rados.0.trial118.stdout:2451: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:38:24.331 INFO:tasks.rados.rados.0.trial118.stdout:2451: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:38:24.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1415 (ObjNum 815 snap 247 seq_num 815) dirty exists 2026-02-17T05:38:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2451: done (2 left) 2026-02-17T05:38:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2452: done (1 left) 2026-02-17T05:38:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2453: done (0 left) 2026-02-17T05:38:25.318 INFO:tasks.rados.rados.0.trial118.stdout:2454: snap_create 2026-02-17T05:38:26.318 INFO:tasks.rados.rados.0.trial118.stdout:2454: done (0 left) 2026-02-17T05:38:26.318 INFO:tasks.rados.rados.0.trial118.stdout:2455: write oid 11 current snap is 264 2026-02-17T05:38:26.318 INFO:tasks.rados.rados.0.trial118.stdout:2455: seq_num 873 ranges {672511=556619,1819486=754634} 2026-02-17T05:38:26.323 INFO:tasks.rados.rados.0.trial118.stdout:2455: writing trial11845692-11 from 672511 to 1229130 tid 1 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:2455: writing trial11845692-11 from 1819486 to 2574120 tid 2 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:2456: rollback oid 14 current snap is 264 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 239 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:2455: finishing write tid 1 to trial11845692-11 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:2457: write (excl) oid 8 current snap is 264 2026-02-17T05:38:26.328 INFO:tasks.rados.rados.0.trial118.stdout:2457: seq_num 874 ranges {689318=631868,1877968=498292} 2026-02-17T05:38:26.333 INFO:tasks.rados.rados.0.trial118.stdout:2457: writing trial11845692-8 from 689318 to 1321186 tid 1 2026-02-17T05:38:26.337 INFO:tasks.rados.rados.0.trial118.stdout:2457: writing trial11845692-8 from 1877968 to 2376260 tid 2 2026-02-17T05:38:26.337 INFO:tasks.rados.rados.0.trial118.stdout:2458: read oid 20 snap -1 2026-02-17T05:38:26.337 INFO:tasks.rados.rados.0.trial118.stdout:2458: expect (ObjNum 839 snap 254 seq_num 839) 2026-02-17T05:38:26.337 INFO:tasks.rados.rados.0.trial118.stdout:2459: write oid 43 current snap is 264 2026-02-17T05:38:26.337 INFO:tasks.rados.rados.0.trial118.stdout:2459: seq_num 875 ranges {706125=423470,1652803=758303} 2026-02-17T05:38:26.342 INFO:tasks.rados.rados.0.trial118.stdout:2459: writing trial11845692-43 from 706125 to 1129595 tid 1 2026-02-17T05:38:26.347 INFO:tasks.rados.rados.0.trial118.stdout:2459: writing trial11845692-43 from 1652803 to 2411106 tid 2 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2460: delete oid 21 current snap is 264 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: finishing write tid 2 to trial11845692-11 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: finishing write tid 3 to trial11845692-11 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: finishing write tid 4 to trial11845692-11 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: oid 11 updating version 0 to 1518 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: oid 11 updating version 1518 to 1519 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: oid 11 updating version 1519 to 1520 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1520 (ObjNum 873 snap 264 seq_num 873) dirty exists 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2455: left oid 11 (ObjNum 873 snap 264 seq_num 873) 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2456: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:38:26.348 INFO:tasks.rados.rados.0.trial118.stdout:2456: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:38:26.349 INFO:tasks.rados.rados.0.trial118.stdout:2456: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:38:26.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1211 (ObjNum 739 snap 216 seq_num 739) dirty exists 2026-02-17T05:38:26.349 INFO:tasks.rados.rados.0.trial118.stdout:2457: finishing write tid 1 to trial11845692-8 2026-02-17T05:38:26.349 INFO:tasks.rados.rados.0.trial118.stdout:2457: finishing write tid 2 to trial11845692-8 2026-02-17T05:38:26.349 INFO:tasks.rados.rados.0.trial118.stdout:2458: expect (ObjNum 839 snap 254 seq_num 839) 2026-02-17T05:38:26.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1232335 2026-02-17T05:38:26.387 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:26.409 INFO:tasks.rados.rados.0.trial118.stdout:2457: finishing write tid 3 to trial11845692-8 2026-02-17T05:38:26.409 INFO:tasks.rados.rados.0.trial118.stdout:2457: finishing write tid 4 to trial11845692-8 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2457: oid 8 updating version 0 to 1524 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2457: oid 8 version 1524 is already newer than 1523 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2457: oid 8 version 1524 is already newer than 1522 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1524 (ObjNum 874 snap 264 seq_num 874) dirty exists 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2457: left oid 8 (ObjNum 874 snap 264 seq_num 874) 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2459: finishing write tid 1 to trial11845692-43 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2455: done (5 left) 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2456: done (4 left) 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2457: done (3 left) 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2458: done (2 left) 2026-02-17T05:38:26.410 INFO:tasks.rados.rados.0.trial118.stdout:2460: done (1 left) 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2461: snap_create 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: finishing write tid 2 to trial11845692-43 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: finishing write tid 3 to trial11845692-43 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: finishing write tid 4 to trial11845692-43 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: oid 43 updating version 0 to 1112 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: oid 43 updating version 1112 to 1113 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: oid 43 updating version 1113 to 1114 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1114 (ObjNum 875 snap 264 seq_num 875) dirty exists 2026-02-17T05:38:26.411 INFO:tasks.rados.rados.0.trial118.stdout:2459: left oid 43 (ObjNum 875 snap 264 seq_num 875) 2026-02-17T05:38:27.329 INFO:tasks.rados.rados.0.trial118.stdout:2459: done (1 left) 2026-02-17T05:38:27.329 INFO:tasks.rados.rados.0.trial118.stdout:2461: done (0 left) 2026-02-17T05:38:27.329 INFO:tasks.rados.rados.0.trial118.stdout:2462: write (excl) oid 9 current snap is 265 2026-02-17T05:38:27.329 INFO:tasks.rados.rados.0.trial118.stdout:2462: seq_num 877 ranges {739739=573968,2053414=686325} 2026-02-17T05:38:27.334 INFO:tasks.rados.rados.0.trial118.stdout:2462: writing trial11845692-9 from 739739 to 1313707 tid 1 2026-02-17T05:38:27.340 INFO:tasks.rados.rados.0.trial118.stdout:2462: writing trial11845692-9 from 2053414 to 2739739 tid 2 2026-02-17T05:38:27.340 INFO:tasks.rados.rados.0.trial118.stdout:2463: snap_create 2026-02-17T05:38:27.340 INFO:tasks.rados.rados.0.trial118.stdout:2462: finishing write tid 1 to trial11845692-9 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: finishing write tid 2 to trial11845692-9 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: finishing write tid 3 to trial11845692-9 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: finishing write tid 4 to trial11845692-9 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: oid 9 updating version 0 to 1384 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: oid 9 updating version 1384 to 1385 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:2462: oid 9 version 1385 is already newer than 1383 2026-02-17T05:38:27.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1385 (ObjNum 877 snap 265 seq_num 877) dirty exists 2026-02-17T05:38:27.344 INFO:tasks.rados.rados.0.trial118.stdout:2462: left oid 9 (ObjNum 877 snap 265 seq_num 877) 2026-02-17T05:38:28.330 INFO:tasks.rados.rados.0.trial118.stdout:2462: done (1 left) 2026-02-17T05:38:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2463: done (0 left) 2026-02-17T05:38:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2464: read oid 23 snap -1 2026-02-17T05:38:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2464: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2465: write (excl) oid 11 current snap is 266 2026-02-17T05:38:28.331 INFO:tasks.rados.rados.0.trial118.stdout:2465: seq_num 878 ranges {756546=649217,2111896=505630} 2026-02-17T05:38:28.336 INFO:tasks.rados.rados.0.trial118.stdout:2465: writing trial11845692-11 from 756546 to 1405763 tid 1 2026-02-17T05:38:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2465: writing trial11845692-11 from 2111896 to 2617526 tid 2 2026-02-17T05:38:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2466: read oid 6 snap 248 2026-02-17T05:38:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2466: expect (ObjNum 651 snap 191 seq_num 651) 2026-02-17T05:38:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2467: delete oid 33 current snap is 266 2026-02-17T05:38:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2464: expect (ObjNum 767 snap 227 seq_num 767) 2026-02-17T05:38:28.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2237340 2026-02-17T05:38:28.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1743238 2026-02-17T05:38:28.446 INFO:tasks.rados.rados.0.trial118.stdout:2465: finishing write tid 1 to trial11845692-11 2026-02-17T05:38:28.446 INFO:tasks.rados.rados.0.trial118.stdout:2464: done (3 left) 2026-02-17T05:38:28.447 INFO:tasks.rados.rados.0.trial118.stdout:2467: done (2 left) 2026-02-17T05:38:28.447 INFO:tasks.rados.rados.0.trial118.stdout:2468: write (excl) oid 30 current snap is 266 2026-02-17T05:38:28.447 INFO:tasks.rados.rados.0.trial118.stdout:2465: finishing write tid 2 to trial11845692-11 2026-02-17T05:38:28.447 INFO:tasks.rados.rados.0.trial118.stdout:2465: finishing write tid 3 to trial11845692-11 2026-02-17T05:38:28.447 INFO:tasks.rados.rados.0.trial118.stdout:2468: seq_num 880 ranges {790160=799715,2112507=509299} 2026-02-17T05:38:28.452 INFO:tasks.rados.rados.0.trial118.stdout:2468: writing trial11845692-30 from 790160 to 1589875 tid 1 2026-02-17T05:38:28.456 INFO:tasks.rados.rados.0.trial118.stdout:2468: writing trial11845692-30 from 2112507 to 2621806 tid 2 2026-02-17T05:38:28.456 INFO:tasks.rados.rados.0.trial118.stdout:2469: write (excl) oid 17 current snap is 266 2026-02-17T05:38:28.457 INFO:tasks.rados.rados.0.trial118.stdout:2469: seq_num 881 ranges {406967=474964,1370989=769310,2677186=129781} 2026-02-17T05:38:28.459 INFO:tasks.rados.rados.0.trial118.stdout:2469: writing trial11845692-17 from 406967 to 881931 tid 1 2026-02-17T05:38:28.464 INFO:tasks.rados.rados.0.trial118.stdout:2469: writing trial11845692-17 from 1370989 to 2140299 tid 2 2026-02-17T05:38:28.467 INFO:tasks.rados.rados.0.trial118.stdout:2469: writing trial11845692-17 from 2677186 to 2806967 tid 3 2026-02-17T05:38:28.467 INFO:tasks.rados.rados.0.trial118.stdout:2470: rollback oid 13 current snap is 266 2026-02-17T05:38:28.467 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 264 2026-02-17T05:38:28.467 INFO:tasks.rados.rados.0.trial118.stdout:2465: finishing write tid 4 to trial11845692-11 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:2465: oid 11 updating version 0 to 1527 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:2465: oid 11 version 1527 is already newer than 1526 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:2465: oid 11 updating version 1527 to 1528 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1528 (ObjNum 878 snap 266 seq_num 878) dirty exists 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:2465: left oid 11 (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:2466: expect (ObjNum 651 snap 191 seq_num 651) 2026-02-17T05:38:28.468 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:28.496 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2468: finishing write tid 1 to trial11845692-30 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2468: finishing write tid 2 to trial11845692-30 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2465: done (4 left) 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2466: done (3 left) 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2471: write oid 33 current snap is 266 2026-02-17T05:38:28.555 INFO:tasks.rados.rados.0.trial118.stdout:2471: seq_num 882 ranges {423774=666566,1545824=512968,2704609=119165} 2026-02-17T05:38:28.559 INFO:tasks.rados.rados.0.trial118.stdout:2471: writing trial11845692-33 from 423774 to 1090340 tid 1 2026-02-17T05:38:28.563 INFO:tasks.rados.rados.0.trial118.stdout:2471: writing trial11845692-33 from 1545824 to 2058792 tid 2 2026-02-17T05:38:28.566 INFO:tasks.rados.rados.0.trial118.stdout:2471: writing trial11845692-33 from 2704609 to 2823774 tid 3 2026-02-17T05:38:28.566 INFO:tasks.rados.rados.0.trial118.stdout:2472: snap_remove snap 262 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2472: done (4 left) 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2473: read oid 49 snap -1 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2473: expect deleted 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: finishing write tid 3 to trial11845692-30 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2474: read oid 48 snap -1 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2474: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2475: rollback oid 2 current snap is 266 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 238 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: finishing write tid 4 to trial11845692-30 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: oid 30 updating version 0 to 1420 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: oid 30 updating version 1420 to 1422 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: oid 30 version 1422 is already newer than 1421 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1422 (ObjNum 880 snap 266 seq_num 880) dirty exists 2026-02-17T05:38:29.336 INFO:tasks.rados.rados.0.trial118.stdout:2468: left oid 30 (ObjNum 880 snap 266 seq_num 880) 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: finishing write tid 1 to trial11845692-17 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: finishing write tid 2 to trial11845692-17 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: finishing write tid 3 to trial11845692-17 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: finishing write tid 4 to trial11845692-17 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: finishing write tid 5 to trial11845692-17 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: oid 17 updating version 0 to 1274 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: oid 17 updating version 1274 to 1276 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: oid 17 version 1276 is already newer than 1275 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: oid 17 version 1276 is already newer than 1273 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1276 (ObjNum 881 snap 266 seq_num 881) dirty exists 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: left oid 17 (ObjNum 881 snap 266 seq_num 881) 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2470: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2470: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2470: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1110 (ObjNum 865 snap 261 seq_num 865) dirty exists 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2471: finishing write tid 1 to trial11845692-33 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2468: done (6 left) 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2469: done (5 left) 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2470: done (4 left) 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2476: write (excl) oid 40 current snap is 266 2026-02-17T05:38:29.337 INFO:tasks.rados.rados.0.trial118.stdout:2476: seq_num 883 ranges {440581=741815,1604306=656626,2732032=108549} 2026-02-17T05:38:29.340 INFO:tasks.rados.rados.0.trial118.stdout:2476: writing trial11845692-40 from 440581 to 1182396 tid 1 2026-02-17T05:38:29.345 INFO:tasks.rados.rados.0.trial118.stdout:2476: writing trial11845692-40 from 1604306 to 2260932 tid 2 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2476: writing trial11845692-40 from 2732032 to 2840581 tid 3 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2477: snap_create 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2471: finishing write tid 2 to trial11845692-33 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2471: finishing write tid 3 to trial11845692-33 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2471: finishing write tid 4 to trial11845692-33 2026-02-17T05:38:29.347 INFO:tasks.rados.rados.0.trial118.stdout:2471: finishing write tid 5 to trial11845692-33 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2471: oid 33 updating version 0 to 1425 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2471: oid 33 version 1425 is already newer than 1423 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2471: oid 33 version 1425 is already newer than 1424 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2471: oid 33 updating version 1425 to 1426 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1426 (ObjNum 882 snap 266 seq_num 882) dirty exists 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2471: left oid 33 (ObjNum 882 snap 266 seq_num 882) 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2475: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2475: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2475: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1534 (ObjNum 722 snap 211 seq_num 722) dirty exists 2026-02-17T05:38:29.348 INFO:tasks.rados.rados.0.trial118.stdout:2474: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:38:29.414 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1132203 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: finishing write tid 1 to trial11845692-40 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: finishing write tid 2 to trial11845692-40 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: finishing write tid 3 to trial11845692-40 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: finishing write tid 4 to trial11845692-40 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: finishing write tid 5 to trial11845692-40 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: oid 40 updating version 0 to 1434 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: oid 40 version 1434 is already newer than 1432 2026-02-17T05:38:29.516 INFO:tasks.rados.rados.0.trial118.stdout:2476: oid 40 updating version 1434 to 1435 2026-02-17T05:38:29.517 INFO:tasks.rados.rados.0.trial118.stdout:2476: oid 40 version 1435 is already newer than 1433 2026-02-17T05:38:29.517 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1435 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:38:29.517 INFO:tasks.rados.rados.0.trial118.stdout:2476: left oid 40 (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2471: done (5 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2473: done (4 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2474: done (3 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2475: done (2 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2476: done (1 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2477: done (0 left) 2026-02-17T05:38:30.318 INFO:tasks.rados.rados.0.trial118.stdout:2478: snap_remove snap 249 2026-02-17T05:38:31.321 INFO:tasks.rados.rados.0.trial118.stdout:2478: done (0 left) 2026-02-17T05:38:31.321 INFO:tasks.rados.rados.0.trial118.stdout:2479: read oid 40 snap -1 2026-02-17T05:38:31.321 INFO:tasks.rados.rados.0.trial118.stdout:2479: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:38:31.321 INFO:tasks.rados.rados.0.trial118.stdout:2480: snap_create 2026-02-17T05:38:31.328 INFO:tasks.rados.rados.0.trial118.stdout:2479: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:38:31.341 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2546003 2026-02-17T05:38:31.350 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:32.322 INFO:tasks.rados.rados.0.trial118.stdout:2479: done (1 left) 2026-02-17T05:38:32.322 INFO:tasks.rados.rados.0.trial118.stdout:2480: done (0 left) 2026-02-17T05:38:32.322 INFO:tasks.rados.rados.0.trial118.stdout:2481: snap_remove snap 265 2026-02-17T05:38:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2481: done (0 left) 2026-02-17T05:38:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2482: copy_from oid 31 from oid 49 current snap is 268 2026-02-17T05:38:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2483: write (excl) oid 16 current snap is 268 2026-02-17T05:38:33.323 INFO:tasks.rados.rados.0.trial118.stdout:2483: seq_num 884 ranges {457388=417064,1546435=516637,2643102=214286} 2026-02-17T05:38:33.327 INFO:tasks.rados.rados.0.trial118.stdout:2483: writing trial11845692-16 from 457388 to 874452 tid 1 2026-02-17T05:38:33.331 INFO:tasks.rados.rados.0.trial118.stdout:2483: writing trial11845692-16 from 1546435 to 2063072 tid 2 2026-02-17T05:38:33.335 INFO:tasks.rados.rados.0.trial118.stdout:2483: writing trial11845692-16 from 2643102 to 2857388 tid 3 2026-02-17T05:38:33.335 INFO:tasks.rados.rados.0.trial118.stdout:2484: snap_remove snap 263 2026-02-17T05:38:34.328 INFO:tasks.rados.rados.0.trial118.stdout:2484: done (2 left) 2026-02-17T05:38:34.328 INFO:tasks.rados.rados.0.trial118.stdout:2485: delete oid 36 current snap is 268 2026-02-17T05:38:34.328 INFO:tasks.rados.rados.0.trial118.stdout:2482: finishing copy_from to trial11845692-31 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2482: got expected ENOENT (src dne) 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2482: finishing copy_from racing read to trial11845692-31 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: finishing write tid 1 to trial11845692-16 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: finishing write tid 2 to trial11845692-16 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: finishing write tid 3 to trial11845692-16 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: finishing write tid 4 to trial11845692-16 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: finishing write tid 5 to trial11845692-16 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: oid 16 updating version 0 to 1389 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: oid 16 version 1389 is already newer than 1388 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: oid 16 version 1389 is already newer than 1387 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:2483: oid 16 version 1389 is already newer than 1386 2026-02-17T05:38:34.329 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1389 (ObjNum 884 snap 268 seq_num 884) dirty exists 2026-02-17T05:38:34.330 INFO:tasks.rados.rados.0.trial118.stdout:2483: left oid 16 (ObjNum 884 snap 268 seq_num 884) 2026-02-17T05:38:34.330 INFO:tasks.rados.rados.0.trial118.stdout:2482: done (2 left) 2026-02-17T05:38:34.330 INFO:tasks.rados.rados.0.trial118.stdout:2483: done (1 left) 2026-02-17T05:38:34.330 INFO:tasks.rados.rados.0.trial118.stdout:2485: done (0 left) 2026-02-17T05:38:34.330 INFO:tasks.rados.rados.0.trial118.stdout:2486: delete oid 7 current snap is 268 2026-02-17T05:38:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2486: done (0 left) 2026-02-17T05:38:34.331 INFO:tasks.rados.rados.0.trial118.stdout:2487: write (excl) oid 49 current snap is 268 2026-02-17T05:38:34.332 INFO:tasks.rados.rados.0.trial118.stdout:2487: seq_num 887 ranges {507809=642811,1721881=663964} 2026-02-17T05:38:34.337 INFO:tasks.rados.rados.0.trial118.stdout:2487: writing trial11845692-49 from 507809 to 1150620 tid 1 2026-02-17T05:38:34.342 INFO:tasks.rados.rados.0.trial118.stdout:2487: writing trial11845692-49 from 1721881 to 2385845 tid 2 2026-02-17T05:38:34.342 INFO:tasks.rados.rados.0.trial118.stdout:2488: snap_remove snap 238 2026-02-17T05:38:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2488: done (1 left) 2026-02-17T05:38:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2489: delete oid 30 current snap is 268 2026-02-17T05:38:35.319 INFO:tasks.rados.rados.0.trial118.stdout:2487: finishing write tid 1 to trial11845692-49 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: finishing write tid 2 to trial11845692-49 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: finishing write tid 3 to trial11845692-49 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: finishing write tid 4 to trial11845692-49 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: oid 49 updating version 0 to 1189 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: oid 49 updating version 1189 to 1191 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: oid 49 version 1191 is already newer than 1190 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1191 (ObjNum 887 snap 268 seq_num 887) dirty exists 2026-02-17T05:38:35.320 INFO:tasks.rados.rados.0.trial118.stdout:2487: left oid 49 (ObjNum 887 snap 268 seq_num 887) 2026-02-17T05:38:35.323 INFO:tasks.rados.rados.0.trial118.stdout:2487: done (1 left) 2026-02-17T05:38:35.324 INFO:tasks.rados.rados.0.trial118.stdout:2489: done (0 left) 2026-02-17T05:38:35.324 INFO:tasks.rados.rados.0.trial118.stdout:2490: write (excl) oid 26 current snap is 268 2026-02-17T05:38:35.324 INFO:tasks.rados.rados.0.trial118.stdout:2490: seq_num 889 ranges {541423=793309,2122492=667633} 2026-02-17T05:38:35.329 INFO:tasks.rados.rados.0.trial118.stdout:2490: writing trial11845692-26 from 541423 to 1334732 tid 1 2026-02-17T05:38:35.335 INFO:tasks.rados.rados.0.trial118.stdout:2490: writing trial11845692-26 from 2122492 to 2790125 tid 2 2026-02-17T05:38:35.335 INFO:tasks.rados.rados.0.trial118.stdout:2491: snap_remove snap 259 2026-02-17T05:38:36.330 INFO:tasks.rados.rados.0.trial118.stdout:2491: done (1 left) 2026-02-17T05:38:36.330 INFO:tasks.rados.rados.0.trial118.stdout:2492: write oid 21 current snap is 268 2026-02-17T05:38:36.330 INFO:tasks.rados.rados.0.trial118.stdout:2492: seq_num 890 ranges {558230=584911,1897327=527644,2923993=34237} 2026-02-17T05:38:36.336 INFO:tasks.rados.rados.0.trial118.stdout:2492: writing trial11845692-21 from 558230 to 1143141 tid 1 2026-02-17T05:38:36.340 INFO:tasks.rados.rados.0.trial118.stdout:2492: writing trial11845692-21 from 1897327 to 2424971 tid 2 2026-02-17T05:38:36.342 INFO:tasks.rados.rados.0.trial118.stdout:2492: writing trial11845692-21 from 2923993 to 2958230 tid 3 2026-02-17T05:38:36.342 INFO:tasks.rados.rados.0.trial118.stdout:2493: snap_remove snap 250 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:2493: done (2 left) 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:2494: rollback oid 42 current snap is 268 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 254 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:2490: finishing write tid 1 to trial11845692-26 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:2490: finishing write tid 2 to trial11845692-26 2026-02-17T05:38:37.333 INFO:tasks.rados.rados.0.trial118.stdout:2490: finishing write tid 3 to trial11845692-26 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2490: finishing write tid 4 to trial11845692-26 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2490: oid 26 updating version 0 to 1271 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2490: oid 26 version 1271 is already newer than 1270 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2490: oid 26 updating version 1271 to 1272 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1272 (ObjNum 889 snap 268 seq_num 889) dirty exists 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2490: left oid 26 (ObjNum 889 snap 268 seq_num 889) 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: finishing write tid 1 to trial11845692-21 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: finishing write tid 2 to trial11845692-21 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: finishing write tid 3 to trial11845692-21 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: finishing write tid 4 to trial11845692-21 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: finishing write tid 5 to trial11845692-21 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: oid 21 updating version 0 to 1475 2026-02-17T05:38:37.334 INFO:tasks.rados.rados.0.trial118.stdout:2492: oid 21 updating version 1475 to 1476 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2492: oid 21 updating version 1476 to 1477 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2492: oid 21 version 1477 is already newer than 1472 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1477 (ObjNum 890 snap 268 seq_num 890) dirty exists 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2492: left oid 21 (ObjNum 890 snap 268 seq_num 890) 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2490: done (2 left) 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2492: done (1 left) 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2495: write (excl) oid 31 current snap is 268 2026-02-17T05:38:37.335 INFO:tasks.rados.rados.0.trial118.stdout:2495: seq_num 891 ranges {575037=660160,1955809=671302} 2026-02-17T05:38:37.337 INFO:tasks.rados.rados.0.trial118.stdout:2495: writing trial11845692-31 from 575037 to 1235197 tid 1 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:2495: writing trial11845692-31 from 1955809 to 2627111 tid 2 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:2496: snap_create 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:2494: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:2494: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1234 (ObjNum 529 snap 0 seq_num 12879123) dirty dne 2026-02-17T05:38:37.343 INFO:tasks.rados.rados.0.trial118.stdout:2495: finishing write tid 1 to trial11845692-31 2026-02-17T05:38:37.345 INFO:tasks.rados.rados.0.trial118.stdout:2495: finishing write tid 2 to trial11845692-31 2026-02-17T05:38:37.345 INFO:tasks.rados.rados.0.trial118.stdout:2495: finishing write tid 3 to trial11845692-31 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:2495: finishing write tid 4 to trial11845692-31 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:2495: oid 31 updating version 0 to 1581 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:2495: oid 31 version 1581 is already newer than 1580 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:2495: oid 31 updating version 1581 to 1582 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1582 (ObjNum 891 snap 268 seq_num 891) dirty exists 2026-02-17T05:38:37.346 INFO:tasks.rados.rados.0.trial118.stdout:2495: left oid 31 (ObjNum 891 snap 268 seq_num 891) 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2494: done (2 left) 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2495: done (1 left) 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2496: done (0 left) 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2497: read oid 2 snap 264 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2497: expect (ObjNum 855 snap 259 seq_num 855) 2026-02-17T05:38:38.335 INFO:tasks.rados.rados.0.trial118.stdout:2498: delete oid 50 current snap is 269 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2498: done (1 left) 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2499: read oid 14 snap -1 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2499: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2500: rollback oid 6 current snap is 269 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 254 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2501: write (excl) oid 32 current snap is 269 2026-02-17T05:38:38.337 INFO:tasks.rados.rados.0.trial118.stdout:2501: seq_num 893 ranges {608651=410658,1556420=674971,2773556=235095} 2026-02-17T05:38:38.341 INFO:tasks.rados.rados.0.trial118.stdout:2501: writing trial11845692-32 from 608651 to 1019309 tid 1 2026-02-17T05:38:38.346 INFO:tasks.rados.rados.0.trial118.stdout:2501: writing trial11845692-32 from 1556420 to 2231391 tid 2 2026-02-17T05:38:38.349 INFO:tasks.rados.rados.0.trial118.stdout:2501: writing trial11845692-32 from 2773556 to 3008651 tid 3 2026-02-17T05:38:38.349 INFO:tasks.rados.rados.0.trial118.stdout:2502: snap_remove snap 260 2026-02-17T05:38:39.337 INFO:tasks.rados.rados.0.trial118.stdout:2502: done (4 left) 2026-02-17T05:38:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2503: read oid 13 snap -1 2026-02-17T05:38:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2503: expect (ObjNum 865 snap 261 seq_num 865) 2026-02-17T05:38:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2504: write (excl) oid 8 current snap is 269 2026-02-17T05:38:39.338 INFO:tasks.rados.rados.0.trial118.stdout:2504: seq_num 894 ranges {625458=485907,1614902=534982,2917332=108126} 2026-02-17T05:38:39.342 INFO:tasks.rados.rados.0.trial118.stdout:2504: writing trial11845692-8 from 625458 to 1111365 tid 1 2026-02-17T05:38:39.346 INFO:tasks.rados.rados.0.trial118.stdout:2504: writing trial11845692-8 from 1614902 to 2149884 tid 2 2026-02-17T05:38:39.349 INFO:tasks.rados.rados.0.trial118.stdout:2504: writing trial11845692-8 from 2917332 to 3025458 tid 3 2026-02-17T05:38:39.349 INFO:tasks.rados.rados.0.trial118.stdout:2505: copy_from oid 23 from oid 38 current snap is 269 2026-02-17T05:38:39.349 INFO:tasks.rados.rados.0.trial118.stdout:2497: expect (ObjNum 855 snap 259 seq_num 855) 2026-02-17T05:38:39.376 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 887015 2026-02-17T05:38:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2500: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:38:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2500: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:38:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2500: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:38:39.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1262 (ObjNum 796 snap 240 seq_num 796) dirty exists 2026-02-17T05:38:39.387 INFO:tasks.rados.rados.0.trial118.stdout:2499: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: finishing write tid 1 to trial11845692-32 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2497: done (6 left) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2499: done (5 left) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2500: done (4 left) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2506: delete oid 24 current snap is 269 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: finishing write tid 2 to trial11845692-32 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: finishing write tid 3 to trial11845692-32 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: finishing write tid 4 to trial11845692-32 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: finishing write tid 5 to trial11845692-32 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: oid 32 updating version 0 to 1193 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: oid 32 updating version 1193 to 1195 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: oid 32 version 1195 is already newer than 1194 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: oid 32 version 1195 is already newer than 1192 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1195 (ObjNum 893 snap 269 seq_num 893) dirty exists 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2501: left oid 32 (ObjNum 893 snap 269 seq_num 893) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:2503: expect (ObjNum 865 snap 261 seq_num 865) 2026-02-17T05:38:39.446 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:39.532 INFO:tasks.rados.rados.0.trial118.stdout:2504: finishing write tid 1 to trial11845692-8 2026-02-17T05:38:39.532 INFO:tasks.rados.rados.0.trial118.stdout:2501: done (4 left) 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2503: done (3 left) 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2506: done (2 left) 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2507: snap_create 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: finishing write tid 2 to trial11845692-8 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: finishing write tid 3 to trial11845692-8 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: finishing write tid 4 to trial11845692-8 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: finishing write tid 5 to trial11845692-8 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: oid 8 updating version 0 to 1590 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: oid 8 version 1590 is already newer than 1584 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: oid 8 version 1590 is already newer than 1589 2026-02-17T05:38:39.533 INFO:tasks.rados.rados.0.trial118.stdout:2504: oid 8 updating version 1590 to 1591 2026-02-17T05:38:39.534 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1591 (ObjNum 894 snap 269 seq_num 894) dirty exists 2026-02-17T05:38:39.534 INFO:tasks.rados.rados.0.trial118.stdout:2504: left oid 8 (ObjNum 894 snap 269 seq_num 894) 2026-02-17T05:38:39.534 INFO:tasks.rados.rados.0.trial118.stdout:2505: finishing copy_from racing read to trial11845692-23 2026-02-17T05:38:39.534 INFO:tasks.rados.rados.0.trial118.stdout:2505: finishing copy_from to trial11845692-23 2026-02-17T05:38:39.534 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1197 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:38:40.320 INFO:tasks.rados.rados.0.trial118.stdout:2504: done (2 left) 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2505: done (1 left) 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2507: done (0 left) 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2508: read oid 48 snap -1 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2508: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2509: write oid 22 current snap is 270 2026-02-17T05:38:40.321 INFO:tasks.rados.rados.0.trial118.stdout:2509: seq_num 896 ranges {659072=636405,1731866=422298,2855825=203247} 2026-02-17T05:38:40.325 INFO:tasks.rados.rados.0.trial118.stdout:2509: writing trial11845692-22 from 659072 to 1295477 tid 1 2026-02-17T05:38:40.328 INFO:tasks.rados.rados.0.trial118.stdout:2509: writing trial11845692-22 from 1731866 to 2154164 tid 2 2026-02-17T05:38:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2509: writing trial11845692-22 from 2855825 to 3059072 tid 3 2026-02-17T05:38:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2510: rollback oid 18 current snap is 270 2026-02-17T05:38:40.332 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 253 2026-02-17T05:38:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2508: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2509: finishing write tid 1 to trial11845692-22 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2509: finishing write tid 2 to trial11845692-22 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2508: done (2 left) 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2511: delete oid 46 current snap is 270 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2509: finishing write tid 3 to trial11845692-22 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2509: finishing write tid 4 to trial11845692-22 2026-02-17T05:38:40.497 INFO:tasks.rados.rados.0.trial118.stdout:2509: finishing write tid 5 to trial11845692-22 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2509: oid 22 updating version 0 to 1240 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2509: oid 22 updating version 1240 to 1241 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2509: oid 22 updating version 1241 to 1243 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2509: oid 22 version 1243 is already newer than 1242 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1243 (ObjNum 896 snap 270 seq_num 896) dirty exists 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2509: left oid 22 (ObjNum 896 snap 270 seq_num 896) 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2510: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2510: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:2510: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:38:40.498 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1267 (ObjNum 699 snap 202 seq_num 699) dirty exists 2026-02-17T05:38:40.499 INFO:tasks.rados.rados.0.trial118.stdout:2509: done (2 left) 2026-02-17T05:38:40.499 INFO:tasks.rados.rados.0.trial118.stdout:2510: done (1 left) 2026-02-17T05:38:40.499 INFO:tasks.rados.rados.0.trial118.stdout:2511: done (0 left) 2026-02-17T05:38:40.500 INFO:tasks.rados.rados.0.trial118.stdout:2512: read oid 41 snap 252 2026-02-17T05:38:40.500 INFO:tasks.rados.rados.0.trial118.stdout:2512: expect (ObjNum 805 snap 244 seq_num 805) 2026-02-17T05:38:40.500 INFO:tasks.rados.rados.0.trial118.stdout:2513: write oid 2 current snap is 270 2026-02-17T05:38:40.500 INFO:tasks.rados.rados.0.trial118.stdout:2513: seq_num 898 ranges {692686=503256,1848830=425967,2910671=182015} 2026-02-17T05:38:40.504 INFO:tasks.rados.rados.0.trial118.stdout:2513: writing trial11845692-2 from 692686 to 1195942 tid 1 2026-02-17T05:38:40.508 INFO:tasks.rados.rados.0.trial118.stdout:2513: writing trial11845692-2 from 1848830 to 2274797 tid 2 2026-02-17T05:38:40.511 INFO:tasks.rados.rados.0.trial118.stdout:2513: writing trial11845692-2 from 2910671 to 3092686 tid 3 2026-02-17T05:38:40.511 INFO:tasks.rados.rados.0.trial118.stdout:2514: write oid 50 current snap is 270 2026-02-17T05:38:40.511 INFO:tasks.rados.rados.0.trial118.stdout:2514: seq_num 899 ranges {709493=578505,1907312=685978} 2026-02-17T05:38:40.516 INFO:tasks.rados.rados.0.trial118.stdout:2514: writing trial11845692-50 from 709493 to 1287998 tid 1 2026-02-17T05:38:40.521 INFO:tasks.rados.rados.0.trial118.stdout:2514: writing trial11845692-50 from 1907312 to 2593290 tid 2 2026-02-17T05:38:40.521 INFO:tasks.rados.rados.0.trial118.stdout:2515: delete oid 44 current snap is 270 2026-02-17T05:38:40.521 INFO:tasks.rados.rados.0.trial118.stdout:2512: expect (ObjNum 805 snap 244 seq_num 805) 2026-02-17T05:38:40.547 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2354667 2026-02-17T05:38:40.582 INFO:tasks.rados.rados.0.trial118.stdout:2513: finishing write tid 1 to trial11845692-2 2026-02-17T05:38:40.582 INFO:tasks.rados.rados.0.trial118.stdout:2513: finishing write tid 2 to trial11845692-2 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: finishing write tid 3 to trial11845692-2 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: finishing write tid 4 to trial11845692-2 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2512: done (3 left) 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2515: done (2 left) 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2516: rollback oid 41 current snap is 270 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 264 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: finishing write tid 5 to trial11845692-2 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: oid 2 updating version 0 to 1593 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: oid 2 updating version 1593 to 1594 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: oid 2 updating version 1594 to 1595 2026-02-17T05:38:40.583 INFO:tasks.rados.rados.0.trial118.stdout:2513: oid 2 updating version 1595 to 1596 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1596 (ObjNum 898 snap 270 seq_num 898) dirty exists 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2513: left oid 2 (ObjNum 898 snap 270 seq_num 898) 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: finishing write tid 1 to trial11845692-50 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: finishing write tid 2 to trial11845692-50 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: finishing write tid 3 to trial11845692-50 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: finishing write tid 4 to trial11845692-50 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: oid 50 updating version 0 to 1115 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: oid 50 updating version 1115 to 1116 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: oid 50 updating version 1116 to 1117 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1117 (ObjNum 899 snap 270 seq_num 899) dirty exists 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: left oid 50 (ObjNum 899 snap 270 seq_num 899) 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2513: done (2 left) 2026-02-17T05:38:40.584 INFO:tasks.rados.rados.0.trial118.stdout:2514: done (1 left) 2026-02-17T05:38:40.585 INFO:tasks.rados.rados.0.trial118.stdout:2517: copy_from oid 24 from oid 15 current snap is 270 2026-02-17T05:38:40.585 INFO:tasks.rados.rados.0.trial118.stdout:2518: copy_from oid 18 from oid 38 current snap is 270 2026-02-17T05:38:40.585 INFO:tasks.rados.rados.0.trial118.stdout:2519: read oid 11 snap -1 2026-02-17T05:38:40.585 INFO:tasks.rados.rados.0.trial118.stdout:2519: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:38:40.585 INFO:tasks.rados.rados.0.trial118.stdout:2520: snap_remove snap 268 2026-02-17T05:38:41.343 INFO:tasks.rados.rados.0.trial118.stdout:2520: done (4 left) 2026-02-17T05:38:41.344 INFO:tasks.rados.rados.0.trial118.stdout:2521: write (excl) oid 14 current snap is 270 2026-02-17T05:38:41.344 INFO:tasks.rados.rados.0.trial118.stdout:2521: seq_num 901 ranges {743107=729003,1907923=689647} 2026-02-17T05:38:41.349 INFO:tasks.rados.rados.0.trial118.stdout:2521: writing trial11845692-14 from 743107 to 1472110 tid 1 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:2521: writing trial11845692-14 from 1907923 to 2597570 tid 2 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:2522: delete oid 37 current snap is 270 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:2516: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:2516: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:2519: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:38:41.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 168759 2026-02-17T05:38:41.387 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 944970 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2516: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1393 (ObjNum 805 snap 244 seq_num 805) dirty exists 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2518: finishing copy_from racing read to trial11845692-18 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2517: finishing copy_from racing read to trial11845692-24 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2518: finishing copy_from to trial11845692-18 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1197 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2517: finishing copy_from to trial11845692-24 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1221 (ObjNum 872 snap 262 seq_num 872) dirty exists 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2521: finishing write tid 1 to trial11845692-14 2026-02-17T05:38:41.434 INFO:tasks.rados.rados.0.trial118.stdout:2521: finishing write tid 2 to trial11845692-14 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: finishing write tid 3 to trial11845692-14 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: finishing write tid 4 to trial11845692-14 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: oid 14 updating version 0 to 1213 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: oid 14 version 1213 is already newer than 1212 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: oid 14 updating version 1213 to 1214 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1214 (ObjNum 901 snap 270 seq_num 901) dirty exists 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: left oid 14 (ObjNum 901 snap 270 seq_num 901) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2516: done (5 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2517: done (4 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2518: done (3 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2519: done (2 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2521: done (1 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2522: done (0 left) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2523: read oid 17 snap -1 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2523: expect (ObjNum 881 snap 266 seq_num 881) 2026-02-17T05:38:41.435 INFO:tasks.rados.rados.0.trial118.stdout:2524: snap_create 2026-02-17T05:38:41.440 INFO:tasks.rados.rados.0.trial118.stdout:2523: expect (ObjNum 881 snap 266 seq_num 881) 2026-02-17T05:38:41.440 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 294150 2026-02-17T05:38:41.520 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 95051 2026-02-17T05:38:42.346 INFO:tasks.rados.rados.0.trial118.stdout:2523: done (1 left) 2026-02-17T05:38:42.346 INFO:tasks.rados.rados.0.trial118.stdout:2524: done (0 left) 2026-02-17T05:38:42.346 INFO:tasks.rados.rados.0.trial118.stdout:2525: write oid 7 current snap is 271 2026-02-17T05:38:42.346 INFO:tasks.rados.rados.0.trial118.stdout:2525: seq_num 903 ranges {776721=479501,2024887=693316} 2026-02-17T05:38:42.351 INFO:tasks.rados.rados.0.trial118.stdout:2525: writing trial11845692-7 from 776721 to 1256222 tid 1 2026-02-17T05:38:42.356 INFO:tasks.rados.rados.0.trial118.stdout:2525: writing trial11845692-7 from 2024887 to 2718203 tid 2 2026-02-17T05:38:42.356 INFO:tasks.rados.rados.0.trial118.stdout:2526: delete oid 4 current snap is 271 2026-02-17T05:38:42.356 INFO:tasks.rados.rados.0.trial118.stdout:2525: finishing write tid 1 to trial11845692-7 2026-02-17T05:38:42.358 INFO:tasks.rados.rados.0.trial118.stdout:2525: finishing write tid 2 to trial11845692-7 2026-02-17T05:38:42.358 INFO:tasks.rados.rados.0.trial118.stdout:2525: finishing write tid 3 to trial11845692-7 2026-02-17T05:38:42.358 INFO:tasks.rados.rados.0.trial118.stdout:2525: finishing write tid 4 to trial11845692-7 2026-02-17T05:38:42.358 INFO:tasks.rados.rados.0.trial118.stdout:2525: oid 7 updating version 0 to 1395 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2525: oid 7 updating version 1395 to 1396 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2525: oid 7 version 1396 is already newer than 1394 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1396 (ObjNum 903 snap 271 seq_num 903) dirty exists 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2525: left oid 7 (ObjNum 903 snap 271 seq_num 903) 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2525: done (1 left) 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2526: done (0 left) 2026-02-17T05:38:42.359 INFO:tasks.rados.rados.0.trial118.stdout:2527: delete oid 50 current snap is 271 2026-02-17T05:38:42.362 INFO:tasks.rados.rados.0.trial118.stdout:2527: done (0 left) 2026-02-17T05:38:42.362 INFO:tasks.rados.rados.0.trial118.stdout:2528: read oid 29 snap -1 2026-02-17T05:38:42.362 INFO:tasks.rados.rados.0.trial118.stdout:2528: expect (ObjNum 857 snap 259 seq_num 857) 2026-02-17T05:38:42.362 INFO:tasks.rados.rados.0.trial118.stdout:2529: snap_create 2026-02-17T05:38:42.364 INFO:tasks.rados.rados.0.trial118.stdout:2528: expect (ObjNum 857 snap 259 seq_num 857) 2026-02-17T05:38:42.381 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2528: done (1 left) 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2529: done (0 left) 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2530: read oid 24 snap -1 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2530: expect (ObjNum 872 snap 262 seq_num 872) 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2531: read oid 21 snap -1 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2531: expect (ObjNum 890 snap 268 seq_num 890) 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2532: copy_from oid 2 from oid 27 current snap is 272 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2533: rollback oid 1 current snap is 272 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 247 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2534: rollback oid 36 current snap is 272 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 256 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2535: read oid 44 snap -1 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2535: expect deleted 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2536: copy_from oid 46 from oid 35 current snap is 272 2026-02-17T05:38:43.348 INFO:tasks.rados.rados.0.trial118.stdout:2537: read oid 38 snap -1 2026-02-17T05:38:43.349 INFO:tasks.rados.rados.0.trial118.stdout:2537: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:43.349 INFO:tasks.rados.rados.0.trial118.stdout:2538: copy_from oid 22 from oid 49 current snap is 272 2026-02-17T05:38:43.349 INFO:tasks.rados.rados.0.trial118.stdout:2539: read oid 11 snap -1 2026-02-17T05:38:43.349 INFO:tasks.rados.rados.0.trial118.stdout:2539: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:38:43.349 INFO:tasks.rados.rados.0.trial118.stdout:2540: snap_create 2026-02-17T05:38:43.350 INFO:tasks.rados.rados.0.trial118.stdout:2534: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:38:43.350 INFO:tasks.rados.rados.0.trial118.stdout:2534: finishing rollback tid 2 to trial11845692-36 2026-02-17T05:38:43.350 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1245 (ObjNum 701 snap 202 seq_num 701) dirty exists 2026-02-17T05:38:43.353 INFO:tasks.rados.rados.0.trial118.stdout:2539: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:38:43.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1313721 2026-02-17T05:38:43.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.435 INFO:tasks.rados.rados.0.trial118.stdout:2532: finishing copy_from to trial11845692-2 2026-02-17T05:38:43.435 INFO:tasks.rados.rados.0.trial118.stdout:2532: got expected ENOENT (src dne) 2026-02-17T05:38:43.435 INFO:tasks.rados.rados.0.trial118.stdout:2532: finishing copy_from racing read to trial11845692-2 2026-02-17T05:38:43.435 INFO:tasks.rados.rados.0.trial118.stdout:2537: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:43.435 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.578 INFO:tasks.rados.rados.0.trial118.stdout:2530: expect (ObjNum 872 snap 262 seq_num 872) 2026-02-17T05:38:43.618 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.637 INFO:tasks.rados.rados.0.trial118.stdout:2538: finishing copy_from racing read to trial11845692-22 2026-02-17T05:38:43.638 INFO:tasks.rados.rados.0.trial118.stdout:2531: expect (ObjNum 890 snap 268 seq_num 890) 2026-02-17T05:38:43.638 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.659 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:43.703 INFO:tasks.rados.rados.0.trial118.stdout:2533: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:38:43.703 INFO:tasks.rados.rados.0.trial118.stdout:2533: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:2533: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1499 (ObjNum 815 snap 247 seq_num 815) dirty exists 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:2538: finishing copy_from to trial11845692-22 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1191 (ObjNum 887 snap 268 seq_num 887) dirty exists 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:2536: finishing copy_from racing read to trial11845692-46 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:2536: finishing copy_from to trial11845692-46 2026-02-17T05:38:43.704 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1264 (ObjNum 806 snap 244 seq_num 806) dirty exists 2026-02-17T05:38:44.354 INFO:tasks.rados.rados.0.trial118.stdout:2530: done (10 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2531: done (9 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2532: done (8 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2533: done (7 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2534: done (6 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2535: done (5 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2536: done (4 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2537: done (3 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2538: done (2 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2539: done (1 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2540: done (0 left) 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2541: write (excl) oid 26 current snap is 273 2026-02-17T05:38:44.355 INFO:tasks.rados.rados.0.trial118.stdout:2541: seq_num 906 ranges {427142=421601,1400333=440643,2613702=450326} 2026-02-17T05:38:44.357 INFO:tasks.rados.rados.0.trial118.stdout:2541: writing trial11845692-26 from 427142 to 848743 tid 1 2026-02-17T05:38:44.361 INFO:tasks.rados.rados.0.trial118.stdout:2541: writing trial11845692-26 from 1400333 to 1840976 tid 2 2026-02-17T05:38:44.365 INFO:tasks.rados.rados.0.trial118.stdout:2541: writing trial11845692-26 from 2613702 to 3064028 tid 3 2026-02-17T05:38:44.366 INFO:tasks.rados.rados.0.trial118.stdout:2542: write oid 13 current snap is 273 2026-02-17T05:38:44.366 INFO:tasks.rados.rados.0.trial118.stdout:2542: seq_num 907 ranges {443949=496850,1458815=584301,2641125=602824} 2026-02-17T05:38:44.369 INFO:tasks.rados.rados.0.trial118.stdout:2542: writing trial11845692-13 from 443949 to 940799 tid 1 2026-02-17T05:38:44.373 INFO:tasks.rados.rados.0.trial118.stdout:2542: writing trial11845692-13 from 1458815 to 2043116 tid 2 2026-02-17T05:38:44.378 INFO:tasks.rados.rados.0.trial118.stdout:2542: writing trial11845692-13 from 2641125 to 3243949 tid 3 2026-02-17T05:38:44.378 INFO:tasks.rados.rados.0.trial118.stdout:2543: delete oid 20 current snap is 273 2026-02-17T05:38:44.378 INFO:tasks.rados.rados.0.trial118.stdout:2541: finishing write tid 1 to trial11845692-26 2026-02-17T05:38:44.378 INFO:tasks.rados.rados.0.trial118.stdout:2541: finishing write tid 2 to trial11845692-26 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: finishing write tid 3 to trial11845692-26 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: finishing write tid 4 to trial11845692-26 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: finishing write tid 5 to trial11845692-26 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: oid 26 updating version 0 to 1275 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: oid 26 updating version 1275 to 1276 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: oid 26 version 1276 is already newer than 1273 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: oid 26 version 1276 is already newer than 1274 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1276 (ObjNum 906 snap 273 seq_num 906) dirty exists 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2541: left oid 26 (ObjNum 906 snap 273 seq_num 906) 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2542: finishing write tid 1 to trial11845692-13 2026-02-17T05:38:44.379 INFO:tasks.rados.rados.0.trial118.stdout:2542: finishing write tid 2 to trial11845692-13 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2541: done (2 left) 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2543: done (1 left) 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2544: read oid 7 snap -1 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2544: expect (ObjNum 903 snap 271 seq_num 903) 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2545: read oid 47 snap -1 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2545: expect (ObjNum 860 snap 260 seq_num 860) 2026-02-17T05:38:44.380 INFO:tasks.rados.rados.0.trial118.stdout:2546: rollback oid 2 current snap is 273 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 254 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2547: snap_create 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: finishing write tid 3 to trial11845692-13 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: finishing write tid 4 to trial11845692-13 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: finishing write tid 5 to trial11845692-13 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: oid 13 updating version 0 to 1112 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: oid 13 version 1112 is already newer than 1111 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: oid 13 updating version 1112 to 1114 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: oid 13 version 1114 is already newer than 1113 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1114 (ObjNum 907 snap 273 seq_num 907) dirty exists 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2542: left oid 13 (ObjNum 907 snap 273 seq_num 907) 2026-02-17T05:38:44.381 INFO:tasks.rados.rados.0.trial118.stdout:2546: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:38:44.382 INFO:tasks.rados.rados.0.trial118.stdout:2546: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:38:44.382 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1605 (ObjNum 33 snap 0 seq_num 12463248) dirty dne 2026-02-17T05:38:44.382 INFO:tasks.rados.rados.0.trial118.stdout:2544: expect (ObjNum 903 snap 271 seq_num 903) 2026-02-17T05:38:44.409 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1984175 2026-02-17T05:38:44.443 INFO:tasks.rados.rados.0.trial118.stdout:2545: expect (ObjNum 860 snap 260 seq_num 860) 2026-02-17T05:38:44.443 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:44.460 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:45.321 INFO:tasks.rados.rados.0.trial118.stdout:2542: done (4 left) 2026-02-17T05:38:45.322 INFO:tasks.rados.rados.0.trial118.stdout:2544: done (3 left) 2026-02-17T05:38:45.322 INFO:tasks.rados.rados.0.trial118.stdout:2545: done (2 left) 2026-02-17T05:38:45.322 INFO:tasks.rados.rados.0.trial118.stdout:2546: done (1 left) 2026-02-17T05:38:45.322 INFO:tasks.rados.rados.0.trial118.stdout:2547: done (0 left) 2026-02-17T05:38:45.322 INFO:tasks.rados.rados.0.trial118.stdout:2548: snap_create 2026-02-17T05:38:46.322 INFO:tasks.rados.rados.0.trial118.stdout:2548: done (0 left) 2026-02-17T05:38:46.322 INFO:tasks.rados.rados.0.trial118.stdout:2549: snap_remove snap 274 2026-02-17T05:38:47.324 INFO:tasks.rados.rados.0.trial118.stdout:2549: done (0 left) 2026-02-17T05:38:47.324 INFO:tasks.rados.rados.0.trial118.stdout:2550: write oid 17 current snap is 275 2026-02-17T05:38:47.325 INFO:tasks.rados.rados.0.trial118.stdout:2550: seq_num 909 ranges {477563=647348,1859426=587970,2979618=297945} 2026-02-17T05:38:47.328 INFO:tasks.rados.rados.0.trial118.stdout:2550: writing trial11845692-17 from 477563 to 1124911 tid 1 2026-02-17T05:38:47.333 INFO:tasks.rados.rados.0.trial118.stdout:2550: writing trial11845692-17 from 1859426 to 2447396 tid 2 2026-02-17T05:38:47.336 INFO:tasks.rados.rados.0.trial118.stdout:2550: writing trial11845692-17 from 2979618 to 3277563 tid 3 2026-02-17T05:38:47.336 INFO:tasks.rados.rados.0.trial118.stdout:2551: delete oid 30 current snap is 275 2026-02-17T05:38:47.337 INFO:tasks.rados.rados.0.trial118.stdout:2550: finishing write tid 1 to trial11845692-17 2026-02-17T05:38:47.337 INFO:tasks.rados.rados.0.trial118.stdout:2550: finishing write tid 2 to trial11845692-17 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2550: finishing write tid 3 to trial11845692-17 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2550: finishing write tid 4 to trial11845692-17 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2551: done (1 left) 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2552: rollback oid 37 current snap is 275 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 248 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2550: finishing write tid 5 to trial11845692-17 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2550: oid 17 updating version 0 to 1280 2026-02-17T05:38:47.338 INFO:tasks.rados.rados.0.trial118.stdout:2550: oid 17 version 1280 is already newer than 1279 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2550: oid 17 updating version 1280 to 1281 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2550: oid 17 version 1281 is already newer than 1278 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1281 (ObjNum 909 snap 275 seq_num 909) dirty exists 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2550: left oid 17 (ObjNum 909 snap 275 seq_num 909) 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2550: done (1 left) 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2553: read oid 36 snap -1 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2553: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2554: copy_from oid 20 from oid 15 current snap is 275 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2555: read oid 39 snap 269 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2555: expect deleted 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2556: read oid 3 snap -1 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2556: expect deleted 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2557: write oid 49 current snap is 275 2026-02-17T05:38:47.339 INFO:tasks.rados.rados.0.trial118.stdout:2557: seq_num 911 ranges {511177=797846,1976390=591639,3034464=276713} 2026-02-17T05:38:47.343 INFO:tasks.rados.rados.0.trial118.stdout:2557: writing trial11845692-49 from 511177 to 1309023 tid 1 2026-02-17T05:38:47.348 INFO:tasks.rados.rados.0.trial118.stdout:2557: writing trial11845692-49 from 1976390 to 2568029 tid 2 2026-02-17T05:38:47.351 INFO:tasks.rados.rados.0.trial118.stdout:2557: writing trial11845692-49 from 3034464 to 3311177 tid 3 2026-02-17T05:38:47.351 INFO:tasks.rados.rados.0.trial118.stdout:2558: snap_remove snap 256 2026-02-17T05:38:48.327 INFO:tasks.rados.rados.0.trial118.stdout:2558: done (6 left) 2026-02-17T05:38:48.327 INFO:tasks.rados.rados.0.trial118.stdout:2559: copy_from oid 26 from oid 40 current snap is 275 2026-02-17T05:38:48.327 INFO:tasks.rados.rados.0.trial118.stdout:2552: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:38:48.328 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1170 (ObjNum 129 snap 0 seq_num 13056568) dirty dne 2026-02-17T05:38:48.328 INFO:tasks.rados.rados.0.trial118.stdout:2553: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:38:48.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2557: finishing write tid 1 to trial11845692-49 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2554: finishing copy_from racing read to trial11845692-20 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2554: finishing copy_from to trial11845692-20 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1221 (ObjNum 872 snap 262 seq_num 872) dirty exists 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2557: finishing write tid 2 to trial11845692-49 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2557: finishing write tid 3 to trial11845692-49 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2557: finishing write tid 4 to trial11845692-49 2026-02-17T05:38:48.473 INFO:tasks.rados.rados.0.trial118.stdout:2557: finishing write tid 5 to trial11845692-49 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2557: oid 49 updating version 0 to 1198 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2557: oid 49 version 1198 is already newer than 1196 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2557: oid 49 version 1198 is already newer than 1197 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2557: oid 49 updating version 1198 to 1199 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1199 (ObjNum 911 snap 275 seq_num 911) dirty exists 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2557: left oid 49 (ObjNum 911 snap 275 seq_num 911) 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2559: finishing copy_from racing read to trial11845692-26 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2559: finishing copy_from to trial11845692-26 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1435 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2552: done (6 left) 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2553: done (5 left) 2026-02-17T05:38:48.474 INFO:tasks.rados.rados.0.trial118.stdout:2554: done (4 left) 2026-02-17T05:38:48.475 INFO:tasks.rados.rados.0.trial118.stdout:2555: done (3 left) 2026-02-17T05:38:48.475 INFO:tasks.rados.rados.0.trial118.stdout:2556: done (2 left) 2026-02-17T05:38:48.475 INFO:tasks.rados.rados.0.trial118.stdout:2557: done (1 left) 2026-02-17T05:38:48.475 INFO:tasks.rados.rados.0.trial118.stdout:2559: done (0 left) 2026-02-17T05:38:48.475 INFO:tasks.rados.rados.0.trial118.stdout:2560: snap_remove snap 267 2026-02-17T05:38:49.330 INFO:tasks.rados.rados.0.trial118.stdout:2560: done (0 left) 2026-02-17T05:38:49.330 INFO:tasks.rados.rados.0.trial118.stdout:2561: snap_create 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2561: done (0 left) 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2562: read oid 47 snap 273 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2562: expect (ObjNum 860 snap 260 seq_num 860) 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2563: read oid 37 snap -1 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2563: expect deleted 2026-02-17T05:38:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2564: delete oid 31 current snap is 276 2026-02-17T05:38:50.333 INFO:tasks.rados.rados.0.trial118.stdout:2562: expect (ObjNum 860 snap 260 seq_num 860) 2026-02-17T05:38:50.378 INFO:tasks.rados.rados.0.trial118.stdout:2562: done (2 left) 2026-02-17T05:38:50.378 INFO:tasks.rados.rados.0.trial118.stdout:2563: done (1 left) 2026-02-17T05:38:50.378 INFO:tasks.rados.rados.0.trial118.stdout:2564: done (0 left) 2026-02-17T05:38:50.378 INFO:tasks.rados.rados.0.trial118.stdout:2565: write (excl) oid 14 current snap is 276 2026-02-17T05:38:50.378 INFO:tasks.rados.rados.0.trial118.stdout:2565: seq_num 913 ranges {544791=664697,1693354=595308,2689310=445583} 2026-02-17T05:38:50.383 INFO:tasks.rados.rados.0.trial118.stdout:2565: writing trial11845692-14 from 544791 to 1209488 tid 1 2026-02-17T05:38:50.387 INFO:tasks.rados.rados.0.trial118.stdout:2565: writing trial11845692-14 from 1693354 to 2288662 tid 2 2026-02-17T05:38:50.390 INFO:tasks.rados.rados.0.trial118.stdout:2565: writing trial11845692-14 from 2689310 to 3134893 tid 3 2026-02-17T05:38:50.390 INFO:tasks.rados.rados.0.trial118.stdout:2566: delete oid 15 current snap is 276 2026-02-17T05:38:50.390 INFO:tasks.rados.rados.0.trial118.stdout:2565: finishing write tid 1 to trial11845692-14 2026-02-17T05:38:50.390 INFO:tasks.rados.rados.0.trial118.stdout:2565: finishing write tid 2 to trial11845692-14 2026-02-17T05:38:50.391 INFO:tasks.rados.rados.0.trial118.stdout:2565: finishing write tid 3 to trial11845692-14 2026-02-17T05:38:50.391 INFO:tasks.rados.rados.0.trial118.stdout:2565: finishing write tid 4 to trial11845692-14 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: finishing write tid 5 to trial11845692-14 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: oid 14 updating version 0 to 1218 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: oid 14 version 1218 is already newer than 1217 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: oid 14 version 1218 is already newer than 1216 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: oid 14 version 1218 is already newer than 1215 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1218 (ObjNum 913 snap 276 seq_num 913) dirty exists 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: left oid 14 (ObjNum 913 snap 276 seq_num 913) 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2565: done (1 left) 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2566: done (0 left) 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2567: write oid 12 current snap is 276 2026-02-17T05:38:50.392 INFO:tasks.rados.rados.0.trial118.stdout:2567: seq_num 915 ranges {578405=415195,1410318=598977,2744156=584480} 2026-02-17T05:38:50.396 INFO:tasks.rados.rados.0.trial118.stdout:2567: writing trial11845692-12 from 578405 to 993600 tid 1 2026-02-17T05:38:50.400 INFO:tasks.rados.rados.0.trial118.stdout:2567: writing trial11845692-12 from 1410318 to 2009295 tid 2 2026-02-17T05:38:50.405 INFO:tasks.rados.rados.0.trial118.stdout:2567: writing trial11845692-12 from 2744156 to 3328636 tid 3 2026-02-17T05:38:50.405 INFO:tasks.rados.rados.0.trial118.stdout:2568: write (excl) oid 19 current snap is 276 2026-02-17T05:38:50.405 INFO:tasks.rados.rados.0.trial118.stdout:2567: finishing write tid 1 to trial11845692-12 2026-02-17T05:38:50.405 INFO:tasks.rados.rados.0.trial118.stdout:2567: finishing write tid 2 to trial11845692-12 2026-02-17T05:38:50.405 INFO:tasks.rados.rados.0.trial118.stdout:2568: seq_num 916 ranges {595212=490444,1868800=458988,2887932=507280} 2026-02-17T05:38:50.409 INFO:tasks.rados.rados.0.trial118.stdout:2568: writing trial11845692-19 from 595212 to 1085656 tid 1 2026-02-17T05:38:50.413 INFO:tasks.rados.rados.0.trial118.stdout:2568: writing trial11845692-19 from 1868800 to 2327788 tid 2 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2568: writing trial11845692-19 from 2887932 to 3395212 tid 3 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2569: read oid 10 snap -1 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2569: expect deleted 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2570: read oid 16 snap -1 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2570: expect (ObjNum 884 snap 268 seq_num 884) 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2571: read oid 25 snap -1 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2571: expect (ObjNum 871 snap 262 seq_num 871) 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2572: write oid 29 current snap is 276 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: finishing write tid 3 to trial11845692-12 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: finishing write tid 4 to trial11845692-12 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: finishing write tid 5 to trial11845692-12 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: oid 12 updating version 0 to 1122 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: oid 12 version 1122 is already newer than 1119 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: oid 12 version 1122 is already newer than 1121 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: oid 12 version 1122 is already newer than 1120 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1122 (ObjNum 915 snap 276 seq_num 915) dirty exists 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2567: left oid 12 (ObjNum 915 snap 276 seq_num 915) 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2568: finishing write tid 1 to trial11845692-19 2026-02-17T05:38:50.418 INFO:tasks.rados.rados.0.trial118.stdout:2572: seq_num 917 ranges {612019=565693,1810929=602646,3082649=329370} 2026-02-17T05:38:50.422 INFO:tasks.rados.rados.0.trial118.stdout:2572: writing trial11845692-29 from 612019 to 1177712 tid 1 2026-02-17T05:38:50.426 INFO:tasks.rados.rados.0.trial118.stdout:2572: writing trial11845692-29 from 1810929 to 2413575 tid 2 2026-02-17T05:38:50.430 INFO:tasks.rados.rados.0.trial118.stdout:2572: writing trial11845692-29 from 3082649 to 3412019 tid 3 2026-02-17T05:38:50.430 INFO:tasks.rados.rados.0.trial118.stdout:2567: done (5 left) 2026-02-17T05:38:50.430 INFO:tasks.rados.rados.0.trial118.stdout:2573: copy_from oid 47 from oid 15 current snap is 276 2026-02-17T05:38:50.430 INFO:tasks.rados.rados.0.trial118.stdout:2568: finishing write tid 2 to trial11845692-19 2026-02-17T05:38:50.430 INFO:tasks.rados.rados.0.trial118.stdout:2571: expect (ObjNum 871 snap 262 seq_num 871) 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: finishing write tid 3 to trial11845692-19 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: finishing write tid 4 to trial11845692-19 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: finishing write tid 5 to trial11845692-19 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: oid 19 updating version 0 to 1116 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: oid 19 updating version 1116 to 1118 2026-02-17T05:38:50.484 INFO:tasks.rados.rados.0.trial118.stdout:2568: oid 19 version 1118 is already newer than 1115 2026-02-17T05:38:50.485 INFO:tasks.rados.rados.0.trial118.stdout:2568: oid 19 version 1118 is already newer than 1117 2026-02-17T05:38:50.485 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1118 (ObjNum 916 snap 276 seq_num 916) dirty exists 2026-02-17T05:38:50.485 INFO:tasks.rados.rados.0.trial118.stdout:2568: left oid 19 (ObjNum 916 snap 276 seq_num 916) 2026-02-17T05:38:50.485 INFO:tasks.rados.rados.0.trial118.stdout:2570: expect (ObjNum 884 snap 268 seq_num 884) 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2572: finishing write tid 1 to trial11845692-29 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2572: finishing write tid 2 to trial11845692-29 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2573: finishing copy_from to trial11845692-47 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2573: got expected ENOENT (src dne) 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2573: finishing copy_from racing read to trial11845692-47 2026-02-17T05:38:50.611 INFO:tasks.rados.rados.0.trial118.stdout:2572: finishing write tid 3 to trial11845692-29 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: finishing write tid 4 to trial11845692-29 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: finishing write tid 5 to trial11845692-29 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: oid 29 updating version 0 to 1398 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: oid 29 updating version 1398 to 1400 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: oid 29 version 1400 is already newer than 1399 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: oid 29 version 1400 is already newer than 1397 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1400 (ObjNum 917 snap 276 seq_num 917) dirty exists 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: left oid 29 (ObjNum 917 snap 276 seq_num 917) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2568: done (5 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2569: done (4 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2570: done (3 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2571: done (2 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2572: done (1 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2573: done (0 left) 2026-02-17T05:38:50.612 INFO:tasks.rados.rados.0.trial118.stdout:2574: snap_remove snap 273 2026-02-17T05:38:51.336 INFO:tasks.rados.rados.0.trial118.stdout:2574: done (0 left) 2026-02-17T05:38:51.336 INFO:tasks.rados.rados.0.trial118.stdout:2575: copy_from oid 46 from oid 16 current snap is 276 2026-02-17T05:38:51.336 INFO:tasks.rados.rados.0.trial118.stdout:2576: snap_remove snap 264 2026-02-17T05:38:52.341 INFO:tasks.rados.rados.0.trial118.stdout:2576: done (1 left) 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2577: read oid 8 snap 197 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2577: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2578: read oid 38 snap 269 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2578: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2579: read oid 43 snap 271 2026-02-17T05:38:52.342 INFO:tasks.rados.rados.0.trial118.stdout:2579: expect (ObjNum 875 snap 264 seq_num 875) 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2580: copy_from oid 20 from oid 49 current snap is 276 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2575: finishing copy_from racing read to trial11845692-46 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2575: finishing copy_from to trial11845692-46 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1389 (ObjNum 884 snap 268 seq_num 884) dirty exists 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2575: done (4 left) 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2581: copy_from oid 26 from oid 13 current snap is 276 2026-02-17T05:38:52.343 INFO:tasks.rados.rados.0.trial118.stdout:2582: write oid 23 current snap is 276 2026-02-17T05:38:52.344 INFO:tasks.rados.rados.0.trial118.stdout:2582: seq_num 918 ranges {628826=640942,1869411=462657,2826425=534649} 2026-02-17T05:38:52.345 INFO:tasks.rados.rados.0.trial118.stdout:2582: writing trial11845692-23 from 628826 to 1269768 tid 1 2026-02-17T05:38:52.349 INFO:tasks.rados.rados.0.trial118.stdout:2582: writing trial11845692-23 from 1869411 to 2332068 tid 2 2026-02-17T05:38:52.353 INFO:tasks.rados.rados.0.trial118.stdout:2582: writing trial11845692-23 from 2826425 to 3361074 tid 3 2026-02-17T05:38:52.353 INFO:tasks.rados.rados.0.trial118.stdout:2583: write oid 24 current snap is 276 2026-02-17T05:38:52.354 INFO:tasks.rados.rados.0.trial118.stdout:2583: seq_num 919 ranges {645633=716191,1927893=606315,3137495=308138} 2026-02-17T05:38:52.358 INFO:tasks.rados.rados.0.trial118.stdout:2583: writing trial11845692-24 from 645633 to 1361824 tid 1 2026-02-17T05:38:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2583: writing trial11845692-24 from 1927893 to 2534208 tid 2 2026-02-17T05:38:52.366 INFO:tasks.rados.rados.0.trial118.stdout:2583: writing trial11845692-24 from 3137495 to 3445633 tid 3 2026-02-17T05:38:52.367 INFO:tasks.rados.rados.0.trial118.stdout:2584: rollback oid 34 current snap is 276 2026-02-17T05:38:52.367 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 257 2026-02-17T05:38:52.367 INFO:tasks.rados.rados.0.trial118.stdout:2578: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:38:52.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1498070 2026-02-17T05:38:52.506 INFO:tasks.rados.rados.0.trial118.stdout:2579: expect (ObjNum 875 snap 264 seq_num 875) 2026-02-17T05:38:52.507 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 81470 2026-02-17T05:38:52.572 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:52.606 INFO:tasks.rados.rados.0.trial118.stdout:2577: expect (ObjNum 618 snap 181 seq_num 618) 2026-02-17T05:38:52.613 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1230991 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2582: finishing write tid 1 to trial11845692-23 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2577: done (7 left) 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2578: done (6 left) 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2579: done (5 left) 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2585: read oid 42 snap -1 2026-02-17T05:38:52.663 INFO:tasks.rados.rados.0.trial118.stdout:2585: expect deleted 2026-02-17T05:38:52.664 INFO:tasks.rados.rados.0.trial118.stdout:2586: write oid 5 current snap is 276 2026-02-17T05:38:52.664 INFO:tasks.rados.rados.0.trial118.stdout:2586: seq_num 920 ranges {662440=507793,1702728=749973,2881271=557193} 2026-02-17T05:38:52.668 INFO:tasks.rados.rados.0.trial118.stdout:2586: writing trial11845692-5 from 662440 to 1170233 tid 1 2026-02-17T05:38:52.673 INFO:tasks.rados.rados.0.trial118.stdout:2586: writing trial11845692-5 from 1702728 to 2452701 tid 2 2026-02-17T05:38:52.676 INFO:tasks.rados.rados.0.trial118.stdout:2586: writing trial11845692-5 from 2881271 to 3438464 tid 3 2026-02-17T05:38:52.676 INFO:tasks.rados.rados.0.trial118.stdout:2587: snap_remove snap 255 2026-02-17T05:38:53.343 INFO:tasks.rados.rados.0.trial118.stdout:2587: done (7 left) 2026-02-17T05:38:53.343 INFO:tasks.rados.rados.0.trial118.stdout:2588: write (excl) oid 41 current snap is 276 2026-02-17T05:38:53.343 INFO:tasks.rados.rados.0.trial118.stdout:2588: seq_num 921 ranges {679247=583042,2044857=609984,3192341=286906} 2026-02-17T05:38:53.347 INFO:tasks.rados.rados.0.trial118.stdout:2588: writing trial11845692-41 from 679247 to 1262289 tid 1 2026-02-17T05:38:53.353 INFO:tasks.rados.rados.0.trial118.stdout:2588: writing trial11845692-41 from 2044857 to 2654841 tid 2 2026-02-17T05:38:53.356 INFO:tasks.rados.rados.0.trial118.stdout:2588: writing trial11845692-41 from 3192341 to 3479247 tid 3 2026-02-17T05:38:53.356 INFO:tasks.rados.rados.0.trial118.stdout:2589: write (excl) oid 43 current snap is 276 2026-02-17T05:38:53.356 INFO:tasks.rados.rados.0.trial118.stdout:2589: seq_num 922 ranges {696054=658291,2103339=753642} 2026-02-17T05:38:53.361 INFO:tasks.rados.rados.0.trial118.stdout:2589: writing trial11845692-43 from 696054 to 1354345 tid 1 2026-02-17T05:38:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2589: writing trial11845692-43 from 2103339 to 2856981 tid 2 2026-02-17T05:38:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2590: snap_create 2026-02-17T05:38:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2581: finishing copy_from racing read to trial11845692-26 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: finishing write tid 2 to trial11845692-23 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2581: finishing copy_from to trial11845692-26 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1114 (ObjNum 907 snap 273 seq_num 907) dirty exists 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2580: finishing copy_from racing read to trial11845692-20 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2580: finishing copy_from to trial11845692-20 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1199 (ObjNum 911 snap 275 seq_num 911) dirty exists 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: finishing write tid 3 to trial11845692-23 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: finishing write tid 4 to trial11845692-23 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: finishing write tid 5 to trial11845692-23 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: oid 23 updating version 0 to 1266 2026-02-17T05:38:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2582: oid 23 version 1266 is already newer than 1264 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2582: oid 23 version 1266 is already newer than 1265 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2582: oid 23 version 1266 is already newer than 1263 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1266 (ObjNum 918 snap 276 seq_num 918) dirty exists 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2582: left oid 23 (ObjNum 918 snap 276 seq_num 918) 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: finishing write tid 1 to trial11845692-24 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: finishing write tid 2 to trial11845692-24 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: finishing write tid 3 to trial11845692-24 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: finishing write tid 4 to trial11845692-24 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: finishing write tid 5 to trial11845692-24 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: oid 24 updating version 0 to 1379 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: oid 24 version 1379 is already newer than 1376 2026-02-17T05:38:53.369 INFO:tasks.rados.rados.0.trial118.stdout:2583: oid 24 version 1379 is already newer than 1378 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2583: oid 24 version 1379 is already newer than 1377 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1379 (ObjNum 919 snap 276 seq_num 919) dirty exists 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2583: left oid 24 (ObjNum 919 snap 276 seq_num 919) 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2584: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2584: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2584: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1270 (ObjNum 782 snap 229 seq_num 782) dirty exists 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: finishing write tid 1 to trial11845692-5 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: finishing write tid 2 to trial11845692-5 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: finishing write tid 3 to trial11845692-5 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: finishing write tid 4 to trial11845692-5 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: finishing write tid 5 to trial11845692-5 2026-02-17T05:38:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2586: oid 5 updating version 0 to 1220 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2586: oid 5 version 1220 is already newer than 1219 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2586: oid 5 updating version 1220 to 1221 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2586: oid 5 updating version 1221 to 1222 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1222 (ObjNum 920 snap 276 seq_num 920) dirty exists 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2586: left oid 5 (ObjNum 920 snap 276 seq_num 920) 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: finishing write tid 1 to trial11845692-41 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: finishing write tid 2 to trial11845692-41 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: finishing write tid 3 to trial11845692-41 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: finishing write tid 4 to trial11845692-41 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: finishing write tid 5 to trial11845692-41 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: oid 41 updating version 0 to 1410 2026-02-17T05:38:53.371 INFO:tasks.rados.rados.0.trial118.stdout:2588: oid 41 updating version 1410 to 1412 2026-02-17T05:38:53.372 INFO:tasks.rados.rados.0.trial118.stdout:2588: oid 41 version 1412 is already newer than 1411 2026-02-17T05:38:53.372 INFO:tasks.rados.rados.0.trial118.stdout:2588: oid 41 version 1412 is already newer than 1407 2026-02-17T05:38:53.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1412 (ObjNum 921 snap 276 seq_num 921) dirty exists 2026-02-17T05:38:53.372 INFO:tasks.rados.rados.0.trial118.stdout:2588: left oid 41 (ObjNum 921 snap 276 seq_num 921) 2026-02-17T05:38:53.372 INFO:tasks.rados.rados.0.trial118.stdout:2589: finishing write tid 1 to trial11845692-43 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: finishing write tid 2 to trial11845692-43 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: finishing write tid 3 to trial11845692-43 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: finishing write tid 4 to trial11845692-43 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: oid 43 updating version 0 to 1123 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: oid 43 updating version 1123 to 1125 2026-02-17T05:38:53.373 INFO:tasks.rados.rados.0.trial118.stdout:2589: oid 43 version 1125 is already newer than 1124 2026-02-17T05:38:53.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1125 (ObjNum 922 snap 276 seq_num 922) dirty exists 2026-02-17T05:38:53.374 INFO:tasks.rados.rados.0.trial118.stdout:2589: left oid 43 (ObjNum 922 snap 276 seq_num 922) 2026-02-17T05:38:54.346 INFO:tasks.rados.rados.0.trial118.stdout:2580: done (9 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2581: done (8 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2582: done (7 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2583: done (6 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2584: done (5 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2585: done (4 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2586: done (3 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2588: done (2 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2589: done (1 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2590: done (0 left) 2026-02-17T05:38:54.347 INFO:tasks.rados.rados.0.trial118.stdout:2591: snap_create 2026-02-17T05:38:55.323 INFO:tasks.rados.rados.0.trial118.stdout:2591: done (0 left) 2026-02-17T05:38:55.323 INFO:tasks.rados.rados.0.trial118.stdout:2592: snap_remove snap 197 2026-02-17T05:38:56.323 INFO:tasks.rados.rados.0.trial118.stdout:2592: done (0 left) 2026-02-17T05:38:56.323 INFO:tasks.rados.rados.0.trial118.stdout:2593: snap_remove snap 269 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2593: done (0 left) 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2594: copy_from oid 6 from oid 50 current snap is 278 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2595: delete oid 32 current snap is 278 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2594: finishing copy_from to trial11845692-6 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2594: got expected ENOENT (src dne) 2026-02-17T05:38:57.324 INFO:tasks.rados.rados.0.trial118.stdout:2594: finishing copy_from racing read to trial11845692-6 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2594: done (1 left) 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2595: done (0 left) 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2596: read oid 42 snap -1 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2596: expect deleted 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2597: read oid 33 snap 272 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2597: expect (ObjNum 882 snap 266 seq_num 882) 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2598: write (excl) oid 46 current snap is 278 2026-02-17T05:38:57.326 INFO:tasks.rados.rados.0.trial118.stdout:2598: seq_num 924 ranges {729668=408789,1820303=757311,3274610=255058} 2026-02-17T05:38:57.331 INFO:tasks.rados.rados.0.trial118.stdout:2598: writing trial11845692-46 from 729668 to 1138457 tid 1 2026-02-17T05:38:57.336 INFO:tasks.rados.rados.0.trial118.stdout:2598: writing trial11845692-46 from 1820303 to 2577614 tid 2 2026-02-17T05:38:57.340 INFO:tasks.rados.rados.0.trial118.stdout:2598: writing trial11845692-46 from 3274610 to 3529668 tid 3 2026-02-17T05:38:57.340 INFO:tasks.rados.rados.0.trial118.stdout:2599: read oid 43 snap -1 2026-02-17T05:38:57.340 INFO:tasks.rados.rados.0.trial118.stdout:2599: expect (ObjNum 922 snap 276 seq_num 922) 2026-02-17T05:38:57.340 INFO:tasks.rados.rados.0.trial118.stdout:2600: snap_remove snap 248 2026-02-17T05:38:58.329 INFO:tasks.rados.rados.0.trial118.stdout:2600: done (4 left) 2026-02-17T05:38:58.329 INFO:tasks.rados.rados.0.trial118.stdout:2601: write oid 5 current snap is 278 2026-02-17T05:38:58.329 INFO:tasks.rados.rados.0.trial118.stdout:2601: seq_num 925 ranges {746475=484038,1762432=617322,2785680=529906} 2026-02-17T05:38:58.333 INFO:tasks.rados.rados.0.trial118.stdout:2601: writing trial11845692-5 from 746475 to 1230513 tid 1 2026-02-17T05:38:58.338 INFO:tasks.rados.rados.0.trial118.stdout:2601: writing trial11845692-5 from 1762432 to 2379754 tid 2 2026-02-17T05:38:58.342 INFO:tasks.rados.rados.0.trial118.stdout:2601: writing trial11845692-5 from 2785680 to 3315586 tid 3 2026-02-17T05:38:58.342 INFO:tasks.rados.rados.0.trial118.stdout:2602: write oid 16 current snap is 278 2026-02-17T05:38:58.342 INFO:tasks.rados.rados.0.trial118.stdout:2597: expect (ObjNum 882 snap 266 seq_num 882) 2026-02-17T05:38:58.356 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:58.388 INFO:tasks.rados.rados.0.trial118.stdout:2598: finishing write tid 1 to trial11845692-46 2026-02-17T05:38:58.388 INFO:tasks.rados.rados.0.trial118.stdout:2598: finishing write tid 2 to trial11845692-46 2026-02-17T05:38:58.388 INFO:tasks.rados.rados.0.trial118.stdout:2598: finishing write tid 3 to trial11845692-46 2026-02-17T05:38:58.388 INFO:tasks.rados.rados.0.trial118.stdout:2598: finishing write tid 4 to trial11845692-46 2026-02-17T05:38:58.388 INFO:tasks.rados.rados.0.trial118.stdout:2598: finishing write tid 5 to trial11845692-46 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2598: oid 46 updating version 0 to 1391 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2598: oid 46 updating version 1391 to 1392 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2598: oid 46 updating version 1392 to 1393 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2598: oid 46 version 1393 is already newer than 1390 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1393 (ObjNum 924 snap 278 seq_num 924) dirty exists 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2598: left oid 46 (ObjNum 924 snap 278 seq_num 924) 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:2599: expect (ObjNum 922 snap 276 seq_num 922) 2026-02-17T05:38:58.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:58.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:38:58.460 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 391268 2026-02-17T05:38:58.494 INFO:tasks.rados.rados.0.trial118.stdout:2601: finishing write tid 1 to trial11845692-5 2026-02-17T05:38:58.494 INFO:tasks.rados.rados.0.trial118.stdout:2601: finishing write tid 2 to trial11845692-5 2026-02-17T05:38:58.495 INFO:tasks.rados.rados.0.trial118.stdout:2602: seq_num 926 ranges {763282=559287,1820914=760980,3213103=350179} 2026-02-17T05:38:58.500 INFO:tasks.rados.rados.0.trial118.stdout:2602: writing trial11845692-16 from 763282 to 1322569 tid 1 2026-02-17T05:38:58.504 INFO:tasks.rados.rados.0.trial118.stdout:2602: writing trial11845692-16 from 1820914 to 2581894 tid 2 2026-02-17T05:38:58.508 INFO:tasks.rados.rados.0.trial118.stdout:2602: writing trial11845692-16 from 3213103 to 3563282 tid 3 2026-02-17T05:38:58.508 INFO:tasks.rados.rados.0.trial118.stdout:2596: done (5 left) 2026-02-17T05:38:58.508 INFO:tasks.rados.rados.0.trial118.stdout:2597: done (4 left) 2026-02-17T05:38:58.508 INFO:tasks.rados.rados.0.trial118.stdout:2598: done (3 left) 2026-02-17T05:38:58.508 INFO:tasks.rados.rados.0.trial118.stdout:2599: done (2 left) 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2603: snap_create 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: finishing write tid 3 to trial11845692-5 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: finishing write tid 4 to trial11845692-5 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: finishing write tid 5 to trial11845692-5 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: oid 5 updating version 0 to 1224 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: oid 5 updating version 1224 to 1226 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: oid 5 version 1226 is already newer than 1225 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: oid 5 version 1226 is already newer than 1223 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1226 (ObjNum 925 snap 278 seq_num 925) dirty exists 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2601: left oid 5 (ObjNum 925 snap 278 seq_num 925) 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2602: finishing write tid 1 to trial11845692-16 2026-02-17T05:38:58.509 INFO:tasks.rados.rados.0.trial118.stdout:2602: finishing write tid 2 to trial11845692-16 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: finishing write tid 3 to trial11845692-16 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: finishing write tid 4 to trial11845692-16 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: finishing write tid 5 to trial11845692-16 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: oid 16 updating version 0 to 1441 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: oid 16 version 1441 is already newer than 1438 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: oid 16 version 1441 is already newer than 1439 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: oid 16 version 1441 is already newer than 1440 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1441 (ObjNum 926 snap 278 seq_num 926) dirty exists 2026-02-17T05:38:58.510 INFO:tasks.rados.rados.0.trial118.stdout:2602: left oid 16 (ObjNum 926 snap 278 seq_num 926) 2026-02-17T05:38:59.330 INFO:tasks.rados.rados.0.trial118.stdout:2601: done (2 left) 2026-02-17T05:38:59.331 INFO:tasks.rados.rados.0.trial118.stdout:2602: done (1 left) 2026-02-17T05:38:59.331 INFO:tasks.rados.rados.0.trial118.stdout:2603: done (0 left) 2026-02-17T05:38:59.331 INFO:tasks.rados.rados.0.trial118.stdout:2604: write (excl) oid 21 current snap is 279 2026-02-17T05:38:59.331 INFO:tasks.rados.rados.0.trial118.stdout:2604: seq_num 927 ranges {780089=634536,1879396=620991,3240526=339563} 2026-02-17T05:38:59.335 INFO:tasks.rados.rados.0.trial118.stdout:2604: writing trial11845692-21 from 780089 to 1414625 tid 1 2026-02-17T05:38:59.339 INFO:tasks.rados.rados.0.trial118.stdout:2604: writing trial11845692-21 from 1879396 to 2500387 tid 2 2026-02-17T05:38:59.344 INFO:tasks.rados.rados.0.trial118.stdout:2604: writing trial11845692-21 from 3240526 to 3580089 tid 3 2026-02-17T05:38:59.344 INFO:tasks.rados.rados.0.trial118.stdout:2605: write (excl) oid 17 current snap is 279 2026-02-17T05:38:59.344 INFO:tasks.rados.rados.0.trial118.stdout:2604: finishing write tid 1 to trial11845692-21 2026-02-17T05:38:59.344 INFO:tasks.rados.rados.0.trial118.stdout:2604: finishing write tid 2 to trial11845692-21 2026-02-17T05:38:59.344 INFO:tasks.rados.rados.0.trial118.stdout:2605: seq_num 928 ranges {796896=426138,1654231=764649,2984302=480075} 2026-02-17T05:38:59.348 INFO:tasks.rados.rados.0.trial118.stdout:2605: writing trial11845692-17 from 796896 to 1223034 tid 1 2026-02-17T05:38:59.353 INFO:tasks.rados.rados.0.trial118.stdout:2605: writing trial11845692-17 from 1654231 to 2418880 tid 2 2026-02-17T05:38:59.357 INFO:tasks.rados.rados.0.trial118.stdout:2605: writing trial11845692-17 from 2984302 to 3464377 tid 3 2026-02-17T05:38:59.357 INFO:tasks.rados.rados.0.trial118.stdout:2606: delete oid 5 current snap is 279 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: finishing write tid 3 to trial11845692-21 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: finishing write tid 4 to trial11845692-21 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: finishing write tid 5 to trial11845692-21 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: oid 21 updating version 0 to 1549 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: oid 21 updating version 1549 to 1551 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: oid 21 version 1551 is already newer than 1550 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: oid 21 version 1551 is already newer than 1548 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1551 (ObjNum 927 snap 279 seq_num 927) dirty exists 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2604: left oid 21 (ObjNum 927 snap 279 seq_num 927) 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2605: finishing write tid 1 to trial11845692-17 2026-02-17T05:38:59.358 INFO:tasks.rados.rados.0.trial118.stdout:2605: finishing write tid 2 to trial11845692-17 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: finishing write tid 3 to trial11845692-17 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: finishing write tid 4 to trial11845692-17 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: finishing write tid 5 to trial11845692-17 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: oid 17 updating version 0 to 1394 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: oid 17 updating version 1394 to 1396 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: oid 17 version 1396 is already newer than 1395 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: oid 17 updating version 1396 to 1397 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1397 (ObjNum 928 snap 279 seq_num 928) dirty exists 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: left oid 17 (ObjNum 928 snap 279 seq_num 928) 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2604: done (2 left) 2026-02-17T05:38:59.360 INFO:tasks.rados.rados.0.trial118.stdout:2605: done (1 left) 2026-02-17T05:38:59.361 INFO:tasks.rados.rados.0.trial118.stdout:2606: done (0 left) 2026-02-17T05:38:59.361 INFO:tasks.rados.rados.0.trial118.stdout:2607: copy_from oid 42 from oid 29 current snap is 279 2026-02-17T05:38:59.361 INFO:tasks.rados.rados.0.trial118.stdout:2608: snap_create 2026-02-17T05:38:59.366 INFO:tasks.rados.rados.0.trial118.stdout:2607: finishing copy_from racing read to trial11845692-42 2026-02-17T05:38:59.367 INFO:tasks.rados.rados.0.trial118.stdout:2607: finishing copy_from to trial11845692-42 2026-02-17T05:38:59.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1400 (ObjNum 917 snap 276 seq_num 917) dirty exists 2026-02-17T05:39:00.335 INFO:tasks.rados.rados.0.trial118.stdout:2607: done (1 left) 2026-02-17T05:39:00.335 INFO:tasks.rados.rados.0.trial118.stdout:2608: done (0 left) 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2609: rollback oid 12 current snap is 280 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 279 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2610: read oid 24 snap -1 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2610: expect (ObjNum 919 snap 276 seq_num 919) 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2611: rollback oid 44 current snap is 280 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 44 to 278 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2612: rollback oid 33 current snap is 280 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 239 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2613: copy_from oid 34 from oid 11 current snap is 280 2026-02-17T05:39:00.336 INFO:tasks.rados.rados.0.trial118.stdout:2614: snap_remove snap 277 2026-02-17T05:39:01.337 INFO:tasks.rados.rados.0.trial118.stdout:2614: done (5 left) 2026-02-17T05:39:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2615: write (excl) oid 10 current snap is 280 2026-02-17T05:39:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2615: seq_num 930 ranges {430510=576636,1654842=768318,2922795=502619} 2026-02-17T05:39:01.341 INFO:tasks.rados.rados.0.trial118.stdout:2615: writing trial11845692-10 from 430510 to 1007146 tid 1 2026-02-17T05:39:01.347 INFO:tasks.rados.rados.0.trial118.stdout:2615: writing trial11845692-10 from 1654842 to 2423160 tid 2 2026-02-17T05:39:01.350 INFO:tasks.rados.rados.0.trial118.stdout:2615: writing trial11845692-10 from 2922795 to 3425414 tid 3 2026-02-17T05:39:01.350 INFO:tasks.rados.rados.0.trial118.stdout:2616: read oid 35 snap -1 2026-02-17T05:39:01.350 INFO:tasks.rados.rados.0.trial118.stdout:2616: expect (ObjNum 806 snap 244 seq_num 806) 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2617: delete oid 2 current snap is 280 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2612: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2612: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1554 (ObjNum 33 snap 0 seq_num 12389648) dirty dne 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2609: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2609: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2609: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1128 (ObjNum 915 snap 276 seq_num 915) dirty exists 2026-02-17T05:39:01.351 INFO:tasks.rados.rados.0.trial118.stdout:2610: expect (ObjNum 919 snap 276 seq_num 919) 2026-02-17T05:39:01.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 737578 2026-02-17T05:39:01.382 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:01.451 INFO:tasks.rados.rados.0.trial118.stdout:2611: finishing rollback tid 1 to trial11845692-44 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1375 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2613: finishing copy_from racing read to trial11845692-34 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2613: finishing copy_from to trial11845692-34 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1528 (ObjNum 878 snap 266 seq_num 878) dirty exists 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2615: finishing write tid 1 to trial11845692-10 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2609: done (7 left) 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2610: done (6 left) 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2611: done (5 left) 2026-02-17T05:39:01.452 INFO:tasks.rados.rados.0.trial118.stdout:2612: done (4 left) 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2613: done (3 left) 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2617: done (2 left) 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2618: copy_from oid 14 from oid 31 current snap is 280 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: finishing write tid 2 to trial11845692-10 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: finishing write tid 3 to trial11845692-10 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: finishing write tid 4 to trial11845692-10 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: finishing write tid 5 to trial11845692-10 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: oid 10 updating version 0 to 1201 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: oid 10 updating version 1201 to 1202 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: oid 10 updating version 1202 to 1204 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:2615: oid 10 version 1204 is already newer than 1203 2026-02-17T05:39:01.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1204 (ObjNum 930 snap 280 seq_num 930) dirty exists 2026-02-17T05:39:01.454 INFO:tasks.rados.rados.0.trial118.stdout:2615: left oid 10 (ObjNum 930 snap 280 seq_num 930) 2026-02-17T05:39:01.454 INFO:tasks.rados.rados.0.trial118.stdout:2616: expect (ObjNum 806 snap 244 seq_num 806) 2026-02-17T05:39:01.454 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:01.483 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:01.533 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2983506 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2618: finishing copy_from to trial11845692-14 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2618: got expected ENOENT (src dne) 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2618: finishing copy_from racing read to trial11845692-14 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2615: done (2 left) 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2616: done (1 left) 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2618: done (0 left) 2026-02-17T05:39:01.541 INFO:tasks.rados.rados.0.trial118.stdout:2619: delete oid 26 current snap is 280 2026-02-17T05:39:01.543 INFO:tasks.rados.rados.0.trial118.stdout:2619: done (0 left) 2026-02-17T05:39:01.543 INFO:tasks.rados.rados.0.trial118.stdout:2620: write oid 26 current snap is 280 2026-02-17T05:39:01.543 INFO:tasks.rados.rados.0.trial118.stdout:2620: seq_num 933 ranges {480931=402383,1313935=515645,2488711=452788,3443230=237701} 2026-02-17T05:39:01.546 INFO:tasks.rados.rados.0.trial118.stdout:2620: writing trial11845692-26 from 480931 to 883314 tid 1 2026-02-17T05:39:01.549 INFO:tasks.rados.rados.0.trial118.stdout:2620: writing trial11845692-26 from 1313935 to 1829580 tid 2 2026-02-17T05:39:01.553 INFO:tasks.rados.rados.0.trial118.stdout:2620: writing trial11845692-26 from 2488711 to 2941499 tid 3 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2620: writing trial11845692-26 from 3443230 to 3680931 tid 4 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2621: rollback oid 3 current snap is 280 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 271 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 1 to trial11845692-26 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 2 to trial11845692-26 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 3 to trial11845692-26 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2622: read oid 11 snap -1 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2622: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2623: rollback oid 10 current snap is 280 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 251 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2624: read oid 15 snap -1 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2624: expect deleted 2026-02-17T05:39:01.557 INFO:tasks.rados.rados.0.trial118.stdout:2625: snap_create 2026-02-17T05:39:01.558 INFO:tasks.rados.rados.0.trial118.stdout:2621: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:39:01.558 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1104 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:39:01.558 INFO:tasks.rados.rados.0.trial118.stdout:2623: finishing rollback tid 0 to trial11845692-10 2026-02-17T05:39:01.558 INFO:tasks.rados.rados.0.trial118.stdout:2623: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:39:01.558 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1206 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 4 to trial11845692-26 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 5 to trial11845692-26 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: finishing write tid 6 to trial11845692-26 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: oid 26 updating version 0 to 1437 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: oid 26 updating version 1437 to 1439 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: oid 26 version 1439 is already newer than 1438 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: oid 26 updating version 1439 to 1441 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:2620: oid 26 version 1441 is already newer than 1440 2026-02-17T05:39:01.559 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1441 (ObjNum 933 snap 280 seq_num 933) dirty exists 2026-02-17T05:39:01.560 INFO:tasks.rados.rados.0.trial118.stdout:2620: left oid 26 (ObjNum 933 snap 280 seq_num 933) 2026-02-17T05:39:01.560 INFO:tasks.rados.rados.0.trial118.stdout:2622: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:39:01.561 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:02.340 INFO:tasks.rados.rados.0.trial118.stdout:2620: done (5 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2621: done (4 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2622: done (3 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2623: done (2 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2624: done (1 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2625: done (0 left) 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2626: rollback oid 19 current snap is 281 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 254 2026-02-17T05:39:02.341 INFO:tasks.rados.rados.0.trial118.stdout:2627: delete oid 46 current snap is 281 2026-02-17T05:39:02.344 INFO:tasks.rados.rados.0.trial118.stdout:2627: done (1 left) 2026-02-17T05:39:02.344 INFO:tasks.rados.rados.0.trial118.stdout:2628: write oid 5 current snap is 281 2026-02-17T05:39:02.344 INFO:tasks.rados.rados.0.trial118.stdout:2628: seq_num 935 ranges {514545=552881,1830899=519314,2943557=475332} 2026-02-17T05:39:02.348 INFO:tasks.rados.rados.0.trial118.stdout:2628: writing trial11845692-5 from 514545 to 1067426 tid 1 2026-02-17T05:39:02.353 INFO:tasks.rados.rados.0.trial118.stdout:2628: writing trial11845692-5 from 1830899 to 2350213 tid 2 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2628: writing trial11845692-5 from 2943557 to 3418889 tid 3 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2629: delete oid 34 current snap is 281 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2626: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2626: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1120 (ObjNum 129 snap 0 seq_num 12468048) dirty dne 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2628: finishing write tid 1 to trial11845692-5 2026-02-17T05:39:02.357 INFO:tasks.rados.rados.0.trial118.stdout:2628: finishing write tid 2 to trial11845692-5 2026-02-17T05:39:02.358 INFO:tasks.rados.rados.0.trial118.stdout:2628: finishing write tid 3 to trial11845692-5 2026-02-17T05:39:02.358 INFO:tasks.rados.rados.0.trial118.stdout:2628: finishing write tid 4 to trial11845692-5 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: finishing write tid 5 to trial11845692-5 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: oid 5 updating version 0 to 1230 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: oid 5 updating version 1230 to 1231 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: oid 5 version 1231 is already newer than 1228 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: oid 5 version 1231 is already newer than 1229 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1231 (ObjNum 935 snap 281 seq_num 935) dirty exists 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: left oid 5 (ObjNum 935 snap 281 seq_num 935) 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2626: done (2 left) 2026-02-17T05:39:02.359 INFO:tasks.rados.rados.0.trial118.stdout:2628: done (1 left) 2026-02-17T05:39:02.360 INFO:tasks.rados.rados.0.trial118.stdout:2629: done (0 left) 2026-02-17T05:39:02.360 INFO:tasks.rados.rados.0.trial118.stdout:2630: write oid 34 current snap is 281 2026-02-17T05:39:02.360 INFO:tasks.rados.rados.0.trial118.stdout:2630: seq_num 937 ranges {548159=419732,1664216=522983,2714756=614229} 2026-02-17T05:39:02.363 INFO:tasks.rados.rados.0.trial118.stdout:2630: writing trial11845692-34 from 548159 to 967891 tid 1 2026-02-17T05:39:02.367 INFO:tasks.rados.rados.0.trial118.stdout:2630: writing trial11845692-34 from 1664216 to 2187199 tid 2 2026-02-17T05:39:02.372 INFO:tasks.rados.rados.0.trial118.stdout:2630: writing trial11845692-34 from 2714756 to 3328985 tid 3 2026-02-17T05:39:02.373 INFO:tasks.rados.rados.0.trial118.stdout:2631: read oid 14 snap 239 2026-02-17T05:39:02.373 INFO:tasks.rados.rados.0.trial118.stdout:2631: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:39:02.373 INFO:tasks.rados.rados.0.trial118.stdout:2632: delete oid 43 current snap is 281 2026-02-17T05:39:02.373 INFO:tasks.rados.rados.0.trial118.stdout:2630: finishing write tid 1 to trial11845692-34 2026-02-17T05:39:02.373 INFO:tasks.rados.rados.0.trial118.stdout:2630: finishing write tid 2 to trial11845692-34 2026-02-17T05:39:02.375 INFO:tasks.rados.rados.0.trial118.stdout:2630: finishing write tid 3 to trial11845692-34 2026-02-17T05:39:02.375 INFO:tasks.rados.rados.0.trial118.stdout:2630: finishing write tid 4 to trial11845692-34 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: finishing write tid 5 to trial11845692-34 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: oid 34 updating version 0 to 1530 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: oid 34 updating version 1530 to 1532 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: oid 34 version 1532 is already newer than 1531 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: oid 34 updating version 1532 to 1533 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1533 (ObjNum 937 snap 281 seq_num 937) dirty exists 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: left oid 34 (ObjNum 937 snap 281 seq_num 937) 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2630: done (2 left) 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2632: done (1 left) 2026-02-17T05:39:02.376 INFO:tasks.rados.rados.0.trial118.stdout:2633: read oid 6 snap -1 2026-02-17T05:39:02.377 INFO:tasks.rados.rados.0.trial118.stdout:2633: expect (ObjNum 796 snap 240 seq_num 796) 2026-02-17T05:39:02.377 INFO:tasks.rados.rados.0.trial118.stdout:2634: rollback oid 35 current snap is 281 2026-02-17T05:39:02.377 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 257 2026-02-17T05:39:02.377 INFO:tasks.rados.rados.0.trial118.stdout:2635: write (excl) oid 15 current snap is 281 2026-02-17T05:39:02.377 INFO:tasks.rados.rados.0.trial118.stdout:2635: seq_num 939 ranges {581773=570230,1664827=526652,2653249=636773} 2026-02-17T05:39:02.379 INFO:tasks.rados.rados.0.trial118.stdout:2635: writing trial11845692-15 from 581773 to 1152003 tid 1 2026-02-17T05:39:02.383 INFO:tasks.rados.rados.0.trial118.stdout:2635: writing trial11845692-15 from 1664827 to 2191479 tid 2 2026-02-17T05:39:02.387 INFO:tasks.rados.rados.0.trial118.stdout:2635: writing trial11845692-15 from 2653249 to 3290022 tid 3 2026-02-17T05:39:02.387 INFO:tasks.rados.rados.0.trial118.stdout:2636: delete oid 28 current snap is 281 2026-02-17T05:39:02.388 INFO:tasks.rados.rados.0.trial118.stdout:2631: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:39:02.447 INFO:tasks.rados.rados.0.trial118.stdout:2634: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:39:02.447 INFO:tasks.rados.rados.0.trial118.stdout:2634: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:39:02.447 INFO:tasks.rados.rados.0.trial118.stdout:2634: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:39:02.447 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1382 (ObjNum 806 snap 244 seq_num 806) dirty exists 2026-02-17T05:39:02.447 INFO:tasks.rados.rados.0.trial118.stdout:2633: expect (ObjNum 796 snap 240 seq_num 796) 2026-02-17T05:39:02.475 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 206099 2026-02-17T05:39:02.543 INFO:tasks.rados.rados.0.trial118.stdout:2635: finishing write tid 1 to trial11845692-15 2026-02-17T05:39:02.543 INFO:tasks.rados.rados.0.trial118.stdout:2635: finishing write tid 2 to trial11845692-15 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2631: done (4 left) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2633: done (3 left) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2634: done (2 left) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2636: done (1 left) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2637: read oid 24 snap -1 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2637: expect (ObjNum 919 snap 276 seq_num 919) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2638: read oid 4 snap 254 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2638: expect (ObjNum 819 snap 249 seq_num 819) 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2639: write oid 29 current snap is 281 2026-02-17T05:39:02.544 INFO:tasks.rados.rados.0.trial118.stdout:2639: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2026-02-17T05:39:02.548 INFO:tasks.rados.rados.0.trial118.stdout:2639: writing trial11845692-29 from 615387 to 1336115 tid 1 2026-02-17T05:39:02.552 INFO:tasks.rados.rados.0.trial118.stdout:2639: writing trial11845692-29 from 1781791 to 2312112 tid 2 2026-02-17T05:39:02.557 INFO:tasks.rados.rados.0.trial118.stdout:2639: writing trial11845692-29 from 3108095 to 3815387 tid 3 2026-02-17T05:39:02.557 INFO:tasks.rados.rados.0.trial118.stdout:2640: write oid 2 current snap is 281 2026-02-17T05:39:02.558 INFO:tasks.rados.rados.0.trial118.stdout:2640: seq_num 942 ranges {632194=795977,2123920=790332,3419165=413029} 2026-02-17T05:39:02.563 INFO:tasks.rados.rados.0.trial118.stdout:2640: writing trial11845692-2 from 632194 to 1428171 tid 1 2026-02-17T05:39:02.568 INFO:tasks.rados.rados.0.trial118.stdout:2640: writing trial11845692-2 from 2123920 to 2914252 tid 2 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2640: writing trial11845692-2 from 3419165 to 3832194 tid 3 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2641: rollback oid 25 current snap is 281 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 25 to 270 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2635: finishing write tid 3 to trial11845692-15 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2635: finishing write tid 4 to trial11845692-15 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2635: finishing write tid 5 to trial11845692-15 2026-02-17T05:39:02.573 INFO:tasks.rados.rados.0.trial118.stdout:2635: oid 15 updating version 0 to 1283 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2635: oid 15 version 1283 is already newer than 1281 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2635: oid 15 version 1283 is already newer than 1282 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2635: oid 15 version 1283 is already newer than 1280 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2635: left oid 15 (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:39:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2637: expect (ObjNum 919 snap 276 seq_num 919) 2026-02-17T05:39:02.586 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2646947 2026-02-17T05:39:02.598 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:02.667 INFO:tasks.rados.rados.0.trial118.stdout:2638: expect (ObjNum 819 snap 249 seq_num 819) 2026-02-17T05:39:02.667 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:02.715 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2267390 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: finishing write tid 1 to trial11845692-29 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: finishing write tid 2 to trial11845692-29 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: finishing write tid 3 to trial11845692-29 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: finishing write tid 4 to trial11845692-29 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: finishing write tid 5 to trial11845692-29 2026-02-17T05:39:02.729 INFO:tasks.rados.rados.0.trial118.stdout:2639: oid 29 updating version 0 to 1447 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:2639: oid 29 version 1447 is already newer than 1446 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:2639: oid 29 updating version 1447 to 1448 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:2639: oid 29 version 1448 is already newer than 1445 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1448 (ObjNum 941 snap 281 seq_num 941) dirty exists 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:2639: left oid 29 (ObjNum 941 snap 281 seq_num 941) 2026-02-17T05:39:02.730 INFO:tasks.rados.rados.0.trial118.stdout:2640: finishing write tid 1 to trial11845692-2 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: finishing write tid 2 to trial11845692-2 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: finishing write tid 3 to trial11845692-2 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: finishing write tid 4 to trial11845692-2 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: finishing write tid 5 to trial11845692-2 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: oid 2 updating version 0 to 1676 2026-02-17T05:39:02.731 INFO:tasks.rados.rados.0.trial118.stdout:2640: oid 2 version 1676 is already newer than 1675 2026-02-17T05:39:02.732 INFO:tasks.rados.rados.0.trial118.stdout:2640: oid 2 updating version 1676 to 1677 2026-02-17T05:39:02.732 INFO:tasks.rados.rados.0.trial118.stdout:2640: oid 2 version 1677 is already newer than 1674 2026-02-17T05:39:02.732 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1677 (ObjNum 942 snap 281 seq_num 942) dirty exists 2026-02-17T05:39:02.732 INFO:tasks.rados.rados.0.trial118.stdout:2640: left oid 2 (ObjNum 942 snap 281 seq_num 942) 2026-02-17T05:39:02.732 INFO:tasks.rados.rados.0.trial118.stdout:2641: finishing rollback tid 0 to trial11845692-25 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2641: finishing rollback tid 1 to trial11845692-25 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2641: finishing rollback tid 2 to trial11845692-25 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1562 (ObjNum 871 snap 262 seq_num 871) dirty exists 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2635: done (5 left) 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2637: done (4 left) 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2638: done (3 left) 2026-02-17T05:39:02.733 INFO:tasks.rados.rados.0.trial118.stdout:2639: done (2 left) 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2640: done (1 left) 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2641: done (0 left) 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2642: copy_from oid 16 from oid 28 current snap is 281 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2643: copy_from oid 13 from oid 29 current snap is 281 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2644: write oid 6 current snap is 281 2026-02-17T05:39:02.734 INFO:tasks.rados.rados.0.trial118.stdout:2644: seq_num 943 ranges {649001=587579,1898755=533990,3162941=686060} 2026-02-17T05:39:02.735 INFO:tasks.rados.rados.0.trial118.stdout:2644: writing trial11845692-6 from 649001 to 1236580 tid 1 2026-02-17T05:39:02.738 INFO:tasks.rados.rados.0.trial118.stdout:2644: writing trial11845692-6 from 1898755 to 2432745 tid 2 2026-02-17T05:39:02.745 INFO:tasks.rados.rados.0.trial118.stdout:2644: writing trial11845692-6 from 3162941 to 3849001 tid 3 2026-02-17T05:39:02.745 INFO:tasks.rados.rados.0.trial118.stdout:2645: read oid 43 snap -1 2026-02-17T05:39:02.745 INFO:tasks.rados.rados.0.trial118.stdout:2645: expect deleted 2026-02-17T05:39:02.746 INFO:tasks.rados.rados.0.trial118.stdout:2646: read oid 21 snap -1 2026-02-17T05:39:02.746 INFO:tasks.rados.rados.0.trial118.stdout:2646: expect (ObjNum 927 snap 279 seq_num 927) 2026-02-17T05:39:02.746 INFO:tasks.rados.rados.0.trial118.stdout:2647: snap_create 2026-02-17T05:39:02.746 INFO:tasks.rados.rados.0.trial118.stdout:2642: finishing copy_from to trial11845692-16 2026-02-17T05:39:02.746 INFO:tasks.rados.rados.0.trial118.stdout:2642: got expected ENOENT (src dne) 2026-02-17T05:39:02.747 INFO:tasks.rados.rados.0.trial118.stdout:2642: finishing copy_from racing read to trial11845692-16 2026-02-17T05:39:02.747 INFO:tasks.rados.rados.0.trial118.stdout:2644: finishing write tid 1 to trial11845692-6 2026-02-17T05:39:02.747 INFO:tasks.rados.rados.0.trial118.stdout:2643: finishing copy_from racing read to trial11845692-13 2026-02-17T05:39:02.747 INFO:tasks.rados.rados.0.trial118.stdout:2644: finishing write tid 2 to trial11845692-6 2026-02-17T05:39:02.748 INFO:tasks.rados.rados.0.trial118.stdout:2643: finishing copy_from to trial11845692-13 2026-02-17T05:39:02.748 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1448 (ObjNum 941 snap 281 seq_num 941) dirty exists 2026-02-17T05:39:02.748 INFO:tasks.rados.rados.0.trial118.stdout:2644: finishing write tid 3 to trial11845692-6 2026-02-17T05:39:02.750 INFO:tasks.rados.rados.0.trial118.stdout:2644: finishing write tid 4 to trial11845692-6 2026-02-17T05:39:02.750 INFO:tasks.rados.rados.0.trial118.stdout:2644: finishing write tid 5 to trial11845692-6 2026-02-17T05:39:02.750 INFO:tasks.rados.rados.0.trial118.stdout:2644: oid 6 updating version 0 to 1268 2026-02-17T05:39:02.750 INFO:tasks.rados.rados.0.trial118.stdout:2644: oid 6 updating version 1268 to 1269 2026-02-17T05:39:02.750 INFO:tasks.rados.rados.0.trial118.stdout:2644: oid 6 updating version 1269 to 1270 2026-02-17T05:39:02.751 INFO:tasks.rados.rados.0.trial118.stdout:2644: oid 6 version 1270 is already newer than 1267 2026-02-17T05:39:02.751 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1270 (ObjNum 943 snap 281 seq_num 943) dirty exists 2026-02-17T05:39:02.751 INFO:tasks.rados.rados.0.trial118.stdout:2644: left oid 6 (ObjNum 943 snap 281 seq_num 943) 2026-02-17T05:39:02.751 INFO:tasks.rados.rados.0.trial118.stdout:2646: expect (ObjNum 927 snap 279 seq_num 927) 2026-02-17T05:39:03.346 INFO:tasks.rados.rados.0.trial118.stdout:2642: done (5 left) 2026-02-17T05:39:03.347 INFO:tasks.rados.rados.0.trial118.stdout:2643: done (4 left) 2026-02-17T05:39:03.347 INFO:tasks.rados.rados.0.trial118.stdout:2644: done (3 left) 2026-02-17T05:39:03.347 INFO:tasks.rados.rados.0.trial118.stdout:2645: done (2 left) 2026-02-17T05:39:03.347 INFO:tasks.rados.rados.0.trial118.stdout:2646: done (1 left) 2026-02-17T05:39:03.347 INFO:tasks.rados.rados.0.trial118.stdout:2647: done (0 left) 2026-02-17T05:39:03.348 INFO:tasks.rados.rados.0.trial118.stdout:2648: read oid 16 snap -1 2026-02-17T05:39:03.348 INFO:tasks.rados.rados.0.trial118.stdout:2648: expect (ObjNum 926 snap 278 seq_num 926) 2026-02-17T05:39:03.348 INFO:tasks.rados.rados.0.trial118.stdout:2649: delete oid 21 current snap is 282 2026-02-17T05:39:03.349 INFO:tasks.rados.rados.0.trial118.stdout:2649: done (1 left) 2026-02-17T05:39:03.349 INFO:tasks.rados.rados.0.trial118.stdout:2650: read oid 10 snap -1 2026-02-17T05:39:03.349 INFO:tasks.rados.rados.0.trial118.stdout:2650: expect deleted 2026-02-17T05:39:03.349 INFO:tasks.rados.rados.0.trial118.stdout:2651: snap_remove snap 253 2026-02-17T05:39:04.348 INFO:tasks.rados.rados.0.trial118.stdout:2651: done (2 left) 2026-02-17T05:39:04.348 INFO:tasks.rados.rados.0.trial118.stdout:2652: write oid 42 current snap is 282 2026-02-17T05:39:04.348 INFO:tasks.rados.rados.0.trial118.stdout:2652: seq_num 945 ranges {682615=738077,2015719=537659,3217787=420758} 2026-02-17T05:39:04.353 INFO:tasks.rados.rados.0.trial118.stdout:2652: writing trial11845692-42 from 682615 to 1420692 tid 1 2026-02-17T05:39:04.357 INFO:tasks.rados.rados.0.trial118.stdout:2652: writing trial11845692-42 from 2015719 to 2553378 tid 2 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:2652: writing trial11845692-42 from 3217787 to 3638545 tid 3 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:2653: read oid 2 snap 275 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:2653: expect deleted 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:2654: snap_create 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:2648: expect (ObjNum 926 snap 278 seq_num 926) 2026-02-17T05:39:04.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:04.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:04.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: finishing write tid 1 to trial11845692-42 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: finishing write tid 2 to trial11845692-42 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: finishing write tid 3 to trial11845692-42 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: finishing write tid 4 to trial11845692-42 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: finishing write tid 5 to trial11845692-42 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: oid 42 updating version 0 to 1401 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: oid 42 updating version 1401 to 1404 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: oid 42 version 1404 is already newer than 1402 2026-02-17T05:39:04.511 INFO:tasks.rados.rados.0.trial118.stdout:2652: oid 42 version 1404 is already newer than 1403 2026-02-17T05:39:04.512 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1404 (ObjNum 945 snap 282 seq_num 945) dirty exists 2026-02-17T05:39:04.512 INFO:tasks.rados.rados.0.trial118.stdout:2652: left oid 42 (ObjNum 945 snap 282 seq_num 945) 2026-02-17T05:39:05.326 INFO:tasks.rados.rados.0.trial118.stdout:2648: done (4 left) 2026-02-17T05:39:05.326 INFO:tasks.rados.rados.0.trial118.stdout:2650: done (3 left) 2026-02-17T05:39:05.326 INFO:tasks.rados.rados.0.trial118.stdout:2652: done (2 left) 2026-02-17T05:39:05.326 INFO:tasks.rados.rados.0.trial118.stdout:2653: done (1 left) 2026-02-17T05:39:05.326 INFO:tasks.rados.rados.0.trial118.stdout:2654: done (0 left) 2026-02-17T05:39:05.327 INFO:tasks.rados.rados.0.trial118.stdout:2655: snap_create 2026-02-17T05:39:06.328 INFO:tasks.rados.rados.0.trial118.stdout:2655: done (0 left) 2026-02-17T05:39:06.328 INFO:tasks.rados.rados.0.trial118.stdout:2656: write oid 35 current snap is 284 2026-02-17T05:39:06.328 INFO:tasks.rados.rados.0.trial118.stdout:2656: seq_num 946 ranges {699422=413326,1557848=681317,3012504=748383} 2026-02-17T05:39:06.333 INFO:tasks.rados.rados.0.trial118.stdout:2656: writing trial11845692-35 from 699422 to 1112748 tid 1 2026-02-17T05:39:06.337 INFO:tasks.rados.rados.0.trial118.stdout:2656: writing trial11845692-35 from 1557848 to 2239165 tid 2 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2656: writing trial11845692-35 from 3012504 to 3760887 tid 3 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2657: read oid 20 snap -1 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2657: expect (ObjNum 911 snap 275 seq_num 911) 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2658: snap_create 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2656: finishing write tid 1 to trial11845692-35 2026-02-17T05:39:06.343 INFO:tasks.rados.rados.0.trial118.stdout:2656: finishing write tid 2 to trial11845692-35 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: finishing write tid 3 to trial11845692-35 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: finishing write tid 4 to trial11845692-35 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: finishing write tid 5 to trial11845692-35 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: oid 35 updating version 0 to 1385 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: oid 35 updating version 1385 to 1386 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: oid 35 version 1386 is already newer than 1384 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: oid 35 version 1386 is already newer than 1383 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1386 (ObjNum 946 snap 284 seq_num 946) dirty exists 2026-02-17T05:39:06.345 INFO:tasks.rados.rados.0.trial118.stdout:2656: left oid 35 (ObjNum 946 snap 284 seq_num 946) 2026-02-17T05:39:06.347 INFO:tasks.rados.rados.0.trial118.stdout:2657: expect (ObjNum 911 snap 275 seq_num 911) 2026-02-17T05:39:06.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:07.329 INFO:tasks.rados.rados.0.trial118.stdout:2656: done (2 left) 2026-02-17T05:39:07.329 INFO:tasks.rados.rados.0.trial118.stdout:2657: done (1 left) 2026-02-17T05:39:07.329 INFO:tasks.rados.rados.0.trial118.stdout:2658: done (0 left) 2026-02-17T05:39:07.329 INFO:tasks.rados.rados.0.trial118.stdout:2659: delete oid 26 current snap is 285 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2659: done (0 left) 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2660: read oid 11 snap -1 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2660: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2661: copy_from oid 23 from oid 13 current snap is 285 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2662: rollback oid 32 current snap is 285 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 239 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2663: write oid 26 current snap is 285 2026-02-17T05:39:07.333 INFO:tasks.rados.rados.0.trial118.stdout:2663: seq_num 948 ranges {733036=563824,2074812=684986,3183703=749333} 2026-02-17T05:39:07.337 INFO:tasks.rados.rados.0.trial118.stdout:2663: writing trial11845692-26 from 733036 to 1296860 tid 1 2026-02-17T05:39:07.343 INFO:tasks.rados.rados.0.trial118.stdout:2663: writing trial11845692-26 from 2074812 to 2759798 tid 2 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:2663: writing trial11845692-26 from 3183703 to 3933036 tid 3 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:2664: snap_create 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:2662: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:2662: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1208 (ObjNum 773 snap 227 seq_num 773) dirty exists 2026-02-17T05:39:07.347 INFO:tasks.rados.rados.0.trial118.stdout:2660: expect (ObjNum 878 snap 266 seq_num 878) 2026-02-17T05:39:07.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2285935 2026-02-17T05:39:07.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:07.397 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: finishing write tid 1 to trial11845692-26 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2661: finishing copy_from racing read to trial11845692-23 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: finishing write tid 2 to trial11845692-26 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2661: finishing copy_from to trial11845692-23 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1448 (ObjNum 941 snap 281 seq_num 941) dirty exists 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: finishing write tid 3 to trial11845692-26 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: finishing write tid 4 to trial11845692-26 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: finishing write tid 5 to trial11845692-26 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: oid 26 updating version 0 to 1444 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: oid 26 updating version 1444 to 1445 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: oid 26 version 1445 is already newer than 1443 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: oid 26 updating version 1445 to 1446 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1446 (ObjNum 948 snap 285 seq_num 948) dirty exists 2026-02-17T05:39:07.426 INFO:tasks.rados.rados.0.trial118.stdout:2663: left oid 26 (ObjNum 948 snap 285 seq_num 948) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2660: done (4 left) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2661: done (3 left) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2662: done (2 left) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2663: done (1 left) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2664: done (0 left) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2665: read oid 48 snap -1 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2665: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2666: write (excl) oid 46 current snap is 286 2026-02-17T05:39:08.334 INFO:tasks.rados.rados.0.trial118.stdout:2666: seq_num 949 ranges {749843=639073,2133294=544997,3211126=582199} 2026-02-17T05:39:08.339 INFO:tasks.rados.rados.0.trial118.stdout:2666: writing trial11845692-46 from 749843 to 1388916 tid 1 2026-02-17T05:39:08.344 INFO:tasks.rados.rados.0.trial118.stdout:2666: writing trial11845692-46 from 2133294 to 2678291 tid 2 2026-02-17T05:39:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2666: writing trial11845692-46 from 3211126 to 3793325 tid 3 2026-02-17T05:39:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2667: read oid 42 snap -1 2026-02-17T05:39:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2667: expect (ObjNum 945 snap 282 seq_num 945) 2026-02-17T05:39:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2668: write (excl) oid 5 current snap is 286 2026-02-17T05:39:08.348 INFO:tasks.rados.rados.0.trial118.stdout:2668: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2026-02-17T05:39:08.354 INFO:tasks.rados.rados.0.trial118.stdout:2668: writing trial11845692-5 from 766650 to 1480972 tid 1 2026-02-17T05:39:08.358 INFO:tasks.rados.rados.0.trial118.stdout:2668: writing trial11845692-5 from 2075423 to 2764078 tid 2 2026-02-17T05:39:08.363 INFO:tasks.rados.rados.0.trial118.stdout:2668: writing trial11845692-5 from 3522196 to 3966650 tid 3 2026-02-17T05:39:08.363 INFO:tasks.rados.rados.0.trial118.stdout:2669: write (excl) oid 31 current snap is 286 2026-02-17T05:39:08.363 INFO:tasks.rados.rados.0.trial118.stdout:2665: expect (ObjNum 699 snap 202 seq_num 699) 2026-02-17T05:39:08.400 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3042452 2026-02-17T05:39:08.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:08.518 INFO:tasks.rados.rados.0.trial118.stdout:2666: finishing write tid 1 to trial11845692-46 2026-02-17T05:39:08.518 INFO:tasks.rados.rados.0.trial118.stdout:2666: finishing write tid 2 to trial11845692-46 2026-02-17T05:39:08.518 INFO:tasks.rados.rados.0.trial118.stdout:2669: seq_num 951 ranges {783457=505924,1850258=548666,2865972=721096} 2026-02-17T05:39:08.523 INFO:tasks.rados.rados.0.trial118.stdout:2669: writing trial11845692-31 from 783457 to 1289381 tid 1 2026-02-17T05:39:08.527 INFO:tasks.rados.rados.0.trial118.stdout:2669: writing trial11845692-31 from 1850258 to 2398924 tid 2 2026-02-17T05:39:08.531 INFO:tasks.rados.rados.0.trial118.stdout:2669: writing trial11845692-31 from 2865972 to 3587068 tid 3 2026-02-17T05:39:08.531 INFO:tasks.rados.rados.0.trial118.stdout:2665: done (4 left) 2026-02-17T05:39:08.531 INFO:tasks.rados.rados.0.trial118.stdout:2670: snap_create 2026-02-17T05:39:08.531 INFO:tasks.rados.rados.0.trial118.stdout:2666: finishing write tid 3 to trial11845692-46 2026-02-17T05:39:08.531 INFO:tasks.rados.rados.0.trial118.stdout:2666: finishing write tid 4 to trial11845692-46 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: finishing write tid 5 to trial11845692-46 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: oid 46 updating version 0 to 1399 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: oid 46 updating version 1399 to 1401 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: oid 46 version 1401 is already newer than 1400 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: oid 46 updating version 1401 to 1402 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1402 (ObjNum 949 snap 286 seq_num 949) dirty exists 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2666: left oid 46 (ObjNum 949 snap 286 seq_num 949) 2026-02-17T05:39:08.532 INFO:tasks.rados.rados.0.trial118.stdout:2667: expect (ObjNum 945 snap 282 seq_num 945) 2026-02-17T05:39:08.574 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:08.671 INFO:tasks.rados.rados.0.trial118.stdout:2668: finishing write tid 1 to trial11845692-5 2026-02-17T05:39:08.671 INFO:tasks.rados.rados.0.trial118.stdout:2668: finishing write tid 2 to trial11845692-5 2026-02-17T05:39:08.671 INFO:tasks.rados.rados.0.trial118.stdout:2668: finishing write tid 3 to trial11845692-5 2026-02-17T05:39:08.671 INFO:tasks.rados.rados.0.trial118.stdout:2668: finishing write tid 4 to trial11845692-5 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: finishing write tid 5 to trial11845692-5 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: oid 5 updating version 0 to 1235 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: oid 5 version 1235 is already newer than 1233 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: oid 5 version 1235 is already newer than 1232 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: oid 5 version 1235 is already newer than 1234 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1235 (ObjNum 950 snap 286 seq_num 950) dirty exists 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2668: left oid 5 (ObjNum 950 snap 286 seq_num 950) 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: finishing write tid 1 to trial11845692-31 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: finishing write tid 2 to trial11845692-31 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: finishing write tid 3 to trial11845692-31 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: finishing write tid 4 to trial11845692-31 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: finishing write tid 5 to trial11845692-31 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: oid 31 updating version 0 to 1689 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: oid 31 version 1689 is already newer than 1686 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: oid 31 version 1689 is already newer than 1688 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: oid 31 version 1689 is already newer than 1687 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1689 (ObjNum 951 snap 286 seq_num 951) dirty exists 2026-02-17T05:39:08.672 INFO:tasks.rados.rados.0.trial118.stdout:2669: left oid 31 (ObjNum 951 snap 286 seq_num 951) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2666: done (4 left) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2667: done (3 left) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2668: done (2 left) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2669: done (1 left) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2670: done (0 left) 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2671: copy_from oid 24 from oid 18 current snap is 287 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2672: rollback oid 22 current snap is 287 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 257 2026-02-17T05:39:09.338 INFO:tasks.rados.rados.0.trial118.stdout:2673: delete oid 11 current snap is 287 2026-02-17T05:39:09.339 INFO:tasks.rados.rados.0.trial118.stdout:2673: done (2 left) 2026-02-17T05:39:09.339 INFO:tasks.rados.rados.0.trial118.stdout:2674: write oid 47 current snap is 287 2026-02-17T05:39:09.339 INFO:tasks.rados.rados.0.trial118.stdout:2674: seq_num 953 ranges {417071=656422,1567222=449849} 2026-02-17T05:39:09.343 INFO:tasks.rados.rados.0.trial118.stdout:2674: writing trial11845692-47 from 417071 to 1073493 tid 1 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2674: writing trial11845692-47 from 1567222 to 2017071 tid 2 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2675: rollback oid 39 current snap is 287 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 252 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2672: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2672: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1292 (ObjNum 81 snap 0 seq_num 12406927) dirty dne 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2674: finishing write tid 1 to trial11845692-47 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2671: finishing copy_from racing read to trial11845692-24 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2672: done (3 left) 2026-02-17T05:39:09.347 INFO:tasks.rados.rados.0.trial118.stdout:2676: snap_remove snap 279 2026-02-17T05:39:10.341 INFO:tasks.rados.rados.0.trial118.stdout:2676: done (3 left) 2026-02-17T05:39:10.341 INFO:tasks.rados.rados.0.trial118.stdout:2677: write oid 13 current snap is 287 2026-02-17T05:39:10.341 INFO:tasks.rados.rados.0.trial118.stdout:2677: seq_num 954 ranges {433878=731671,1909351=124527} 2026-02-17T05:39:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2677: writing trial11845692-13 from 433878 to 1165549 tid 1 2026-02-17T05:39:10.349 INFO:tasks.rados.rados.0.trial118.stdout:2677: writing trial11845692-13 from 1909351 to 2033878 tid 2 2026-02-17T05:39:10.349 INFO:tasks.rados.rados.0.trial118.stdout:2678: write oid 30 current snap is 287 2026-02-17T05:39:10.349 INFO:tasks.rados.rados.0.trial118.stdout:2671: finishing copy_from to trial11845692-24 2026-02-17T05:39:10.349 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1197 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:39:10.349 INFO:tasks.rados.rados.0.trial118.stdout:2678: seq_num 955 ranges {450685=406920,1567833=482852} 2026-02-17T05:39:10.351 INFO:tasks.rados.rados.0.trial118.stdout:2678: writing trial11845692-30 from 450685 to 857605 tid 1 2026-02-17T05:39:10.357 INFO:tasks.rados.rados.0.trial118.stdout:2678: writing trial11845692-30 from 1567833 to 2050685 tid 2 2026-02-17T05:39:10.357 INFO:tasks.rados.rados.0.trial118.stdout:2671: done (4 left) 2026-02-17T05:39:10.357 INFO:tasks.rados.rados.0.trial118.stdout:2679: read oid 6 snap 286 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2679: expect (ObjNum 943 snap 281 seq_num 943) 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2680: snap_create 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: finishing write tid 2 to trial11845692-47 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: finishing write tid 3 to trial11845692-47 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: finishing write tid 4 to trial11845692-47 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: oid 47 updating version 0 to 1407 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: oid 47 version 1407 is already newer than 1406 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: oid 47 version 1407 is already newer than 1405 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1407 (ObjNum 953 snap 287 seq_num 953) dirty exists 2026-02-17T05:39:10.358 INFO:tasks.rados.rados.0.trial118.stdout:2674: left oid 47 (ObjNum 953 snap 287 seq_num 953) 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2675: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2675: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1409 (ObjNum 825 snap 250 seq_num 825) dirty exists 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: finishing write tid 1 to trial11845692-13 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: finishing write tid 2 to trial11845692-13 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: finishing write tid 3 to trial11845692-13 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: finishing write tid 4 to trial11845692-13 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: oid 13 updating version 0 to 1449 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: oid 13 updating version 1449 to 1450 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:2677: oid 13 updating version 1450 to 1451 2026-02-17T05:39:10.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1451 (ObjNum 954 snap 287 seq_num 954) dirty exists 2026-02-17T05:39:10.360 INFO:tasks.rados.rados.0.trial118.stdout:2677: left oid 13 (ObjNum 954 snap 287 seq_num 954) 2026-02-17T05:39:10.360 INFO:tasks.rados.rados.0.trial118.stdout:2678: finishing write tid 1 to trial11845692-30 2026-02-17T05:39:10.361 INFO:tasks.rados.rados.0.trial118.stdout:2678: finishing write tid 2 to trial11845692-30 2026-02-17T05:39:10.361 INFO:tasks.rados.rados.0.trial118.stdout:2678: finishing write tid 3 to trial11845692-30 2026-02-17T05:39:10.361 INFO:tasks.rados.rados.0.trial118.stdout:2678: finishing write tid 4 to trial11845692-30 2026-02-17T05:39:10.361 INFO:tasks.rados.rados.0.trial118.stdout:2678: oid 30 updating version 0 to 1579 2026-02-17T05:39:10.361 INFO:tasks.rados.rados.0.trial118.stdout:2678: oid 30 updating version 1579 to 1581 2026-02-17T05:39:10.362 INFO:tasks.rados.rados.0.trial118.stdout:2678: oid 30 version 1581 is already newer than 1580 2026-02-17T05:39:10.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1581 (ObjNum 955 snap 287 seq_num 955) dirty exists 2026-02-17T05:39:10.362 INFO:tasks.rados.rados.0.trial118.stdout:2678: left oid 30 (ObjNum 955 snap 287 seq_num 955) 2026-02-17T05:39:10.362 INFO:tasks.rados.rados.0.trial118.stdout:2679: expect (ObjNum 943 snap 281 seq_num 943) 2026-02-17T05:39:10.363 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 176881 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2674: done (5 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2675: done (4 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2677: done (3 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2678: done (2 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2679: done (1 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2680: done (0 left) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2681: read oid 15 snap -1 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2681: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2682: write oid 4 current snap is 288 2026-02-17T05:39:11.343 INFO:tasks.rados.rados.0.trial118.stdout:2682: seq_num 956 ranges {467492=482169,1626315=441177} 2026-02-17T05:39:11.346 INFO:tasks.rados.rados.0.trial118.stdout:2682: writing trial11845692-4 from 467492 to 949661 tid 1 2026-02-17T05:39:11.351 INFO:tasks.rados.rados.0.trial118.stdout:2682: writing trial11845692-4 from 1626315 to 2067492 tid 2 2026-02-17T05:39:11.351 INFO:tasks.rados.rados.0.trial118.stdout:2683: copy_from oid 43 from oid 9 current snap is 288 2026-02-17T05:39:11.351 INFO:tasks.rados.rados.0.trial118.stdout:2681: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:39:11.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2648937 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: finishing write tid 1 to trial11845692-4 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: finishing write tid 2 to trial11845692-4 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2681: done (2 left) 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2684: copy_from oid 14 from oid 12 current snap is 288 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: finishing write tid 3 to trial11845692-4 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: finishing write tid 4 to trial11845692-4 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: oid 4 updating version 0 to 1462 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: oid 4 updating version 1462 to 1463 2026-02-17T05:39:11.423 INFO:tasks.rados.rados.0.trial118.stdout:2682: oid 4 version 1463 is already newer than 1461 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1463 (ObjNum 956 snap 288 seq_num 956) dirty exists 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2682: left oid 4 (ObjNum 956 snap 288 seq_num 956) 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2683: finishing copy_from racing read to trial11845692-43 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2683: finishing copy_from to trial11845692-43 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1385 (ObjNum 877 snap 265 seq_num 877) dirty exists 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2682: done (2 left) 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2683: done (1 left) 2026-02-17T05:39:11.424 INFO:tasks.rados.rados.0.trial118.stdout:2685: snap_create 2026-02-17T05:39:11.432 INFO:tasks.rados.rados.0.trial118.stdout:2684: finishing copy_from racing read to trial11845692-14 2026-02-17T05:39:11.434 INFO:tasks.rados.rados.0.trial118.stdout:2684: finishing copy_from to trial11845692-14 2026-02-17T05:39:11.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1128 (ObjNum 915 snap 276 seq_num 915) dirty exists 2026-02-17T05:39:12.347 INFO:tasks.rados.rados.0.trial118.stdout:2684: done (1 left) 2026-02-17T05:39:12.347 INFO:tasks.rados.rados.0.trial118.stdout:2685: done (0 left) 2026-02-17T05:39:12.347 INFO:tasks.rados.rados.0.trial118.stdout:2686: read oid 29 snap -1 2026-02-17T05:39:12.348 INFO:tasks.rados.rados.0.trial118.stdout:2686: expect (ObjNum 941 snap 281 seq_num 941) 2026-02-17T05:39:12.348 INFO:tasks.rados.rados.0.trial118.stdout:2687: read oid 17 snap -1 2026-02-17T05:39:12.348 INFO:tasks.rados.rados.0.trial118.stdout:2687: expect (ObjNum 928 snap 279 seq_num 928) 2026-02-17T05:39:12.348 INFO:tasks.rados.rados.0.trial118.stdout:2688: snap_create 2026-02-17T05:39:12.351 INFO:tasks.rados.rados.0.trial118.stdout:2687: expect (ObjNum 928 snap 279 seq_num 928) 2026-02-17T05:39:12.438 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2549257 2026-02-17T05:39:12.526 INFO:tasks.rados.rados.0.trial118.stdout:2686: expect (ObjNum 941 snap 281 seq_num 941) 2026-02-17T05:39:12.605 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3362004 2026-02-17T05:39:13.349 INFO:tasks.rados.rados.0.trial118.stdout:2686: done (2 left) 2026-02-17T05:39:13.349 INFO:tasks.rados.rados.0.trial118.stdout:2687: done (1 left) 2026-02-17T05:39:13.349 INFO:tasks.rados.rados.0.trial118.stdout:2688: done (0 left) 2026-02-17T05:39:13.350 INFO:tasks.rados.rados.0.trial118.stdout:2689: rollback oid 47 current snap is 290 2026-02-17T05:39:13.350 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 266 2026-02-17T05:39:13.350 INFO:tasks.rados.rados.0.trial118.stdout:2690: copy_from oid 46 from oid 21 current snap is 290 2026-02-17T05:39:13.350 INFO:tasks.rados.rados.0.trial118.stdout:2691: snap_create 2026-02-17T05:39:13.351 INFO:tasks.rados.rados.0.trial118.stdout:2690: finishing copy_from to trial11845692-46 2026-02-17T05:39:13.351 INFO:tasks.rados.rados.0.trial118.stdout:2690: got expected ENOENT (src dne) 2026-02-17T05:39:13.351 INFO:tasks.rados.rados.0.trial118.stdout:2690: finishing copy_from racing read to trial11845692-46 2026-02-17T05:39:13.353 INFO:tasks.rados.rados.0.trial118.stdout:2689: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:39:13.353 INFO:tasks.rados.rados.0.trial118.stdout:2689: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:39:13.353 INFO:tasks.rados.rados.0.trial118.stdout:2689: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:39:13.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1412 (ObjNum 860 snap 260 seq_num 860) dirty exists 2026-02-17T05:39:14.352 INFO:tasks.rados.rados.0.trial118.stdout:2689: done (2 left) 2026-02-17T05:39:14.352 INFO:tasks.rados.rados.0.trial118.stdout:2690: done (1 left) 2026-02-17T05:39:14.352 INFO:tasks.rados.rados.0.trial118.stdout:2691: done (0 left) 2026-02-17T05:39:14.353 INFO:tasks.rados.rados.0.trial118.stdout:2692: copy_from oid 14 from oid 15 current snap is 291 2026-02-17T05:39:14.353 INFO:tasks.rados.rados.0.trial118.stdout:2693: write (excl) oid 36 current snap is 291 2026-02-17T05:39:14.353 INFO:tasks.rados.rados.0.trial118.stdout:2693: seq_num 957 ranges {484299=557418,1684797=399502} 2026-02-17T05:39:14.357 INFO:tasks.rados.rados.0.trial118.stdout:2693: writing trial11845692-36 from 484299 to 1041717 tid 1 2026-02-17T05:39:14.361 INFO:tasks.rados.rados.0.trial118.stdout:2693: writing trial11845692-36 from 1684797 to 2084299 tid 2 2026-02-17T05:39:14.361 INFO:tasks.rados.rados.0.trial118.stdout:2694: write (excl) oid 26 current snap is 291 2026-02-17T05:39:14.361 INFO:tasks.rados.rados.0.trial118.stdout:2694: seq_num 958 ranges {501106=749020,1743279=357827} 2026-02-17T05:39:14.365 INFO:tasks.rados.rados.0.trial118.stdout:2694: writing trial11845692-26 from 501106 to 1250126 tid 1 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2694: writing trial11845692-26 from 1743279 to 2101106 tid 2 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2695: rollback oid 34 current snap is 291 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 254 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2693: finishing write tid 1 to trial11845692-36 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2692: finishing copy_from racing read to trial11845692-14 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2692: finishing copy_from to trial11845692-14 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2693: finishing write tid 2 to trial11845692-36 2026-02-17T05:39:14.369 INFO:tasks.rados.rados.0.trial118.stdout:2693: finishing write tid 3 to trial11845692-36 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: finishing write tid 4 to trial11845692-36 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: oid 36 updating version 0 to 1298 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: oid 36 version 1298 is already newer than 1296 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: oid 36 version 1298 is already newer than 1297 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1298 (ObjNum 957 snap 291 seq_num 957) dirty exists 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: left oid 36 (ObjNum 957 snap 291 seq_num 957) 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2692: done (3 left) 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2693: done (2 left) 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2696: rollback oid 15 current snap is 291 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 289 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2697: read oid 36 snap -1 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2697: expect (ObjNum 957 snap 291 seq_num 957) 2026-02-17T05:39:14.370 INFO:tasks.rados.rados.0.trial118.stdout:2698: snap_create 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2696: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: finishing write tid 1 to trial11845692-26 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2696: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: finishing write tid 2 to trial11845692-26 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: finishing write tid 3 to trial11845692-26 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: finishing write tid 4 to trial11845692-26 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: oid 26 updating version 0 to 1449 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: oid 26 version 1449 is already newer than 1447 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:2694: oid 26 version 1449 is already newer than 1448 2026-02-17T05:39:14.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1449 (ObjNum 958 snap 291 seq_num 958) dirty exists 2026-02-17T05:39:14.373 INFO:tasks.rados.rados.0.trial118.stdout:2694: left oid 26 (ObjNum 958 snap 291 seq_num 958) 2026-02-17T05:39:14.373 INFO:tasks.rados.rados.0.trial118.stdout:2695: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:39:14.373 INFO:tasks.rados.rados.0.trial118.stdout:2695: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:39:14.373 INFO:tasks.rados.rados.0.trial118.stdout:2695: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:39:14.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1536 (ObjNum 782 snap 229 seq_num 782) dirty exists 2026-02-17T05:39:14.374 INFO:tasks.rados.rados.0.trial118.stdout:2696: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:39:14.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1302 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:39:14.374 INFO:tasks.rados.rados.0.trial118.stdout:2697: expect (ObjNum 957 snap 291 seq_num 957) 2026-02-17T05:39:14.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:14.425 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2694: done (4 left) 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2695: done (3 left) 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2696: done (2 left) 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2697: done (1 left) 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2698: done (0 left) 2026-02-17T05:39:15.328 INFO:tasks.rados.rados.0.trial118.stdout:2699: read oid 36 snap -1 2026-02-17T05:39:15.329 INFO:tasks.rados.rados.0.trial118.stdout:2699: expect (ObjNum 957 snap 291 seq_num 957) 2026-02-17T05:39:15.329 INFO:tasks.rados.rados.0.trial118.stdout:2700: snap_remove snap 266 2026-02-17T05:39:16.331 INFO:tasks.rados.rados.0.trial118.stdout:2700: done (1 left) 2026-02-17T05:39:16.331 INFO:tasks.rados.rados.0.trial118.stdout:2701: delete oid 30 current snap is 292 2026-02-17T05:39:16.331 INFO:tasks.rados.rados.0.trial118.stdout:2699: expect (ObjNum 957 snap 291 seq_num 957) 2026-02-17T05:39:16.335 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 658092 2026-02-17T05:39:16.394 INFO:tasks.rados.rados.0.trial118.stdout:2699: done (1 left) 2026-02-17T05:39:16.394 INFO:tasks.rados.rados.0.trial118.stdout:2701: done (0 left) 2026-02-17T05:39:16.394 INFO:tasks.rados.rados.0.trial118.stdout:2702: read oid 5 snap -1 2026-02-17T05:39:16.394 INFO:tasks.rados.rados.0.trial118.stdout:2702: expect (ObjNum 950 snap 286 seq_num 950) 2026-02-17T05:39:16.394 INFO:tasks.rados.rados.0.trial118.stdout:2703: write (excl) oid 40 current snap is 292 2026-02-17T05:39:16.395 INFO:tasks.rados.rados.0.trial118.stdout:2703: seq_num 960 ranges {534720=499518,1460243=674477} 2026-02-17T05:39:16.397 INFO:tasks.rados.rados.0.trial118.stdout:2703: writing trial11845692-40 from 534720 to 1034238 tid 1 2026-02-17T05:39:16.401 INFO:tasks.rados.rados.0.trial118.stdout:2703: writing trial11845692-40 from 1460243 to 2134720 tid 2 2026-02-17T05:39:16.401 INFO:tasks.rados.rados.0.trial118.stdout:2704: rollback oid 9 current snap is 292 2026-02-17T05:39:16.401 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 291 2026-02-17T05:39:16.401 INFO:tasks.rados.rados.0.trial118.stdout:2702: expect (ObjNum 950 snap 286 seq_num 950) 2026-02-17T05:39:16.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3356228 2026-02-17T05:39:16.464 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:16.501 INFO:tasks.rados.rados.0.trial118.stdout:2703: finishing write tid 1 to trial11845692-40 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: finishing write tid 2 to trial11845692-40 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2702: done (2 left) 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2705: delete oid 11 current snap is 292 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: finishing write tid 3 to trial11845692-40 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: finishing write tid 4 to trial11845692-40 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: oid 40 updating version 0 to 1594 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: oid 40 updating version 1594 to 1595 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: oid 40 version 1595 is already newer than 1593 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1595 (ObjNum 960 snap 292 seq_num 960) dirty exists 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2703: left oid 40 (ObjNum 960 snap 292 seq_num 960) 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2704: finishing rollback tid 0 to trial11845692-9 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2704: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:2704: finishing rollback tid 2 to trial11845692-9 2026-02-17T05:39:16.502 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1475 (ObjNum 877 snap 265 seq_num 877) dirty exists 2026-02-17T05:39:16.503 INFO:tasks.rados.rados.0.trial118.stdout:2703: done (2 left) 2026-02-17T05:39:16.503 INFO:tasks.rados.rados.0.trial118.stdout:2704: done (1 left) 2026-02-17T05:39:16.503 INFO:tasks.rados.rados.0.trial118.stdout:2705: done (0 left) 2026-02-17T05:39:16.503 INFO:tasks.rados.rados.0.trial118.stdout:2706: write (excl) oid 6 current snap is 292 2026-02-17T05:39:16.503 INFO:tasks.rados.rados.0.trial118.stdout:2706: seq_num 962 ranges {568334=650016,1860854=307480} 2026-02-17T05:39:16.507 INFO:tasks.rados.rados.0.trial118.stdout:2706: writing trial11845692-6 from 568334 to 1218350 tid 1 2026-02-17T05:39:16.510 INFO:tasks.rados.rados.0.trial118.stdout:2706: writing trial11845692-6 from 1860854 to 2168334 tid 2 2026-02-17T05:39:16.511 INFO:tasks.rados.rados.0.trial118.stdout:2707: snap_remove snap 289 2026-02-17T05:39:17.354 INFO:tasks.rados.rados.0.trial118.stdout:2707: done (1 left) 2026-02-17T05:39:17.355 INFO:tasks.rados.rados.0.trial118.stdout:2708: write oid 46 current snap is 292 2026-02-17T05:39:17.355 INFO:tasks.rados.rados.0.trial118.stdout:2708: seq_num 963 ranges {585141=725265,1919336=265805} 2026-02-17T05:39:17.360 INFO:tasks.rados.rados.0.trial118.stdout:2708: writing trial11845692-46 from 585141 to 1310406 tid 1 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2708: writing trial11845692-46 from 1919336 to 2185141 tid 2 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2709: copy_from oid 28 from oid 23 current snap is 292 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2706: finishing write tid 1 to trial11845692-6 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2706: finishing write tid 2 to trial11845692-6 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2706: finishing write tid 3 to trial11845692-6 2026-02-17T05:39:17.363 INFO:tasks.rados.rados.0.trial118.stdout:2706: finishing write tid 4 to trial11845692-6 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2706: oid 6 updating version 0 to 1450 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2706: oid 6 updating version 1450 to 1451 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2706: oid 6 version 1451 is already newer than 1449 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1451 (ObjNum 962 snap 292 seq_num 962) dirty exists 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2706: left oid 6 (ObjNum 962 snap 292 seq_num 962) 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2708: finishing write tid 1 to trial11845692-46 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2706: done (2 left) 2026-02-17T05:39:17.364 INFO:tasks.rados.rados.0.trial118.stdout:2710: snap_remove snap 291 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2710: done (2 left) 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2711: delete oid 42 current snap is 292 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: finishing write tid 2 to trial11845692-46 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: finishing write tid 3 to trial11845692-46 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: finishing write tid 4 to trial11845692-46 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: oid 46 updating version 0 to 1403 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: oid 46 updating version 1403 to 1404 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: oid 46 updating version 1404 to 1405 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1405 (ObjNum 963 snap 292 seq_num 963) dirty exists 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2708: left oid 46 (ObjNum 963 snap 292 seq_num 963) 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2709: finishing copy_from racing read to trial11845692-28 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:2709: finishing copy_from to trial11845692-28 2026-02-17T05:39:18.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1448 (ObjNum 941 snap 281 seq_num 941) dirty exists 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2708: done (2 left) 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2709: done (1 left) 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2711: done (0 left) 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2712: copy_from oid 5 from oid 49 current snap is 292 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2713: read oid 7 snap -1 2026-02-17T05:39:18.361 INFO:tasks.rados.rados.0.trial118.stdout:2713: expect (ObjNum 903 snap 271 seq_num 903) 2026-02-17T05:39:18.362 INFO:tasks.rados.rados.0.trial118.stdout:2714: delete oid 44 current snap is 292 2026-02-17T05:39:18.362 INFO:tasks.rados.rados.0.trial118.stdout:2714: done (2 left) 2026-02-17T05:39:18.362 INFO:tasks.rados.rados.0.trial118.stdout:2715: read oid 30 snap -1 2026-02-17T05:39:18.362 INFO:tasks.rados.rados.0.trial118.stdout:2715: expect deleted 2026-02-17T05:39:18.362 INFO:tasks.rados.rados.0.trial118.stdout:2716: snap_remove snap 278 2026-02-17T05:39:19.360 INFO:tasks.rados.rados.0.trial118.stdout:2716: done (3 left) 2026-02-17T05:39:19.361 INFO:tasks.rados.rados.0.trial118.stdout:2717: delete oid 35 current snap is 292 2026-02-17T05:39:19.361 INFO:tasks.rados.rados.0.trial118.stdout:2713: expect (ObjNum 903 snap 271 seq_num 903) 2026-02-17T05:39:19.432 INFO:tasks.rados.rados.0.trial118.stdout:2712: finishing copy_from racing read to trial11845692-5 2026-02-17T05:39:19.432 INFO:tasks.rados.rados.0.trial118.stdout:2712: finishing copy_from to trial11845692-5 2026-02-17T05:39:19.432 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1199 (ObjNum 911 snap 275 seq_num 911) dirty exists 2026-02-17T05:39:19.432 INFO:tasks.rados.rados.0.trial118.stdout:2712: done (3 left) 2026-02-17T05:39:19.432 INFO:tasks.rados.rados.0.trial118.stdout:2713: done (2 left) 2026-02-17T05:39:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2715: done (1 left) 2026-02-17T05:39:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2717: done (0 left) 2026-02-17T05:39:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2718: write (excl) oid 38 current snap is 292 2026-02-17T05:39:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2718: seq_num 967 ranges {652369=742614,2153264=99105} 2026-02-17T05:39:19.436 INFO:tasks.rados.rados.0.trial118.stdout:2718: writing trial11845692-38 from 652369 to 1394983 tid 1 2026-02-17T05:39:19.440 INFO:tasks.rados.rados.0.trial118.stdout:2718: writing trial11845692-38 from 2153264 to 2252369 tid 2 2026-02-17T05:39:19.440 INFO:tasks.rados.rados.0.trial118.stdout:2719: copy_from oid 48 from oid 6 current snap is 292 2026-02-17T05:39:19.440 INFO:tasks.rados.rados.0.trial118.stdout:2720: delete oid 47 current snap is 292 2026-02-17T05:39:19.440 INFO:tasks.rados.rados.0.trial118.stdout:2718: finishing write tid 1 to trial11845692-38 2026-02-17T05:39:19.441 INFO:tasks.rados.rados.0.trial118.stdout:2718: finishing write tid 2 to trial11845692-38 2026-02-17T05:39:19.442 INFO:tasks.rados.rados.0.trial118.stdout:2718: finishing write tid 3 to trial11845692-38 2026-02-17T05:39:19.442 INFO:tasks.rados.rados.0.trial118.stdout:2718: finishing write tid 4 to trial11845692-38 2026-02-17T05:39:19.442 INFO:tasks.rados.rados.0.trial118.stdout:2718: oid 38 updating version 0 to 1415 2026-02-17T05:39:19.442 INFO:tasks.rados.rados.0.trial118.stdout:2718: oid 38 version 1415 is already newer than 1414 2026-02-17T05:39:19.442 INFO:tasks.rados.rados.0.trial118.stdout:2718: oid 38 updating version 1415 to 1416 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1416 (ObjNum 967 snap 292 seq_num 967) dirty exists 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2718: left oid 38 (ObjNum 967 snap 292 seq_num 967) 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2718: done (2 left) 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2720: done (1 left) 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2721: copy_from oid 36 from oid 41 current snap is 292 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2722: write (excl) oid 33 current snap is 292 2026-02-17T05:39:19.443 INFO:tasks.rados.rados.0.trial118.stdout:2722: seq_num 969 ranges {685983=493112,1870228=415755} 2026-02-17T05:39:19.446 INFO:tasks.rados.rados.0.trial118.stdout:2722: writing trial11845692-33 from 685983 to 1179095 tid 1 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2722: writing trial11845692-33 from 1870228 to 2285983 tid 2 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2723: copy_from oid 7 from oid 2 current snap is 292 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2719: finishing copy_from racing read to trial11845692-48 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2721: finishing copy_from racing read to trial11845692-36 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2722: finishing write tid 1 to trial11845692-33 2026-02-17T05:39:19.452 INFO:tasks.rados.rados.0.trial118.stdout:2719: finishing copy_from to trial11845692-48 2026-02-17T05:39:19.453 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1451 (ObjNum 962 snap 292 seq_num 962) dirty exists 2026-02-17T05:39:19.453 INFO:tasks.rados.rados.0.trial118.stdout:2719: done (3 left) 2026-02-17T05:39:19.453 INFO:tasks.rados.rados.0.trial118.stdout:2724: snap_remove snap 287 2026-02-17T05:39:20.364 INFO:tasks.rados.rados.0.trial118.stdout:2724: done (3 left) 2026-02-17T05:39:20.364 INFO:tasks.rados.rados.0.trial118.stdout:2725: rollback oid 8 current snap is 292 2026-02-17T05:39:20.364 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 283 2026-02-17T05:39:20.364 INFO:tasks.rados.rados.0.trial118.stdout:2721: finishing copy_from to trial11845692-36 2026-02-17T05:39:20.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1412 (ObjNum 921 snap 276 seq_num 921) dirty exists 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: finishing write tid 2 to trial11845692-33 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: finishing write tid 3 to trial11845692-33 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: finishing write tid 4 to trial11845692-33 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: oid 33 updating version 0 to 1614 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: oid 33 version 1614 is already newer than 1612 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: oid 33 version 1614 is already newer than 1613 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1614 (ObjNum 969 snap 292 seq_num 969) dirty exists 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2722: left oid 33 (ObjNum 969 snap 292 seq_num 969) 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2723: finishing copy_from racing read to trial11845692-7 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:2723: finishing copy_from to trial11845692-7 2026-02-17T05:39:20.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1677 (ObjNum 942 snap 281 seq_num 942) dirty exists 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2721: done (3 left) 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2722: done (2 left) 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2723: done (1 left) 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2726: read oid 7 snap -1 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2726: expect (ObjNum 942 snap 281 seq_num 942) 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2727: read oid 27 snap 276 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2727: expect deleted 2026-02-17T05:39:20.366 INFO:tasks.rados.rados.0.trial118.stdout:2728: snap_create 2026-02-17T05:39:20.367 INFO:tasks.rados.rados.0.trial118.stdout:2725: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:39:20.367 INFO:tasks.rados.rados.0.trial118.stdout:2725: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:39:20.367 INFO:tasks.rados.rados.0.trial118.stdout:2725: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:39:20.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1710 (ObjNum 894 snap 269 seq_num 894) dirty exists 2026-02-17T05:39:20.370 INFO:tasks.rados.rados.0.trial118.stdout:2726: expect (ObjNum 942 snap 281 seq_num 942) 2026-02-17T05:39:20.370 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:20.398 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:21.365 INFO:tasks.rados.rados.0.trial118.stdout:2725: done (3 left) 2026-02-17T05:39:21.365 INFO:tasks.rados.rados.0.trial118.stdout:2726: done (2 left) 2026-02-17T05:39:21.365 INFO:tasks.rados.rados.0.trial118.stdout:2727: done (1 left) 2026-02-17T05:39:21.366 INFO:tasks.rados.rados.0.trial118.stdout:2728: done (0 left) 2026-02-17T05:39:21.366 INFO:tasks.rados.rados.0.trial118.stdout:2729: write (excl) oid 29 current snap is 293 2026-02-17T05:39:21.366 INFO:tasks.rados.rados.0.trial118.stdout:2729: seq_num 970 ranges {702790=568361,1812357=490433} 2026-02-17T05:39:21.370 INFO:tasks.rados.rados.0.trial118.stdout:2729: writing trial11845692-29 from 702790 to 1271151 tid 1 2026-02-17T05:39:21.374 INFO:tasks.rados.rados.0.trial118.stdout:2729: writing trial11845692-29 from 1812357 to 2302790 tid 2 2026-02-17T05:39:21.374 INFO:tasks.rados.rados.0.trial118.stdout:2730: read oid 9 snap 271 2026-02-17T05:39:21.374 INFO:tasks.rados.rados.0.trial118.stdout:2730: expect (ObjNum 877 snap 265 seq_num 877) 2026-02-17T05:39:21.375 INFO:tasks.rados.rados.0.trial118.stdout:2731: copy_from oid 39 from oid 38 current snap is 293 2026-02-17T05:39:21.375 INFO:tasks.rados.rados.0.trial118.stdout:2729: finishing write tid 1 to trial11845692-29 2026-02-17T05:39:21.375 INFO:tasks.rados.rados.0.trial118.stdout:2732: copy_from oid 7 from oid 31 current snap is 293 2026-02-17T05:39:21.375 INFO:tasks.rados.rados.0.trial118.stdout:2733: delete oid 43 current snap is 293 2026-02-17T05:39:21.377 INFO:tasks.rados.rados.0.trial118.stdout:2733: done (4 left) 2026-02-17T05:39:21.377 INFO:tasks.rados.rados.0.trial118.stdout:2734: write oid 17 current snap is 293 2026-02-17T05:39:21.377 INFO:tasks.rados.rados.0.trial118.stdout:2734: seq_num 972 ranges {736404=718859,1929321=407083} 2026-02-17T05:39:21.383 INFO:tasks.rados.rados.0.trial118.stdout:2734: writing trial11845692-17 from 736404 to 1455263 tid 1 2026-02-17T05:39:21.387 INFO:tasks.rados.rados.0.trial118.stdout:2734: writing trial11845692-17 from 1929321 to 2336404 tid 2 2026-02-17T05:39:21.388 INFO:tasks.rados.rados.0.trial118.stdout:2735: read oid 36 snap -1 2026-02-17T05:39:21.388 INFO:tasks.rados.rados.0.trial118.stdout:2735: expect (ObjNum 921 snap 276 seq_num 921) 2026-02-17T05:39:21.388 INFO:tasks.rados.rados.0.trial118.stdout:2736: copy_from oid 45 from oid 42 current snap is 293 2026-02-17T05:39:21.388 INFO:tasks.rados.rados.0.trial118.stdout:2729: finishing write tid 2 to trial11845692-29 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: finishing write tid 3 to trial11845692-29 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: finishing write tid 4 to trial11845692-29 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: oid 29 updating version 0 to 1678 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: oid 29 updating version 1678 to 1679 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: oid 29 updating version 1679 to 1680 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1680 (ObjNum 970 snap 293 seq_num 970) dirty exists 2026-02-17T05:39:21.389 INFO:tasks.rados.rados.0.trial118.stdout:2729: left oid 29 (ObjNum 970 snap 293 seq_num 970) 2026-02-17T05:39:21.390 INFO:tasks.rados.rados.0.trial118.stdout:2731: finishing copy_from racing read to trial11845692-39 2026-02-17T05:39:21.390 INFO:tasks.rados.rados.0.trial118.stdout:2730: expect (ObjNum 877 snap 265 seq_num 877) 2026-02-17T05:39:21.505 INFO:tasks.rados.rados.0.trial118.stdout:2731: finishing copy_from to trial11845692-39 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1416 (ObjNum 967 snap 292 seq_num 967) dirty exists 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: finishing write tid 1 to trial11845692-17 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2729: done (6 left) 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2730: done (5 left) 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2731: done (4 left) 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2737: delete oid 16 current snap is 293 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: finishing write tid 2 to trial11845692-17 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: finishing write tid 3 to trial11845692-17 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: finishing write tid 4 to trial11845692-17 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: oid 17 updating version 0 to 1408 2026-02-17T05:39:21.506 INFO:tasks.rados.rados.0.trial118.stdout:2734: oid 17 version 1408 is already newer than 1407 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:2734: oid 17 version 1408 is already newer than 1406 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1408 (ObjNum 972 snap 293 seq_num 972) dirty exists 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:2734: left oid 17 (ObjNum 972 snap 293 seq_num 972) 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:2732: finishing copy_from racing read to trial11845692-7 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:2732: finishing copy_from to trial11845692-7 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1689 (ObjNum 951 snap 286 seq_num 951) dirty exists 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:2735: expect (ObjNum 921 snap 276 seq_num 921) 2026-02-17T05:39:21.507 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:21.572 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2700685 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2736: finishing copy_from to trial11845692-45 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2736: got expected ENOENT (src dne) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2736: finishing copy_from racing read to trial11845692-45 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2732: done (4 left) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2734: done (3 left) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2735: done (2 left) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2736: done (1 left) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2737: done (0 left) 2026-02-17T05:39:21.581 INFO:tasks.rados.rados.0.trial118.stdout:2738: delete oid 23 current snap is 293 2026-02-17T05:39:21.582 INFO:tasks.rados.rados.0.trial118.stdout:2738: done (0 left) 2026-02-17T05:39:21.582 INFO:tasks.rados.rados.0.trial118.stdout:2739: copy_from oid 7 from oid 11 current snap is 293 2026-02-17T05:39:21.582 INFO:tasks.rados.rados.0.trial118.stdout:2740: snap_create 2026-02-17T05:39:21.583 INFO:tasks.rados.rados.0.trial118.stdout:2739: finishing copy_from to trial11845692-7 2026-02-17T05:39:21.583 INFO:tasks.rados.rados.0.trial118.stdout:2739: got expected ENOENT (src dne) 2026-02-17T05:39:21.583 INFO:tasks.rados.rados.0.trial118.stdout:2739: finishing copy_from racing read to trial11845692-7 2026-02-17T05:39:21.672 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:39:21.672 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:39:21.672 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:39:21.673 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:39:21.686 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:39:21.687 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:39:21.687 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:39:21.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 10 monclient: get_monmap_and_config 2026-02-17T05:39:21.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 10 monclient: build_initial_monmap 2026-02-17T05:39:21.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 10 monclient: monmap: 2026-02-17T05:39:21.754 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:21.753600+0000 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:21.753600+0000 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:21.755 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 1 Processor -- start 2026-02-17T05:39:21.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 1 -- start start 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.753+0000 7f928190c640 10 monclient: init 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient(hunting): picked mon.noname-c con 0x7f927c142470 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient(hunting): picked mon.noname-a con 0x7f927c08dcf0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient(hunting): picked mon.noname-b con 0x7f927c184950 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c05e440 con 0x7f927c08dcf0 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c08cd50 con 0x7f927c142470 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c141eb0 con 0x7f927c184950 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient(hunting): authenticate will time out at 1290.382268s 2026-02-17T05:39:21.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f927a7fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f927c08dcf0 0x7f927c183230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42922/0 (socket says 10.20.193.106:42922) 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f927a7fc640 1 -- 10.20.193.106:0/216670617 learned_addr learned my addr 10.20.193.106:0/216670617 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288028674 0 0) 0x7f927c141eb0 con 0x7f927c184950 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient(hunting): my global_id is 5012 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92680035e0 con 0x7f927c184950 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3956556768 0 0) 0x7f92680035e0 con 0x7f927c184950 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 >> v1:10.20.193.118:6789/0 conn(0x7f927c142470 legacy=0x7f927c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 >> v1:10.20.193.106:6789/0 conn(0x7f927c08dcf0 legacy=0x7f927c183230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 monclient: found mon.noname-b 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:21.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c08ca70 con 0x7f927c184950 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: _finish_auth 0 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f926c003eb0 con 0x7f927c184950 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 5 monclient: authenticate success, global_id 5012 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: dump: 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.764 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f926c004170 con 0x7f927c184950 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 1 -- 10.20.193.106:0/216670617 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f926c004540 con 0x7f927c184950 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f928190c640 4 set_mon_vals no callback set 2026-02-17T05:39:21.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.754+0000 7f9279ffb640 10 monclient: dump: 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 10 monclient: shutdown 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- 10.20.193.106:0/216670617 >> v1:10.20.193.106:6790/0 conn(0x7f927c184950 legacy=0x7f927c1a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- 10.20.193.106:0/216670617 shutdown_connections 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- 10.20.193.106:0/216670617 >> 10.20.193.106:0/216670617 conn(0x7f927c091f30 msgr2=0x7f927c08e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- 10.20.193.106:0/216670617 shutdown_connections 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- 10.20.193.106:0/216670617 wait complete. 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 10 monclient: build_initial_monmap 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 10 monclient: monmap: 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:21.767 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 Processor -- start 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 1 -- start start 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.755+0000 7f928190c640 10 monclient: init 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient(hunting): picked mon.noname-a con 0x7f927c08dcf0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient(hunting): picked mon.noname-c con 0x7f927c142470 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient(hunting): picked mon.noname-b con 0x7f927c184950 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c138ab0 con 0x7f927c08dcf0 2026-02-17T05:39:21.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c0889c0 con 0x7f927c184950 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c139310 con 0x7f927c142470 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient(hunting): authenticate will time out at 1290.384149s 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f927a7fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f927c142470 0x7f927c182860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48390/0 (socket says 10.20.193.106:48390) 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f927a7fc640 1 -- 10.20.193.106:0/3988459110 learned_addr learned my addr 10.20.193.106:0/3988459110 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336643094 0 0) 0x7f927c139310 con 0x7f927c142470 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): my global_id is 5015 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f924c0035e0 con 0x7f927c142470 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2980521671 0 0) 0x7f924c0035e0 con 0x7f927c142470 2026-02-17T05:39:21.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f927c139310 con 0x7f927c142470 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9264002ff0 con 0x7f927c142470 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): dump: 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:21.770 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2279990993 0 0) 0x7f927c139310 con 0x7f927c142470 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 >> v1:10.20.193.118:6789/0 conn(0x7f927c184950 legacy=0x7f927c183f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 >> v1:10.20.193.106:6789/0 conn(0x7f927c08dcf0 legacy=0x7f927c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: _finish_hunting 0 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 monclient: found mon.c 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c1395f0 con 0x7f927c142470 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: _finish_auth 0 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: _check_auth_tickets 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 5 monclient: authenticate success, global_id 5015 2026-02-17T05:39:21.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _renew_subs 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f927c184690 con 0x7f927c142470 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _renew_subs 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f927c138550 con 0x7f927c142470 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92640048a0 con 0x7f927c142470 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9264004c80 con 0x7f927c142470 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f9253fff640 10 monclient: dump: 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.772 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.756+0000 7f92797fa640 4 set_mon_vals no callback set 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f928190c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f928190c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f928190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c0008d0 con 0x7f927c142470 2026-02-17T05:39:21.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9264004de0 con 0x7f927c142470 2026-02-17T05:39:21.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(589..589 src has 356..589) ==== 3963+0+0 (unknown 285937485 0 0) 0x7f926404fd00 con 0x7f927c142470 2026-02-17T05:39:21.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.757+0000 7f927affd640 10 monclient: get_auth_request con 0x7f924c040800 auth_method 0 2026-02-17T05:39:21.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.760+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9264017350 con 0x7f927c142470 2026-02-17T05:39:21.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.760+0000 7f9253fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:21.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.760+0000 7f9253fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f928190c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f928190c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f928190c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f927c05e440 con 0x7f927c142470 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f9253fff640 1 -- 10.20.193.106:0/3988459110 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1142208195) 0x7f927c05e440 con 0x7f927c142470 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f9253fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:21.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.905+0000 7f9253fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:21.908 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.906+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 >> v1:10.20.193.118:6812/703720803 conn(0x7f924c040800 legacy=0x7f924c060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.906+0000 7f928190c640 10 monclient: shutdown 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.906+0000 7f928190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.906+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 >> v1:10.20.193.106:6790/0 conn(0x7f927c142470 legacy=0x7f927c182860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.906+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 shutdown_connections 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.907+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 >> 10.20.193.106:0/3988459110 conn(0x7f927c091f30 msgr2=0x7f927c140d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.907+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 shutdown_connections 2026-02-17T05:39:21.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.907+0000 7f928190c640 1 -- 10.20.193.106:0/3988459110 wait complete. 2026-02-17T05:39:21.916 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:39:21.916 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:39:21.916 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.981+0000 7faf31fae640 10 monclient: get_monmap_and_config 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.981+0000 7faf31fae640 10 monclient: build_initial_monmap 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.981+0000 7faf31fae640 10 monclient: monmap: 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:21.997 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:21.982376+0000 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:21.982376+0000 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 1 Processor -- start 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 1 -- start start 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient: init 2026-02-17T05:39:21.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-b con 0x7faf2c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-c con 0x7faf2c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-a con 0x7faf2c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c08b060 con 0x7faf2c182720 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c05dc90 con 0x7faf2c05dee0 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c08d6a0 con 0x7faf2c05d1b0 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf31fae640 10 monclient(hunting): authenticate will time out at 1290.610760s 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf2b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7faf2c05d1b0 0x7faf2c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48398/0 (socket says 10.20.193.106:48398) 2026-02-17T05:39:21.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf2b7fe640 1 -- 10.20.193.106:0/1560861956 learned_addr learned my addr 10.20.193.106:0/1560861956 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.982+0000 7faf2bfff640 1 --1- 10.20.193.106:0/1560861956 >> v1:10.20.193.106:6789/0 conn(0x7faf2c182720 0x7faf2c1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42948/0 (socket says 10.20.193.106:42948) 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481357868 0 0) 0x7faf2c08d6a0 con 0x7faf2c05d1b0 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): my global_id is 5018 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf100035e0 con 0x7faf2c05d1b0 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308640382 0 0) 0x7faf2c05dc90 con 0x7faf2c05dee0 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient(hunting): my global_id is 94267 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c08d6a0 con 0x7faf2c05dee0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2437532249 0 0) 0x7faf2c08d6a0 con 0x7faf2c05dee0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 >> v1:10.20.193.106:6790/0 conn(0x7faf2c05d1b0 legacy=0x7faf2c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 >> v1:10.20.193.106:6789/0 conn(0x7faf2c182720 legacy=0x7faf2c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 monclient: found mon.noname-c 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c057960 con 0x7faf2c05dee0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf1c002dd0 con 0x7faf2c05dee0 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf31fae640 5 monclient: authenticate success, global_id 94267 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf31fae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: dump: 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.002 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf31fae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf1c003090 con 0x7faf2c05dee0 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 1 -- 10.20.193.106:0/1560861956 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf1c0034a0 con 0x7faf2c05dee0 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf2a7fc640 10 monclient: dump: 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.003 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf31fae640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.983+0000 7faf31fae640 4 set_mon_vals no callback set 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 10 monclient: shutdown 2026-02-17T05:39:22.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- 10.20.193.106:0/1560861956 >> v1:10.20.193.118:6789/0 conn(0x7faf2c05dee0 legacy=0x7faf2c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- 10.20.193.106:0/1560861956 shutdown_connections 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- 10.20.193.106:0/1560861956 >> 10.20.193.106:0/1560861956 conn(0x7faf2c0915f0 msgr2=0x7faf2c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- 10.20.193.106:0/1560861956 shutdown_connections 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- 10.20.193.106:0/1560861956 wait complete. 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 10 monclient: monmap: 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:22.005 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 Processor -- start 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 1 -- start start 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.984+0000 7faf31fae640 10 monclient: init 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-b con 0x7faf2c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.006 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-c con 0x7faf2c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient(hunting): picked mon.noname-a con 0x7faf2c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c12c110 con 0x7faf2c182720 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c05e8e0 con 0x7faf2c05d1b0 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c10bd80 con 0x7faf2c05dee0 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient(hunting): authenticate will time out at 1290.613122s 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf2affd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7faf2c05dee0 0x7faf2c12ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48410/0 (socket says 10.20.193.106:48410) 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf2affd640 1 -- 10.20.193.106:0/3407788699 learned_addr learned my addr 10.20.193.106:0/3407788699 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811088977 0 0) 0x7faf2c10bd80 con 0x7faf2c05dee0 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.007 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): my global_id is 5021 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faefc0035e0 con 0x7faf2c05dee0 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029784057 0 0) 0x7faf2c12c110 con 0x7faf2c182720 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): my global_id is 114099 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c10bd80 con 0x7faf2c182720 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2374116129 0 0) 0x7faefc0035e0 con 0x7faf2c05dee0 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf2c12c110 con 0x7faf2c05dee0 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf1c0033b0 con 0x7faf2c05dee0 2026-02-17T05:39:22.008 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): dump: 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54841023 0 0) 0x7faf2c05e8e0 con 0x7faf2c05d1b0 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient(hunting): my global_id is 94270 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faefc0035e0 con 0x7faf2c05d1b0 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2624129939 0 0) 0x7faf2c12c110 con 0x7faf2c05dee0 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.118:6789/0 conn(0x7faf2c05d1b0 legacy=0x7faf2c12b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6789/0 conn(0x7faf2c182720 legacy=0x7faf2c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 monclient: found mon.c 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c10a890 con 0x7faf2c05dee0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 5 monclient: authenticate success, global_id 5021 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _renew_subs 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1824f0 con 0x7faf2c05dee0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _renew_subs 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faf2c10b620 con 0x7faf2c05dee0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf1c003a20 con 0x7faf2c05dee0 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf1c003e00 con 0x7faf2c05dee0 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf07fff640 10 monclient: dump: 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.012 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.985+0000 7faf29ffb640 4 set_mon_vals no callback set 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf31fae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf2c1285f0 con 0x7faf2c128220 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7faf1c003f60 con 0x7faf2c05dee0 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(589..589 src has 356..589) ==== 3963+0+0 (unknown 285937485 0 0) 0x7faf1c04fea0 con 0x7faf2c05dee0 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097927906 0 0) 0x7faf2c1285f0 con 0x7faf2c128220 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient(hunting): my global_id is 114102 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c12c110 con 0x7faf2c128220 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf2bfff640 10 monclient: get_auth_request con 0x7faefc040a90 auth_method 0 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3318232576 0 0) 0x7faf2c12c110 con 0x7faf2c128220 2026-02-17T05:39:22.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf2c1285f0 con 0x7faf2c128220 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf18002eb0 con 0x7faf2c128220 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 10 monclient: dump: 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.014 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2408383268 0 0) 0x7faf2c1285f0 con 0x7faf2c128220 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.986+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf2c057cd0 con 0x7faf2c128220 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.987+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7faf180032c0 con 0x7faf2c128220 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.987+0000 7faf07fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.987+0000 7faf07fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.987+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6789/0 conn(0x7faf2c128220 legacy=0x7faf2c059e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.987+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6789/0 conn(0x7faf2c128220 legacy=0x7faf2c059e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf31fae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf2c10c870 con 0x7faf2c109e30 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979767 0 0) 0x7faf2c10c870 con 0x7faf2c109e30 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient(hunting): my global_id is 114105 2026-02-17T05:39:22.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf2c1285f0 con 0x7faf2c109e30 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3485068095 0 0) 0x7faf2c1285f0 con 0x7faf2c109e30 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf2c10c870 con 0x7faf2c109e30 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faf18004a50 con 0x7faf2c109e30 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient: dump: 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.016 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3482827214 0 0) 0x7faf2c10c870 con 0x7faf2c109e30 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf2c055570 con 0x7faf2c109e30 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 1660068819) 0x7faf18004e60 con 0x7faf2c109e30 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6789/0 conn(0x7faf2c109e30 legacy=0x7faf2c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.990+0000 7faf07fff640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6789/0 conn(0x7faf2c109e30 legacy=0x7faf2c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.017 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 246, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:22.018 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:22.019 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.020 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:22.021 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:22.022 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.023 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.024 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.025 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:22.026 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:22.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.118:6812/703720803 conn(0x7faefc040a90 legacy=0x7faefc060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 10 monclient: shutdown 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 >> v1:10.20.193.106:6790/0 conn(0x7faf2c05dee0 legacy=0x7faf2c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf2bfff640 1 -- 10.20.193.106:0/3407788699 reap_dead start 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf2bfff640 1 -- 10.20.193.106:0/3407788699 reap_dead start 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 shutdown_connections 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 >> 10.20.193.106:0/3407788699 conn(0x7faf2c0915f0 msgr2=0x7faf2c1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 shutdown_connections 2026-02-17T05:39:22.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:21.991+0000 7faf31fae640 1 -- 10.20.193.106:0/3407788699 wait complete. 2026-02-17T05:39:22.027 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:22.027 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:39:22.027 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:39:22.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 10 monclient: get_monmap_and_config 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 10 monclient: monmap: 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:22.092486+0000 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:22.092486+0000 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 1 Processor -- start 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 1 -- start start 2026-02-17T05:39:22.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.092+0000 7fb726acc640 10 monclient: init 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-c con 0x7fb72008dea0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-a con 0x7fb720056e10 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-b con 0x7fb720184200 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72013f650 con 0x7fb720056e10 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72008e980 con 0x7fb72008dea0 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72005d970 con 0x7fb720184200 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient(hunting): authenticate will time out at 1290.721117s 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb717fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb720056e10 0x7fb72008e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42978/0 (socket says 10.20.193.106:42978) 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb717fff640 1 -- 10.20.193.106:0/541126483 learned_addr learned my addr 10.20.193.106:0/541126483 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112123698 0 0) 0x7fb72013f650 con 0x7fb720056e10 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): my global_id is 114108 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb70c0035e0 con 0x7fb720056e10 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868067411 0 0) 0x7fb72005d970 con 0x7fb720184200 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient(hunting): my global_id is 5024 2026-02-17T05:39:22.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb72013f650 con 0x7fb720184200 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234125318 0 0) 0x7fb72013f650 con 0x7fb720184200 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 >> v1:10.20.193.118:6789/0 conn(0x7fb72008dea0 legacy=0x7fb72013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 >> v1:10.20.193.106:6789/0 conn(0x7fb720056e10 legacy=0x7fb72008e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 monclient: found mon.noname-b 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72005dc50 con 0x7fb720184200 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb71c003eb0 con 0x7fb720184200 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: dump: 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.095 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 5 monclient: authenticate success, global_id 5024 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb71c0040b0 con 0x7fb720184200 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 1 -- 10.20.193.106:0/541126483 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb71c0044c0 con 0x7fb720184200 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb7177fe640 10 monclient: dump: 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.093+0000 7fb726acc640 4 set_mon_vals no callback set 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: shutdown 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- 10.20.193.106:0/541126483 >> v1:10.20.193.106:6790/0 conn(0x7fb720184200 legacy=0x7fb7201a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- 10.20.193.106:0/541126483 shutdown_connections 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- 10.20.193.106:0/541126483 >> 10.20.193.106:0/541126483 conn(0x7fb720055050 msgr2=0x7fb720092090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- 10.20.193.106:0/541126483 shutdown_connections 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- 10.20.193.106:0/541126483 wait complete. 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: monmap: 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 Processor -- start 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- start start 2026-02-17T05:39:22.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: init 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-b con 0x7fb720056e10 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-a con 0x7fb72008dea0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient(hunting): picked mon.noname-c con 0x7fb720184200 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72005e900 con 0x7fb72008dea0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72008d5c0 con 0x7fb720056e10 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7201a1830 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.094+0000 7fb726acc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 monclient(hunting): authenticate will time out at 1290.723002s 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb717fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb72008dea0 0x7fb72018ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42980/0 (socket says 10.20.193.106:42980) 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb717fff640 1 -- 10.20.193.106:0/3969060 learned_addr learned my addr 10.20.193.106:0/3969060 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247903876 0 0) 0x7fb7201a1830 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): my global_id is 5027 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6f00035e0 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957550290 0 0) 0x7fb72005e900 con 0x7fb72008dea0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): my global_id is 114111 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7201a1830 con 0x7fb72008dea0 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1909417595 0 0) 0x7fb6f00035e0 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb72005e900 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb71c003dc0 con 0x7fb720184200 2026-02-17T05:39:22.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): dump: 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 78211624 0 0) 0x7fb7201a1830 con 0x7fb72008dea0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6f00035e0 con 0x7fb72008dea0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb708003170 con 0x7fb72008dea0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient(hunting): dump: 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1551317389 0 0) 0x7fb72005e900 con 0x7fb720184200 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.118:6789/0 conn(0x7fb720056e10 legacy=0x7fb72019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6789/0 conn(0x7fb72008dea0 legacy=0x7fb72018ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 monclient: found mon.c 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7201a38b0 con 0x7fb720184200 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 5 monclient: authenticate success, global_id 5027 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 monclient: _renew_subs 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7201a59c0 con 0x7fb720184200 2026-02-17T05:39:22.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 monclient: _renew_subs 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb720183dd0 con 0x7fb720184200 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb71c0049e0 con 0x7fb720184200 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb71c003890 con 0x7fb720184200 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb7157fa640 10 monclient: dump: 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb716ffd640 4 set_mon_vals no callback set 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.095+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7200008d0 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995448404 0 0) 0x7fb7200008d0 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient(hunting): my global_id is 5030 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb72005e900 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1940327136 0 0) 0x7fb72005e900 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7200008d0 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb710002c80 con 0x7fb7201a5d00 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient: dump: 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb71c011b40 con 0x7fb720184200 2026-02-17T05:39:22.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(589..589 src has 356..589) ==== 3963+0+0 (unknown 285937485 0 0) 0x7fb71c04fb80 con 0x7fb720184200 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1587745073 0 0) 0x7fb7200008d0 con 0x7fb7201a5d00 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb720091010 con 0x7fb7201a5d00 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb717fff640 10 monclient: get_auth_request con 0x7fb6f0040dd0 auth_method 0 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb710003230 con 0x7fb7201a5d00 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6790/0 conn(0x7fb7201a5d00 legacy=0x7fb72008b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.096+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6790/0 conn(0x7fb7201a5d00 legacy=0x7fb72008b5e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb726acc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb720091180 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277984723 0 0) 0x7fb720091180 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient(hunting): my global_id is 5033 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7200008d0 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1971044540 0 0) 0x7fb7200008d0 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb720091180 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb710003a30 con 0x7fb72019c440 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 10 monclient: dump: 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.101 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 415939786 0 0) 0x7fb720091180 con 0x7fb72019c440 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.100+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb72004d910 con 0x7fb72019c440 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 656656609) 0x7fb710004830 con 0x7fb72019c440 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb7157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb7157fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6790/0 conn(0x7fb72019c440 legacy=0x7fb72004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb7157fa640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6790/0 conn(0x7fb72019c440 legacy=0x7fb72004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 686862, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.102 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:22.103 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:22.104 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.105 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.118:6812/703720803 conn(0x7fb6f0040dd0 legacy=0x7fb6f0061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 10 monclient: shutdown 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 >> v1:10.20.193.106:6790/0 conn(0x7fb720184200 legacy=0x7fb72018b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb725042640 1 -- 10.20.193.106:0/3969060 reap_dead start 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb725042640 1 -- 10.20.193.106:0/3969060 reap_dead start 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 shutdown_connections 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 >> 10.20.193.106:0/3969060 conn(0x7fb720055050 msgr2=0x7fb72008f440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 shutdown_connections 2026-02-17T05:39:22.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.101+0000 7fb726acc640 1 -- 10.20.193.106:0/3969060 wait complete. 2026-02-17T05:39:22.108 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:22.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:39:22.108 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 10 monclient: get_monmap_and_config 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 10 monclient: monmap: 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:22.171794+0000 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:22.171794+0000 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:22.172 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 1 Processor -- start 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 1 -- start start 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.171+0000 7ff7e6a07640 10 monclient: init 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-b con 0x7ff7e005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-c con 0x7ff7e005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-a con 0x7ff7e0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e008b060 con 0x7ff7e0182720 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e005dc90 con 0x7ff7e005dee0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e008d6a0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient(hunting): authenticate will time out at 1290.800202s 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e4f7d640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7ff7e0182720 0x7ff7e01a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42996/0 (socket says 10.20.193.106:42996) 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e4f7d640 1 -- 10.20.193.106:0/1167321018 learned_addr learned my addr 10.20.193.106:0/1167321018 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816530446 0 0) 0x7ff7e008d6a0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): my global_id is 5036 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7c40035e0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502899741 0 0) 0x7ff7e008b060 con 0x7ff7e0182720 2026-02-17T05:39:22.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient(hunting): my global_id is 114114 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e008d6a0 con 0x7ff7e0182720 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4096141556 0 0) 0x7ff7c40035e0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 >> v1:10.20.193.118:6789/0 conn(0x7ff7e005dee0 legacy=0x7ff7e0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 >> v1:10.20.193.106:6789/0 conn(0x7ff7e0182720 legacy=0x7ff7e01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 monclient: found mon.noname-b 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e0057960 con 0x7ff7e005d1b0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7cc002dd0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: dump: 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.175 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 5 monclient: authenticate success, global_id 5036 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7cc003090 con 0x7ff7e005d1b0 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 1 -- 10.20.193.106:0/1167321018 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7cc0034a0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7deffd640 10 monclient: dump: 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.172+0000 7ff7e6a07640 4 set_mon_vals no callback set 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 10 monclient: shutdown 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- 10.20.193.106:0/1167321018 >> v1:10.20.193.106:6790/0 conn(0x7ff7e005d1b0 legacy=0x7ff7e005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- 10.20.193.106:0/1167321018 shutdown_connections 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- 10.20.193.106:0/1167321018 >> 10.20.193.106:0/1167321018 conn(0x7ff7e00915f0 msgr2=0x7ff7e00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- 10.20.193.106:0/1167321018 shutdown_connections 2026-02-17T05:39:22.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- 10.20.193.106:0/1167321018 wait complete. 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 10 monclient: monmap: 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 Processor -- start 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 1 -- start start 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.173+0000 7ff7e6a07640 10 monclient: init 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-a con 0x7ff7e005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-c con 0x7ff7e005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient(hunting): picked mon.noname-b con 0x7ff7e0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e010cd50 con 0x7ff7e005d1b0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e012c270 con 0x7ff7e0182720 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e010bee0 con 0x7ff7e005dee0 2026-02-17T05:39:22.179 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient(hunting): authenticate will time out at 1290.802172s 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7df7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7ff7e005dee0 0x7ff7e012bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48452/0 (socket says 10.20.193.106:48452) 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7df7fe640 1 -- 10.20.193.106:0/237246013 learned_addr learned my addr 10.20.193.106:0/237246013 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547833748 0 0) 0x7ff7e010bee0 con 0x7ff7e005dee0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): my global_id is 5039 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7b00035e0 con 0x7ff7e005dee0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512922409 0 0) 0x7ff7e010cd50 con 0x7ff7e005d1b0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): my global_id is 114117 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e010bee0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4031277805 0 0) 0x7ff7b00035e0 con 0x7ff7e005dee0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7e010cd50 con 0x7ff7e005dee0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7d0003030 con 0x7ff7e005dee0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): dump: 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.180 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3399959945 0 0) 0x7ff7e010bee0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7b00035e0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7cc0033b0 con 0x7ff7e005d1b0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient(hunting): dump: 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2401736988 0 0) 0x7ff7e010cd50 con 0x7ff7e005dee0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6789/0 conn(0x7ff7e0182720 legacy=0x7ff7e0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.106:6789/0 conn(0x7ff7e005d1b0 legacy=0x7ff7e012b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 monclient: found mon.c 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e010a9f0 con 0x7ff7e005dee0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 5 monclient: authenticate success, global_id 5039 2026-02-17T05:39:22.181 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _renew_subs 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e01824f0 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _renew_subs 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff7e010b6f0 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7d00036d0 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7d0003a70 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7de7fc640 4 set_mon_vals no callback set 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.174+0000 7ff7dcff9640 10 monclient: dump: 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7e6a07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff7e00008d0 con 0x7ff7e0128390 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7ff7d0003bd0 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(589..589 src has 356..589) ==== 3963+0+0 (unknown 285937485 0 0) 0x7ff7d004fd90 con 0x7ff7e005dee0 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074223475 0 0) 0x7ff7e00008d0 con 0x7ff7e0128390 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.182 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 10 monclient(hunting): my global_id is 94282 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e010cd50 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7e4f7d640 10 monclient: get_auth_request con 0x7ff7b0040bb0 auth_method 0 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 374475564 0 0) 0x7ff7e010cd50 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.175+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7e00008d0 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7cc003530 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 10 monclient: dump: 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2556483952 0 0) 0x7ff7e00008d0 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7e0057cd0 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff7cc005b70 con 0x7ff7e0128390 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6789/0 conn(0x7ff7e0128390 legacy=0x7ff7e005a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.176+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6789/0 conn(0x7ff7e0128390 legacy=0x7ff7e005a010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.179+0000 7ff7e6a07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.179+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff7e008a610 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875556908 0 0) 0x7ff7e008a610 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient(hunting): my global_id is 94285 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e00008d0 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 572347035 0 0) 0x7ff7e00008d0 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7e008a610 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7ff7cc004210 con 0x7ff7e010a000 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 10 monclient: dump: 2026-02-17T05:39:22.184 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1840399919 0 0) 0x7ff7e008a610 con 0x7ff7e010a000 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.180+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff7e0128760 con 0x7ff7e010a000 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 3919140563) 0x7ff7cc005620 con 0x7ff7e010a000 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7dcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7dcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6789/0 conn(0x7ff7e010a000 legacy=0x7ff7e004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7dcff9640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6789/0 conn(0x7ff7e010a000 legacy=0x7ff7e004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 214422, 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:22.185 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.186 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:22.187 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.188 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.189 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:22.190 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.118:6812/703720803 conn(0x7ff7b0040bb0 legacy=0x7ff7b0061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 10 monclient: shutdown 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 >> v1:10.20.193.106:6790/0 conn(0x7ff7e005dee0 legacy=0x7ff7e012bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e4f7d640 1 -- 10.20.193.106:0/237246013 reap_dead start 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e4f7d640 1 -- 10.20.193.106:0/237246013 reap_dead start 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 shutdown_connections 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 >> 10.20.193.106:0/237246013 conn(0x7ff7e00915f0 msgr2=0x7ff7e008c270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 shutdown_connections 2026-02-17T05:39:22.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.181+0000 7ff7e6a07640 1 -- 10.20.193.106:0/237246013 wait complete. 2026-02-17T05:39:22.192 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:22.192 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:39:22.192 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: get_monmap_and_config 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: monmap: 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:22.258408+0000 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:22.258408+0000 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:22.259 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 1 Processor -- start 2026-02-17T05:39:22.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 1 -- start start 2026-02-17T05:39:22.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: init 2026-02-17T05:39:22.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f692405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f692405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f6924182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692408b060 con 0x7f692405d1b0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692405dc90 con 0x7f6924182720 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692408d6a0 con 0x7f692405dee0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f692b6cc640 10 monclient(hunting): authenticate will time out at 1290.886823s 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f6929441640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f692405d1b0 0x7f692405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43006/0 (socket says 10.20.193.106:43006) 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f6928c40640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f692405dee0 0x7f6924181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48456/0 (socket says 10.20.193.106:48456) 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.258+0000 7f6929441640 1 -- 10.20.193.106:0/1805707122 learned_addr learned my addr 10.20.193.106:0/1805707122 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230829752 0 0) 0x7f692408b060 con 0x7f692405d1b0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): my global_id is 114120 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f690c0035e0 con 0x7f692405d1b0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234906406 0 0) 0x7f692408d6a0 con 0x7f692405dee0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient(hunting): my global_id is 5042 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f692408b060 con 0x7f692405dee0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543468072 0 0) 0x7f690c0035e0 con 0x7f692405d1b0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 >> v1:10.20.193.106:6790/0 conn(0x7f692405dee0 legacy=0x7f6924181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 >> v1:10.20.193.118:6789/0 conn(0x7f6924182720 legacy=0x7f69241a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 monclient: found mon.noname-a 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6924057960 con 0x7f692405d1b0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6914002d00 con 0x7f692405d1b0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: dump: 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 5 monclient: authenticate success, global_id 114120 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6914002f40 con 0x7f692405d1b0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 1 -- 10.20.193.106:0/1805707122 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6914003350 con 0x7f692405d1b0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f6913fff640 10 monclient: dump: 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.264 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 4 set_mon_vals no callback set 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 10 monclient: shutdown 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 1 -- 10.20.193.106:0/1805707122 >> v1:10.20.193.106:6789/0 conn(0x7f692405d1b0 legacy=0x7f692405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 1 -- 10.20.193.106:0/1805707122 shutdown_connections 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 1 -- 10.20.193.106:0/1805707122 >> 10.20.193.106:0/1805707122 conn(0x7f69240915f0 msgr2=0x7f69240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 1 -- 10.20.193.106:0/1805707122 shutdown_connections 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.259+0000 7f692b6cc640 1 -- 10.20.193.106:0/1805707122 wait complete. 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient: monmap: 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 1 Processor -- start 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 1 -- start start 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient: init 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f692405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f692405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f6924182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692405e950 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692410ef30 con 0x7f692405dee0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692412e450 con 0x7f692405d1b0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f692b6cc640 10 monclient(hunting): authenticate will time out at 1290.888553s 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6929441640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f692405d1b0 0x7f692412d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48464/0 (socket says 10.20.193.106:48464) 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6929441640 1 -- 10.20.193.106:0/900738224 learned_addr learned my addr 10.20.193.106:0/900738224 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355579859 0 0) 0x7f692412e450 con 0x7f692405d1b0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): my global_id is 5045 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f40035e0 con 0x7f692405d1b0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379087404 0 0) 0x7f6920004970 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): my global_id is 114123 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f692412e450 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3333782967 0 0) 0x7f692412e450 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6920004970 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6920003d80 con 0x7f6924182720 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): dump: 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1584284630 0 0) 0x7f68f40035e0 con 0x7f692405d1b0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f692412e450 con 0x7f692405d1b0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6914002c10 con 0x7f692405d1b0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): dump: 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524794804 0 0) 0x7f692410ef30 con 0x7f692405dee0 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:22.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 10 monclient(hunting): my global_id is 94288 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.260+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f40035e0 con 0x7f692405dee0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2500110873 0 0) 0x7f6920004970 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 >> v1:10.20.193.106:6790/0 conn(0x7f692405d1b0 legacy=0x7f692412d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 >> v1:10.20.193.118:6789/0 conn(0x7f692405dee0 legacy=0x7f692412dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 monclient: found mon.a 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692410e0c0 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: _finish_auth 0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 5 monclient: authenticate success, global_id 114123 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _renew_subs 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f692410cbd0 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _renew_subs 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f692410c550 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69200043c0 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f69200045f0 con 0x7f6924182720 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 10 monclient: dump: 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.268 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f69137fe640 4 set_mon_vals no callback set 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69240008d0 con 0x7f6924182720 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6920011b60 con 0x7f6924182720 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.261+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(589..589 src has 356..589) ==== 3963+0+0 (unknown 285937485 0 0) 0x7f692004fb60 con 0x7f6924182720 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.262+0000 7f6929441640 10 monclient: get_auth_request con 0x7f68f4040dd0 auth_method 0 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.264+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f69200171b0 con 0x7f6924182720 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.264+0000 7f6911ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:22.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.264+0000 7f6911ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:22.366 INFO:tasks.rados.rados.0.trial118.stdout:2739: done (1 left) 2026-02-17T05:39:22.366 INFO:tasks.rados.rados.0.trial118.stdout:2740: done (0 left) 2026-02-17T05:39:22.366 INFO:tasks.rados.rados.0.trial118.stdout:2741: read oid 1 snap -1 2026-02-17T05:39:22.366 INFO:tasks.rados.rados.0.trial118.stdout:2741: expect (ObjNum 815 snap 247 seq_num 815) 2026-02-17T05:39:22.366 INFO:tasks.rados.rados.0.trial118.stdout:2742: snap_remove snap 283 2026-02-17T05:39:22.412 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.411+0000 7f692b6cc640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:39:22.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.411+0000 7f692b6cc640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:39:22.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.411+0000 7f692b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:39:22.413 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.411+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f6924057ca0 con 0x7f6924182720 2026-02-17T05:39:22.413 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.413 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=1233784931,config=1618278320,health=130033755,kv=675723720,logm=615237219}) 2026-02-17T05:39:22.413 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=11,logm=56} crc {auth=2405153651,config=1618278320,health=2003857082,kv=675723720,logm=4186635872}) 2026-02-17T05:39:22.414 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.412+0000 7f6911ffb640 1 -- 10.20.193.106:0/900738224 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f6920015140 con 0x7f6924182720 2026-02-17T05:39:22.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.412+0000 7f6911ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:39:22.414 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.412+0000 7f6911ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=1233784931,config=1618278320,health=130033755,kv=675723720,logm=615237219}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.412+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=4135148433,config=1618278320,health=336416713,kv=2318243043,logm=1798297863}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=288615591}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1099389882}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=288615591}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3128702351}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2226555631}) 2026-02-17T05:39:22.416 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1530170253}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2226555631}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.413+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=930025780}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=974742990}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2564976114}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=974742990}) 2026-02-17T05:39:22.417 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1314436686}) 2026-02-17T05:39:22.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 >> v1:10.20.193.118:6812/703720803 conn(0x7f68f4040dd0 legacy=0x7f68f4061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.418 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 10 monclient: shutdown 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 >> v1:10.20.193.106:6789/0 conn(0x7f6924182720 legacy=0x7f6924181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 shutdown_connections 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 >> 10.20.193.106:0/900738224 conn(0x7f69240915f0 msgr2=0x7f69240886d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 shutdown_connections 2026-02-17T05:39:22.419 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:22.414+0000 7f692b6cc640 1 -- 10.20.193.106:0/900738224 wait complete. 2026-02-17T05:39:22.424 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=984912926}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1633888437}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=984912926}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.414+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2725230083}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2479884280}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1462101000}) 2026-02-17T05:39:22.425 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2479884280}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1274808902}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2543444774}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320883468}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2543444774}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.415+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3632887086}) 2026-02-17T05:39:22.426 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=538674945}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1386794602}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=538674945}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1385974855}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1845554090}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1164541598}) 2026-02-17T05:39:22.427 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1845554090}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.416+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=718201356}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=220031848}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3351278941}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=220031848}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3119328267}) 2026-02-17T05:39:22.428 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=327824689}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187967840}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=327824689}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.417+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082753352}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1891637766}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281778345}) 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.429 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1891637766}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4078694115}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357996740}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1423797663}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357996740}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.418+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=474135369}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311981490}) 2026-02-17T05:39:22.430 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008926238}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311981490}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3699066169}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4278671322}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027800186}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4278671322}) 2026-02-17T05:39:22.431 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.419+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2383822495}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3470320779}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2654154555}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3470320779}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2857272786}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1354484470}) 2026-02-17T05:39:22.432 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3246094333}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1354484470}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.420+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3005239033}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1728313586}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1293931695}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1728313586}) 2026-02-17T05:39:22.433 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3649865256}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=34238055}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278919739}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=34238055}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1873348651}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.421+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3579210946}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1295486359}) 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.434 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3579210946}) 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3155423935}) 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3451879239}) 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3240756687}) 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3451879239}) 2026-02-17T05:39:22.435 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3259044271}) 2026-02-17T05:39:22.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:39:22.440 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4062569414}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=249863932}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4062569414}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.422+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=814399776}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1091993939}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2770583850}) 2026-02-17T05:39:22.441 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1091993939}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4113598862}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1090492993}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2642266526}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1090492993}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.423+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3100923381}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=53} crc {logm=2803106360,mdsmap=443047005,mgr=1186266238,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2724034923,mon_config_key=597233681,monmap=1459694897,nvmeofgw=2171349011,osd_metadata=2778810656,osd_pg_creating=3567796918,osd_snap=3480675104}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=54} crc {logm=2803106360,mdsmap=3140514009,mgr=3324194213,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=478968165,mon_config_key=3856452920,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3567796918,osd_snap=1833611185}) 2026-02-17T05:39:22.442 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=53} crc {logm=2803106360,mdsmap=443047005,mgr=1186266238,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2724034923,mon_config_key=597233681,monmap=1459694897,nvmeofgw=2171349011,osd_metadata=2778810656,osd_pg_creating=3567796918,osd_snap=3480675104}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=4,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=55} crc {logm=781128302,mdsmap=568353036,mgr=1739161107,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=3642706187,mon_config_key=1771751348,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=1163265349,osd_pg_creating=3567796918,osd_snap=3427474238}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=3051844391,osdmap=1863197764}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=26,osdmap=74} crc {osd_snap=245646073,osdmap=3430264391}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=3051844391,osdmap=1863197764}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.424+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=26,osdmap=74} crc {osd_snap=1794834203,osdmap=2397226459}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3948905716}) 2026-02-17T05:39:22.443 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=655832021}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3948905716}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2716507395}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1959707833}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3888772398}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1959707833}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.425+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=534855823}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=84} crc {osdmap=65825985}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=81} crc {osdmap=1415901112}) 2026-02-17T05:39:22.444 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:39:22.445 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=84} crc {osdmap=65825985}) 2026-02-17T05:39:22.445 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:39:22.427+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=77} crc {osdmap=1364920858}) 2026-02-17T05:39:23.375 INFO:tasks.rados.rados.0.trial118.stdout:2742: done (1 left) 2026-02-17T05:39:23.375 INFO:tasks.rados.rados.0.trial118.stdout:2743: write oid 12 current snap is 294 2026-02-17T05:39:23.375 INFO:tasks.rados.rados.0.trial118.stdout:2743: seq_num 975 ranges {786825=660959,2104767=282058} 2026-02-17T05:39:23.381 INFO:tasks.rados.rados.0.trial118.stdout:2743: writing trial11845692-12 from 786825 to 1447784 tid 1 2026-02-17T05:39:23.385 INFO:tasks.rados.rados.0.trial118.stdout:2743: writing trial11845692-12 from 2104767 to 2386825 tid 2 2026-02-17T05:39:23.385 INFO:tasks.rados.rados.0.trial118.stdout:2744: read oid 14 snap 239 2026-02-17T05:39:23.386 INFO:tasks.rados.rados.0.trial118.stdout:2744: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:39:23.386 INFO:tasks.rados.rados.0.trial118.stdout:2745: write (excl) oid 50 current snap is 294 2026-02-17T05:39:23.386 INFO:tasks.rados.rados.0.trial118.stdout:2745: seq_num 976 ranges {403632=736208,1763249=619999} 2026-02-17T05:39:23.390 INFO:tasks.rados.rados.0.trial118.stdout:2745: writing trial11845692-50 from 403632 to 1139840 tid 1 2026-02-17T05:39:23.396 INFO:tasks.rados.rados.0.trial118.stdout:2745: writing trial11845692-50 from 1763249 to 2383248 tid 2 2026-02-17T05:39:23.396 INFO:tasks.rados.rados.0.trial118.stdout:2746: write (excl) oid 26 current snap is 294 2026-02-17T05:39:23.396 INFO:tasks.rados.rados.0.trial118.stdout:2746: seq_num 977 ranges {420439=411457,1421731=480010} 2026-02-17T05:39:23.399 INFO:tasks.rados.rados.0.trial118.stdout:2746: writing trial11845692-26 from 420439 to 831896 tid 1 2026-02-17T05:39:23.403 INFO:tasks.rados.rados.0.trial118.stdout:2746: writing trial11845692-26 from 1421731 to 1901741 tid 2 2026-02-17T05:39:23.403 INFO:tasks.rados.rados.0.trial118.stdout:2747: delete oid 37 current snap is 294 2026-02-17T05:39:23.403 INFO:tasks.rados.rados.0.trial118.stdout:2741: expect (ObjNum 815 snap 247 seq_num 815) 2026-02-17T05:39:23.438 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:39:23.438 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:39:23.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: get_monmap_and_config 2026-02-17T05:39:23.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: monmap: 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:23.500598+0000 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:23.500598+0000 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:23.510 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 1 Processor -- start 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 1 -- start start 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: init 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-a con 0x7f13d005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-b con 0x7f13d005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-c con 0x7f13d0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d008b060 con 0x7f13d005d1b0 2026-02-17T05:39:23.511 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d005dc90 con 0x7f13d0182720 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d008d6a0 con 0x7f13d005dee0 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.500+0000 7f13d721b640 10 monclient(hunting): authenticate will time out at 1292.128973s 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d4f90640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f13d005d1b0 0x7f13d005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43028/0 (socket says 10.20.193.106:43028) 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d4f90640 1 -- 10.20.193.106:0/3604694205 learned_addr learned my addr 10.20.193.106:0/3604694205 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282504289 0 0) 0x7f13d008d6a0 con 0x7f13d005dee0 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): my global_id is 5048 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13bc0035e0 con 0x7f13d005dee0 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500355061 0 0) 0x7f13d008b060 con 0x7f13d005d1b0 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient(hunting): my global_id is 114126 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d008d6a0 con 0x7f13d005d1b0 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3174763296 0 0) 0x7f13bc0035e0 con 0x7f13d005dee0 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 >> v1:10.20.193.118:6789/0 conn(0x7f13d0182720 legacy=0x7f13d01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 >> v1:10.20.193.106:6789/0 conn(0x7f13d005d1b0 legacy=0x7f13d005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 monclient: found mon.noname-b 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d0057960 con 0x7f13d005dee0 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13b8002dd0 con 0x7f13d005dee0 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: dump: 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.514 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.515 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 5 monclient: authenticate success, global_id 5048 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13b8003090 con 0x7f13d005dee0 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 4 set_mon_vals no callback set 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 1 -- 10.20.193.106:0/3604694205 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13b80034a0 con 0x7f13d005dee0 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13c77fe640 10 monclient: dump: 2026-02-17T05:39:23.516 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 10 monclient: shutdown 2026-02-17T05:39:23.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 1 -- 10.20.193.106:0/3604694205 >> v1:10.20.193.106:6790/0 conn(0x7f13d005dee0 legacy=0x7f13d0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 1 -- 10.20.193.106:0/3604694205 shutdown_connections 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 1 -- 10.20.193.106:0/3604694205 >> 10.20.193.106:0/3604694205 conn(0x7f13d00915f0 msgr2=0x7f13d00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 1 -- 10.20.193.106:0/3604694205 shutdown_connections 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.501+0000 7f13d721b640 1 -- 10.20.193.106:0/3604694205 wait complete. 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient: monmap: 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:23.518 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 1 Processor -- start 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 1 -- start start 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient: init 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:23.519 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-b con 0x7f13d005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-a con 0x7f13d005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient(hunting): picked mon.noname-c con 0x7f13d0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d005e8e0 con 0x7f13d005dee0 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d012b6d0 con 0x7f13d005d1b0 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d0129ed0 con 0x7f13d0182720 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d721b640 10 monclient(hunting): authenticate will time out at 1292.130702s 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d5791640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f13d0182720 0x7f13d0181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48480/0 (socket says 10.20.193.106:48480) 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c7fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f13d005dee0 0x7f13d01a3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43040/0 (socket says 10.20.193.106:43040) 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13d5791640 1 -- 10.20.193.106:0/1976326495 learned_addr learned my addr 10.20.193.106:0/1976326495 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229629751 0 0) 0x7f13d0129ed0 con 0x7f13d0182720 2026-02-17T05:39:23.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): my global_id is 5051 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13a00035e0 con 0x7f13d0182720 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798016691 0 0) 0x7f13d005e8e0 con 0x7f13d005dee0 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 10 monclient(hunting): my global_id is 114129 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.502+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d0129ed0 con 0x7f13d005dee0 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467036911 0 0) 0x7f13d012b6d0 con 0x7f13d005d1b0 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): my global_id is 94294 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d005e8e0 con 0x7f13d005d1b0 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 210552381 0 0) 0x7f13a00035e0 con 0x7f13d0182720 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d012b6d0 con 0x7f13d0182720 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13cc0041d0 con 0x7f13d0182720 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): dump: 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.522 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2490139264 0 0) 0x7f13d0129ed0 con 0x7f13d005dee0 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13a00035e0 con 0x7f13d005dee0 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13b80033b0 con 0x7f13d005dee0 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient(hunting): dump: 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 488236387 0 0) 0x7f13d012b6d0 con 0x7f13d0182720 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 >> v1:10.20.193.118:6789/0 conn(0x7f13d005d1b0 legacy=0x7f13d01a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 >> v1:10.20.193.106:6789/0 conn(0x7f13d005dee0 legacy=0x7f13d01a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 monclient: found mon.c 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01824f0 con 0x7f13d0182720 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 5 monclient: authenticate success, global_id 5051 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _renew_subs 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13d012c230 con 0x7f13d0182720 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _renew_subs 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13d012aa30 con 0x7f13d0182720 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13cc0043e0 con 0x7f13d0182720 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f13cc004c10 con 0x7f13d0182720 2026-02-17T05:39:23.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 10 monclient: dump: 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.527 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c6ffd640 4 set_mon_vals no callback set 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d00008d0 con 0x7f13d0182720 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.503+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f13cc004d70 con 0x7f13d0182720 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.504+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f13cc050f20 con 0x7f13d0182720 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.504+0000 7f13d4f90640 10 monclient: get_auth_request con 0x7f13a0040d50 auth_method 0 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.506+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f13cc005600 con 0x7f13d0182720 2026-02-17T05:39:23.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.506+0000 7f13c57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.506+0000 7f13c57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:23.542 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3488057 2026-02-17T05:39:23.547 INFO:tasks.rados.rados.0.trial118.stdout:2743: finishing write tid 1 to trial11845692-12 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: finishing write tid 2 to trial11845692-12 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: finishing write tid 3 to trial11845692-12 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: finishing write tid 4 to trial11845692-12 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: oid 12 updating version 0 to 1389 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: oid 12 version 1389 is already newer than 1388 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: oid 12 version 1389 is already newer than 1387 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1389 (ObjNum 975 snap 294 seq_num 975) dirty exists 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2743: left oid 12 (ObjNum 975 snap 294 seq_num 975) 2026-02-17T05:39:23.548 INFO:tasks.rados.rados.0.trial118.stdout:2744: expect (ObjNum 739 snap 216 seq_num 739) 2026-02-17T05:39:23.571 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:23.594 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:23.617 INFO:tasks.rados.rados.0.trial118.stdout:2745: finishing write tid 1 to trial11845692-50 2026-02-17T05:39:23.617 INFO:tasks.rados.rados.0.trial118.stdout:2741: done (5 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2743: done (4 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2744: done (3 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2747: done (2 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2748: copy_from oid 25 from oid 11 current snap is 294 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: finishing write tid 2 to trial11845692-50 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: finishing write tid 3 to trial11845692-50 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: finishing write tid 4 to trial11845692-50 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: oid 50 updating version 0 to 1390 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: oid 50 updating version 1390 to 1392 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: oid 50 version 1392 is already newer than 1391 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1392 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: left oid 50 (ObjNum 976 snap 294 seq_num 976) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: finishing write tid 1 to trial11845692-26 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: finishing write tid 2 to trial11845692-26 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: finishing write tid 3 to trial11845692-26 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: finishing write tid 4 to trial11845692-26 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: oid 26 updating version 0 to 1452 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: oid 26 version 1452 is already newer than 1451 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: oid 26 version 1452 is already newer than 1450 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1452 (ObjNum 977 snap 294 seq_num 977) dirty exists 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: left oid 26 (ObjNum 977 snap 294 seq_num 977) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2745: done (2 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2746: done (1 left) 2026-02-17T05:39:23.618 INFO:tasks.rados.rados.0.trial118.stdout:2749: delete oid 43 current snap is 294 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2748: finishing copy_from to trial11845692-25 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2748: got expected ENOENT (src dne) 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2748: finishing copy_from racing read to trial11845692-25 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2748: done (1 left) 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2749: done (0 left) 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2750: write (excl) oid 43 current snap is 294 2026-02-17T05:39:23.619 INFO:tasks.rados.rados.0.trial118.stdout:2750: seq_num 980 ranges {470860=637204,1880824=590036} 2026-02-17T05:39:23.622 INFO:tasks.rados.rados.0.trial118.stdout:2750: writing trial11845692-43 from 470860 to 1108064 tid 1 2026-02-17T05:39:23.628 INFO:tasks.rados.rados.0.trial118.stdout:2750: writing trial11845692-43 from 1880824 to 2470860 tid 2 2026-02-17T05:39:23.628 INFO:tasks.rados.rados.0.trial118.stdout:2751: snap_create 2026-02-17T05:39:23.628 INFO:tasks.rados.rados.0.trial118.stdout:2750: finishing write tid 1 to trial11845692-43 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: finishing write tid 2 to trial11845692-43 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: finishing write tid 3 to trial11845692-43 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: finishing write tid 4 to trial11845692-43 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: oid 43 updating version 0 to 1395 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: oid 43 version 1395 is already newer than 1393 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: oid 43 version 1395 is already newer than 1394 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1395 (ObjNum 980 snap 294 seq_num 980) dirty exists 2026-02-17T05:39:23.630 INFO:tasks.rados.rados.0.trial118.stdout:2750: left oid 43 (ObjNum 980 snap 294 seq_num 980) 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13d721b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13d721b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13d721b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f13d008e3d0 con 0x7f13d0182720 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13c57fa640 1 -- 10.20.193.106:0/1976326495 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1404489379) 0x7f13cc017cf0 con 0x7f13d0182720 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13c57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.656+0000 7f13c57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:23.657 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 >> v1:10.20.193.118:6812/703720803 conn(0x7f13a0040d50 legacy=0x7f13a0061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 10 monclient: shutdown 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 >> v1:10.20.193.106:6790/0 conn(0x7f13d0182720 legacy=0x7f13d0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 shutdown_connections 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 >> 10.20.193.106:0/1976326495 conn(0x7f13d00915f0 msgr2=0x7f13d008b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 shutdown_connections 2026-02-17T05:39:23.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.657+0000 7f13d721b640 1 -- 10.20.193.106:0/1976326495 wait complete. 2026-02-17T05:39:23.667 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:39:23.667 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:39:23.667 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:39:23.667 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:39:23.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: get_monmap_and_config 2026-02-17T05:39:23.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: monmap: 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:23.734432+0000 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:23.734432+0000 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.747 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 1 Processor -- start 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 1 -- start start 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: init 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-b con 0x7fdd4405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-c con 0x7fdd4405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-a con 0x7fdd44182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4408b060 con 0x7fdd44182720 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4405dc90 con 0x7fdd4405dee0 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4408d6a0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd4ba5b640 10 monclient(hunting): authenticate will time out at 1292.362832s 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd497d0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdd4405d1b0 0x7fdd4405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48488/0 (socket says 10.20.193.106:48488) 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.734+0000 7fdd497d0640 1 -- 10.20.193.106:0/1010095409 learned_addr learned my addr 10.20.193.106:0/1010095409 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762257022 0 0) 0x7fdd4408b060 con 0x7fdd44182720 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): my global_id is 114132 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c0035e0 con 0x7fdd44182720 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437583749 0 0) 0x7fdd4408d6a0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient(hunting): my global_id is 5054 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4408b060 con 0x7fdd4405d1b0 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4258109904 0 0) 0x7fdd4408b060 con 0x7fdd4405d1b0 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 >> v1:10.20.193.118:6789/0 conn(0x7fdd4405dee0 legacy=0x7fdd44181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:39:23.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 >> v1:10.20.193.106:6789/0 conn(0x7fdd44182720 legacy=0x7fdd441a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 monclient: found mon.noname-b 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd44057960 con 0x7fdd4405d1b0 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 5 monclient: authenticate success, global_id 5054 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd34002dd0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: dump: 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.752 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd34003050 con 0x7fdd4405d1b0 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 1 -- 10.20.193.106:0/1010095409 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd34003420 con 0x7fdd4405d1b0 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd33fff640 10 monclient: dump: 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.753 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 4 set_mon_vals no callback set 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 10 monclient: shutdown 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/1010095409 >> v1:10.20.193.106:6790/0 conn(0x7fdd4405d1b0 legacy=0x7fdd4405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/1010095409 shutdown_connections 2026-02-17T05:39:23.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/1010095409 >> 10.20.193.106:0/1010095409 conn(0x7fdd440915f0 msgr2=0x7fdd440919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/1010095409 shutdown_connections 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.735+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/1010095409 wait complete. 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient: monmap: 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:23.755 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 1 Processor -- start 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 1 -- start start 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient: init 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-c con 0x7fdd4405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-a con 0x7fdd4405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient(hunting): picked mon.noname-b con 0x7fdd44182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4410ce60 con 0x7fdd4405dee0 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4412c380 con 0x7fdd44182720 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4410bff0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd4ba5b640 10 monclient(hunting): authenticate will time out at 1292.364719s 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd497d0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdd4405d1b0 0x7fdd4412b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48494/0 (socket says 10.20.193.106:48494) 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd497d0640 1 -- 10.20.193.106:0/450034288 learned_addr learned my addr 10.20.193.106:0/450034288 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974585976 0 0) 0x7fdd4410bff0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): my global_id is 5057 2026-02-17T05:39:23.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd140035e0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825645932 0 0) 0x7fdd4410ce60 con 0x7fdd4405dee0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 10 monclient(hunting): my global_id is 114135 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.736+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4410bff0 con 0x7fdd4405dee0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1147353401 0 0) 0x7fdd140035e0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd4410ce60 con 0x7fdd4405d1b0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd34002dd0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): dump: 2026-02-17T05:39:23.758 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:23.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4036402051 0 0) 0x7fdd4410bff0 con 0x7fdd4405dee0 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd140035e0 con 0x7fdd4405dee0 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd38002ec0 con 0x7fdd4405dee0 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): dump: 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.760 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514896110 0 0) 0x7fdd4412c380 con 0x7fdd44182720 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): my global_id is 94300 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4410bff0 con 0x7fdd44182720 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1658386852 0 0) 0x7fdd4410ce60 con 0x7fdd4405d1b0 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.118:6789/0 conn(0x7fdd44182720 legacy=0x7fdd44181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6789/0 conn(0x7fdd4405dee0 legacy=0x7fdd4412bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 monclient: found mon.c 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4410ab00 con 0x7fdd4405d1b0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 5 monclient: authenticate success, global_id 5057 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 10 monclient: _renew_subs 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd441824f0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 10 monclient: _renew_subs 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd4410b890 con 0x7fdd4405d1b0 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd34004b50 con 0x7fdd4405d1b0 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd34004ef0 con 0x7fdd4405d1b0 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient: dump: 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.763 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd337fe640 4 set_mon_vals no callback set 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd44058890 con 0x7fdd441284f0 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358434753 0 0) 0x7fdd44058890 con 0x7fdd441284f0 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 10 monclient(hunting): my global_id is 114138 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4410ce60 con 0x7fdd441284f0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.737+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fdd34005050 con 0x7fdd4405d1b0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7fdd3404ff60 con 0x7fdd4405d1b0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1873779698 0 0) 0x7fdd4410ce60 con 0x7fdd441284f0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd44058890 con 0x7fdd441284f0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd380034b0 con 0x7fdd441284f0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 10 monclient: dump: 2026-02-17T05:39:23.765 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3215489499 0 0) 0x7fdd44058890 con 0x7fdd441284f0 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd44057ca0 con 0x7fdd441284f0 2026-02-17T05:39:23.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd49fd1640 10 monclient: get_auth_request con 0x7fdd14040dc0 auth_method 0 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdd380057f0 con 0x7fdd441284f0 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6789/0 conn(0x7fdd441284f0 legacy=0x7fdd44059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.738+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6789/0 conn(0x7fdd441284f0 legacy=0x7fdd44059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd4ba5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd441288c0 con 0x7fdd4410a020 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597431539 0 0) 0x7fdd441288c0 con 0x7fdd4410a020 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 10 monclient(hunting): my global_id is 114141 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.741+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd44058890 con 0x7fdd4410a020 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1137737625 0 0) 0x7fdd44058890 con 0x7fdd4410a020 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd441288c0 con 0x7fdd4410a020 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdd38003e50 con 0x7fdd4410a020 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 10 monclient: dump: 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.768 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3355893397 0 0) 0x7fdd441288c0 con 0x7fdd4410a020 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd44055570 con 0x7fdd4410a020 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 320289628) 0x7fdd38005370 con 0x7fdd4410a020 2026-02-17T05:39:23.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6789/0 conn(0x7fdd4410a020 legacy=0x7fdd4404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd31ffb640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6789/0 conn(0x7fdd4410a020 legacy=0x7fdd4404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:39:23.770 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 1998, 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 1, 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.771 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.772 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:23.773 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:23.774 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.775 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.776 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.777 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.778 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:23.779 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:23.780 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:23.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.118:6812/703720803 conn(0x7fdd14040dc0 legacy=0x7fdd14061270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 10 monclient: shutdown 2026-02-17T05:39:23.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 >> v1:10.20.193.106:6790/0 conn(0x7fdd4405d1b0 legacy=0x7fdd4412b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd49fd1640 1 -- 10.20.193.106:0/450034288 reap_dead start 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd49fd1640 1 -- 10.20.193.106:0/450034288 reap_dead start 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 shutdown_connections 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 >> 10.20.193.106:0/450034288 conn(0x7fdd440915f0 msgr2=0x7fdd441a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 shutdown_connections 2026-02-17T05:39:23.782 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.742+0000 7fdd4ba5b640 1 -- 10.20.193.106:0/450034288 wait complete. 2026-02-17T05:39:23.782 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:23.782 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:39:23.782 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: get_monmap_and_config 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: monmap: 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:23.846433+0000 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:23.846433+0000 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 1 Processor -- start 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 1 -- start start 2026-02-17T05:39:23.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: init 2026-02-17T05:39:23.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:23.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f68f413bb70 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f68f408d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f68f41849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f405cca0 con 0x7f68f41849f0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f413c650 con 0x7f68f408d4f0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f405e010 con 0x7f68f413bb70 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f8c5b640 10 monclient(hunting): authenticate will time out at 1292.474810s 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f2575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f68f413bb70 0x7f68f413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48500/0 (socket says 10.20.193.106:48500) 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.846+0000 7f68f2575640 1 -- 10.20.193.106:0/2801965892 learned_addr learned my addr 10.20.193.106:0/2801965892 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780827362 0 0) 0x7f68f405e010 con 0x7f68f413bb70 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): my global_id is 5060 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e00035e0 con 0x7f68f413bb70 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697031798 0 0) 0x7f68f405cca0 con 0x7f68f41849f0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient(hunting): my global_id is 114144 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f405e010 con 0x7f68f41849f0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1448213294 0 0) 0x7f68e00035e0 con 0x7f68f413bb70 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 >> v1:10.20.193.118:6789/0 conn(0x7f68f408d4f0 legacy=0x7f68f41832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 >> v1:10.20.193.106:6789/0 conn(0x7f68f41849f0 legacy=0x7f68f41a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 monclient: found mon.noname-b 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f408d950 con 0x7f68f413bb70 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e8002dd0 con 0x7f68f413bb70 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: dump: 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 5 monclient: authenticate success, global_id 5060 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68e8002fe0 con 0x7f68f413bb70 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 4 set_mon_vals no callback set 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 1 -- 10.20.193.106:0/2801965892 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e80033f0 con 0x7f68f413bb70 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f1573640 10 monclient: dump: 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.852 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 10 monclient: shutdown 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 1 -- 10.20.193.106:0/2801965892 >> v1:10.20.193.106:6790/0 conn(0x7f68f413bb70 legacy=0x7f68f413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 1 -- 10.20.193.106:0/2801965892 shutdown_connections 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 1 -- 10.20.193.106:0/2801965892 >> 10.20.193.106:0/2801965892 conn(0x7f68f40915f0 msgr2=0x7f68f40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 1 -- 10.20.193.106:0/2801965892 shutdown_connections 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.847+0000 7f68f8c5b640 1 -- 10.20.193.106:0/2801965892 wait complete. 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient: monmap: 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 1 Processor -- start 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 1 -- start start 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient: init 2026-02-17T05:39:23.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f68f408d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f68f413bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f68f41849f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f410b800 con 0x7f68f413bb70 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f405e8e0 con 0x7f68f408d4f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f410d1c0 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f8c5b640 10 monclient(hunting): authenticate will time out at 1292.476630s 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f2d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f68f41849f0 0x7f68f4181260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48512/0 (socket says 10.20.193.106:48512) 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f2d76640 1 -- 10.20.193.106:0/676277866 learned_addr learned my addr 10.20.193.106:0/676277866 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68f1d74640 1 --1- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6789/0 conn(0x7f68f413bb70 0x7f68f417fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43110/0 (socket says 10.20.193.106:43110) 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896642853 0 0) 0x7f68f410d1c0 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): my global_id is 5063 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c00035e0 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41346374 0 0) 0x7f68f413c650 con 0x7f68f413bb70 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 10 monclient(hunting): my global_id is 114147 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.848+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f410d1c0 con 0x7f68f413bb70 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1275544831 0 0) 0x7f68c00035e0 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68f413c650 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e4004250 con 0x7f68f41849f0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:23.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): dump: 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695625265 0 0) 0x7f68f405e8e0 con 0x7f68f408d4f0 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): my global_id is 94306 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c00035e0 con 0x7f68f408d4f0 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2112090684 0 0) 0x7f68f410d1c0 con 0x7f68f413bb70 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68f405e8e0 con 0x7f68f413bb70 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68dc0030b0 con 0x7f68f413bb70 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient(hunting): dump: 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.855 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1320042661 0 0) 0x7f68f413c650 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.118:6789/0 conn(0x7f68f408d4f0 legacy=0x7f68f413ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6789/0 conn(0x7f68f413bb70 legacy=0x7f68f417fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 monclient: found mon.c 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f410bcd0 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 5 monclient: authenticate success, global_id 5063 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 10 monclient: _renew_subs 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68f410e030 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 10 monclient: _renew_subs 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f68f4129860 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68e4004750 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e4004af0 con 0x7f68f41849f0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 10 monclient: dump: 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.856 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f0d72640 4 set_mon_vals no callback set 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68f410cc00 con 0x7f68f410c830 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f68e4004c50 con 0x7f68f41849f0 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.849+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f68e4050da0 con 0x7f68f41849f0 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773458002 0 0) 0x7f68f410cc00 con 0x7f68f410c830 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient(hunting): my global_id is 5066 2026-02-17T05:39:23.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f413c650 con 0x7f68f410c830 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3183463386 0 0) 0x7f68f413c650 con 0x7f68f410c830 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68f410cc00 con 0x7f68f410c830 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68f1d74640 10 monclient: get_auth_request con 0x7f68c0040d80 auth_method 0 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e8003300 con 0x7f68f410c830 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient: dump: 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3363556204 0 0) 0x7f68f410cc00 con 0x7f68f410c830 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68f405d940 con 0x7f68f410c830 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f68e80048a0 con 0x7f68f410c830 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6790/0 conn(0x7f68f410c830 legacy=0x7f68f413cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.850+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6790/0 conn(0x7f68f410c830 legacy=0x7f68f413cac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68f8c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68f4055570 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660661380 0 0) 0x7f68f4055570 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient(hunting): my global_id is 5069 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f410cc00 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 933714854 0 0) 0x7f68f410cc00 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68f4055570 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68e8004e30 con 0x7f68f413b250 2026-02-17T05:39:23.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient: dump: 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2211333604 0 0) 0x7f68f4055570 con 0x7f68f413b250 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68f410dcb0 con 0x7f68f413b250 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 3939860935) 0x7f68e8007010 con 0x7f68f413b250 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6790/0 conn(0x7f68f413b250 legacy=0x7f68f413d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.854+0000 7f68daffd640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6790/0 conn(0x7f68f413b250 legacy=0x7f68f413d1d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:23.860 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 688615, 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.861 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:23.862 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.863 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.864 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.865 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:23.866 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.118:6812/703720803 conn(0x7f68c0040d80 legacy=0x7f68c0061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 10 monclient: shutdown 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 >> v1:10.20.193.106:6790/0 conn(0x7f68f41849f0 legacy=0x7f68f4181260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f2d76640 1 -- 10.20.193.106:0/676277866 reap_dead start 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f2d76640 1 -- 10.20.193.106:0/676277866 reap_dead start 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 shutdown_connections 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 >> 10.20.193.106:0/676277866 conn(0x7f68f40915f0 msgr2=0x7f68f408c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 shutdown_connections 2026-02-17T05:39:23.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.855+0000 7f68f8c5b640 1 -- 10.20.193.106:0/676277866 wait complete. 2026-02-17T05:39:23.867 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:23.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:39:23.867 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:39:23.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.932+0000 7fc3390cc640 10 monclient: get_monmap_and_config 2026-02-17T05:39:23.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.932+0000 7fc3390cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.932+0000 7fc3390cc640 10 monclient: monmap: 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:23.933149+0000 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:23.933149+0000 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:23.934 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 1 Processor -- start 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 1 -- start start 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient: init 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc33405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc33405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc334182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33408b060 con 0x7fc33405d1b0 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33405dc90 con 0x7fc334182720 2026-02-17T05:39:23.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33408d6a0 con 0x7fc33405dee0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc3390cc640 10 monclient(hunting): authenticate will time out at 1292.561570s 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc332d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc33405d1b0 0x7fc33405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43116/0 (socket says 10.20.193.106:43116) 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc332d76640 1 -- 10.20.193.106:0/964748866 learned_addr learned my addr 10.20.193.106:0/964748866 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226408172 0 0) 0x7fc33408d6a0 con 0x7fc33405dee0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): my global_id is 5072 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3200035e0 con 0x7fc33405dee0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367991538 0 0) 0x7fc33408b060 con 0x7fc33405d1b0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 10 monclient(hunting): my global_id is 114150 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.933+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33408d6a0 con 0x7fc33405d1b0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3001384088 0 0) 0x7fc3200035e0 con 0x7fc33405dee0 2026-02-17T05:39:23.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 >> v1:10.20.193.118:6789/0 conn(0x7fc334182720 legacy=0x7fc3341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 >> v1:10.20.193.106:6789/0 conn(0x7fc33405d1b0 legacy=0x7fc33405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 monclient: found mon.noname-b 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc334057960 con 0x7fc33405dee0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 5 monclient: authenticate success, global_id 5072 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc31c002dd0 con 0x7fc33405dee0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: dump: 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.942 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc31c002fa0 con 0x7fc33405dee0 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 4 set_mon_vals no callback set 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 1 -- 10.20.193.106:0/964748866 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc31c0033b0 con 0x7fc33405dee0 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc331d74640 10 monclient: dump: 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.943 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 10 monclient: shutdown 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 1 -- 10.20.193.106:0/964748866 >> v1:10.20.193.106:6790/0 conn(0x7fc33405dee0 legacy=0x7fc334181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 1 -- 10.20.193.106:0/964748866 shutdown_connections 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 1 -- 10.20.193.106:0/964748866 >> 10.20.193.106:0/964748866 conn(0x7fc3340915f0 msgr2=0x7fc3340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 1 -- 10.20.193.106:0/964748866 shutdown_connections 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 1 -- 10.20.193.106:0/964748866 wait complete. 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.934+0000 7fc3390cc640 10 monclient: monmap: 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:23.944 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 Processor -- start 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- start start 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: init 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc33405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc33405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc334182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33412bcc0 con 0x7fc33405d1b0 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33412bfa0 con 0x7fc33405dee0 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334129040 con 0x7fc334182720 2026-02-17T05:39:23.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient(hunting): authenticate will time out at 1292.563388s 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc332d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc33405d1b0 0x7fc334128220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43122/0 (socket says 10.20.193.106:43122) 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc332d76640 1 -- 10.20.193.106:0/424323463 learned_addr learned my addr 10.20.193.106:0/424323463 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc333577640 1 --1- 10.20.193.106:0/424323463 >> v1:10.20.193.106:6790/0 conn(0x7fc334182720 0x7fc334181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48564/0 (socket says 10.20.193.106:48564) 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260288283 0 0) 0x7fc334129040 con 0x7fc334182720 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): my global_id is 5075 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3000035e0 con 0x7fc334182720 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390876289 0 0) 0x7fc33412bcc0 con 0x7fc33405d1b0 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): my global_id is 114153 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334129040 con 0x7fc33405d1b0 2026-02-17T05:39:23.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2172050738 0 0) 0x7fc3000035e0 con 0x7fc334182720 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc33412bcc0 con 0x7fc334182720 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc3240040f0 con 0x7fc334182720 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): dump: 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3797925601 0 0) 0x7fc334129040 con 0x7fc33405d1b0 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3000035e0 con 0x7fc33405d1b0 2026-02-17T05:39:23.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc3280030a0 con 0x7fc33405d1b0 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient(hunting): dump: 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4020696891 0 0) 0x7fc33412bcc0 con 0x7fc334182720 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6789/0 conn(0x7fc33405dee0 legacy=0x7fc334128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.106:6789/0 conn(0x7fc33405d1b0 legacy=0x7fc334128220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient: _finish_hunting 0 2026-02-17T05:39:23.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 monclient: found mon.c 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33405c5f0 con 0x7fc334182720 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient: _finish_auth 0 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 10 monclient: _check_auth_tickets 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 5 monclient: authenticate success, global_id 5075 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _renew_subs 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc33413f5b0 con 0x7fc334182720 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _renew_subs 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.935+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3341824f0 con 0x7fc334182720 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3240042c0 con 0x7fc334182720 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc3240049e0 con 0x7fc334182720 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient: dump: 2026-02-17T05:39:23.949 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc331573640 4 set_mon_vals no callback set 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3390cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc334055570 con 0x7fc334058ba0 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc324004b40 con 0x7fc334182720 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7fc324050e20 con 0x7fc334182720 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136576755 0 0) 0x7fc334055570 con 0x7fc334058ba0 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 10 monclient(hunting): my global_id is 94315 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33412bcc0 con 0x7fc334058ba0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.936+0000 7fc332575640 10 monclient: get_auth_request con 0x7fc300040bb0 auth_method 0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1761614430 0 0) 0x7fc33412bcc0 con 0x7fc334058ba0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc334055570 con 0x7fc334058ba0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc328004a50 con 0x7fc334058ba0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 10 monclient: dump: 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2552348643 0 0) 0x7fc334055570 con 0x7fc334058ba0 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc334057ca0 con 0x7fc334058ba0 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc328004ef0 con 0x7fc334058ba0 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6789/0 conn(0x7fc334058ba0 legacy=0x7fc334058f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.937+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6789/0 conn(0x7fc334058ba0 legacy=0x7fc334058f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.940+0000 7fc3390cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.940+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc33412c3c0 con 0x7fc334059680 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612195125 0 0) 0x7fc33412c3c0 con 0x7fc334059680 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient(hunting): my global_id is 94318 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334055570 con 0x7fc334059680 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3176036928 0 0) 0x7fc334055570 con 0x7fc334059680 2026-02-17T05:39:23.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc33412c3c0 con 0x7fc334059680 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc328005590 con 0x7fc334059680 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 10 monclient: dump: 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1947924562 0 0) 0x7fc33412c3c0 con 0x7fc334059680 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.941+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc334059a50 con 0x7fc334059680 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 3467026185) 0x7fc328005940 con 0x7fc334059680 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:23.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6789/0 conn(0x7fc334059680 legacy=0x7fc334197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3137fe640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6789/0 conn(0x7fc334059680 legacy=0x7fc334197330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 38, 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 216183, 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:23.955 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.956 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:23.957 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:23.958 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:23.959 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:23.960 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:23.961 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:23.962 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:23.963 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:23.964 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.118:6812/703720803 conn(0x7fc300040bb0 legacy=0x7fc300061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 10 monclient: shutdown 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 >> v1:10.20.193.106:6790/0 conn(0x7fc334182720 legacy=0x7fc334181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc333577640 1 -- 10.20.193.106:0/424323463 reap_dead start 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc333577640 1 -- 10.20.193.106:0/424323463 reap_dead start 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 shutdown_connections 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 >> 10.20.193.106:0/424323463 conn(0x7fc3340915f0 msgr2=0x7fc3340885f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 shutdown_connections 2026-02-17T05:39:23.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:23.942+0000 7fc3390cc640 1 -- 10.20.193.106:0/424323463 wait complete. 2026-02-17T05:39:23.966 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:39:23.966 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:39:23.966 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:39:23.966 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:39:23.966 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:39:23.966 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:39:23.966 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:39:23.974 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:39:23.974 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:39:23.974 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:39:24.084 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 10 monclient: get_monmap_and_config 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 10 monclient: build_initial_monmap 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 10 monclient: monmap: 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:24.076919+0000 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:24.076919+0000 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:24.085 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 1 Processor -- start 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 1 -- start start 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.076+0000 7fbf7d7c2640 10 monclient: init 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-a con 0x7fbf7805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-c con 0x7fbf7805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:24.086 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-b con 0x7fbf78182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7808b060 con 0x7fbf7805d1b0 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7805dc90 con 0x7fbf7805dee0 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7808d6a0 con 0x7fbf78182720 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient(hunting): authenticate will time out at 1292.705286s 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf76ffd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fbf7805d1b0 legacy=0x7fbf7805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf777fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbf78182720 0x7fbf781a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48568/0 (socket says 10.20.193.106:48568) 2026-02-17T05:39:24.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf777fe640 1 -- 10.20.193.106:0/1189837974 learned_addr learned my addr 10.20.193.106:0/1189837974 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152085214 0 0) 0x7fbf7808d6a0 con 0x7fbf78182720 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): my global_id is 5078 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf640035e0 con 0x7fbf78182720 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105879664 0 0) 0x7fbf7805dc90 con 0x7fbf7805dee0 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:24.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient(hunting): my global_id is 94321 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf7808d6a0 con 0x7fbf7805dee0 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 879103675 0 0) 0x7fbf640035e0 con 0x7fbf78182720 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 >> v1:10.20.193.118:6789/0 conn(0x7fbf7805dee0 legacy=0x7fbf78181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 >> v1:10.20.193.106:6789/0 conn(0x7fbf7805d1b0 legacy=0x7fbf7805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 monclient: found mon.noname-b 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf78057960 con 0x7fbf78182720 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: _finish_auth 0 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:39:24.089 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbf68003eb0 con 0x7fbf78182720 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: dump: 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:24.090 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 5 monclient: authenticate success, global_id 5078 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf68004170 con 0x7fbf78182720 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf7d7c2640 4 set_mon_vals no callback set 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 1 -- 10.20.193.106:0/1189837974 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbf68004580 con 0x7fbf78182720 2026-02-17T05:39:24.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.077+0000 7fbf75ffb640 10 monclient: dump: 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:24.092 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 10 monclient: shutdown 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1189837974 >> v1:10.20.193.106:6790/0 conn(0x7fbf78182720 legacy=0x7fbf781a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1189837974 shutdown_connections 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1189837974 >> 10.20.193.106:0/1189837974 conn(0x7fbf780915f0 msgr2=0x7fbf780919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1189837974 shutdown_connections 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1189837974 wait complete. 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 10 monclient: build_initial_monmap 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 10 monclient: monmap: 2026-02-17T05:39:24.093 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.078+0000 7fbf7d7c2640 1 Processor -- start 2026-02-17T05:39:24.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- start start 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: init 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-a con 0x7fbf7805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-b con 0x7fbf7805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient(hunting): picked mon.noname-c con 0x7fbf78182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7805e950 con 0x7fbf7805d1b0 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7810c5c0 con 0x7fbf7805dee0 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7810cb80 con 0x7fbf78182720 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:24.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf76ffd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fbf7805d1b0 legacy=0x7fbf7812b280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient(hunting): authenticate will time out at 1292.707317s 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf777fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbf78182720 0x7fbf78181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:48574/0 (socket says 10.20.193.106:48574) 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf777fe640 1 -- 10.20.193.106:0/1388781483 learned_addr learned my addr 10.20.193.106:0/1388781483 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506924094 0 0) 0x7fbf7810cb80 con 0x7fbf78182720 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): my global_id is 5081 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf440035e0 con 0x7fbf78182720 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1885826307 0 0) 0x7fbf440035e0 con 0x7fbf78182720 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf7810cb80 con 0x7fbf78182720 2026-02-17T05:39:24.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbf68004490 con 0x7fbf78182720 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): dump: 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:24.097 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836137127 0 0) 0x7fbf7810c5c0 con 0x7fbf7805dee0 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient(hunting): my global_id is 94324 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf440035e0 con 0x7fbf7805dee0 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2498746026 0 0) 0x7fbf7810cb80 con 0x7fbf78182720 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 >> v1:10.20.193.118:6789/0 conn(0x7fbf7805dee0 legacy=0x7fbf7812b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 >> v1:10.20.193.106:6789/0 conn(0x7fbf7805d1b0 legacy=0x7fbf7812b280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:39:24.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: _finish_hunting 0 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 monclient: found mon.c 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7812c0a0 con 0x7fbf78182720 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: _finish_auth 0 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: _check_auth_tickets 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 5 monclient: authenticate success, global_id 5081 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _renew_subs 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7810a820 con 0x7fbf78182720 2026-02-17T05:39:24.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _renew_subs 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf7810c2e0 con 0x7fbf78182720 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf680039d0 con 0x7fbf78182720 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbf68005f40 con 0x7fbf78182720 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf577fe640 10 monclient: dump: 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.100 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.079+0000 7fbf757fa640 4 set_mon_vals no callback set 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf7d7c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf7d7c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf7d7c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7810c770 con 0x7fbf78182720 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fbf68012ee0 con 0x7fbf78182720 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7fbf68050ff0 con 0x7fbf78182720 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.080+0000 7fbf76ffd640 10 monclient: get_auth_request con 0x7fbf440405f0 auth_method 0 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.083+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fbf7810c770 con 0x7fbf78182720 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.083+0000 7fbf577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:24.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.083+0000 7fbf577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:24.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf7d7c2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:39:24.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf7d7c2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:24.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf7d7c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:24.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbf7810c770 con 0x7fbf78182720 2026-02-17T05:39:24.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf577fe640 1 -- 10.20.193.106:0/1388781483 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1800422915) 0x7fbf7810c770 con 0x7fbf78182720 2026-02-17T05:39:24.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:24.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.228+0000 7fbf577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:24.231 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:39:24.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 >> v1:10.20.193.118:6812/703720803 conn(0x7fbf440405f0 legacy=0x7fbf44060aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:24.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 10 monclient: shutdown 2026-02-17T05:39:24.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:24.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 >> v1:10.20.193.106:6790/0 conn(0x7fbf78182720 legacy=0x7fbf78181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:24.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 shutdown_connections 2026-02-17T05:39:24.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 >> 10.20.193.106:0/1388781483 conn(0x7fbf780915f0 msgr2=0x7fbf781a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:24.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 shutdown_connections 2026-02-17T05:39:24.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:24.229+0000 7fbf7d7c2640 1 -- 10.20.193.106:0/1388781483 wait complete. 2026-02-17T05:39:27.239 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.303+0000 7f7cd8eaf640 10 monclient: get_monmap_and_config 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.303+0000 7f7cd8eaf640 10 monclient: build_initial_monmap 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.303+0000 7f7cd8eaf640 10 monclient: monmap: 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:27.304209+0000 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:27.304209+0000 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:27.305 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:27.306 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:27.306 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 1 Processor -- start 2026-02-17T05:39:27.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 1 -- start start 2026-02-17T05:39:27.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient: init 2026-02-17T05:39:27.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:27.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:39:27.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7cd405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cd405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd408b060 con 0x7f7cd405dee0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd405dc90 con 0x7f7cd4182720 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd408d6a0 con 0x7f7cd405d1b0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd8eaf640 10 monclient(hunting): authenticate will time out at 1295.932584s 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1d74640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f7cd405dee0 legacy=0x7f7cd4181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd2575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7cd405d1b0 0x7f7cd405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42256/0 (socket says 10.20.193.106:42256) 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd2575640 1 -- 10.20.193.106:0/904463653 learned_addr learned my addr 10.20.193.106:0/904463653 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907944494 0 0) 0x7f7cd408d6a0 con 0x7f7cd405d1b0 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 10 monclient(hunting): _negotiate 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 10 monclient(hunting): my global_id is 5084 2026-02-17T05:39:27.311 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.304+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc00035e0 con 0x7f7cd405d1b0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3936574417 0 0) 0x7f7cc00035e0 con 0x7f7cd405d1b0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 >> v1:10.20.193.118:6789/0 conn(0x7f7cd4182720 legacy=0x7f7cd41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 >> v1:10.20.193.106:6789/0 conn(0x7f7cd405dee0 legacy=0x7f7cd4181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: _finish_hunting 0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 monclient: found mon.noname-b 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4057960 con 0x7f7cd405d1b0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: _finish_auth 0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: _check_auth_tickets 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cc8002dd0 con 0x7f7cd405d1b0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: dump: 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:27.312 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 5 monclient: authenticate success, global_id 5084 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc8003010 con 0x7f7cd405d1b0 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 1 -- 10.20.193.106:0/904463653 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cc8003420 con 0x7f7cd405d1b0 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd1573640 10 monclient: dump: 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:27.313 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 4 set_mon_vals no callback set 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 10 monclient: shutdown 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/904463653 >> v1:10.20.193.106:6790/0 conn(0x7f7cd405d1b0 legacy=0x7f7cd405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/904463653 shutdown_connections 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/904463653 >> 10.20.193.106:0/904463653 conn(0x7f7cd40915f0 msgr2=0x7f7cd40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/904463653 shutdown_connections 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/904463653 wait complete. 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 10 monclient: build_initial_monmap 2026-02-17T05:39:27.314 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.305+0000 7f7cd8eaf640 10 monclient: monmap: 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 Processor -- start 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- start start 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: init 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7cd405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:27.315 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cd405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd4182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4129020 con 0x7f7cd405dee0 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd412bf30 con 0x7f7cd405d1b0 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd413f570 con 0x7f7cd4182720 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient(hunting): authenticate will time out at 1295.934277s 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd1d74640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f7cd405dee0 legacy=0x7f7cd4128910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd2d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7cd4182720 0x7f7cd4181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42270/0 (socket says 10.20.193.106:42270) 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd2d76640 1 -- 10.20.193.106:0/393325402 learned_addr learned my addr 10.20.193.106:0/393325402 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117613511 0 0) 0x7f7cd413f570 con 0x7f7cd4182720 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): my global_id is 5087 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca00035e0 con 0x7f7cd4182720 2026-02-17T05:39:27.316 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1302535274 0 0) 0x7f7ca00035e0 con 0x7f7cd4182720 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cd413f570 con 0x7f7cd4182720 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cc4005110 con 0x7f7cd4182720 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): dump: 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3935888075 0 0) 0x7f7cd413f570 con 0x7f7cd4182720 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 >> v1:10.20.193.118:6789/0 conn(0x7f7cd405d1b0 legacy=0x7f7cd4128200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:27.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 >> v1:10.20.193.106:6789/0 conn(0x7f7cd405dee0 legacy=0x7f7cd4128910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 monclient: found mon.c 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd405e8e0 con 0x7f7cd4182720 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: _finish_auth 0 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 5 monclient: authenticate success, global_id 5087 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _renew_subs 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd412b0c0 con 0x7f7cd4182720 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _renew_subs 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cd41824f0 con 0x7f7cd4182720 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc40052e0 con 0x7f7cd4182720 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:27.318 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cc40039b0 con 0x7f7cd4182720 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cbaffd640 10 monclient: dump: 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.306+0000 7f7cd0d72640 4 set_mon_vals no callback set 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cd8eaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cd8eaf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:27.319 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cd8eaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd4055570 con 0x7f7cd4182720 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7cc4003b10 con 0x7f7cd4182720 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f7cc4050dd0 con 0x7f7cd4182720 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.307+0000 7f7cd2575640 10 monclient: get_auth_request con 0x7f7ca0040740 auth_method 0 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.309+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f7cc4017d80 con 0x7f7cd4182720 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.309+0000 7f7cbaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:27.320 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.309+0000 7f7cbaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:27.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cd8eaf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cd8eaf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cd8eaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7cd412c350 con 0x7f7cd4182720 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cbaffd640 1 -- 10.20.193.106:0/393325402 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 222244643) 0x7f7cc4017ba0 con 0x7f7cd4182720 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cbaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:27.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.455+0000 7f7cbaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:27.458 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 >> v1:10.20.193.118:6812/703720803 conn(0x7f7ca0040740 legacy=0x7f7ca0060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 10 monclient: shutdown 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 >> v1:10.20.193.106:6790/0 conn(0x7f7cd4182720 legacy=0x7f7cd4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 shutdown_connections 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 >> 10.20.193.106:0/393325402 conn(0x7f7cd40915f0 msgr2=0x7f7cd405bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 shutdown_connections 2026-02-17T05:39:27.459 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:27.456+0000 7f7cd8eaf640 1 -- 10.20.193.106:0/393325402 wait complete. 2026-02-17T05:39:30.466 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:39:30.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: get_monmap_and_config 2026-02-17T05:39:30.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: monmap: 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:30.532536+0000 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:30.532536+0000 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:30.535 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 1 Processor -- start 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 1 -- start start 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: init 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2eb805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2eb8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb808b060 con 0x7f2eb805d1b0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb805dc90 con 0x7f2eb8182720 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2eb6ffd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb808d6a0 con 0x7f2eb805dee0 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:30.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.532+0000 7f2ebd8cc640 10 monclient(hunting): authenticate will time out at 1299.160936s 2026-02-17T05:39:30.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.533+0000 7f2eb67fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2eb805dee0 0x7f2eb8181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42272/0 (socket says 10.20.193.106:42272) 2026-02-17T05:39:30.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.533+0000 7f2eb67fc640 1 -- 10.20.193.106:0/3239342107 learned_addr learned my addr 10.20.193.106:0/3239342107 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:30.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:30.733+0000 7f2eb6ffd640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:31.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:31.134+0000 7f2eb6ffd640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:31.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:31.935+0000 7f2eb6ffd640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): tick 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6790/0 conn(0x7f2eb805dee0 legacy=0x7f2eb8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.118:6789/0 conn(0x7f2eb8182720 legacy=0x7f2eb81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f2eb805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f2eb8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb8057960 con 0x7f2eb805d1b0 2026-02-17T05:39:33.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb808b060 con 0x7f2eb8182720 2026-02-17T05:39:33.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb67fc640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:33.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c069f50 con 0x7f2eb805dee0 2026-02-17T05:39:33.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.532+0000 7f2eb4ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:33.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:33.733+0000 7f2eb67fc640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:34.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:34.134+0000 7f2eb67fc640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:34.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:34.935+0000 7f2eb67fc640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): tick 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 monclient(hunting): continuing hunt 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6790/0 conn(0x7f2eb805dee0 legacy=0x7f2e9c023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:36.535 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.118:6789/0 conn(0x7f2eb8182720 legacy=0x7f2e9c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f2e9c06a210 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f2eb8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c06b1b0 con 0x7f2eb805d1b0 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb8057960 con 0x7f2eb8182720 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c06af40 con 0x7f2e9c06a210 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb4ff9640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:36.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.532+0000 7f2eb77fe640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:36.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:36.734+0000 7f2eb77fe640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:37.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:37.135+0000 7f2eb77fe640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:37.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:37.936+0000 7f2eb77fe640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927492404 0 0) 0x7f2eb8057960 con 0x7f2eb8182720 2026-02-17T05:39:38.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.388 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient(hunting): my global_id is 94327 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea40035e0 con 0x7f2eb8182720 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3516595197 0 0) 0x7f2ea40035e0 con 0x7f2eb8182720 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6790/0 conn(0x7f2e9c06a210 legacy=0x7f2e9c06a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2e9c044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 monclient: found mon.noname-c 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c0047f0 con 0x7f2eb8182720 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ea0002dc0 con 0x7f2eb8182720 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: dump: 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.390 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2ebd8cc640 5 monclient: authenticate success, global_id 94327 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2ebd8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ea0002f90 con 0x7f2eb8182720 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 1 -- 10.20.193.106:0/3239342107 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ea00033a0 con 0x7f2eb8182720 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:38.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2eb5ffb640 10 monclient: dump: 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2ebd8cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:38.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.380+0000 7f2ebd8cc640 4 set_mon_vals no callback set 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 10 monclient: shutdown 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/3239342107 >> v1:10.20.193.118:6789/0 conn(0x7f2eb8182720 legacy=0x7f2e9c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/3239342107 shutdown_connections 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/3239342107 >> 10.20.193.106:0/3239342107 conn(0x7f2eb80915f0 msgr2=0x7f2eb80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/3239342107 shutdown_connections 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/3239342107 wait complete. 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 10 monclient: build_initial_monmap 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.381+0000 7f2ebd8cc640 10 monclient: monmap: 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:38.393 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 1 Processor -- start 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 1 -- start start 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient: init 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:38.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2e9c06a210 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2eb805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2eb8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb8152770 con 0x7f2eb805d1b0 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb812fdf0 con 0x7f2eb8182720 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb805e8e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2ebd8cc640 10 monclient(hunting): authenticate will time out at 1307.011622s 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2eb67fc640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb813cc70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2eb6ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2e9c06a210 0x7f2eb8152060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53808/0 (socket says 10.20.193.106:53808) 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2eb6ffd640 1 -- 10.20.193.106:0/1892358921 learned_addr learned my addr 10.20.193.106:0/1892358921 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:38.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587285790 0 0) 0x7f2eb805e8e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 10 monclient(hunting): my global_id is 5093 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.382+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e880035e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 726807117 0 0) 0x7f2e880035e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2eb805e8e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2eac0042b0 con 0x7f2e9c06a210 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:38.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient(hunting): dump: 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:38.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 161915235 0 0) 0x7f2eb805e8e0 con 0x7f2e9c06a210 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 >> v1:10.20.193.118:6789/0 conn(0x7f2eb8182720 legacy=0x7f2eb81743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 >> v1:10.20.193.106:6789/0 conn(0x7f2eb805d1b0 legacy=0x7f2eb813cc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 monclient: found mon.c 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb808a090 con 0x7f2e9c06a210 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 5 monclient: authenticate success, global_id 5093 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _renew_subs 2026-02-17T05:39:38.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb8130690 con 0x7f2e9c06a210 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _renew_subs 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2eb813d380 con 0x7f2e9c06a210 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2eac004700 con 0x7f2e9c06a210 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2eac004b10 con 0x7f2e9c06a210 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2e8ffff640 10 monclient: dump: 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.399 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2eb57fa640 4 set_mon_vals no callback set 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.383+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb80008d0 con 0x7f2e9c06a210 2026-02-17T05:39:38.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.384+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2eac004ce0 con 0x7f2e9c06a210 2026-02-17T05:39:38.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.384+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f2eac04fe90 con 0x7f2e9c06a210 2026-02-17T05:39:38.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.384+0000 7f2eb67fc640 10 monclient: get_auth_request con 0x7f2e88040680 auth_method 0 2026-02-17T05:39:38.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.387+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f2eac006120 con 0x7f2e9c06a210 2026-02-17T05:39:38.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.387+0000 7f2e8ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.387+0000 7f2e8ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:38.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2ebd8cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2ebd8cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2ebd8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2eb813d630 con 0x7f2e9c06a210 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2e8ffff640 1 -- 10.20.193.106:0/1892358921 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3288768357) 0x7f2eac016c60 con 0x7f2e9c06a210 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2e8ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:39:38.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.534+0000 7f2e8ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:38.539 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":42,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:39:38.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 >> v1:10.20.193.118:6812/703720803 conn(0x7f2e88040680 legacy=0x7f2e88060b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 10 monclient: shutdown 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 >> v1:10.20.193.106:6790/0 conn(0x7f2e9c06a210 legacy=0x7f2eb8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 shutdown_connections 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 >> 10.20.193.106:0/1892358921 conn(0x7f2eb80915f0 msgr2=0x7f2eb8058e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 shutdown_connections 2026-02-17T05:39:38.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.535+0000 7f2ebd8cc640 1 -- 10.20.193.106:0/1892358921 wait complete. 2026-02-17T05:39:38.546 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:39:38.546 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:39:38.546 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: get_monmap_and_config 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: build_initial_monmap 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: monmap: 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:38.616495+0000 2026-02-17T05:39:38.630 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:38.616495+0000 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:38.631 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 1 Processor -- start 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 1 -- start start 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: init 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:39:38.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient(hunting): picked mon.noname-b con 0x7f405008be90 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient(hunting): picked mon.noname-a con 0x7f405008cc00 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient(hunting): picked mon.noname-c con 0x7f40501824b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405008a6e0 con 0x7f405008cc00 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405008afe0 con 0x7f40501824b0 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405008d3a0 con 0x7f405008be90 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f4055483640 10 monclient(hunting): authenticate will time out at 1307.244861s 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f404f7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f405008cc00 legacy=0x7f4050180d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f404ffff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f405008be90 0x7f405008c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53814/0 (socket says 10.20.193.106:53814) 2026-02-17T05:39:38.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.615+0000 7f404ffff640 1 -- 10.20.193.106:0/1491869039 learned_addr learned my addr 10.20.193.106:0/1491869039 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889910544 0 0) 0x7f405008d3a0 con 0x7f405008be90 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient(hunting): my global_id is 5096 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40340035e0 con 0x7f405008be90 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3420079304 0 0) 0x7f40340035e0 con 0x7f405008be90 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 >> v1:10.20.193.118:6789/0 conn(0x7f40501824b0 legacy=0x7f40501a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 >> v1:10.20.193.106:6789/0 conn(0x7f405008cc00 legacy=0x7f4050180d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 monclient: found mon.noname-b 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40500578b0 con 0x7f405008be90 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f403c002dd0 con 0x7f405008be90 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 5 monclient: authenticate success, global_id 5096 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:38.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: dump: 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:38.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f403c003010 con 0x7f405008be90 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 4 set_mon_vals no callback set 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 1 -- 10.20.193.106:0/1491869039 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f403c003420 con 0x7f405008be90 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f404effd640 10 monclient: dump: 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.637 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 10 monclient: shutdown 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 1 -- 10.20.193.106:0/1491869039 >> v1:10.20.193.106:6790/0 conn(0x7f405008be90 legacy=0x7f405008c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 1 -- 10.20.193.106:0/1491869039 shutdown_connections 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 1 -- 10.20.193.106:0/1491869039 >> 10.20.193.106:0/1491869039 conn(0x7f4050054d80 msgr2=0x7f4050090ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 1 -- 10.20.193.106:0/1491869039 shutdown_connections 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.616+0000 7f4055483640 1 -- 10.20.193.106:0/1491869039 wait complete. 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient: build_initial_monmap 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient: monmap: 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:38.639 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 1 Processor -- start 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 1 -- start start 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient: init 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient(hunting): picked mon.noname-a con 0x7f405008be90 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient(hunting): picked mon.noname-c con 0x7f40501824b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient(hunting): picked mon.noname-b con 0x7f405018d290 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405005cca0 con 0x7f405008be90 2026-02-17T05:39:38.640 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405018e1f0 con 0x7f405018d290 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404ffff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f405008be90 legacy=0x7f40501a30f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405005e6e0 con 0x7f40501824b0 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f4055483640 10 monclient(hunting): authenticate will time out at 1307.246557s 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f40501824b0 0x7f4050171a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53826/0 (socket says 10.20.193.106:53826) 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404f7fe640 1 -- 10.20.193.106:0/2856875601 learned_addr learned my addr 10.20.193.106:0/2856875601 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237867358 0 0) 0x7f405005e6e0 con 0x7f40501824b0 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 10 monclient(hunting): my global_id is 5099 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40200035e0 con 0x7f40501824b0 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1208154786 0 0) 0x7f40200035e0 con 0x7f40501824b0 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f405005e6e0 con 0x7f40501824b0 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f40400041f0 con 0x7f40501824b0 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.617+0000 7f404cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): dump: 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.642 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2188818448 0 0) 0x7f405005e6e0 con 0x7f40501824b0 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.118:6789/0 conn(0x7f405018d290 legacy=0x7f4050173180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6789/0 conn(0x7f405008be90 legacy=0x7f40501a30f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 monclient: found mon.c 2026-02-17T05:39:38.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405018c730 con 0x7f40501824b0 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 5 monclient: authenticate success, global_id 5099 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 10 monclient: _renew_subs 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f405018ea90 con 0x7f40501824b0 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 10 monclient: _renew_subs 2026-02-17T05:39:38.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f40501a39a0 con 0x7f40501824b0 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40400043c0 con 0x7f40501824b0 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f40400047a0 con 0x7f40501824b0 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient: dump: 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.645 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404e7fc640 4 set_mon_vals no callback set 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f405008c9d0 con 0x7f405008cc00 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249642312 0 0) 0x7f405008c9d0 con 0x7f405008cc00 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 10 monclient(hunting): my global_id is 5102 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f405005e6e0 con 0x7f405008cc00 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4040004900 con 0x7f40501824b0 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.618+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f404004fde0 con 0x7f40501824b0 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3014317345 0 0) 0x7f405005e6e0 con 0x7f405008cc00 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f405008c9d0 con 0x7f405008cc00 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f403c0029d0 con 0x7f405008cc00 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 10 monclient: dump: 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.647 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2471407987 0 0) 0x7f405008c9d0 con 0x7f405008cc00 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4050090010 con 0x7f405008cc00 2026-02-17T05:39:38.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f4054c82640 10 monclient: get_auth_request con 0x7f40200408b0 auth_method 0 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f403c003430 con 0x7f405008cc00 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6790/0 conn(0x7f405008cc00 legacy=0x7f4050186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.619+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6790/0 conn(0x7f405008cc00 legacy=0x7f4050186d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.622+0000 7f4055483640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.622+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f405008eda0 con 0x7f405018b230 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958527139 0 0) 0x7f405008eda0 con 0x7f405018b230 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient(hunting): my global_id is 5105 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f405008c9d0 con 0x7f405018b230 2026-02-17T05:39:38.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1001453604 0 0) 0x7f405008c9d0 con 0x7f405018b230 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f405008eda0 con 0x7f405018b230 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f403c004da0 con 0x7f405018b230 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient: dump: 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.650 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2509852594 0 0) 0x7f405008eda0 con 0x7f405018b230 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f405018b630 con 0x7f405018b230 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 871798859) 0x7f403c005150 con 0x7f405018b230 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6790/0 conn(0x7f405018b230 legacy=0x7f40501874a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f404cff9640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6790/0 conn(0x7f405018b230 legacy=0x7f40501874a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 42, 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 703385, 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.652 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.653 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.654 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:38.655 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:38.656 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.657 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.658 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:38.659 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:38.660 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.661 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.662 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:38.663 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:38.664 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.665 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.666 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:38.667 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.668 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:38.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.669 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.669 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.669 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:38.669 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.118:6812/703720803 conn(0x7f40200408b0 legacy=0x7f4020060d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 10 monclient: shutdown 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 >> v1:10.20.193.106:6790/0 conn(0x7f40501824b0 legacy=0x7f4050171a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4054c82640 1 -- 10.20.193.106:0/2856875601 reap_dead start 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4054c82640 1 -- 10.20.193.106:0/2856875601 reap_dead start 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 shutdown_connections 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 >> 10.20.193.106:0/2856875601 conn(0x7f4050054d80 msgr2=0x7f40500899d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 shutdown_connections 2026-02-17T05:39:38.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.623+0000 7f4055483640 1 -- 10.20.193.106:0/2856875601 wait complete. 2026-02-17T05:39:38.672 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:39:38.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:39:38.672 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: get_monmap_and_config 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: build_initial_monmap 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: monmap: 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:39:38.737590+0000 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:39:38.737590+0000 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:39:38.738 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 1 Processor -- start 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 1 -- start start 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: init 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f58bc05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f58bc05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f58bc182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc08b060 con 0x7f58bc05d1b0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc05dc90 con 0x7f58bc182720 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc08d6a0 con 0x7f58bc05dee0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c2d0c640 10 monclient(hunting): authenticate will time out at 1307.366009s 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.736+0000 7f58c0a81640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f58bc05d1b0 legacy=0x7f58bc05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b3fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f58bc05dee0 0x7f58bc181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53866/0 (socket says 10.20.193.106:53866) 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b3fff640 1 -- 10.20.193.106:0/4284379765 learned_addr learned my addr 10.20.193.106:0/4284379765 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059448851 0 0) 0x7f58bc08d6a0 con 0x7f58bc05dee0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient(hunting): my global_id is 5108 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a80035e0 con 0x7f58bc05dee0 2026-02-17T05:39:38.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2906248210 0 0) 0x7f58a80035e0 con 0x7f58bc05dee0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 >> v1:10.20.193.118:6789/0 conn(0x7f58bc182720 legacy=0x7f58bc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 >> v1:10.20.193.106:6789/0 conn(0x7f58bc05d1b0 legacy=0x7f58bc05d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 monclient: found mon.noname-b 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc057960 con 0x7f58bc05dee0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58a4002dd0 con 0x7f58bc05dee0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 5 monclient: authenticate success, global_id 5108 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: dump: 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.741 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58a4003090 con 0x7f58bc05dee0 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 1 -- 10.20.193.106:0/4284379765 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58a40034a0 con 0x7f58bc05dee0 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 4 set_mon_vals no callback set 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58b37fe640 10 monclient: dump: 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 10 monclient: shutdown 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 1 -- 10.20.193.106:0/4284379765 >> v1:10.20.193.106:6790/0 conn(0x7f58bc05dee0 legacy=0x7f58bc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 1 -- 10.20.193.106:0/4284379765 shutdown_connections 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 1 -- 10.20.193.106:0/4284379765 >> 10.20.193.106:0/4284379765 conn(0x7f58bc0915f0 msgr2=0x7f58bc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 1 -- 10.20.193.106:0/4284379765 shutdown_connections 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.737+0000 7f58c2d0c640 1 -- 10.20.193.106:0/4284379765 wait complete. 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient: build_initial_monmap 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient: monmap: 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 1 Processor -- start 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 1 -- start start 2026-02-17T05:39:38.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient: init 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f58bc05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f58bc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f58bc182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:39:38.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc10cdf0 con 0x7f58bc05dee0 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc12c310 con 0x7f58bc05d1b0 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc10bf80 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c2d0c640 10 monclient(hunting): authenticate will time out at 1307.367748s 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b3fff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f58bc05dee0 legacy=0x7f58bc12bc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c1282640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f58bc182720 0x7f58bc181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53872/0 (socket says 10.20.193.106:53872) 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58c1282640 1 -- 10.20.193.106:0/1490950898 learned_addr learned my addr 10.20.193.106:0/1490950898 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791812270 0 0) 0x7f58bc10bf80 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 10 monclient(hunting): my global_id is 5111 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.738+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f588c0035e0 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3540395011 0 0) 0x7f588c0035e0 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58bc10bf80 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58b80041d0 con 0x7f58bc182720 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient(hunting): dump: 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.746 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 882573572 0 0) 0x7f58bc10bf80 con 0x7f58bc182720 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6789/0 conn(0x7f58bc05d1b0 legacy=0x7f58bc12b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.106:6789/0 conn(0x7f58bc05dee0 legacy=0x7f58bc12bc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: _finish_hunting 0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 monclient: found mon.c 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc10aa90 con 0x7f58bc182720 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: _finish_auth 0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: _check_auth_tickets 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 5 monclient: authenticate success, global_id 5111 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 10 monclient: _renew_subs 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc1824f0 con 0x7f58bc182720 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 10 monclient: _renew_subs 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f58bc10b820 con 0x7f58bc182720 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58b8004540 con 0x7f58bc182720 2026-02-17T05:39:38.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58b8004c50 con 0x7f58bc182720 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b2ffd640 4 set_mon_vals no callback set 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 10 monclient: dump: 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58bc10c970 con 0x7f58bc128420 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.739+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f58b8004db0 con 0x7f58bc182720 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(591..591 src has 356..591) ==== 4007+0+0 (unknown 2085806514 0 0) 0x7f58b8050f40 con 0x7f58bc182720 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b3fff640 10 monclient: get_auth_request con 0x7f588c0406d0 auth_method 0 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956475748 0 0) 0x7f58bc10c970 con 0x7f58bc128420 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient(hunting): my global_id is 94339 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58bc10bf80 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 350262953 0 0) 0x7f58bc10bf80 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58bc10c970 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58ac003f20 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 10 monclient: dump: 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3599053926 0 0) 0x7f58bc10c970 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.740+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58bc057cd0 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.741+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f58ac006290 con 0x7f58bc128420 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.741+0000 7f58b17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.741+0000 7f58b17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.741+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6789/0 conn(0x7f58bc128420 legacy=0x7f58bc059e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.741+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6789/0 conn(0x7f58bc128420 legacy=0x7f58bc059e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:38.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.744+0000 7f58c2d0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:39:38.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.744+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58bc055570 con 0x7f58bc109fb0 2026-02-17T05:39:38.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83086457 0 0) 0x7f58bc055570 con 0x7f58bc109fb0 2026-02-17T05:39:38.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:39:38.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient(hunting): my global_id is 94342 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58bc10c970 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2390746055 0 0) 0x7f58bc10c970 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58bc055570 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f58ac0048c0 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 10 monclient: dump: 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 426528813 0 0) 0x7f58bc055570 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.745+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f58bc1287f0 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4670 (unknown 0 0 1747720569) 0x7f58ac005e60 con 0x7f58bc109fb0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58b17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58b17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6789/0 conn(0x7f58bc109fb0 legacy=0x7f58bc04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58b17fa640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6789/0 conn(0x7f58bc109fb0 legacy=0x7f58bc04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 42, 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 230989, 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.752 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.753 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:39:38.754 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.755 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:39:38.756 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.757 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:39:38.758 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:39:38.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:39:38.759 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:39:38.759 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:39:38.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.118:6812/703720803 conn(0x7f588c0406d0 legacy=0x7f588c060b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 10 monclient: shutdown 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 >> v1:10.20.193.106:6790/0 conn(0x7f58bc182720 legacy=0x7f58bc181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c1282640 1 -- 10.20.193.106:0/1490950898 reap_dead start 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c1282640 1 -- 10.20.193.106:0/1490950898 reap_dead start 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 shutdown_connections 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 >> 10.20.193.106:0/1490950898 conn(0x7f58bc0915f0 msgr2=0x7f58bc08b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 shutdown_connections 2026-02-17T05:39:38.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:39:38.746+0000 7f58c2d0c640 1 -- 10.20.193.106:0/1490950898 wait complete. 2026-02-17T05:39:38.760 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:39:38.760 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:39:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2750: done (1 left) 2026-02-17T05:39:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2751: done (0 left) 2026-02-17T05:39:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2752: copy_from oid 21 from oid 50 current snap is 295 2026-02-17T05:39:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2753: write (excl) oid 6 current snap is 295 2026-02-17T05:39:39.386 INFO:tasks.rados.rados.0.trial118.stdout:2753: seq_num 981 ranges {487667=428806,1655659=770995} 2026-02-17T05:39:39.390 INFO:tasks.rados.rados.0.trial118.stdout:2753: writing trial11845692-6 from 487667 to 916473 tid 1 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2753: writing trial11845692-6 from 1655659 to 2426654 tid 2 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2754: copy_from oid 2 from oid 22 current snap is 295 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2753: finishing write tid 1 to trial11845692-6 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2752: finishing copy_from racing read to trial11845692-21 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2752: finishing copy_from to trial11845692-21 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1392 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2752: done (2 left) 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2755: read oid 18 snap -1 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2755: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2756: read oid 46 snap -1 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2756: expect (ObjNum 963 snap 292 seq_num 963) 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2757: copy_from oid 36 from oid 13 current snap is 295 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2758: write (excl) oid 50 current snap is 295 2026-02-17T05:39:39.396 INFO:tasks.rados.rados.0.trial118.stdout:2758: seq_num 982 ranges {504474=504055,1714141=631006} 2026-02-17T05:39:39.399 INFO:tasks.rados.rados.0.trial118.stdout:2758: writing trial11845692-50 from 504474 to 1008529 tid 1 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2758: writing trial11845692-50 from 1714141 to 2345147 tid 2 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2759: write oid 11 current snap is 295 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2754: finishing copy_from to trial11845692-2 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2754: got expected ENOENT (src dne) 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2754: finishing copy_from racing read to trial11845692-2 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2753: finishing write tid 2 to trial11845692-6 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2753: finishing write tid 3 to trial11845692-6 2026-02-17T05:39:39.404 INFO:tasks.rados.rados.0.trial118.stdout:2759: seq_num 983 ranges {521281=579304,1656270=774664} 2026-02-17T05:39:39.408 INFO:tasks.rados.rados.0.trial118.stdout:2759: writing trial11845692-11 from 521281 to 1100585 tid 1 2026-02-17T05:39:39.414 INFO:tasks.rados.rados.0.trial118.stdout:2759: writing trial11845692-11 from 1656270 to 2430934 tid 2 2026-02-17T05:39:39.414 INFO:tasks.rados.rados.0.trial118.stdout:2754: done (6 left) 2026-02-17T05:39:39.414 INFO:tasks.rados.rados.0.trial118.stdout:2760: rollback oid 25 current snap is 295 2026-02-17T05:39:39.414 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 25 to 239 2026-02-17T05:39:39.414 INFO:tasks.rados.rados.0.trial118.stdout:2753: finishing write tid 4 to trial11845692-6 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:2753: oid 6 updating version 0 to 1453 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:2753: oid 6 updating version 1453 to 1455 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:2753: oid 6 version 1455 is already newer than 1454 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1455 (ObjNum 981 snap 295 seq_num 981) dirty exists 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:2753: left oid 6 (ObjNum 981 snap 295 seq_num 981) 2026-02-17T05:39:39.415 INFO:tasks.rados.rados.0.trial118.stdout:2755: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:39:39.473 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1541940 2026-02-17T05:39:39.560 INFO:tasks.rados.rados.0.trial118.stdout:2756: expect (ObjNum 963 snap 292 seq_num 963) 2026-02-17T05:39:39.560 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 483710 2026-02-17T05:39:39.619 INFO:tasks.rados.rados.0.trial118.stdout:2758: finishing write tid 1 to trial11845692-50 2026-02-17T05:39:39.619 INFO:tasks.rados.rados.0.trial118.stdout:2757: finishing copy_from racing read to trial11845692-36 2026-02-17T05:39:39.619 INFO:tasks.rados.rados.0.trial118.stdout:2757: finishing copy_from to trial11845692-36 2026-02-17T05:39:39.619 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1451 (ObjNum 954 snap 287 seq_num 954) dirty exists 2026-02-17T05:39:39.619 INFO:tasks.rados.rados.0.trial118.stdout:2758: finishing write tid 2 to trial11845692-50 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2758: finishing write tid 3 to trial11845692-50 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2753: done (6 left) 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2755: done (5 left) 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2756: done (4 left) 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2757: done (3 left) 2026-02-17T05:39:39.620 INFO:tasks.rados.rados.0.trial118.stdout:2761: snap_remove snap 252 2026-02-17T05:39:40.330 INFO:tasks.rados.rados.0.trial118.stdout:2761: done (3 left) 2026-02-17T05:39:40.330 INFO:tasks.rados.rados.0.trial118.stdout:2762: delete oid 18 current snap is 295 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2758: finishing write tid 4 to trial11845692-50 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2758: oid 50 updating version 0 to 1397 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2758: oid 50 updating version 1397 to 1398 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2758: oid 50 version 1398 is already newer than 1396 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1398 (ObjNum 982 snap 295 seq_num 982) dirty exists 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2758: left oid 50 (ObjNum 982 snap 295 seq_num 982) 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2759: finishing write tid 1 to trial11845692-11 2026-02-17T05:39:40.331 INFO:tasks.rados.rados.0.trial118.stdout:2759: finishing write tid 2 to trial11845692-11 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: finishing write tid 3 to trial11845692-11 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: finishing write tid 4 to trial11845692-11 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: oid 11 updating version 0 to 1715 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: oid 11 updating version 1715 to 1716 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: oid 11 updating version 1716 to 1717 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1717 (ObjNum 983 snap 295 seq_num 983) dirty exists 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2759: left oid 11 (ObjNum 983 snap 295 seq_num 983) 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2760: finishing rollback tid 0 to trial11845692-25 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:2760: finishing rollback tid 1 to trial11845692-25 2026-02-17T05:39:40.332 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1624 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:39:40.334 INFO:tasks.rados.rados.0.trial118.stdout:2758: done (3 left) 2026-02-17T05:39:40.334 INFO:tasks.rados.rados.0.trial118.stdout:2759: done (2 left) 2026-02-17T05:39:40.334 INFO:tasks.rados.rados.0.trial118.stdout:2760: done (1 left) 2026-02-17T05:39:40.334 INFO:tasks.rados.rados.0.trial118.stdout:2762: done (0 left) 2026-02-17T05:39:40.334 INFO:tasks.rados.rados.0.trial118.stdout:2763: read oid 12 snap -1 2026-02-17T05:39:40.335 INFO:tasks.rados.rados.0.trial118.stdout:2763: expect (ObjNum 975 snap 294 seq_num 975) 2026-02-17T05:39:40.335 INFO:tasks.rados.rados.0.trial118.stdout:2764: rollback oid 8 current snap is 295 2026-02-17T05:39:40.335 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 284 2026-02-17T05:39:40.335 INFO:tasks.rados.rados.0.trial118.stdout:2765: copy_from oid 17 from oid 6 current snap is 295 2026-02-17T05:39:40.335 INFO:tasks.rados.rados.0.trial118.stdout:2766: snap_remove snap 247 2026-02-17T05:39:41.334 INFO:tasks.rados.rados.0.trial118.stdout:2766: done (3 left) 2026-02-17T05:39:41.334 INFO:tasks.rados.rados.0.trial118.stdout:2767: snap_create 2026-02-17T05:39:41.334 INFO:tasks.rados.rados.0.trial118.stdout:2763: expect (ObjNum 975 snap 294 seq_num 975) 2026-02-17T05:39:41.362 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:41.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1537603 2026-02-17T05:39:41.421 INFO:tasks.rados.rados.0.trial118.stdout:2764: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:39:41.421 INFO:tasks.rados.rados.0.trial118.stdout:2764: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:39:41.421 INFO:tasks.rados.rados.0.trial118.stdout:2764: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:39:41.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1721 (ObjNum 894 snap 269 seq_num 894) dirty exists 2026-02-17T05:39:41.422 INFO:tasks.rados.rados.0.trial118.stdout:2765: finishing copy_from racing read to trial11845692-17 2026-02-17T05:39:41.422 INFO:tasks.rados.rados.0.trial118.stdout:2765: finishing copy_from to trial11845692-17 2026-02-17T05:39:41.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1455 (ObjNum 981 snap 295 seq_num 981) dirty exists 2026-02-17T05:39:42.334 INFO:tasks.rados.rados.0.trial118.stdout:2763: done (3 left) 2026-02-17T05:39:42.334 INFO:tasks.rados.rados.0.trial118.stdout:2764: done (2 left) 2026-02-17T05:39:42.335 INFO:tasks.rados.rados.0.trial118.stdout:2765: done (1 left) 2026-02-17T05:39:42.335 INFO:tasks.rados.rados.0.trial118.stdout:2767: done (0 left) 2026-02-17T05:39:42.335 INFO:tasks.rados.rados.0.trial118.stdout:2768: delete oid 20 current snap is 296 2026-02-17T05:39:42.338 INFO:tasks.rados.rados.0.trial118.stdout:2768: done (0 left) 2026-02-17T05:39:42.338 INFO:tasks.rados.rados.0.trial118.stdout:2769: read oid 33 snap 281 2026-02-17T05:39:42.338 INFO:tasks.rados.rados.0.trial118.stdout:2769: expect deleted 2026-02-17T05:39:42.338 INFO:tasks.rados.rados.0.trial118.stdout:2770: write (excl) oid 19 current snap is 296 2026-02-17T05:39:42.338 INFO:tasks.rados.rados.0.trial118.stdout:2770: seq_num 986 ranges {571702=405051,1431716=638344,2560365=11337} 2026-02-17T05:39:42.341 INFO:tasks.rados.rados.0.trial118.stdout:2770: writing trial11845692-19 from 571702 to 976753 tid 1 2026-02-17T05:39:42.346 INFO:tasks.rados.rados.0.trial118.stdout:2770: writing trial11845692-19 from 1431716 to 2070060 tid 2 2026-02-17T05:39:42.348 INFO:tasks.rados.rados.0.trial118.stdout:2770: writing trial11845692-19 from 2560365 to 2571702 tid 3 2026-02-17T05:39:42.348 INFO:tasks.rados.rados.0.trial118.stdout:2771: snap_remove snap 288 2026-02-17T05:39:43.336 INFO:tasks.rados.rados.0.trial118.stdout:2771: done (2 left) 2026-02-17T05:39:43.336 INFO:tasks.rados.rados.0.trial118.stdout:2772: delete oid 38 current snap is 296 2026-02-17T05:39:43.336 INFO:tasks.rados.rados.0.trial118.stdout:2770: finishing write tid 1 to trial11845692-19 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: finishing write tid 2 to trial11845692-19 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: finishing write tid 3 to trial11845692-19 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: finishing write tid 4 to trial11845692-19 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: finishing write tid 5 to trial11845692-19 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: oid 19 updating version 0 to 1454 2026-02-17T05:39:43.337 INFO:tasks.rados.rados.0.trial118.stdout:2770: oid 19 version 1454 is already newer than 1452 2026-02-17T05:39:43.338 INFO:tasks.rados.rados.0.trial118.stdout:2770: oid 19 version 1454 is already newer than 1453 2026-02-17T05:39:43.338 INFO:tasks.rados.rados.0.trial118.stdout:2770: oid 19 updating version 1454 to 1455 2026-02-17T05:39:43.338 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1455 (ObjNum 986 snap 296 seq_num 986) dirty exists 2026-02-17T05:39:43.338 INFO:tasks.rados.rados.0.trial118.stdout:2770: left oid 19 (ObjNum 986 snap 296 seq_num 986) 2026-02-17T05:39:43.341 INFO:tasks.rados.rados.0.trial118.stdout:2769: done (2 left) 2026-02-17T05:39:43.341 INFO:tasks.rados.rados.0.trial118.stdout:2770: done (1 left) 2026-02-17T05:39:43.342 INFO:tasks.rados.rados.0.trial118.stdout:2772: done (0 left) 2026-02-17T05:39:43.342 INFO:tasks.rados.rados.0.trial118.stdout:2773: copy_from oid 50 from oid 13 current snap is 296 2026-02-17T05:39:43.342 INFO:tasks.rados.rados.0.trial118.stdout:2774: delete oid 46 current snap is 296 2026-02-17T05:39:43.343 INFO:tasks.rados.rados.0.trial118.stdout:2774: done (1 left) 2026-02-17T05:39:43.343 INFO:tasks.rados.rados.0.trial118.stdout:2775: snap_remove snap 280 2026-02-17T05:39:44.341 INFO:tasks.rados.rados.0.trial118.stdout:2775: done (1 left) 2026-02-17T05:39:44.341 INFO:tasks.rados.rados.0.trial118.stdout:2776: snap_remove snap 284 2026-02-17T05:39:45.341 INFO:tasks.rados.rados.0.trial118.stdout:2776: done (1 left) 2026-02-17T05:39:45.342 INFO:tasks.rados.rados.0.trial118.stdout:2777: write oid 1 current snap is 296 2026-02-17T05:39:45.342 INFO:tasks.rados.rados.0.trial118.stdout:2777: seq_num 989 ranges {622123=747151,2007162=614961} 2026-02-17T05:39:45.346 INFO:tasks.rados.rados.0.trial118.stdout:2777: writing trial11845692-1 from 622123 to 1369274 tid 1 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2777: writing trial11845692-1 from 2007162 to 2622123 tid 2 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2778: read oid 19 snap -1 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2778: expect (ObjNum 986 snap 296 seq_num 986) 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2779: read oid 27 snap -1 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2779: expect deleted 2026-02-17T05:39:45.352 INFO:tasks.rados.rados.0.trial118.stdout:2780: write oid 8 current snap is 296 2026-02-17T05:39:45.353 INFO:tasks.rados.rados.0.trial118.stdout:2773: finishing copy_from racing read to trial11845692-50 2026-02-17T05:39:45.353 INFO:tasks.rados.rados.0.trial118.stdout:2780: seq_num 990 ranges {638930=422400,1665644=645682} 2026-02-17T05:39:45.356 INFO:tasks.rados.rados.0.trial118.stdout:2780: writing trial11845692-8 from 638930 to 1061330 tid 1 2026-02-17T05:39:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2780: writing trial11845692-8 from 1665644 to 2311326 tid 2 2026-02-17T05:39:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2781: delete oid 10 current snap is 296 2026-02-17T05:39:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2773: finishing copy_from to trial11845692-50 2026-02-17T05:39:45.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1451 (ObjNum 954 snap 287 seq_num 954) dirty exists 2026-02-17T05:39:45.362 INFO:tasks.rados.rados.0.trial118.stdout:2777: finishing write tid 1 to trial11845692-1 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: finishing write tid 2 to trial11845692-1 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: finishing write tid 3 to trial11845692-1 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: finishing write tid 4 to trial11845692-1 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: oid 1 updating version 0 to 1658 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: oid 1 version 1658 is already newer than 1656 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: oid 1 version 1658 is already newer than 1657 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1658 (ObjNum 989 snap 296 seq_num 989) dirty exists 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2777: left oid 1 (ObjNum 989 snap 296 seq_num 989) 2026-02-17T05:39:45.363 INFO:tasks.rados.rados.0.trial118.stdout:2778: expect (ObjNum 986 snap 296 seq_num 986) 2026-02-17T05:39:45.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2380755 2026-02-17T05:39:45.372 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2780: finishing write tid 1 to trial11845692-8 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2780: finishing write tid 2 to trial11845692-8 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2773: done (5 left) 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2777: done (4 left) 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2778: done (3 left) 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2779: done (2 left) 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2781: done (1 left) 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2782: snap_create 2026-02-17T05:39:45.408 INFO:tasks.rados.rados.0.trial118.stdout:2780: finishing write tid 3 to trial11845692-8 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:2780: finishing write tid 4 to trial11845692-8 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:2780: oid 8 updating version 0 to 1761 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:2780: oid 8 version 1761 is already newer than 1760 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:2780: oid 8 version 1761 is already newer than 1759 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1761 (ObjNum 990 snap 296 seq_num 990) dirty exists 2026-02-17T05:39:45.409 INFO:tasks.rados.rados.0.trial118.stdout:2780: left oid 8 (ObjNum 990 snap 296 seq_num 990) 2026-02-17T05:39:46.347 INFO:tasks.rados.rados.0.trial118.stdout:2780: done (1 left) 2026-02-17T05:39:46.347 INFO:tasks.rados.rados.0.trial118.stdout:2782: done (0 left) 2026-02-17T05:39:46.347 INFO:tasks.rados.rados.0.trial118.stdout:2783: delete oid 32 current snap is 297 2026-02-17T05:39:46.349 INFO:tasks.rados.rados.0.trial118.stdout:2783: done (0 left) 2026-02-17T05:39:46.350 INFO:tasks.rados.rados.0.trial118.stdout:2784: read oid 8 snap 281 2026-02-17T05:39:46.350 INFO:tasks.rados.rados.0.trial118.stdout:2784: expect (ObjNum 894 snap 269 seq_num 894) 2026-02-17T05:39:46.350 INFO:tasks.rados.rados.0.trial118.stdout:2785: write (excl) oid 39 current snap is 297 2026-02-17T05:39:46.350 INFO:tasks.rados.rados.0.trial118.stdout:2785: seq_num 993 ranges {689351=648147,2124737=564614} 2026-02-17T05:39:46.354 INFO:tasks.rados.rados.0.trial118.stdout:2785: writing trial11845692-39 from 689351 to 1337498 tid 1 2026-02-17T05:39:46.359 INFO:tasks.rados.rados.0.trial118.stdout:2785: writing trial11845692-39 from 2124737 to 2689351 tid 2 2026-02-17T05:39:46.360 INFO:tasks.rados.rados.0.trial118.stdout:2786: snap_remove snap 285 2026-02-17T05:39:47.349 INFO:tasks.rados.rados.0.trial118.stdout:2786: done (2 left) 2026-02-17T05:39:47.349 INFO:tasks.rados.rados.0.trial118.stdout:2787: rollback oid 31 current snap is 297 2026-02-17T05:39:47.349 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 294 2026-02-17T05:39:47.349 INFO:tasks.rados.rados.0.trial118.stdout:2784: expect (ObjNum 894 snap 269 seq_num 894) 2026-02-17T05:39:47.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2401886 2026-02-17T05:39:47.422 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2785: finishing write tid 1 to trial11845692-39 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2784: done (2 left) 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2788: delete oid 32 current snap is 297 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2785: finishing write tid 2 to trial11845692-39 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2785: finishing write tid 3 to trial11845692-39 2026-02-17T05:39:47.463 INFO:tasks.rados.rados.0.trial118.stdout:2785: finishing write tid 4 to trial11845692-39 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2785: oid 39 updating version 0 to 1421 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2785: oid 39 version 1421 is already newer than 1419 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2785: oid 39 version 1421 is already newer than 1420 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1421 (ObjNum 993 snap 297 seq_num 993) dirty exists 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2785: left oid 39 (ObjNum 993 snap 297 seq_num 993) 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2787: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2787: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:2787: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:39:47.464 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1765 (ObjNum 951 snap 286 seq_num 951) dirty exists 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2785: done (2 left) 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2787: done (1 left) 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2788: done (0 left) 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2789: read oid 33 snap -1 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2789: expect (ObjNum 969 snap 292 seq_num 969) 2026-02-17T05:39:47.465 INFO:tasks.rados.rados.0.trial118.stdout:2790: snap_remove snap 286 2026-02-17T05:39:48.351 INFO:tasks.rados.rados.0.trial118.stdout:2790: done (1 left) 2026-02-17T05:39:48.351 INFO:tasks.rados.rados.0.trial118.stdout:2791: copy_from oid 39 from oid 8 current snap is 297 2026-02-17T05:39:48.351 INFO:tasks.rados.rados.0.trial118.stdout:2789: expect (ObjNum 969 snap 292 seq_num 969) 2026-02-17T05:39:48.372 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 917664 2026-02-17T05:39:48.382 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 358621 2026-02-17T05:39:48.398 INFO:tasks.rados.rados.0.trial118.stdout:2791: finishing copy_from racing read to trial11845692-39 2026-02-17T05:39:48.398 INFO:tasks.rados.rados.0.trial118.stdout:2791: finishing copy_from to trial11845692-39 2026-02-17T05:39:48.398 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1761 (ObjNum 990 snap 296 seq_num 990) dirty exists 2026-02-17T05:39:48.399 INFO:tasks.rados.rados.0.trial118.stdout:2789: done (1 left) 2026-02-17T05:39:48.399 INFO:tasks.rados.rados.0.trial118.stdout:2791: done (0 left) 2026-02-17T05:39:48.399 INFO:tasks.rados.rados.0.trial118.stdout:2792: copy_from oid 41 from oid 21 current snap is 297 2026-02-17T05:39:48.399 INFO:tasks.rados.rados.0.trial118.stdout:2793: write oid 25 current snap is 297 2026-02-17T05:39:48.399 INFO:tasks.rados.rados.0.trial118.stdout:2793: seq_num 995 ranges {722965=798645,2125348=597617} 2026-02-17T05:39:48.402 INFO:tasks.rados.rados.0.trial118.stdout:2793: writing trial11845692-25 from 722965 to 1521610 tid 1 2026-02-17T05:39:48.407 INFO:tasks.rados.rados.0.trial118.stdout:2793: writing trial11845692-25 from 2125348 to 2722965 tid 2 2026-02-17T05:39:48.407 INFO:tasks.rados.rados.0.trial118.stdout:2794: delete oid 28 current snap is 297 2026-02-17T05:39:48.408 INFO:tasks.rados.rados.0.trial118.stdout:2792: finishing copy_from racing read to trial11845692-41 2026-02-17T05:39:48.408 INFO:tasks.rados.rados.0.trial118.stdout:2793: finishing write tid 1 to trial11845692-25 2026-02-17T05:39:48.408 INFO:tasks.rados.rados.0.trial118.stdout:2792: finishing copy_from to trial11845692-41 2026-02-17T05:39:48.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1392 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:39:48.409 INFO:tasks.rados.rados.0.trial118.stdout:2792: done (2 left) 2026-02-17T05:39:48.409 INFO:tasks.rados.rados.0.trial118.stdout:2794: done (1 left) 2026-02-17T05:39:48.410 INFO:tasks.rados.rados.0.trial118.stdout:2795: copy_from oid 44 from oid 27 current snap is 297 2026-02-17T05:39:48.410 INFO:tasks.rados.rados.0.trial118.stdout:2796: write oid 12 current snap is 297 2026-02-17T05:39:48.410 INFO:tasks.rados.rados.0.trial118.stdout:2796: seq_num 997 ranges {756579=665496,1958665=400347} 2026-02-17T05:39:48.415 INFO:tasks.rados.rados.0.trial118.stdout:2796: writing trial11845692-12 from 756579 to 1422075 tid 1 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2796: writing trial11845692-12 from 1958665 to 2359012 tid 2 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2797: read oid 21 snap 293 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2797: expect deleted 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2798: read oid 39 snap -1 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2798: expect (ObjNum 990 snap 296 seq_num 990) 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2799: write oid 19 current snap is 297 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2795: finishing copy_from to trial11845692-44 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2795: got expected ENOENT (src dne) 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2795: finishing copy_from racing read to trial11845692-44 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2793: finishing write tid 2 to trial11845692-25 2026-02-17T05:39:48.419 INFO:tasks.rados.rados.0.trial118.stdout:2793: finishing write tid 3 to trial11845692-25 2026-02-17T05:39:48.420 INFO:tasks.rados.rados.0.trial118.stdout:2799: seq_num 998 ranges {773386=740745,2017147=544005} 2026-02-17T05:39:48.424 INFO:tasks.rados.rados.0.trial118.stdout:2799: writing trial11845692-19 from 773386 to 1514131 tid 1 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:2799: writing trial11845692-19 from 2017147 to 2561152 tid 2 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:2795: done (5 left) 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:2800: rollback oid 11 current snap is 297 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 290 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:2793: finishing write tid 4 to trial11845692-25 2026-02-17T05:39:48.429 INFO:tasks.rados.rados.0.trial118.stdout:2793: oid 25 updating version 0 to 1673 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2793: oid 25 version 1673 is already newer than 1672 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2793: oid 25 version 1673 is already newer than 1671 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1673 (ObjNum 995 snap 297 seq_num 995) dirty exists 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2793: left oid 25 (ObjNum 995 snap 297 seq_num 995) 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: finishing write tid 1 to trial11845692-12 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2793: done (5 left) 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2797: done (4 left) 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2801: write (excl) oid 8 current snap is 297 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: finishing write tid 2 to trial11845692-12 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: finishing write tid 3 to trial11845692-12 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: finishing write tid 4 to trial11845692-12 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: oid 12 updating version 0 to 1453 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: oid 12 version 1453 is already newer than 1452 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: oid 12 updating version 1453 to 1454 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1454 (ObjNum 997 snap 297 seq_num 997) dirty exists 2026-02-17T05:39:48.430 INFO:tasks.rados.rados.0.trial118.stdout:2796: left oid 12 (ObjNum 997 snap 297 seq_num 997) 2026-02-17T05:39:48.431 INFO:tasks.rados.rados.0.trial118.stdout:2798: expect (ObjNum 990 snap 296 seq_num 990) 2026-02-17T05:39:48.458 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2546200 2026-02-17T05:39:48.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:48.527 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2310247 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:2799: finishing write tid 1 to trial11845692-19 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:2800: finishing rollback tid 0 to trial11845692-11 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:2800: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1782 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:2799: finishing write tid 2 to trial11845692-19 2026-02-17T05:39:48.538 INFO:tasks.rados.rados.0.trial118.stdout:2801: seq_num 999 ranges {790193=415994,1959276=404016} 2026-02-17T05:39:48.542 INFO:tasks.rados.rados.0.trial118.stdout:2801: writing trial11845692-8 from 790193 to 1206187 tid 1 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2801: writing trial11845692-8 from 1959276 to 2363292 tid 2 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2796: done (4 left) 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2798: done (3 left) 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2800: done (2 left) 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2802: read oid 20 snap 296 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2802: expect deleted 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2803: read oid 50 snap -1 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2803: expect (ObjNum 954 snap 287 seq_num 954) 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2804: read oid 38 snap 251 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2804: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2805: snap_create 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2799: finishing write tid 3 to trial11845692-19 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2799: finishing write tid 4 to trial11845692-19 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2799: oid 19 updating version 0 to 1458 2026-02-17T05:39:48.548 INFO:tasks.rados.rados.0.trial118.stdout:2799: oid 19 version 1458 is already newer than 1457 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2799: oid 19 version 1458 is already newer than 1456 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1458 (ObjNum 998 snap 297 seq_num 998) dirty exists 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2799: left oid 19 (ObjNum 998 snap 297 seq_num 998) 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: finishing write tid 1 to trial11845692-8 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: finishing write tid 2 to trial11845692-8 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: finishing write tid 3 to trial11845692-8 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: finishing write tid 4 to trial11845692-8 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: oid 8 updating version 0 to 1786 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: oid 8 version 1786 is already newer than 1785 2026-02-17T05:39:48.549 INFO:tasks.rados.rados.0.trial118.stdout:2801: oid 8 version 1786 is already newer than 1784 2026-02-17T05:39:48.550 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1786 (ObjNum 999 snap 297 seq_num 999) dirty exists 2026-02-17T05:39:48.550 INFO:tasks.rados.rados.0.trial118.stdout:2801: left oid 8 (ObjNum 999 snap 297 seq_num 999) 2026-02-17T05:39:48.550 INFO:tasks.rados.rados.0.trial118.stdout:2803: expect (ObjNum 954 snap 287 seq_num 954) 2026-02-17T05:39:48.558 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1192036 2026-02-17T05:39:48.592 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 743488 2026-02-17T05:39:48.607 INFO:tasks.rados.rados.0.trial118.stdout:2804: expect (ObjNum 802 snap 242 seq_num 802) 2026-02-17T05:39:48.714 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2260645 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2799: done (5 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2801: done (4 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2802: done (3 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2803: done (2 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2804: done (1 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2805: done (0 left) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2806: rollback oid 16 current snap is 298 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 294 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2807: read oid 7 snap -1 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2807: expect (ObjNum 951 snap 286 seq_num 951) 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2808: read oid 4 snap 257 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2808: expect deleted 2026-02-17T05:39:49.356 INFO:tasks.rados.rados.0.trial118.stdout:2809: snap_create 2026-02-17T05:39:49.361 INFO:tasks.rados.rados.0.trial118.stdout:2807: expect (ObjNum 951 snap 286 seq_num 951) 2026-02-17T05:39:49.361 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:49.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1552862 2026-02-17T05:39:49.441 INFO:tasks.rados.rados.0.trial118.stdout:2806: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:39:49.441 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1690 (ObjNum 193 snap 0 seq_num 3192) dirty dne 2026-02-17T05:39:50.331 INFO:tasks.rados.rados.0.trial118.stdout:2806: done (3 left) 2026-02-17T05:39:50.331 INFO:tasks.rados.rados.0.trial118.stdout:2807: done (2 left) 2026-02-17T05:39:50.331 INFO:tasks.rados.rados.0.trial118.stdout:2808: done (1 left) 2026-02-17T05:39:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2809: done (0 left) 2026-02-17T05:39:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2810: delete oid 30 current snap is 299 2026-02-17T05:39:50.332 INFO:tasks.rados.rados.0.trial118.stdout:2810: done (0 left) 2026-02-17T05:39:50.333 INFO:tasks.rados.rados.0.trial118.stdout:2811: snap_remove snap 270 2026-02-17T05:39:51.333 INFO:tasks.rados.rados.0.trial118.stdout:2811: done (0 left) 2026-02-17T05:39:51.333 INFO:tasks.rados.rados.0.trial118.stdout:2812: write (excl) oid 46 current snap is 299 2026-02-17T05:39:51.334 INFO:tasks.rados.rados.0.trial118.stdout:2812: seq_num 1001 ranges {423807=566492,1676240=407685,2739004=84803} 2026-02-17T05:39:51.337 INFO:tasks.rados.rados.0.trial118.stdout:2812: writing trial11845692-46 from 423807 to 990299 tid 1 2026-02-17T05:39:51.341 INFO:tasks.rados.rados.0.trial118.stdout:2812: writing trial11845692-46 from 1676240 to 2083925 tid 2 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2812: writing trial11845692-46 from 2739004 to 2823807 tid 3 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2813: rollback oid 43 current snap is 299 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 292 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2812: finishing write tid 1 to trial11845692-46 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2812: finishing write tid 2 to trial11845692-46 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2814: write (excl) oid 40 current snap is 299 2026-02-17T05:39:51.345 INFO:tasks.rados.rados.0.trial118.stdout:2814: seq_num 1002 ranges {440614=641741,1734722=551343} 2026-02-17T05:39:51.348 INFO:tasks.rados.rados.0.trial118.stdout:2814: writing trial11845692-40 from 440614 to 1082355 tid 1 2026-02-17T05:39:51.353 INFO:tasks.rados.rados.0.trial118.stdout:2814: writing trial11845692-40 from 1734722 to 2286065 tid 2 2026-02-17T05:39:51.353 INFO:tasks.rados.rados.0.trial118.stdout:2815: read oid 12 snap -1 2026-02-17T05:39:51.353 INFO:tasks.rados.rados.0.trial118.stdout:2815: expect (ObjNum 997 snap 297 seq_num 997) 2026-02-17T05:39:51.353 INFO:tasks.rados.rados.0.trial118.stdout:2816: write (excl) oid 34 current snap is 299 2026-02-17T05:39:51.353 INFO:tasks.rados.rados.0.trial118.stdout:2816: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2026-02-17T05:39:51.357 INFO:tasks.rados.rados.0.trial118.stdout:2816: writing trial11845692-34 from 457421 to 1174411 tid 1 2026-02-17T05:39:51.361 INFO:tasks.rados.rados.0.trial118.stdout:2816: writing trial11845692-34 from 1676851 to 2088205 tid 2 2026-02-17T05:39:51.364 INFO:tasks.rados.rados.0.trial118.stdout:2816: writing trial11845692-34 from 2677497 to 2857421 tid 3 2026-02-17T05:39:51.364 INFO:tasks.rados.rados.0.trial118.stdout:2817: rollback oid 8 current snap is 299 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 271 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: finishing write tid 3 to trial11845692-46 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: finishing write tid 4 to trial11845692-46 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: finishing write tid 5 to trial11845692-46 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: oid 46 updating version 0 to 1460 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: oid 46 version 1460 is already newer than 1458 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: oid 46 version 1460 is already newer than 1459 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: oid 46 version 1460 is already newer than 1457 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1460 (ObjNum 1001 snap 299 seq_num 1001) dirty exists 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2812: left oid 46 (ObjNum 1001 snap 299 seq_num 1001) 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2813: finishing rollback tid 0 to trial11845692-43 2026-02-17T05:39:51.365 INFO:tasks.rados.rados.0.trial118.stdout:2813: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2813: finishing rollback tid 2 to trial11845692-43 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1457 (ObjNum 877 snap 265 seq_num 877) dirty exists 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2814: finishing write tid 1 to trial11845692-40 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2812: done (5 left) 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2813: done (4 left) 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2818: write (excl) oid 13 current snap is 299 2026-02-17T05:39:51.366 INFO:tasks.rados.rados.0.trial118.stdout:2818: seq_num 1004 ranges {474228=508592,1451686=555012,2704920=169308} 2026-02-17T05:39:51.367 INFO:tasks.rados.rados.0.trial118.stdout:2818: writing trial11845692-13 from 474228 to 982820 tid 1 2026-02-17T05:39:51.371 INFO:tasks.rados.rados.0.trial118.stdout:2818: writing trial11845692-13 from 1451686 to 2006698 tid 2 2026-02-17T05:39:51.374 INFO:tasks.rados.rados.0.trial118.stdout:2818: writing trial11845692-13 from 2704920 to 2874228 tid 3 2026-02-17T05:39:51.375 INFO:tasks.rados.rados.0.trial118.stdout:2819: read oid 36 snap -1 2026-02-17T05:39:51.375 INFO:tasks.rados.rados.0.trial118.stdout:2819: expect (ObjNum 954 snap 287 seq_num 954) 2026-02-17T05:39:51.375 INFO:tasks.rados.rados.0.trial118.stdout:2820: snap_remove snap 292 2026-02-17T05:39:52.362 INFO:tasks.rados.rados.0.trial118.stdout:2820: done (6 left) 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2821: read oid 27 snap -1 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2821: expect deleted 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2822: copy_from oid 48 from oid 1 current snap is 299 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: finishing write tid 2 to trial11845692-40 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: finishing write tid 3 to trial11845692-40 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: finishing write tid 4 to trial11845692-40 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: oid 40 updating version 0 to 1686 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: oid 40 updating version 1686 to 1687 2026-02-17T05:39:52.363 INFO:tasks.rados.rados.0.trial118.stdout:2814: oid 40 updating version 1687 to 1688 2026-02-17T05:39:52.364 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1688 (ObjNum 1002 snap 299 seq_num 1002) dirty exists 2026-02-17T05:39:52.364 INFO:tasks.rados.rados.0.trial118.stdout:2814: left oid 40 (ObjNum 1002 snap 299 seq_num 1002) 2026-02-17T05:39:52.364 INFO:tasks.rados.rados.0.trial118.stdout:2815: expect (ObjNum 997 snap 297 seq_num 997) 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:2816: finishing write tid 1 to trial11845692-34 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:2816: finishing write tid 2 to trial11845692-34 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:2814: done (7 left) 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:2815: done (6 left) 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:2823: rollback oid 11 current snap is 299 2026-02-17T05:39:52.465 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 251 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: finishing write tid 3 to trial11845692-34 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: finishing write tid 4 to trial11845692-34 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: finishing write tid 5 to trial11845692-34 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: oid 34 updating version 0 to 1541 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: oid 34 version 1541 is already newer than 1540 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: oid 34 updating version 1541 to 1542 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:2816: oid 34 version 1542 is already newer than 1539 2026-02-17T05:39:52.466 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1542 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2816: left oid 34 (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2817: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2817: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2817: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1800 (ObjNum 894 snap 269 seq_num 894) dirty exists 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2818: finishing write tid 1 to trial11845692-13 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2818: finishing write tid 2 to trial11845692-13 2026-02-17T05:39:52.467 INFO:tasks.rados.rados.0.trial118.stdout:2816: done (6 left) 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2817: done (5 left) 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2824: snap_create 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: finishing write tid 3 to trial11845692-13 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: finishing write tid 4 to trial11845692-13 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: finishing write tid 5 to trial11845692-13 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: oid 13 updating version 0 to 1459 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: oid 13 updating version 1459 to 1461 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: oid 13 version 1461 is already newer than 1460 2026-02-17T05:39:52.468 INFO:tasks.rados.rados.0.trial118.stdout:2818: oid 13 updating version 1461 to 1462 2026-02-17T05:39:52.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1462 (ObjNum 1004 snap 299 seq_num 1004) dirty exists 2026-02-17T05:39:52.469 INFO:tasks.rados.rados.0.trial118.stdout:2818: left oid 13 (ObjNum 1004 snap 299 seq_num 1004) 2026-02-17T05:39:52.469 INFO:tasks.rados.rados.0.trial118.stdout:2819: expect (ObjNum 954 snap 287 seq_num 954) 2026-02-17T05:39:52.480 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2001489 2026-02-17T05:39:52.518 INFO:tasks.rados.rados.0.trial118.stdout:2822: finishing copy_from racing read to trial11845692-48 2026-02-17T05:39:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2822: finishing copy_from to trial11845692-48 2026-02-17T05:39:52.519 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1658 (ObjNum 989 snap 296 seq_num 989) dirty exists 2026-02-17T05:39:52.519 INFO:tasks.rados.rados.0.trial118.stdout:2823: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:39:52.519 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1782 (ObjNum 49 snap 0 seq_num 4556848) dirty dne 2026-02-17T05:39:53.365 INFO:tasks.rados.rados.0.trial118.stdout:2818: done (5 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2819: done (4 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2821: done (3 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2822: done (2 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2823: done (1 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2824: done (0 left) 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2825: copy_from oid 3 from oid 1 current snap is 300 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:2826: rollback oid 26 current snap is 300 2026-02-17T05:39:53.366 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 295 2026-02-17T05:39:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2827: delete oid 38 current snap is 300 2026-02-17T05:39:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2827: done (2 left) 2026-02-17T05:39:53.367 INFO:tasks.rados.rados.0.trial118.stdout:2828: rollback oid 39 current snap is 300 2026-02-17T05:39:53.367 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 276 2026-02-17T05:39:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2829: write oid 5 current snap is 300 2026-02-17T05:39:53.368 INFO:tasks.rados.rados.0.trial118.stdout:2829: seq_num 1006 ranges {507842=659090,1568650=558681,2759766=148076} 2026-02-17T05:39:53.370 INFO:tasks.rados.rados.0.trial118.stdout:2829: writing trial11845692-5 from 507842 to 1166932 tid 1 2026-02-17T05:39:53.374 INFO:tasks.rados.rados.0.trial118.stdout:2829: writing trial11845692-5 from 1568650 to 2127331 tid 2 2026-02-17T05:39:53.377 INFO:tasks.rados.rados.0.trial118.stdout:2829: writing trial11845692-5 from 2759766 to 2907842 tid 3 2026-02-17T05:39:53.377 INFO:tasks.rados.rados.0.trial118.stdout:2830: snap_remove snap 298 2026-02-17T05:39:54.370 INFO:tasks.rados.rados.0.trial118.stdout:2830: done (4 left) 2026-02-17T05:39:54.370 INFO:tasks.rados.rados.0.trial118.stdout:2831: write (excl) oid 12 current snap is 300 2026-02-17T05:39:54.370 INFO:tasks.rados.rados.0.trial118.stdout:2826: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:39:54.370 INFO:tasks.rados.rados.0.trial118.stdout:2831: seq_num 1007 ranges {524649=734339,1910779=702339} 2026-02-17T05:39:54.375 INFO:tasks.rados.rados.0.trial118.stdout:2831: writing trial11845692-12 from 524649 to 1258988 tid 1 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2831: writing trial11845692-12 from 1910779 to 2613118 tid 2 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2832: copy_from oid 4 from oid 37 current snap is 300 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2828: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2826: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2828: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1763 (ObjNum 129 snap 0 seq_num 11435144) dirty dne 2026-02-17T05:39:54.380 INFO:tasks.rados.rados.0.trial118.stdout:2826: finishing rollback tid 2 to trial11845692-26 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1455 (ObjNum 977 snap 294 seq_num 977) dirty exists 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2825: finishing copy_from racing read to trial11845692-3 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2825: finishing copy_from to trial11845692-3 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1658 (ObjNum 989 snap 296 seq_num 989) dirty exists 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: finishing write tid 1 to trial11845692-5 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2825: done (5 left) 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2826: done (4 left) 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2828: done (3 left) 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2833: rollback oid 40 current snap is 300 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 281 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: finishing write tid 2 to trial11845692-5 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: finishing write tid 3 to trial11845692-5 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: finishing write tid 4 to trial11845692-5 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: finishing write tid 5 to trial11845692-5 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: oid 5 updating version 0 to 1285 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: oid 5 updating version 1285 to 1287 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: oid 5 version 1287 is already newer than 1286 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: oid 5 version 1287 is already newer than 1284 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1287 (ObjNum 1006 snap 300 seq_num 1006) dirty exists 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: left oid 5 (ObjNum 1006 snap 300 seq_num 1006) 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2831: finishing write tid 1 to trial11845692-12 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2829: done (3 left) 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2834: write oid 6 current snap is 300 2026-02-17T05:39:54.381 INFO:tasks.rados.rados.0.trial118.stdout:2834: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2026-02-17T05:39:54.383 INFO:tasks.rados.rados.0.trial118.stdout:2834: writing trial11845692-6 from 541456 to 951044 tid 1 2026-02-17T05:39:54.388 INFO:tasks.rados.rados.0.trial118.stdout:2834: writing trial11845692-6 from 1569261 to 2131611 tid 2 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2834: writing trial11845692-6 from 2814612 to 2941456 tid 3 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2835: snap_create 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2832: finishing copy_from to trial11845692-4 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2832: got expected ENOENT (src dne) 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2832: finishing copy_from racing read to trial11845692-4 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2831: finishing write tid 2 to trial11845692-12 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2831: finishing write tid 3 to trial11845692-12 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2831: finishing write tid 4 to trial11845692-12 2026-02-17T05:39:54.392 INFO:tasks.rados.rados.0.trial118.stdout:2831: oid 12 updating version 0 to 1459 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2831: oid 12 version 1459 is already newer than 1458 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2831: oid 12 updating version 1459 to 1460 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1460 (ObjNum 1007 snap 300 seq_num 1007) dirty exists 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2831: left oid 12 (ObjNum 1007 snap 300 seq_num 1007) 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2833: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2833: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2833: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1700 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2834: finishing write tid 1 to trial11845692-6 2026-02-17T05:39:54.393 INFO:tasks.rados.rados.0.trial118.stdout:2834: finishing write tid 2 to trial11845692-6 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: finishing write tid 3 to trial11845692-6 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: finishing write tid 4 to trial11845692-6 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: finishing write tid 5 to trial11845692-6 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: oid 6 updating version 0 to 1458 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: oid 6 version 1458 is already newer than 1456 2026-02-17T05:39:54.394 INFO:tasks.rados.rados.0.trial118.stdout:2834: oid 6 version 1458 is already newer than 1457 2026-02-17T05:39:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2834: oid 6 updating version 1458 to 1459 2026-02-17T05:39:54.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1459 (ObjNum 1008 snap 300 seq_num 1008) dirty exists 2026-02-17T05:39:54.395 INFO:tasks.rados.rados.0.trial118.stdout:2834: left oid 6 (ObjNum 1008 snap 300 seq_num 1008) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2831: done (4 left) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2832: done (3 left) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2833: done (2 left) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2834: done (1 left) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2835: done (0 left) 2026-02-17T05:39:55.372 INFO:tasks.rados.rados.0.trial118.stdout:2836: delete oid 36 current snap is 301 2026-02-17T05:39:55.375 INFO:tasks.rados.rados.0.trial118.stdout:2836: done (0 left) 2026-02-17T05:39:55.375 INFO:tasks.rados.rados.0.trial118.stdout:2837: copy_from oid 12 from oid 43 current snap is 301 2026-02-17T05:39:55.375 INFO:tasks.rados.rados.0.trial118.stdout:2838: delete oid 11 current snap is 301 2026-02-17T05:39:55.376 INFO:tasks.rados.rados.0.trial118.stdout:2838: done (1 left) 2026-02-17T05:39:55.376 INFO:tasks.rados.rados.0.trial118.stdout:2839: write (excl) oid 41 current snap is 301 2026-02-17T05:39:55.377 INFO:tasks.rados.rados.0.trial118.stdout:2839: seq_num 1011 ranges {591877=635335,1628354=709677} 2026-02-17T05:39:55.381 INFO:tasks.rados.rados.0.trial118.stdout:2839: writing trial11845692-41 from 591877 to 1227212 tid 1 2026-02-17T05:39:55.385 INFO:tasks.rados.rados.0.trial118.stdout:2839: writing trial11845692-41 from 1628354 to 2338031 tid 2 2026-02-17T05:39:55.385 INFO:tasks.rados.rados.0.trial118.stdout:2840: write (excl) oid 50 current snap is 301 2026-02-17T05:39:55.386 INFO:tasks.rados.rados.0.trial118.stdout:2840: seq_num 1012 ranges {608684=426937,1803189=569688,2924304=84380} 2026-02-17T05:39:55.389 INFO:tasks.rados.rados.0.trial118.stdout:2840: writing trial11845692-50 from 608684 to 1035621 tid 1 2026-02-17T05:39:55.394 INFO:tasks.rados.rados.0.trial118.stdout:2840: writing trial11845692-50 from 1803189 to 2372877 tid 2 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2840: writing trial11845692-50 from 2924304 to 3008684 tid 3 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2841: snap_create 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2837: finishing copy_from racing read to trial11845692-12 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2839: finishing write tid 1 to trial11845692-41 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2837: finishing copy_from to trial11845692-12 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1457 (ObjNum 877 snap 265 seq_num 877) dirty exists 2026-02-17T05:39:55.398 INFO:tasks.rados.rados.0.trial118.stdout:2839: finishing write tid 2 to trial11845692-41 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: finishing write tid 3 to trial11845692-41 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: finishing write tid 4 to trial11845692-41 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: oid 41 updating version 0 to 1691 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: oid 41 updating version 1691 to 1692 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: oid 41 updating version 1692 to 1693 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1693 (ObjNum 1011 snap 301 seq_num 1011) dirty exists 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2839: left oid 41 (ObjNum 1011 snap 301 seq_num 1011) 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2840: finishing write tid 1 to trial11845692-50 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2840: finishing write tid 2 to trial11845692-50 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2840: finishing write tid 3 to trial11845692-50 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2840: finishing write tid 4 to trial11845692-50 2026-02-17T05:39:55.399 INFO:tasks.rados.rados.0.trial118.stdout:2840: finishing write tid 5 to trial11845692-50 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:2840: oid 50 updating version 0 to 1464 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:2840: oid 50 version 1464 is already newer than 1462 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:2840: oid 50 version 1464 is already newer than 1461 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:2840: oid 50 version 1464 is already newer than 1463 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1464 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:39:55.400 INFO:tasks.rados.rados.0.trial118.stdout:2840: left oid 50 (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:39:56.374 INFO:tasks.rados.rados.0.trial118.stdout:2837: done (3 left) 2026-02-17T05:39:56.374 INFO:tasks.rados.rados.0.trial118.stdout:2839: done (2 left) 2026-02-17T05:39:56.374 INFO:tasks.rados.rados.0.trial118.stdout:2840: done (1 left) 2026-02-17T05:39:56.374 INFO:tasks.rados.rados.0.trial118.stdout:2841: done (0 left) 2026-02-17T05:39:56.374 INFO:tasks.rados.rados.0.trial118.stdout:2842: read oid 19 snap -1 2026-02-17T05:39:56.375 INFO:tasks.rados.rados.0.trial118.stdout:2842: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-17T05:39:56.375 INFO:tasks.rados.rados.0.trial118.stdout:2843: read oid 41 snap 296 2026-02-17T05:39:56.375 INFO:tasks.rados.rados.0.trial118.stdout:2843: expect (ObjNum 921 snap 276 seq_num 921) 2026-02-17T05:39:56.375 INFO:tasks.rados.rados.0.trial118.stdout:2844: write (excl) oid 13 current snap is 302 2026-02-17T05:39:56.375 INFO:tasks.rados.rados.0.trial118.stdout:2844: seq_num 1013 ranges {625491=502186,1861671=713346} 2026-02-17T05:39:56.379 INFO:tasks.rados.rados.0.trial118.stdout:2844: writing trial11845692-13 from 625491 to 1127677 tid 1 2026-02-17T05:39:56.385 INFO:tasks.rados.rados.0.trial118.stdout:2844: writing trial11845692-13 from 1861671 to 2575017 tid 2 2026-02-17T05:39:56.385 INFO:tasks.rados.rados.0.trial118.stdout:2845: snap_create 2026-02-17T05:39:56.385 INFO:tasks.rados.rados.0.trial118.stdout:2842: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-17T05:39:56.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:56.465 INFO:tasks.rados.rados.0.trial118.stdout:2843: expect (ObjNum 921 snap 276 seq_num 921) 2026-02-17T05:39:56.466 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:56.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: finishing write tid 1 to trial11845692-13 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: finishing write tid 2 to trial11845692-13 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: finishing write tid 3 to trial11845692-13 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: finishing write tid 4 to trial11845692-13 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: oid 13 updating version 0 to 1660 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: oid 13 updating version 1660 to 1661 2026-02-17T05:39:56.556 INFO:tasks.rados.rados.0.trial118.stdout:2844: oid 13 version 1661 is already newer than 1659 2026-02-17T05:39:56.557 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1661 (ObjNum 1013 snap 302 seq_num 1013) dirty exists 2026-02-17T05:39:56.557 INFO:tasks.rados.rados.0.trial118.stdout:2844: left oid 13 (ObjNum 1013 snap 302 seq_num 1013) 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2842: done (3 left) 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2843: done (2 left) 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2844: done (1 left) 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2845: done (0 left) 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2846: copy_from oid 31 from oid 50 current snap is 303 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2847: copy_from oid 44 from oid 29 current snap is 303 2026-02-17T05:39:57.377 INFO:tasks.rados.rados.0.trial118.stdout:2848: snap_create 2026-02-17T05:39:57.385 INFO:tasks.rados.rados.0.trial118.stdout:2847: finishing copy_from racing read to trial11845692-44 2026-02-17T05:39:57.386 INFO:tasks.rados.rados.0.trial118.stdout:2846: finishing copy_from racing read to trial11845692-31 2026-02-17T05:39:57.387 INFO:tasks.rados.rados.0.trial118.stdout:2847: finishing copy_from to trial11845692-44 2026-02-17T05:39:57.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1680 (ObjNum 970 snap 293 seq_num 970) dirty exists 2026-02-17T05:39:57.388 INFO:tasks.rados.rados.0.trial118.stdout:2846: finishing copy_from to trial11845692-31 2026-02-17T05:39:57.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1464 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2846: done (2 left) 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2847: done (1 left) 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2848: done (0 left) 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2849: read oid 39 snap -1 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2849: expect deleted 2026-02-17T05:39:58.379 INFO:tasks.rados.rados.0.trial118.stdout:2850: snap_remove snap 281 2026-02-17T05:39:59.382 INFO:tasks.rados.rados.0.trial118.stdout:2850: done (1 left) 2026-02-17T05:39:59.382 INFO:tasks.rados.rados.0.trial118.stdout:2851: snap_create 2026-02-17T05:40:00.331 INFO:tasks.rados.rados.0.trial118.stdout:2849: done (1 left) 2026-02-17T05:40:00.332 INFO:tasks.rados.rados.0.trial118.stdout:2851: done (0 left) 2026-02-17T05:40:00.332 INFO:tasks.rados.rados.0.trial118.stdout:2852: snap_remove snap 300 2026-02-17T05:40:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2852: done (0 left) 2026-02-17T05:40:01.334 INFO:tasks.rados.rados.0.trial118.stdout:2853: delete oid 24 current snap is 305 2026-02-17T05:40:01.337 INFO:tasks.rados.rados.0.trial118.stdout:2853: done (0 left) 2026-02-17T05:40:01.337 INFO:tasks.rados.rados.0.trial118.stdout:2854: copy_from oid 41 from oid 6 current snap is 305 2026-02-17T05:40:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2855: read oid 34 snap 251 2026-02-17T05:40:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2855: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:40:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2856: read oid 3 snap -1 2026-02-17T05:40:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2856: expect (ObjNum 989 snap 296 seq_num 989) 2026-02-17T05:40:01.338 INFO:tasks.rados.rados.0.trial118.stdout:2857: snap_remove snap 303 2026-02-17T05:40:02.335 INFO:tasks.rados.rados.0.trial118.stdout:2857: done (3 left) 2026-02-17T05:40:02.335 INFO:tasks.rados.rados.0.trial118.stdout:2858: copy_from oid 44 from oid 21 current snap is 305 2026-02-17T05:40:02.335 INFO:tasks.rados.rados.0.trial118.stdout:2854: finishing copy_from racing read to trial11845692-41 2026-02-17T05:40:02.335 INFO:tasks.rados.rados.0.trial118.stdout:2856: expect (ObjNum 989 snap 296 seq_num 989) 2026-02-17T05:40:02.431 INFO:tasks.rados.rados.0.trial118.stdout:2854: finishing copy_from to trial11845692-41 2026-02-17T05:40:02.432 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1459 (ObjNum 1008 snap 300 seq_num 1008) dirty exists 2026-02-17T05:40:02.432 INFO:tasks.rados.rados.0.trial118.stdout:2855: expect (ObjNum 782 snap 229 seq_num 782) 2026-02-17T05:40:02.432 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:02.478 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:02.526 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2858: finishing copy_from racing read to trial11845692-44 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2858: finishing copy_from to trial11845692-44 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1392 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2854: done (3 left) 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2855: done (2 left) 2026-02-17T05:40:02.574 INFO:tasks.rados.rados.0.trial118.stdout:2856: done (1 left) 2026-02-17T05:40:02.575 INFO:tasks.rados.rados.0.trial118.stdout:2858: done (0 left) 2026-02-17T05:40:02.575 INFO:tasks.rados.rados.0.trial118.stdout:2859: snap_remove snap 304 2026-02-17T05:40:03.387 INFO:tasks.rados.rados.0.trial118.stdout:2859: done (0 left) 2026-02-17T05:40:03.387 INFO:tasks.rados.rados.0.trial118.stdout:2860: snap_remove snap 295 2026-02-17T05:40:04.390 INFO:tasks.rados.rados.0.trial118.stdout:2860: done (0 left) 2026-02-17T05:40:04.390 INFO:tasks.rados.rados.0.trial118.stdout:2861: copy_from oid 36 from oid 14 current snap is 305 2026-02-17T05:40:04.390 INFO:tasks.rados.rados.0.trial118.stdout:2862: snap_create 2026-02-17T05:40:04.401 INFO:tasks.rados.rados.0.trial118.stdout:2861: finishing copy_from racing read to trial11845692-36 2026-02-17T05:40:04.402 INFO:tasks.rados.rados.0.trial118.stdout:2861: finishing copy_from to trial11845692-36 2026-02-17T05:40:04.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:05.391 INFO:tasks.rados.rados.0.trial118.stdout:2861: done (1 left) 2026-02-17T05:40:05.391 INFO:tasks.rados.rados.0.trial118.stdout:2862: done (0 left) 2026-02-17T05:40:05.391 INFO:tasks.rados.rados.0.trial118.stdout:2863: snap_create 2026-02-17T05:40:06.394 INFO:tasks.rados.rados.0.trial118.stdout:2863: done (0 left) 2026-02-17T05:40:06.394 INFO:tasks.rados.rados.0.trial118.stdout:2864: snap_remove snap 302 2026-02-17T05:40:07.395 INFO:tasks.rados.rados.0.trial118.stdout:2864: done (0 left) 2026-02-17T05:40:07.395 INFO:tasks.rados.rados.0.trial118.stdout:2865: write (excl) oid 18 current snap is 307 2026-02-17T05:40:07.395 INFO:tasks.rados.rados.0.trial118.stdout:2865: seq_num 1015 ranges {659105=652684,1862282=717015} 2026-02-17T05:40:07.401 INFO:tasks.rados.rados.0.trial118.stdout:2865: writing trial11845692-18 from 659105 to 1311789 tid 1 2026-02-17T05:40:07.405 INFO:tasks.rados.rados.0.trial118.stdout:2865: writing trial11845692-18 from 1862282 to 2579297 tid 2 2026-02-17T05:40:07.405 INFO:tasks.rados.rados.0.trial118.stdout:2866: delete oid 29 current snap is 307 2026-02-17T05:40:07.405 INFO:tasks.rados.rados.0.trial118.stdout:2865: finishing write tid 1 to trial11845692-18 2026-02-17T05:40:07.407 INFO:tasks.rados.rados.0.trial118.stdout:2866: done (1 left) 2026-02-17T05:40:07.407 INFO:tasks.rados.rados.0.trial118.stdout:2867: snap_create 2026-02-17T05:40:07.407 INFO:tasks.rados.rados.0.trial118.stdout:2865: finishing write tid 2 to trial11845692-18 2026-02-17T05:40:07.407 INFO:tasks.rados.rados.0.trial118.stdout:2865: finishing write tid 3 to trial11845692-18 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:2865: finishing write tid 4 to trial11845692-18 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:2865: oid 18 updating version 0 to 1544 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:2865: oid 18 updating version 1544 to 1545 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:2865: oid 18 version 1545 is already newer than 1543 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1545 (ObjNum 1015 snap 307 seq_num 1015) dirty exists 2026-02-17T05:40:07.408 INFO:tasks.rados.rados.0.trial118.stdout:2865: left oid 18 (ObjNum 1015 snap 307 seq_num 1015) 2026-02-17T05:40:08.400 INFO:tasks.rados.rados.0.trial118.stdout:2865: done (1 left) 2026-02-17T05:40:08.400 INFO:tasks.rados.rados.0.trial118.stdout:2867: done (0 left) 2026-02-17T05:40:08.401 INFO:tasks.rados.rados.0.trial118.stdout:2868: write (excl) oid 19 current snap is 308 2026-02-17T05:40:08.401 INFO:tasks.rados.rados.0.trial118.stdout:2868: seq_num 1017 ranges {692719=403182,1579246=720684,2828713=264006} 2026-02-17T05:40:08.404 INFO:tasks.rados.rados.0.trial118.stdout:2868: writing trial11845692-19 from 692719 to 1095901 tid 1 2026-02-17T05:40:08.409 INFO:tasks.rados.rados.0.trial118.stdout:2868: writing trial11845692-19 from 1579246 to 2299930 tid 2 2026-02-17T05:40:08.412 INFO:tasks.rados.rados.0.trial118.stdout:2868: writing trial11845692-19 from 2828713 to 3092719 tid 3 2026-02-17T05:40:08.412 INFO:tasks.rados.rados.0.trial118.stdout:2869: snap_create 2026-02-17T05:40:08.412 INFO:tasks.rados.rados.0.trial118.stdout:2868: finishing write tid 1 to trial11845692-19 2026-02-17T05:40:08.412 INFO:tasks.rados.rados.0.trial118.stdout:2868: finishing write tid 2 to trial11845692-19 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: finishing write tid 3 to trial11845692-19 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: finishing write tid 4 to trial11845692-19 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: finishing write tid 5 to trial11845692-19 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: oid 19 updating version 0 to 1662 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: oid 19 updating version 1662 to 1663 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: oid 19 updating version 1663 to 1665 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: oid 19 version 1665 is already newer than 1664 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1665 (ObjNum 1017 snap 308 seq_num 1017) dirty exists 2026-02-17T05:40:08.414 INFO:tasks.rados.rados.0.trial118.stdout:2868: left oid 19 (ObjNum 1017 snap 308 seq_num 1017) 2026-02-17T05:40:09.403 INFO:tasks.rados.rados.0.trial118.stdout:2868: done (1 left) 2026-02-17T05:40:09.403 INFO:tasks.rados.rados.0.trial118.stdout:2869: done (0 left) 2026-02-17T05:40:09.403 INFO:tasks.rados.rados.0.trial118.stdout:2870: delete oid 50 current snap is 309 2026-02-17T05:40:09.405 INFO:tasks.rados.rados.0.trial118.stdout:2870: done (0 left) 2026-02-17T05:40:09.405 INFO:tasks.rados.rados.0.trial118.stdout:2871: snap_remove snap 276 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2871: done (0 left) 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2872: read oid 34 snap 308 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2872: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2873: read oid 44 snap -1 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2873: expect (ObjNum 976 snap 294 seq_num 976) 2026-02-17T05:40:10.334 INFO:tasks.rados.rados.0.trial118.stdout:2874: rollback oid 22 current snap is 309 2026-02-17T05:40:10.335 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 294 2026-02-17T05:40:10.335 INFO:tasks.rados.rados.0.trial118.stdout:2875: write (excl) oid 41 current snap is 309 2026-02-17T05:40:10.335 INFO:tasks.rados.rados.0.trial118.stdout:2875: seq_num 1019 ranges {726333=670033,2096210=724353} 2026-02-17T05:40:10.339 INFO:tasks.rados.rados.0.trial118.stdout:2875: writing trial11845692-41 from 726333 to 1396366 tid 1 2026-02-17T05:40:10.344 INFO:tasks.rados.rados.0.trial118.stdout:2875: writing trial11845692-41 from 2096210 to 2820563 tid 2 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2876: read oid 3 snap -1 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2876: expect (ObjNum 989 snap 296 seq_num 989) 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2877: read oid 18 snap -1 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2877: expect (ObjNum 1015 snap 307 seq_num 1015) 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2878: delete oid 12 current snap is 309 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2874: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1292 (ObjNum 33 snap 0 seq_num 12583264) dirty dne 2026-02-17T05:40:10.345 INFO:tasks.rados.rados.0.trial118.stdout:2873: expect (ObjNum 976 snap 294 seq_num 976) 2026-02-17T05:40:10.357 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 699328 2026-02-17T05:40:10.369 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:10.385 INFO:tasks.rados.rados.0.trial118.stdout:2875: finishing write tid 1 to trial11845692-41 2026-02-17T05:40:10.385 INFO:tasks.rados.rados.0.trial118.stdout:2872: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:40:10.469 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1245405 2026-02-17T05:40:10.499 INFO:tasks.rados.rados.0.trial118.stdout:2875: finishing write tid 2 to trial11845692-41 2026-02-17T05:40:10.499 INFO:tasks.rados.rados.0.trial118.stdout:2875: finishing write tid 3 to trial11845692-41 2026-02-17T05:40:10.499 INFO:tasks.rados.rados.0.trial118.stdout:2875: finishing write tid 4 to trial11845692-41 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:2875: oid 41 updating version 0 to 1695 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:2875: oid 41 updating version 1695 to 1697 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:2875: oid 41 version 1697 is already newer than 1696 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1697 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:2875: left oid 41 (ObjNum 1019 snap 309 seq_num 1019) 2026-02-17T05:40:10.500 INFO:tasks.rados.rados.0.trial118.stdout:2876: expect (ObjNum 989 snap 296 seq_num 989) 2026-02-17T05:40:10.518 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1852723 2026-02-17T05:40:10.562 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 658050 2026-02-17T05:40:10.589 INFO:tasks.rados.rados.0.trial118.stdout:2877: expect (ObjNum 1015 snap 307 seq_num 1015) 2026-02-17T05:40:10.598 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2409851 2026-02-17T05:40:10.625 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2872: done (6 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2873: done (5 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2874: done (4 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2875: done (3 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2876: done (2 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2877: done (1 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2878: done (0 left) 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2879: copy_from oid 32 from oid 10 current snap is 309 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2880: read oid 39 snap -1 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2880: expect deleted 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2881: copy_from oid 8 from oid 14 current snap is 309 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:2882: rollback oid 11 current snap is 309 2026-02-17T05:40:10.647 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 301 2026-02-17T05:40:10.648 INFO:tasks.rados.rados.0.trial118.stdout:2883: rollback oid 27 current snap is 309 2026-02-17T05:40:10.648 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 27 to 257 2026-02-17T05:40:10.648 INFO:tasks.rados.rados.0.trial118.stdout:2884: snap_remove snap 307 2026-02-17T05:40:11.407 INFO:tasks.rados.rados.0.trial118.stdout:2884: done (5 left) 2026-02-17T05:40:11.407 INFO:tasks.rados.rados.0.trial118.stdout:2885: snap_create 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2879: finishing copy_from to trial11845692-32 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2879: got expected ENOENT (src dne) 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2879: finishing copy_from racing read to trial11845692-32 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2882: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1782 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2883: finishing rollback tid 1 to trial11845692-27 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2883: finishing rollback tid 2 to trial11845692-27 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1839 (ObjNum 818 snap 249 seq_num 818) dirty exists 2026-02-17T05:40:11.408 INFO:tasks.rados.rados.0.trial118.stdout:2881: finishing copy_from racing read to trial11845692-8 2026-02-17T05:40:11.409 INFO:tasks.rados.rados.0.trial118.stdout:2881: finishing copy_from to trial11845692-8 2026-02-17T05:40:11.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:12.411 INFO:tasks.rados.rados.0.trial118.stdout:2879: done (5 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2880: done (4 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2881: done (3 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2882: done (2 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2883: done (1 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2885: done (0 left) 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2886: rollback oid 37 current snap is 310 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 282 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2887: write (excl) oid 34 current snap is 310 2026-02-17T05:40:12.412 INFO:tasks.rados.rados.0.trial118.stdout:2887: seq_num 1021 ranges {759947=420531,1813174=728022} 2026-02-17T05:40:12.416 INFO:tasks.rados.rados.0.trial118.stdout:2887: writing trial11845692-34 from 759947 to 1180478 tid 1 2026-02-17T05:40:12.421 INFO:tasks.rados.rados.0.trial118.stdout:2887: writing trial11845692-34 from 1813174 to 2541196 tid 2 2026-02-17T05:40:12.422 INFO:tasks.rados.rados.0.trial118.stdout:2888: write (excl) oid 12 current snap is 310 2026-02-17T05:40:12.422 INFO:tasks.rados.rados.0.trial118.stdout:2888: seq_num 1022 ranges {776754=495780,1871656=471680,2965828=210926} 2026-02-17T05:40:12.426 INFO:tasks.rados.rados.0.trial118.stdout:2888: writing trial11845692-12 from 776754 to 1272534 tid 1 2026-02-17T05:40:12.430 INFO:tasks.rados.rados.0.trial118.stdout:2888: writing trial11845692-12 from 1871656 to 2343336 tid 2 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2888: writing trial11845692-12 from 2965828 to 3176754 tid 3 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2889: delete oid 6 current snap is 310 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2886: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 0 (ObjNum 177 snap 0 seq_num 12503264) dirty dne 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: finishing write tid 1 to trial11845692-34 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: finishing write tid 2 to trial11845692-34 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: finishing write tid 3 to trial11845692-34 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: finishing write tid 4 to trial11845692-34 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: oid 34 updating version 0 to 1546 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: oid 34 updating version 1546 to 1548 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: oid 34 version 1548 is already newer than 1547 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1548 (ObjNum 1021 snap 310 seq_num 1021) dirty exists 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2887: left oid 34 (ObjNum 1021 snap 310 seq_num 1021) 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2888: finishing write tid 1 to trial11845692-12 2026-02-17T05:40:12.434 INFO:tasks.rados.rados.0.trial118.stdout:2888: finishing write tid 2 to trial11845692-12 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: finishing write tid 3 to trial11845692-12 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: finishing write tid 4 to trial11845692-12 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: finishing write tid 5 to trial11845692-12 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: oid 12 updating version 0 to 1470 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: oid 12 version 1470 is already newer than 1469 2026-02-17T05:40:12.435 INFO:tasks.rados.rados.0.trial118.stdout:2888: oid 12 version 1470 is already newer than 1467 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2888: oid 12 version 1470 is already newer than 1468 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1470 (ObjNum 1022 snap 310 seq_num 1022) dirty exists 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2888: left oid 12 (ObjNum 1022 snap 310 seq_num 1022) 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2886: done (3 left) 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2887: done (2 left) 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2888: done (1 left) 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2889: done (0 left) 2026-02-17T05:40:12.436 INFO:tasks.rados.rados.0.trial118.stdout:2890: write oid 9 current snap is 310 2026-02-17T05:40:12.437 INFO:tasks.rados.rados.0.trial118.stdout:2890: seq_num 1024 ranges {410368=646278,1472267=475349,2504321=405600} 2026-02-17T05:40:12.439 INFO:tasks.rados.rados.0.trial118.stdout:2890: writing trial11845692-9 from 410368 to 1056646 tid 1 2026-02-17T05:40:12.443 INFO:tasks.rados.rados.0.trial118.stdout:2890: writing trial11845692-9 from 1472267 to 1947616 tid 2 2026-02-17T05:40:12.447 INFO:tasks.rados.rados.0.trial118.stdout:2890: writing trial11845692-9 from 2504321 to 2909921 tid 3 2026-02-17T05:40:12.447 INFO:tasks.rados.rados.0.trial118.stdout:2891: snap_remove snap 296 2026-02-17T05:40:13.414 INFO:tasks.rados.rados.0.trial118.stdout:2891: done (1 left) 2026-02-17T05:40:13.414 INFO:tasks.rados.rados.0.trial118.stdout:2892: write oid 17 current snap is 310 2026-02-17T05:40:13.414 INFO:tasks.rados.rados.0.trial118.stdout:2890: finishing write tid 1 to trial11845692-9 2026-02-17T05:40:13.414 INFO:tasks.rados.rados.0.trial118.stdout:2890: finishing write tid 2 to trial11845692-9 2026-02-17T05:40:13.414 INFO:tasks.rados.rados.0.trial118.stdout:2892: seq_num 1025 ranges {427175=721527,1930749=735360} 2026-02-17T05:40:13.419 INFO:tasks.rados.rados.0.trial118.stdout:2892: writing trial11845692-17 from 427175 to 1148702 tid 1 2026-02-17T05:40:13.426 INFO:tasks.rados.rados.0.trial118.stdout:2892: writing trial11845692-17 from 1930749 to 2666109 tid 2 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2893: read oid 19 snap -1 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2893: expect (ObjNum 1017 snap 308 seq_num 1017) 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2894: write oid 27 current snap is 310 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: finishing write tid 3 to trial11845692-9 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: finishing write tid 4 to trial11845692-9 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: finishing write tid 5 to trial11845692-9 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: oid 9 updating version 0 to 1699 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: oid 9 updating version 1699 to 1701 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: oid 9 version 1701 is already newer than 1700 2026-02-17T05:40:13.427 INFO:tasks.rados.rados.0.trial118.stdout:2890: oid 9 version 1701 is already newer than 1698 2026-02-17T05:40:13.428 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1701 (ObjNum 1024 snap 310 seq_num 1024) dirty exists 2026-02-17T05:40:13.428 INFO:tasks.rados.rados.0.trial118.stdout:2890: left oid 9 (ObjNum 1024 snap 310 seq_num 1024) 2026-02-17T05:40:13.428 INFO:tasks.rados.rados.0.trial118.stdout:2894: seq_num 1026 ranges {443982=796776,1989231=479018,2959167=284815} 2026-02-17T05:40:13.430 INFO:tasks.rados.rados.0.trial118.stdout:2894: writing trial11845692-27 from 443982 to 1240758 tid 1 2026-02-17T05:40:13.435 INFO:tasks.rados.rados.0.trial118.stdout:2894: writing trial11845692-27 from 1989231 to 2468249 tid 2 2026-02-17T05:40:13.438 INFO:tasks.rados.rados.0.trial118.stdout:2894: writing trial11845692-27 from 2959167 to 3243982 tid 3 2026-02-17T05:40:13.438 INFO:tasks.rados.rados.0.trial118.stdout:2890: done (3 left) 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2895: snap_create 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: finishing write tid 1 to trial11845692-17 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: finishing write tid 2 to trial11845692-17 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: finishing write tid 3 to trial11845692-17 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: finishing write tid 4 to trial11845692-17 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: oid 17 updating version 0 to 1462 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: oid 17 updating version 1462 to 1463 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: oid 17 version 1463 is already newer than 1461 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1463 (ObjNum 1025 snap 310 seq_num 1025) dirty exists 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2892: left oid 17 (ObjNum 1025 snap 310 seq_num 1025) 2026-02-17T05:40:13.439 INFO:tasks.rados.rados.0.trial118.stdout:2893: expect (ObjNum 1017 snap 308 seq_num 1017) 2026-02-17T05:40:13.550 INFO:tasks.rados.rados.0.trial118.stdout:2894: finishing write tid 1 to trial11845692-27 2026-02-17T05:40:13.550 INFO:tasks.rados.rados.0.trial118.stdout:2894: finishing write tid 2 to trial11845692-27 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: finishing write tid 3 to trial11845692-27 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: finishing write tid 4 to trial11845692-27 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: finishing write tid 5 to trial11845692-27 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: oid 27 updating version 0 to 1852 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: oid 27 version 1852 is already newer than 1851 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: oid 27 updating version 1852 to 1853 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: oid 27 updating version 1853 to 1854 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1854 (ObjNum 1026 snap 310 seq_num 1026) dirty exists 2026-02-17T05:40:13.551 INFO:tasks.rados.rados.0.trial118.stdout:2894: left oid 27 (ObjNum 1026 snap 310 seq_num 1026) 2026-02-17T05:40:14.419 INFO:tasks.rados.rados.0.trial118.stdout:2892: done (3 left) 2026-02-17T05:40:14.420 INFO:tasks.rados.rados.0.trial118.stdout:2893: done (2 left) 2026-02-17T05:40:14.420 INFO:tasks.rados.rados.0.trial118.stdout:2894: done (1 left) 2026-02-17T05:40:14.420 INFO:tasks.rados.rados.0.trial118.stdout:2895: done (0 left) 2026-02-17T05:40:14.420 INFO:tasks.rados.rados.0.trial118.stdout:2896: snap_remove snap 275 2026-02-17T05:40:15.420 INFO:tasks.rados.rados.0.trial118.stdout:2896: done (0 left) 2026-02-17T05:40:15.420 INFO:tasks.rados.rados.0.trial118.stdout:2897: delete oid 43 current snap is 311 2026-02-17T05:40:15.425 INFO:tasks.rados.rados.0.trial118.stdout:2897: done (0 left) 2026-02-17T05:40:15.425 INFO:tasks.rados.rados.0.trial118.stdout:2898: snap_create 2026-02-17T05:40:16.423 INFO:tasks.rados.rados.0.trial118.stdout:2898: done (0 left) 2026-02-17T05:40:16.424 INFO:tasks.rados.rados.0.trial118.stdout:2899: write (excl) oid 17 current snap is 312 2026-02-17T05:40:16.424 INFO:tasks.rados.rados.0.trial118.stdout:2899: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2026-02-17T05:40:16.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: writing trial11845692-17 from 477596 to 1141223 tid 1 2026-02-17T05:40:16.432 INFO:tasks.rados.rados.0.trial118.stdout:2899: writing trial11845692-17 from 1706195 to 2188882 tid 2 2026-02-17T05:40:16.436 INFO:tasks.rados.rados.0.trial118.stdout:2899: writing trial11845692-17 from 2614013 to 3181054 tid 3 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2900: copy_from oid 19 from oid 16 current snap is 312 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2899: finishing write tid 1 to trial11845692-17 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2899: finishing write tid 2 to trial11845692-17 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2901: delete oid 30 current snap is 312 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2900: finishing copy_from to trial11845692-19 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2900: got expected ENOENT (src dne) 2026-02-17T05:40:16.437 INFO:tasks.rados.rados.0.trial118.stdout:2900: finishing copy_from racing read to trial11845692-19 2026-02-17T05:40:16.438 INFO:tasks.rados.rados.0.trial118.stdout:2900: done (2 left) 2026-02-17T05:40:16.438 INFO:tasks.rados.rados.0.trial118.stdout:2901: done (1 left) 2026-02-17T05:40:16.439 INFO:tasks.rados.rados.0.trial118.stdout:2902: read oid 33 snap -1 2026-02-17T05:40:16.439 INFO:tasks.rados.rados.0.trial118.stdout:2902: expect (ObjNum 969 snap 292 seq_num 969) 2026-02-17T05:40:16.439 INFO:tasks.rados.rados.0.trial118.stdout:2903: read oid 6 snap 290 2026-02-17T05:40:16.439 INFO:tasks.rados.rados.0.trial118.stdout:2903: expect (ObjNum 943 snap 281 seq_num 943) 2026-02-17T05:40:16.439 INFO:tasks.rados.rados.0.trial118.stdout:2904: snap_remove snap 306 2026-02-17T05:40:17.426 INFO:tasks.rados.rados.0.trial118.stdout:2904: done (3 left) 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2905: copy_from oid 34 from oid 47 current snap is 312 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: finishing write tid 3 to trial11845692-17 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: finishing write tid 4 to trial11845692-17 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: finishing write tid 5 to trial11845692-17 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: oid 17 updating version 0 to 1467 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: oid 17 version 1467 is already newer than 1464 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: oid 17 version 1467 is already newer than 1465 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:2899: oid 17 version 1467 is already newer than 1466 2026-02-17T05:40:17.427 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1467 (ObjNum 1028 snap 312 seq_num 1028) dirty exists 2026-02-17T05:40:17.428 INFO:tasks.rados.rados.0.trial118.stdout:2899: left oid 17 (ObjNum 1028 snap 312 seq_num 1028) 2026-02-17T05:40:17.428 INFO:tasks.rados.rados.0.trial118.stdout:2899: done (3 left) 2026-02-17T05:40:17.428 INFO:tasks.rados.rados.0.trial118.stdout:2906: delete oid 23 current snap is 312 2026-02-17T05:40:17.428 INFO:tasks.rados.rados.0.trial118.stdout:2902: expect (ObjNum 969 snap 292 seq_num 969) 2026-02-17T05:40:17.433 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1940376 2026-02-17T05:40:17.434 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:17.469 INFO:tasks.rados.rados.0.trial118.stdout:2903: expect (ObjNum 943 snap 281 seq_num 943) 2026-02-17T05:40:17.515 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:17.562 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2905: finishing copy_from to trial11845692-34 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2905: got expected ENOENT (src dne) 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2905: finishing copy_from racing read to trial11845692-34 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2902: done (3 left) 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2903: done (2 left) 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2905: done (1 left) 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2906: done (0 left) 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2907: copy_from oid 19 from oid 39 current snap is 312 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2908: rollback oid 5 current snap is 312 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 5 to 251 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2909: rollback oid 44 current snap is 312 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 44 to 301 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2910: write (excl) oid 16 current snap is 312 2026-02-17T05:40:17.609 INFO:tasks.rados.rados.0.trial118.stdout:2910: seq_num 1031 ranges {528017=489374,1481641=630014,2696282=400857} 2026-02-17T05:40:17.613 INFO:tasks.rados.rados.0.trial118.stdout:2910: writing trial11845692-16 from 528017 to 1017391 tid 1 2026-02-17T05:40:17.617 INFO:tasks.rados.rados.0.trial118.stdout:2910: writing trial11845692-16 from 1481641 to 2111655 tid 2 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2910: writing trial11845692-16 from 2696282 to 3097139 tid 3 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2911: delete oid 33 current snap is 312 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2907: finishing copy_from to trial11845692-19 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2907: got expected ENOENT (src dne) 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2907: finishing copy_from racing read to trial11845692-19 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2909: finishing rollback tid 0 to trial11845692-44 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2909: finishing rollback tid 1 to trial11845692-44 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1683 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2908: finishing rollback tid 0 to trial11845692-5 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2908: finishing rollback tid 1 to trial11845692-5 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2908: finishing rollback tid 2 to trial11845692-5 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1290 (ObjNum 793 snap 239 seq_num 793) dirty exists 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2910: finishing write tid 1 to trial11845692-16 2026-02-17T05:40:17.621 INFO:tasks.rados.rados.0.trial118.stdout:2910: finishing write tid 2 to trial11845692-16 2026-02-17T05:40:17.622 INFO:tasks.rados.rados.0.trial118.stdout:2907: done (4 left) 2026-02-17T05:40:17.622 INFO:tasks.rados.rados.0.trial118.stdout:2908: done (3 left) 2026-02-17T05:40:17.622 INFO:tasks.rados.rados.0.trial118.stdout:2909: done (2 left) 2026-02-17T05:40:17.622 INFO:tasks.rados.rados.0.trial118.stdout:2911: done (1 left) 2026-02-17T05:40:17.622 INFO:tasks.rados.rados.0.trial118.stdout:2912: snap_remove snap 299 2026-02-17T05:40:18.430 INFO:tasks.rados.rados.0.trial118.stdout:2912: done (1 left) 2026-02-17T05:40:18.430 INFO:tasks.rados.rados.0.trial118.stdout:2913: read oid 32 snap 254 2026-02-17T05:40:18.430 INFO:tasks.rados.rados.0.trial118.stdout:2913: expect (ObjNum 773 snap 227 seq_num 773) 2026-02-17T05:40:18.430 INFO:tasks.rados.rados.0.trial118.stdout:2914: read oid 10 snap -1 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2914: expect deleted 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2915: read oid 30 snap -1 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2915: expect deleted 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2916: snap_remove snap 309 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2910: finishing write tid 3 to trial11845692-16 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2910: finishing write tid 4 to trial11845692-16 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2910: finishing write tid 5 to trial11845692-16 2026-02-17T05:40:18.431 INFO:tasks.rados.rados.0.trial118.stdout:2910: oid 16 updating version 0 to 1705 2026-02-17T05:40:18.432 INFO:tasks.rados.rados.0.trial118.stdout:2910: oid 16 version 1705 is already newer than 1702 2026-02-17T05:40:18.432 INFO:tasks.rados.rados.0.trial118.stdout:2910: oid 16 version 1705 is already newer than 1703 2026-02-17T05:40:18.432 INFO:tasks.rados.rados.0.trial118.stdout:2910: oid 16 version 1705 is already newer than 1704 2026-02-17T05:40:18.432 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1705 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:40:18.432 INFO:tasks.rados.rados.0.trial118.stdout:2910: left oid 16 (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:40:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2910: done (4 left) 2026-02-17T05:40:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2916: done (3 left) 2026-02-17T05:40:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2917: read oid 18 snap -1 2026-02-17T05:40:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2917: expect (ObjNum 1015 snap 307 seq_num 1015) 2026-02-17T05:40:19.433 INFO:tasks.rados.rados.0.trial118.stdout:2918: snap_remove snap 282 2026-02-17T05:40:20.336 INFO:tasks.rados.rados.0.trial118.stdout:2918: done (4 left) 2026-02-17T05:40:20.336 INFO:tasks.rados.rados.0.trial118.stdout:2919: write oid 23 current snap is 312 2026-02-17T05:40:20.336 INFO:tasks.rados.rados.0.trial118.stdout:2913: expect (ObjNum 773 snap 227 seq_num 773) 2026-02-17T05:40:20.354 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:20.374 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:20.395 INFO:tasks.rados.rados.0.trial118.stdout:2917: expect (ObjNum 1015 snap 307 seq_num 1015) 2026-02-17T05:40:20.395 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:20.460 INFO:tasks.rados.rados.0.trial118.stdout:2919: seq_num 1033 ranges {561631=639872,1882252=633683,3034775=326856} 2026-02-17T05:40:20.465 INFO:tasks.rados.rados.0.trial118.stdout:2919: writing trial11845692-23 from 561631 to 1201503 tid 1 2026-02-17T05:40:20.471 INFO:tasks.rados.rados.0.trial118.stdout:2919: writing trial11845692-23 from 1882252 to 2515935 tid 2 2026-02-17T05:40:20.474 INFO:tasks.rados.rados.0.trial118.stdout:2919: writing trial11845692-23 from 3034775 to 3361631 tid 3 2026-02-17T05:40:20.474 INFO:tasks.rados.rados.0.trial118.stdout:2913: done (4 left) 2026-02-17T05:40:20.474 INFO:tasks.rados.rados.0.trial118.stdout:2914: done (3 left) 2026-02-17T05:40:20.474 INFO:tasks.rados.rados.0.trial118.stdout:2915: done (2 left) 2026-02-17T05:40:20.475 INFO:tasks.rados.rados.0.trial118.stdout:2917: done (1 left) 2026-02-17T05:40:20.475 INFO:tasks.rados.rados.0.trial118.stdout:2920: write (excl) oid 49 current snap is 312 2026-02-17T05:40:20.475 INFO:tasks.rados.rados.0.trial118.stdout:2920: seq_num 1034 ranges {578438=431474,1657087=493694,2778551=599887} 2026-02-17T05:40:20.478 INFO:tasks.rados.rados.0.trial118.stdout:2920: writing trial11845692-49 from 578438 to 1009912 tid 1 2026-02-17T05:40:20.482 INFO:tasks.rados.rados.0.trial118.stdout:2920: writing trial11845692-49 from 1657087 to 2150781 tid 2 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2920: writing trial11845692-49 from 2778551 to 3378438 tid 3 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2921: read oid 45 snap -1 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2921: expect (ObjNum 763 snap 227 seq_num 763) 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2922: read oid 20 snap 254 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2922: expect (ObjNum 839 snap 254 seq_num 839) 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2923: read oid 44 snap -1 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2923: expect deleted 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2924: write oid 27 current snap is 312 2026-02-17T05:40:20.488 INFO:tasks.rados.rados.0.trial118.stdout:2924: seq_num 1035 ranges {595245=506723,1715569=637352,2805974=562298} 2026-02-17T05:40:20.492 INFO:tasks.rados.rados.0.trial118.stdout:2924: writing trial11845692-27 from 595245 to 1101968 tid 1 2026-02-17T05:40:20.497 INFO:tasks.rados.rados.0.trial118.stdout:2924: writing trial11845692-27 from 1715569 to 2352921 tid 2 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2924: writing trial11845692-27 from 2805974 to 3368272 tid 3 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2925: read oid 38 snap -1 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2925: expect deleted 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2926: delete oid 46 current snap is 312 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: finishing write tid 1 to trial11845692-23 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: finishing write tid 2 to trial11845692-23 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: finishing write tid 3 to trial11845692-23 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: finishing write tid 4 to trial11845692-23 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: finishing write tid 5 to trial11845692-23 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: oid 23 updating version 0 to 1464 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: oid 23 version 1464 is already newer than 1462 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: oid 23 version 1464 is already newer than 1461 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: oid 23 version 1464 is already newer than 1463 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1464 (ObjNum 1033 snap 312 seq_num 1033) dirty exists 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2919: left oid 23 (ObjNum 1033 snap 312 seq_num 1033) 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2920: finishing write tid 1 to trial11845692-49 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2920: finishing write tid 2 to trial11845692-49 2026-02-17T05:40:20.501 INFO:tasks.rados.rados.0.trial118.stdout:2922: expect (ObjNum 839 snap 254 seq_num 839) 2026-02-17T05:40:20.503 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1287868 2026-02-17T05:40:20.550 INFO:tasks.rados.rados.0.trial118.stdout:2920: finishing write tid 3 to trial11845692-49 2026-02-17T05:40:20.551 INFO:tasks.rados.rados.0.trial118.stdout:2919: done (7 left) 2026-02-17T05:40:20.551 INFO:tasks.rados.rados.0.trial118.stdout:2922: done (6 left) 2026-02-17T05:40:20.551 INFO:tasks.rados.rados.0.trial118.stdout:2923: done (5 left) 2026-02-17T05:40:20.551 INFO:tasks.rados.rados.0.trial118.stdout:2926: done (4 left) 2026-02-17T05:40:20.551 INFO:tasks.rados.rados.0.trial118.stdout:2927: read oid 19 snap -1 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2927: expect (ObjNum 1017 snap 308 seq_num 1017) 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2928: write (excl) oid 22 current snap is 312 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: finishing write tid 4 to trial11845692-49 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: finishing write tid 5 to trial11845692-49 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: oid 49 updating version 0 to 1212 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: oid 49 version 1212 is already newer than 1211 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: oid 49 version 1212 is already newer than 1210 2026-02-17T05:40:20.552 INFO:tasks.rados.rados.0.trial118.stdout:2920: oid 49 updating version 1212 to 1213 2026-02-17T05:40:20.553 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1213 (ObjNum 1034 snap 312 seq_num 1034) dirty exists 2026-02-17T05:40:20.553 INFO:tasks.rados.rados.0.trial118.stdout:2920: left oid 49 (ObjNum 1034 snap 312 seq_num 1034) 2026-02-17T05:40:20.553 INFO:tasks.rados.rados.0.trial118.stdout:2921: expect (ObjNum 763 snap 227 seq_num 763) 2026-02-17T05:40:20.577 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 547821 2026-02-17T05:40:20.609 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1669833 2026-02-17T05:40:20.624 INFO:tasks.rados.rados.0.trial118.stdout:2924: finishing write tid 1 to trial11845692-27 2026-02-17T05:40:20.624 INFO:tasks.rados.rados.0.trial118.stdout:2924: finishing write tid 2 to trial11845692-27 2026-02-17T05:40:20.624 INFO:tasks.rados.rados.0.trial118.stdout:2928: seq_num 1037 ranges {628859=657221,1716180=641021,3144467=284392} 2026-02-17T05:40:20.629 INFO:tasks.rados.rados.0.trial118.stdout:2928: writing trial11845692-22 from 628859 to 1286080 tid 1 2026-02-17T05:40:20.633 INFO:tasks.rados.rados.0.trial118.stdout:2928: writing trial11845692-22 from 1716180 to 2357201 tid 2 2026-02-17T05:40:20.637 INFO:tasks.rados.rados.0.trial118.stdout:2928: writing trial11845692-22 from 3144467 to 3428859 tid 3 2026-02-17T05:40:20.637 INFO:tasks.rados.rados.0.trial118.stdout:2920: done (5 left) 2026-02-17T05:40:20.637 INFO:tasks.rados.rados.0.trial118.stdout:2921: done (4 left) 2026-02-17T05:40:20.637 INFO:tasks.rados.rados.0.trial118.stdout:2929: copy_from oid 32 from oid 36 current snap is 312 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: finishing write tid 3 to trial11845692-27 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: finishing write tid 4 to trial11845692-27 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: finishing write tid 5 to trial11845692-27 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: oid 27 updating version 0 to 1880 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: oid 27 updating version 1880 to 1881 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: oid 27 version 1881 is already newer than 1879 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: oid 27 version 1881 is already newer than 1878 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 1881 (ObjNum 1035 snap 312 seq_num 1035) dirty exists 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2924: left oid 27 (ObjNum 1035 snap 312 seq_num 1035) 2026-02-17T05:40:20.638 INFO:tasks.rados.rados.0.trial118.stdout:2927: expect (ObjNum 1017 snap 308 seq_num 1017) 2026-02-17T05:40:20.640 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 613889 2026-02-17T05:40:20.675 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:20.713 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2928: finishing write tid 1 to trial11845692-22 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2924: done (4 left) 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2925: done (3 left) 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2927: done (2 left) 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2930: read oid 50 snap -1 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2930: expect deleted 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2931: read oid 7 snap -1 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2931: expect (ObjNum 951 snap 286 seq_num 951) 2026-02-17T05:40:20.752 INFO:tasks.rados.rados.0.trial118.stdout:2932: snap_remove snap 308 2026-02-17T05:40:21.438 INFO:tasks.rados.rados.0.trial118.stdout:2932: done (4 left) 2026-02-17T05:40:21.438 INFO:tasks.rados.rados.0.trial118.stdout:2933: snap_remove snap 254 2026-02-17T05:40:22.443 INFO:tasks.rados.rados.0.trial118.stdout:2933: done (4 left) 2026-02-17T05:40:22.443 INFO:tasks.rados.rados.0.trial118.stdout:2934: rollback oid 10 current snap is 312 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 310 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: finishing write tid 2 to trial11845692-22 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: finishing write tid 3 to trial11845692-22 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: finishing write tid 4 to trial11845692-22 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: finishing write tid 5 to trial11845692-22 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: oid 22 updating version 0 to 1662 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: oid 22 version 1662 is already newer than 1661 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: oid 22 updating version 1662 to 1663 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: oid 22 version 1663 is already newer than 1660 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1663 (ObjNum 1037 snap 312 seq_num 1037) dirty exists 2026-02-17T05:40:22.444 INFO:tasks.rados.rados.0.trial118.stdout:2928: left oid 22 (ObjNum 1037 snap 312 seq_num 1037) 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:2929: finishing copy_from racing read to trial11845692-32 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:2928: done (4 left) 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:2935: write oid 18 current snap is 312 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:2929: finishing copy_from to trial11845692-32 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:22.445 INFO:tasks.rados.rados.0.trial118.stdout:2935: seq_num 1038 ranges {645666=732470,2174662=501032,3288243=157423} 2026-02-17T05:40:22.448 INFO:tasks.rados.rados.0.trial118.stdout:2935: writing trial11845692-18 from 645666 to 1378136 tid 1 2026-02-17T05:40:22.453 INFO:tasks.rados.rados.0.trial118.stdout:2935: writing trial11845692-18 from 2174662 to 2675694 tid 2 2026-02-17T05:40:22.456 INFO:tasks.rados.rados.0.trial118.stdout:2935: writing trial11845692-18 from 3288243 to 3445666 tid 3 2026-02-17T05:40:22.456 INFO:tasks.rados.rados.0.trial118.stdout:2929: done (4 left) 2026-02-17T05:40:22.456 INFO:tasks.rados.rados.0.trial118.stdout:2936: rollback oid 14 current snap is 312 2026-02-17T05:40:22.457 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 293 2026-02-17T05:40:22.457 INFO:tasks.rados.rados.0.trial118.stdout:2931: expect (ObjNum 951 snap 286 seq_num 951) 2026-02-17T05:40:22.484 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2934: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1206 (ObjNum 129 snap 0 seq_num 13199248) dirty dne 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2935: finishing write tid 1 to trial11845692-18 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2935: finishing write tid 2 to trial11845692-18 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2930: done (4 left) 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2931: done (3 left) 2026-02-17T05:40:22.543 INFO:tasks.rados.rados.0.trial118.stdout:2934: done (2 left) 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2937: write oid 2 current snap is 312 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: finishing write tid 3 to trial11845692-18 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: finishing write tid 4 to trial11845692-18 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: finishing write tid 5 to trial11845692-18 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: oid 18 updating version 0 to 1550 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: oid 18 updating version 1550 to 1551 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: oid 18 version 1551 is already newer than 1549 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: oid 18 updating version 1551 to 1552 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1552 (ObjNum 1038 snap 312 seq_num 1038) dirty exists 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2935: left oid 18 (ObjNum 1038 snap 312 seq_num 1038) 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2936: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2936: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:40:22.544 INFO:tasks.rados.rados.0.trial118.stdout:2936: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:40:22.545 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1293 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:22.545 INFO:tasks.rados.rados.0.trial118.stdout:2937: seq_num 1039 ranges {662473=407719,1833144=644690,3199313=263160} 2026-02-17T05:40:22.546 INFO:tasks.rados.rados.0.trial118.stdout:2937: writing trial11845692-2 from 662473 to 1070192 tid 1 2026-02-17T05:40:22.552 INFO:tasks.rados.rados.0.trial118.stdout:2937: writing trial11845692-2 from 1833144 to 2477834 tid 2 2026-02-17T05:40:22.557 INFO:tasks.rados.rados.0.trial118.stdout:2937: writing trial11845692-2 from 3199313 to 3462473 tid 3 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2935: done (2 left) 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2936: done (1 left) 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2938: read oid 43 snap 257 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2938: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2939: write (excl) oid 48 current snap is 312 2026-02-17T05:40:22.558 INFO:tasks.rados.rados.0.trial118.stdout:2937: finishing write tid 1 to trial11845692-2 2026-02-17T05:40:22.559 INFO:tasks.rados.rados.0.trial118.stdout:2937: finishing write tid 2 to trial11845692-2 2026-02-17T05:40:22.559 INFO:tasks.rados.rados.0.trial118.stdout:2939: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2026-02-17T05:40:22.561 INFO:tasks.rados.rados.0.trial118.stdout:2939: writing trial11845692-48 from 679280 to 1162248 tid 1 2026-02-17T05:40:22.566 INFO:tasks.rados.rados.0.trial118.stdout:2939: writing trial11845692-48 from 1775273 to 2563621 tid 2 2026-02-17T05:40:22.570 INFO:tasks.rados.rados.0.trial118.stdout:2939: writing trial11845692-48 from 3110383 to 3479280 tid 3 2026-02-17T05:40:22.570 INFO:tasks.rados.rados.0.trial118.stdout:2940: snap_remove snap 310 2026-02-17T05:40:23.447 INFO:tasks.rados.rados.0.trial118.stdout:2940: done (3 left) 2026-02-17T05:40:23.447 INFO:tasks.rados.rados.0.trial118.stdout:2941: copy_from oid 20 from oid 14 current snap is 312 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: finishing write tid 3 to trial11845692-2 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: finishing write tid 4 to trial11845692-2 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: finishing write tid 5 to trial11845692-2 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: oid 2 updating version 0 to 1894 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: oid 2 updating version 1894 to 1895 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: oid 2 updating version 1895 to 1896 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: oid 2 version 1896 is already newer than 1893 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1896 (ObjNum 1039 snap 312 seq_num 1039) dirty exists 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2937: left oid 2 (ObjNum 1039 snap 312 seq_num 1039) 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:2938: expect (ObjNum 668 snap 195 seq_num 668) 2026-02-17T05:40:23.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 224599 2026-02-17T05:40:23.493 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2644076 2026-02-17T05:40:23.532 INFO:tasks.rados.rados.0.trial118.stdout:2939: finishing write tid 1 to trial11845692-48 2026-02-17T05:40:23.532 INFO:tasks.rados.rados.0.trial118.stdout:2939: finishing write tid 2 to trial11845692-48 2026-02-17T05:40:23.532 INFO:tasks.rados.rados.0.trial118.stdout:2939: finishing write tid 3 to trial11845692-48 2026-02-17T05:40:23.532 INFO:tasks.rados.rados.0.trial118.stdout:2939: finishing write tid 4 to trial11845692-48 2026-02-17T05:40:23.532 INFO:tasks.rados.rados.0.trial118.stdout:2939: finishing write tid 5 to trial11845692-48 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: oid 48 updating version 0 to 1665 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: oid 48 updating version 1665 to 1666 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: oid 48 version 1666 is already newer than 1664 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: oid 48 updating version 1666 to 1667 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1667 (ObjNum 1040 snap 312 seq_num 1040) dirty exists 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: left oid 48 (ObjNum 1040 snap 312 seq_num 1040) 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2941: finishing copy_from racing read to trial11845692-20 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2941: finishing copy_from to trial11845692-20 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1293 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2937: done (3 left) 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2938: done (2 left) 2026-02-17T05:40:23.533 INFO:tasks.rados.rados.0.trial118.stdout:2939: done (1 left) 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2941: done (0 left) 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2942: read oid 13 snap 301 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2942: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2943: copy_from oid 5 from oid 35 current snap is 312 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2944: delete oid 19 current snap is 312 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2943: finishing copy_from to trial11845692-5 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2943: got expected ENOENT (src dne) 2026-02-17T05:40:23.534 INFO:tasks.rados.rados.0.trial118.stdout:2943: finishing copy_from racing read to trial11845692-5 2026-02-17T05:40:23.539 INFO:tasks.rados.rados.0.trial118.stdout:2942: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-17T05:40:23.539 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:23.640 INFO:tasks.rados.rados.0.trial118.stdout:2942: done (2 left) 2026-02-17T05:40:23.640 INFO:tasks.rados.rados.0.trial118.stdout:2943: done (1 left) 2026-02-17T05:40:23.640 INFO:tasks.rados.rados.0.trial118.stdout:2944: done (0 left) 2026-02-17T05:40:23.640 INFO:tasks.rados.rados.0.trial118.stdout:2945: delete oid 2 current snap is 312 2026-02-17T05:40:23.641 INFO:tasks.rados.rados.0.trial118.stdout:2945: done (0 left) 2026-02-17T05:40:23.641 INFO:tasks.rados.rados.0.trial118.stdout:2946: snap_create 2026-02-17T05:40:24.451 INFO:tasks.rados.rados.0.trial118.stdout:2946: done (0 left) 2026-02-17T05:40:24.451 INFO:tasks.rados.rados.0.trial118.stdout:2947: read oid 4 snap -1 2026-02-17T05:40:24.452 INFO:tasks.rados.rados.0.trial118.stdout:2947: expect (ObjNum 956 snap 288 seq_num 956) 2026-02-17T05:40:24.452 INFO:tasks.rados.rados.0.trial118.stdout:2948: delete oid 28 current snap is 313 2026-02-17T05:40:24.453 INFO:tasks.rados.rados.0.trial118.stdout:2948: done (1 left) 2026-02-17T05:40:24.453 INFO:tasks.rados.rados.0.trial118.stdout:2949: write (excl) oid 12 current snap is 313 2026-02-17T05:40:24.453 INFO:tasks.rados.rados.0.trial118.stdout:2949: seq_num 1044 ranges {746508=500317,2009201=795686,3220075=326433} 2026-02-17T05:40:24.458 INFO:tasks.rados.rados.0.trial118.stdout:2949: writing trial11845692-12 from 746508 to 1246825 tid 1 2026-02-17T05:40:24.464 INFO:tasks.rados.rados.0.trial118.stdout:2949: writing trial11845692-12 from 2009201 to 2804887 tid 2 2026-02-17T05:40:24.467 INFO:tasks.rados.rados.0.trial118.stdout:2949: writing trial11845692-12 from 3220075 to 3546508 tid 3 2026-02-17T05:40:24.467 INFO:tasks.rados.rados.0.trial118.stdout:2950: rollback oid 25 current snap is 313 2026-02-17T05:40:24.467 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 25 to 290 2026-02-17T05:40:24.467 INFO:tasks.rados.rados.0.trial118.stdout:2947: expect (ObjNum 956 snap 288 seq_num 956) 2026-02-17T05:40:24.474 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1852045 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2949: finishing write tid 1 to trial11845692-12 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2949: finishing write tid 2 to trial11845692-12 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2947: done (2 left) 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2951: read oid 28 snap 251 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2951: expect deleted 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2952: delete oid 3 current snap is 313 2026-02-17T05:40:24.498 INFO:tasks.rados.rados.0.trial118.stdout:2949: finishing write tid 3 to trial11845692-12 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: finishing write tid 4 to trial11845692-12 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: finishing write tid 5 to trial11845692-12 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: oid 12 updating version 0 to 1475 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: oid 12 version 1475 is already newer than 1474 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: oid 12 version 1475 is already newer than 1472 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: oid 12 version 1475 is already newer than 1473 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1475 (ObjNum 1044 snap 313 seq_num 1044) dirty exists 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2949: left oid 12 (ObjNum 1044 snap 313 seq_num 1044) 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2950: finishing rollback tid 0 to trial11845692-25 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2950: finishing rollback tid 1 to trial11845692-25 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:2950: finishing rollback tid 2 to trial11845692-25 2026-02-17T05:40:24.499 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1765 (ObjNum 871 snap 262 seq_num 871) dirty exists 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2949: done (3 left) 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2950: done (2 left) 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2951: done (1 left) 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2952: done (0 left) 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2953: copy_from oid 44 from oid 8 current snap is 313 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2954: read oid 36 snap 272 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2954: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:40:24.500 INFO:tasks.rados.rados.0.trial118.stdout:2955: snap_create 2026-02-17T05:40:24.504 INFO:tasks.rados.rados.0.trial118.stdout:2954: expect (ObjNum 701 snap 202 seq_num 701) 2026-02-17T05:40:24.604 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1200239 2026-02-17T05:40:24.645 INFO:tasks.rados.rados.0.trial118.stdout:2953: finishing copy_from racing read to trial11845692-44 2026-02-17T05:40:24.645 INFO:tasks.rados.rados.0.trial118.stdout:2953: finishing copy_from to trial11845692-44 2026-02-17T05:40:24.645 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:25.337 INFO:tasks.rados.rados.0.trial118.stdout:2953: done (2 left) 2026-02-17T05:40:25.337 INFO:tasks.rados.rados.0.trial118.stdout:2954: done (1 left) 2026-02-17T05:40:25.337 INFO:tasks.rados.rados.0.trial118.stdout:2955: done (0 left) 2026-02-17T05:40:25.337 INFO:tasks.rados.rados.0.trial118.stdout:2956: read oid 31 snap -1 2026-02-17T05:40:25.337 INFO:tasks.rados.rados.0.trial118.stdout:2956: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:40:25.338 INFO:tasks.rados.rados.0.trial118.stdout:2957: write (excl) oid 9 current snap is 314 2026-02-17T05:40:25.338 INFO:tasks.rados.rados.0.trial118.stdout:2957: seq_num 1046 ranges {780122=650815,2126165=799355} 2026-02-17T05:40:25.342 INFO:tasks.rados.rados.0.trial118.stdout:2957: writing trial11845692-9 from 780122 to 1430937 tid 1 2026-02-17T05:40:25.349 INFO:tasks.rados.rados.0.trial118.stdout:2957: writing trial11845692-9 from 2126165 to 2925520 tid 2 2026-02-17T05:40:25.349 INFO:tasks.rados.rados.0.trial118.stdout:2958: read oid 18 snap -1 2026-02-17T05:40:25.349 INFO:tasks.rados.rados.0.trial118.stdout:2958: expect (ObjNum 1038 snap 312 seq_num 1038) 2026-02-17T05:40:25.349 INFO:tasks.rados.rados.0.trial118.stdout:2959: snap_create 2026-02-17T05:40:25.349 INFO:tasks.rados.rados.0.trial118.stdout:2956: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:40:25.423 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 122067 2026-02-17T05:40:25.460 INFO:tasks.rados.rados.0.trial118.stdout:2957: finishing write tid 1 to trial11845692-9 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: finishing write tid 2 to trial11845692-9 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: finishing write tid 3 to trial11845692-9 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: finishing write tid 4 to trial11845692-9 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: oid 9 updating version 0 to 1708 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: oid 9 version 1708 is already newer than 1706 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: oid 9 version 1708 is already newer than 1707 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1708 (ObjNum 1046 snap 314 seq_num 1046) dirty exists 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2957: left oid 9 (ObjNum 1046 snap 314 seq_num 1046) 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:2958: expect (ObjNum 1038 snap 312 seq_num 1038) 2026-02-17T05:40:25.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:25.544 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2884703 2026-02-17T05:40:26.340 INFO:tasks.rados.rados.0.trial118.stdout:2956: done (3 left) 2026-02-17T05:40:26.340 INFO:tasks.rados.rados.0.trial118.stdout:2957: done (2 left) 2026-02-17T05:40:26.341 INFO:tasks.rados.rados.0.trial118.stdout:2958: done (1 left) 2026-02-17T05:40:26.341 INFO:tasks.rados.rados.0.trial118.stdout:2959: done (0 left) 2026-02-17T05:40:26.341 INFO:tasks.rados.rados.0.trial118.stdout:2960: snap_remove snap 297 2026-02-17T05:40:27.340 INFO:tasks.rados.rados.0.trial118.stdout:2960: done (0 left) 2026-02-17T05:40:27.340 INFO:tasks.rados.rados.0.trial118.stdout:2961: snap_create 2026-02-17T05:40:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2961: done (0 left) 2026-02-17T05:40:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2962: read oid 36 snap -1 2026-02-17T05:40:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2962: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:28.341 INFO:tasks.rados.rados.0.trial118.stdout:2963: snap_remove snap 312 2026-02-17T05:40:29.342 INFO:tasks.rados.rados.0.trial118.stdout:2963: done (1 left) 2026-02-17T05:40:29.343 INFO:tasks.rados.rados.0.trial118.stdout:2964: write (excl) oid 49 current snap is 316 2026-02-17T05:40:29.343 INFO:tasks.rados.rados.0.trial118.stdout:2964: seq_num 1047 ranges {796929=726064,2184647=659366,3302344=294585} 2026-02-17T05:40:29.349 INFO:tasks.rados.rados.0.trial118.stdout:2964: writing trial11845692-49 from 796929 to 1522993 tid 1 2026-02-17T05:40:29.354 INFO:tasks.rados.rados.0.trial118.stdout:2964: writing trial11845692-49 from 2184647 to 2844013 tid 2 2026-02-17T05:40:29.357 INFO:tasks.rados.rados.0.trial118.stdout:2964: writing trial11845692-49 from 3302344 to 3596929 tid 3 2026-02-17T05:40:29.357 INFO:tasks.rados.rados.0.trial118.stdout:2965: snap_remove snap 239 2026-02-17T05:40:30.337 INFO:tasks.rados.rados.0.trial118.stdout:2965: done (2 left) 2026-02-17T05:40:30.337 INFO:tasks.rados.rados.0.trial118.stdout:2966: write (excl) oid 17 current snap is 316 2026-02-17T05:40:30.337 INFO:tasks.rados.rados.0.trial118.stdout:2962: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:30.366 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:30.403 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3400653 2026-02-17T05:40:30.409 INFO:tasks.rados.rados.0.trial118.stdout:2964: finishing write tid 1 to trial11845692-49 2026-02-17T05:40:30.409 INFO:tasks.rados.rados.0.trial118.stdout:2964: finishing write tid 2 to trial11845692-49 2026-02-17T05:40:30.409 INFO:tasks.rados.rados.0.trial118.stdout:2964: finishing write tid 3 to trial11845692-49 2026-02-17T05:40:30.409 INFO:tasks.rados.rados.0.trial118.stdout:2964: finishing write tid 4 to trial11845692-49 2026-02-17T05:40:30.409 INFO:tasks.rados.rados.0.trial118.stdout:2966: seq_num 1048 ranges {413736=401313,1326776=403024,2413414=457893,3438716=175020} 2026-02-17T05:40:30.412 INFO:tasks.rados.rados.0.trial118.stdout:2966: writing trial11845692-17 from 413736 to 815049 tid 1 2026-02-17T05:40:30.416 INFO:tasks.rados.rados.0.trial118.stdout:2966: writing trial11845692-17 from 1326776 to 1729800 tid 2 2026-02-17T05:40:30.420 INFO:tasks.rados.rados.0.trial118.stdout:2966: writing trial11845692-17 from 2413414 to 2871307 tid 3 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2966: writing trial11845692-17 from 3438716 to 3613736 tid 4 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2962: done (2 left) 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2967: copy_from oid 11 from oid 19 current snap is 316 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2964: finishing write tid 5 to trial11845692-49 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2964: oid 49 updating version 0 to 1284 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2964: oid 49 updating version 1284 to 1287 2026-02-17T05:40:30.424 INFO:tasks.rados.rados.0.trial118.stdout:2964: oid 49 version 1287 is already newer than 1285 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2964: oid 49 version 1287 is already newer than 1286 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1287 (ObjNum 1047 snap 316 seq_num 1047) dirty exists 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2964: left oid 49 (ObjNum 1047 snap 316 seq_num 1047) 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 1 to trial11845692-17 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 2 to trial11845692-17 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 3 to trial11845692-17 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2964: done (2 left) 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2968: read oid 31 snap -1 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2968: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2969: write oid 42 current snap is 316 2026-02-17T05:40:30.425 INFO:tasks.rados.rados.0.trial118.stdout:2969: seq_num 1049 ranges {430543=476562,1385258=663035,2840837=669165} 2026-02-17T05:40:30.426 INFO:tasks.rados.rados.0.trial118.stdout:2969: writing trial11845692-42 from 430543 to 907105 tid 1 2026-02-17T05:40:30.431 INFO:tasks.rados.rados.0.trial118.stdout:2969: writing trial11845692-42 from 1385258 to 2048293 tid 2 2026-02-17T05:40:30.437 INFO:tasks.rados.rados.0.trial118.stdout:2969: writing trial11845692-42 from 2840837 to 3510002 tid 3 2026-02-17T05:40:30.437 INFO:tasks.rados.rados.0.trial118.stdout:2970: read oid 33 snap -1 2026-02-17T05:40:30.437 INFO:tasks.rados.rados.0.trial118.stdout:2970: expect deleted 2026-02-17T05:40:30.437 INFO:tasks.rados.rados.0.trial118.stdout:2971: write (excl) oid 37 current snap is 316 2026-02-17T05:40:30.437 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 4 to trial11845692-17 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 5 to trial11845692-17 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: finishing write tid 6 to trial11845692-17 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: oid 17 updating version 0 to 1473 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: oid 17 version 1473 is already newer than 1470 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: oid 17 version 1473 is already newer than 1469 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: oid 17 version 1473 is already newer than 1472 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: oid 17 version 1473 is already newer than 1471 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1473 (ObjNum 1048 snap 316 seq_num 1048) dirty exists 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2966: left oid 17 (ObjNum 1048 snap 316 seq_num 1048) 2026-02-17T05:40:30.438 INFO:tasks.rados.rados.0.trial118.stdout:2971: seq_num 1050 ranges {447350=668164,1560093=406693,2584613=480437} 2026-02-17T05:40:30.440 INFO:tasks.rados.rados.0.trial118.stdout:2971: writing trial11845692-37 from 447350 to 1115514 tid 1 2026-02-17T05:40:30.444 INFO:tasks.rados.rados.0.trial118.stdout:2971: writing trial11845692-37 from 1560093 to 1966786 tid 2 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2971: writing trial11845692-37 from 2584613 to 3065050 tid 3 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2966: done (5 left) 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2972: read oid 2 snap -1 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2972: expect deleted 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2973: read oid 14 snap -1 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2973: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2974: copy_from oid 45 from oid 6 current snap is 316 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2967: finishing copy_from to trial11845692-11 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2967: got expected ENOENT (src dne) 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2967: finishing copy_from racing read to trial11845692-11 2026-02-17T05:40:30.448 INFO:tasks.rados.rados.0.trial118.stdout:2968: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:40:30.449 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:30.487 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:30.563 INFO:tasks.rados.rados.0.trial118.stdout:2969: finishing write tid 1 to trial11845692-42 2026-02-17T05:40:30.563 INFO:tasks.rados.rados.0.trial118.stdout:2967: done (7 left) 2026-02-17T05:40:30.563 INFO:tasks.rados.rados.0.trial118.stdout:2968: done (6 left) 2026-02-17T05:40:30.563 INFO:tasks.rados.rados.0.trial118.stdout:2975: snap_remove snap 272 2026-02-17T05:40:31.350 INFO:tasks.rados.rados.0.trial118.stdout:2975: done (6 left) 2026-02-17T05:40:31.350 INFO:tasks.rados.rados.0.trial118.stdout:2976: write oid 7 current snap is 316 2026-02-17T05:40:31.350 INFO:tasks.rados.rados.0.trial118.stdout:2969: finishing write tid 2 to trial11845692-42 2026-02-17T05:40:31.350 INFO:tasks.rados.rados.0.trial118.stdout:2976: seq_num 1051 ranges {464157=743413,1618575=666704,3012036=408062} 2026-02-17T05:40:31.354 INFO:tasks.rados.rados.0.trial118.stdout:2976: writing trial11845692-7 from 464157 to 1207570 tid 1 2026-02-17T05:40:31.358 INFO:tasks.rados.rados.0.trial118.stdout:2976: writing trial11845692-7 from 1618575 to 2285279 tid 2 2026-02-17T05:40:31.363 INFO:tasks.rados.rados.0.trial118.stdout:2976: writing trial11845692-7 from 3012036 to 3420098 tid 3 2026-02-17T05:40:31.363 INFO:tasks.rados.rados.0.trial118.stdout:2977: snap_remove snap 294 2026-02-17T05:40:32.354 INFO:tasks.rados.rados.0.trial118.stdout:2977: done (7 left) 2026-02-17T05:40:32.354 INFO:tasks.rados.rados.0.trial118.stdout:2978: read oid 49 snap -1 2026-02-17T05:40:32.354 INFO:tasks.rados.rados.0.trial118.stdout:2978: expect (ObjNum 1047 snap 316 seq_num 1047) 2026-02-17T05:40:32.354 INFO:tasks.rados.rados.0.trial118.stdout:2979: read oid 3 snap -1 2026-02-17T05:40:32.355 INFO:tasks.rados.rados.0.trial118.stdout:2979: expect deleted 2026-02-17T05:40:32.355 INFO:tasks.rados.rados.0.trial118.stdout:2980: write (excl) oid 12 current snap is 316 2026-02-17T05:40:32.355 INFO:tasks.rados.rados.0.trial118.stdout:2980: seq_num 1052 ranges {480964=418662,1560704=410362,2523106=619334} 2026-02-17T05:40:32.358 INFO:tasks.rados.rados.0.trial118.stdout:2980: writing trial11845692-12 from 480964 to 899626 tid 1 2026-02-17T05:40:32.363 INFO:tasks.rados.rados.0.trial118.stdout:2980: writing trial11845692-12 from 1560704 to 1971066 tid 2 2026-02-17T05:40:32.367 INFO:tasks.rados.rados.0.trial118.stdout:2980: writing trial11845692-12 from 2523106 to 3142440 tid 3 2026-02-17T05:40:32.367 INFO:tasks.rados.rados.0.trial118.stdout:2981: write oid 35 current snap is 316 2026-02-17T05:40:32.367 INFO:tasks.rados.rados.0.trial118.stdout:2981: seq_num 1053 ranges {497771=493911,1619186=554020,2950529=430606} 2026-02-17T05:40:32.371 INFO:tasks.rados.rados.0.trial118.stdout:2981: writing trial11845692-35 from 497771 to 991682 tid 1 2026-02-17T05:40:32.375 INFO:tasks.rados.rados.0.trial118.stdout:2981: writing trial11845692-35 from 1619186 to 2173206 tid 2 2026-02-17T05:40:32.380 INFO:tasks.rados.rados.0.trial118.stdout:2981: writing trial11845692-35 from 2950529 to 3381135 tid 3 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2982: snap_create 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: finishing write tid 3 to trial11845692-42 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: finishing write tid 4 to trial11845692-42 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: finishing write tid 5 to trial11845692-42 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: oid 42 updating version 0 to 1767 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: oid 42 version 1767 is already newer than 1765 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: oid 42 version 1767 is already newer than 1766 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: oid 42 version 1767 is already newer than 1764 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1767 (ObjNum 1049 snap 316 seq_num 1049) dirty exists 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2969: left oid 42 (ObjNum 1049 snap 316 seq_num 1049) 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2971: finishing write tid 1 to trial11845692-37 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2971: finishing write tid 2 to trial11845692-37 2026-02-17T05:40:32.381 INFO:tasks.rados.rados.0.trial118.stdout:2974: finishing copy_from to trial11845692-45 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2974: got expected ENOENT (src dne) 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2974: finishing copy_from racing read to trial11845692-45 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: finishing write tid 3 to trial11845692-37 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: finishing write tid 4 to trial11845692-37 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: finishing write tid 5 to trial11845692-37 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: oid 37 updating version 0 to 1174 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: oid 37 version 1174 is already newer than 1171 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: oid 37 version 1174 is already newer than 1173 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: oid 37 version 1174 is already newer than 1172 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1174 (ObjNum 1050 snap 316 seq_num 1050) dirty exists 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2971: left oid 37 (ObjNum 1050 snap 316 seq_num 1050) 2026-02-17T05:40:32.382 INFO:tasks.rados.rados.0.trial118.stdout:2973: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:32.390 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3706659 2026-02-17T05:40:32.422 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:32.449 INFO:tasks.rados.rados.0.trial118.stdout:2976: finishing write tid 1 to trial11845692-7 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: finishing write tid 2 to trial11845692-7 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: finishing write tid 3 to trial11845692-7 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: finishing write tid 4 to trial11845692-7 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: finishing write tid 5 to trial11845692-7 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: oid 7 updating version 0 to 1726 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: oid 7 version 1726 is already newer than 1725 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: oid 7 updating version 1726 to 1727 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:2976: oid 7 updating version 1727 to 1728 2026-02-17T05:40:32.450 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1728 (ObjNum 1051 snap 316 seq_num 1051) dirty exists 2026-02-17T05:40:32.451 INFO:tasks.rados.rados.0.trial118.stdout:2976: left oid 7 (ObjNum 1051 snap 316 seq_num 1051) 2026-02-17T05:40:32.451 INFO:tasks.rados.rados.0.trial118.stdout:2978: expect (ObjNum 1047 snap 316 seq_num 1047) 2026-02-17T05:40:32.451 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:32.526 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3456241 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: finishing write tid 1 to trial11845692-12 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: finishing write tid 2 to trial11845692-12 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: finishing write tid 3 to trial11845692-12 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: finishing write tid 4 to trial11845692-12 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: finishing write tid 5 to trial11845692-12 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: oid 12 updating version 0 to 1479 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: oid 12 version 1479 is already newer than 1478 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: oid 12 version 1479 is already newer than 1476 2026-02-17T05:40:32.568 INFO:tasks.rados.rados.0.trial118.stdout:2980: oid 12 version 1479 is already newer than 1477 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1479 (ObjNum 1052 snap 316 seq_num 1052) dirty exists 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2980: left oid 12 (ObjNum 1052 snap 316 seq_num 1052) 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: finishing write tid 1 to trial11845692-35 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: finishing write tid 2 to trial11845692-35 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: finishing write tid 3 to trial11845692-35 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: finishing write tid 4 to trial11845692-35 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: finishing write tid 5 to trial11845692-35 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: oid 35 updating version 0 to 1687 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: oid 35 version 1687 is already newer than 1684 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: oid 35 version 1687 is already newer than 1685 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: oid 35 version 1687 is already newer than 1686 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1687 (ObjNum 1053 snap 316 seq_num 1053) dirty exists 2026-02-17T05:40:32.569 INFO:tasks.rados.rados.0.trial118.stdout:2981: left oid 35 (ObjNum 1053 snap 316 seq_num 1053) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2969: done (11 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2970: done (10 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2971: done (9 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2972: done (8 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2973: done (7 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2974: done (6 left) 2026-02-17T05:40:33.358 INFO:tasks.rados.rados.0.trial118.stdout:2976: done (5 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2978: done (4 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2979: done (3 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2980: done (2 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2981: done (1 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2982: done (0 left) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2983: rollback oid 38 current snap is 317 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 290 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2984: read oid 23 snap -1 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2984: expect (ObjNum 1033 snap 312 seq_num 1033) 2026-02-17T05:40:33.359 INFO:tasks.rados.rados.0.trial118.stdout:2985: snap_create 2026-02-17T05:40:33.360 INFO:tasks.rados.rados.0.trial118.stdout:2983: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:40:33.360 INFO:tasks.rados.rados.0.trial118.stdout:2983: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:40:33.360 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1769 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:40:33.362 INFO:tasks.rados.rados.0.trial118.stdout:2984: expect (ObjNum 1033 snap 312 seq_num 1033) 2026-02-17T05:40:33.382 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:34.361 INFO:tasks.rados.rados.0.trial118.stdout:2983: done (2 left) 2026-02-17T05:40:34.361 INFO:tasks.rados.rados.0.trial118.stdout:2984: done (1 left) 2026-02-17T05:40:34.361 INFO:tasks.rados.rados.0.trial118.stdout:2985: done (0 left) 2026-02-17T05:40:34.361 INFO:tasks.rados.rados.0.trial118.stdout:2986: write oid 17 current snap is 318 2026-02-17T05:40:34.361 INFO:tasks.rados.rados.0.trial118.stdout:2986: seq_num 1054 ranges {514578=569160,1677668=414031,2577952=641878} 2026-02-17T05:40:34.364 INFO:tasks.rados.rados.0.trial118.stdout:2986: writing trial11845692-17 from 514578 to 1083738 tid 1 2026-02-17T05:40:34.368 INFO:tasks.rados.rados.0.trial118.stdout:2986: writing trial11845692-17 from 1677668 to 2091699 tid 2 2026-02-17T05:40:34.373 INFO:tasks.rados.rados.0.trial118.stdout:2986: writing trial11845692-17 from 2577952 to 3219830 tid 3 2026-02-17T05:40:34.373 INFO:tasks.rados.rados.0.trial118.stdout:2987: rollback oid 18 current snap is 318 2026-02-17T05:40:34.373 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 293 2026-02-17T05:40:34.373 INFO:tasks.rados.rados.0.trial118.stdout:2986: finishing write tid 1 to trial11845692-17 2026-02-17T05:40:34.374 INFO:tasks.rados.rados.0.trial118.stdout:2986: finishing write tid 2 to trial11845692-17 2026-02-17T05:40:34.374 INFO:tasks.rados.rados.0.trial118.stdout:2988: delete oid 32 current snap is 318 2026-02-17T05:40:34.375 INFO:tasks.rados.rados.0.trial118.stdout:2986: finishing write tid 3 to trial11845692-17 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: finishing write tid 4 to trial11845692-17 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: finishing write tid 5 to trial11845692-17 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: oid 17 updating version 0 to 1477 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: oid 17 version 1477 is already newer than 1475 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: oid 17 version 1477 is already newer than 1474 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: oid 17 version 1477 is already newer than 1476 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1477 (ObjNum 1054 snap 318 seq_num 1054) dirty exists 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: left oid 17 (ObjNum 1054 snap 318 seq_num 1054) 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2986: done (2 left) 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2988: done (1 left) 2026-02-17T05:40:34.376 INFO:tasks.rados.rados.0.trial118.stdout:2989: write (excl) oid 42 current snap is 318 2026-02-17T05:40:34.377 INFO:tasks.rados.rados.0.trial118.stdout:2989: seq_num 1056 ranges {548192=719658,1678279=417700,2516445=780775} 2026-02-17T05:40:34.380 INFO:tasks.rados.rados.0.trial118.stdout:2989: writing trial11845692-42 from 548192 to 1267850 tid 1 2026-02-17T05:40:34.383 INFO:tasks.rados.rados.0.trial118.stdout:2989: writing trial11845692-42 from 1678279 to 2095979 tid 2 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2989: writing trial11845692-42 from 2516445 to 3297220 tid 3 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2990: snap_remove snap 257 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2987: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2987: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2987: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1555 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2989: finishing write tid 1 to trial11845692-42 2026-02-17T05:40:34.389 INFO:tasks.rados.rados.0.trial118.stdout:2989: finishing write tid 2 to trial11845692-42 2026-02-17T05:40:35.361 INFO:tasks.rados.rados.0.trial118.stdout:2987: done (2 left) 2026-02-17T05:40:35.361 INFO:tasks.rados.rados.0.trial118.stdout:2990: done (1 left) 2026-02-17T05:40:35.361 INFO:tasks.rados.rados.0.trial118.stdout:2991: write oid 39 current snap is 318 2026-02-17T05:40:35.361 INFO:tasks.rados.rados.0.trial118.stdout:2991: seq_num 1057 ranges {564999=511260,1853114=561358,3060221=592047} 2026-02-17T05:40:35.364 INFO:tasks.rados.rados.0.trial118.stdout:2991: writing trial11845692-39 from 564999 to 1076259 tid 1 2026-02-17T05:40:35.369 INFO:tasks.rados.rados.0.trial118.stdout:2991: writing trial11845692-39 from 1853114 to 2414472 tid 2 2026-02-17T05:40:35.374 INFO:tasks.rados.rados.0.trial118.stdout:2991: writing trial11845692-39 from 3060221 to 3652268 tid 3 2026-02-17T05:40:35.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: write oid 14 current snap is 318 2026-02-17T05:40:35.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: seq_num 1058 ranges {581806=586509,1911596=421369,3087644=403319} 2026-02-17T05:40:35.378 INFO:tasks.rados.rados.0.trial118.stdout:2992: writing trial11845692-14 from 581806 to 1168315 tid 1 2026-02-17T05:40:35.382 INFO:tasks.rados.rados.0.trial118.stdout:2992: writing trial11845692-14 from 1911596 to 2332965 tid 2 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:2992: writing trial11845692-14 from 3087644 to 3490963 tid 3 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:2993: rollback oid 22 current snap is 318 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 305 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:2989: finishing write tid 3 to trial11845692-42 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:2994: write (excl) oid 46 current snap is 318 2026-02-17T05:40:35.388 INFO:tasks.rados.rados.0.trial118.stdout:2994: seq_num 1059 ranges {598613=661758,1970078=565027,3115067=614591} 2026-02-17T05:40:35.392 INFO:tasks.rados.rados.0.trial118.stdout:2994: writing trial11845692-46 from 598613 to 1260371 tid 1 2026-02-17T05:40:35.397 INFO:tasks.rados.rados.0.trial118.stdout:2994: writing trial11845692-46 from 1970078 to 2535105 tid 2 2026-02-17T05:40:35.401 INFO:tasks.rados.rados.0.trial118.stdout:2994: writing trial11845692-46 from 3115067 to 3729658 tid 3 2026-02-17T05:40:35.401 INFO:tasks.rados.rados.0.trial118.stdout:2995: snap_remove snap 316 2026-02-17T05:40:36.366 INFO:tasks.rados.rados.0.trial118.stdout:2995: done (5 left) 2026-02-17T05:40:36.366 INFO:tasks.rados.rados.0.trial118.stdout:2996: write (excl) oid 6 current snap is 318 2026-02-17T05:40:36.366 INFO:tasks.rados.rados.0.trial118.stdout:2996: seq_num 1060 ranges {615420=737007,1912207=425038,3026137=542216} 2026-02-17T05:40:36.371 INFO:tasks.rados.rados.0.trial118.stdout:2996: writing trial11845692-6 from 615420 to 1352427 tid 1 2026-02-17T05:40:36.374 INFO:tasks.rados.rados.0.trial118.stdout:2996: writing trial11845692-6 from 1912207 to 2337245 tid 2 2026-02-17T05:40:36.379 INFO:tasks.rados.rados.0.trial118.stdout:2996: writing trial11845692-6 from 3026137 to 3568353 tid 3 2026-02-17T05:40:36.379 INFO:tasks.rados.rados.0.trial118.stdout:2997: write oid 17 current snap is 318 2026-02-17T05:40:36.379 INFO:tasks.rados.rados.0.trial118.stdout:2997: seq_num 1061 ranges {632227=412256,1570689=568696,2653560=753488} 2026-02-17T05:40:36.382 INFO:tasks.rados.rados.0.trial118.stdout:2997: writing trial11845692-17 from 632227 to 1044483 tid 1 2026-02-17T05:40:36.387 INFO:tasks.rados.rados.0.trial118.stdout:2997: writing trial11845692-17 from 1570689 to 2139385 tid 2 2026-02-17T05:40:36.391 INFO:tasks.rados.rados.0.trial118.stdout:2997: writing trial11845692-17 from 2653560 to 3407048 tid 3 2026-02-17T05:40:36.392 INFO:tasks.rados.rados.0.trial118.stdout:2998: write oid 25 current snap is 318 2026-02-17T05:40:36.392 INFO:tasks.rados.rados.0.trial118.stdout:2998: seq_num 1062 ranges {649034=487505,1629171=428707,2680983=564760,3798768=50266} 2026-02-17T05:40:36.395 INFO:tasks.rados.rados.0.trial118.stdout:2998: writing trial11845692-25 from 649034 to 1136539 tid 1 2026-02-17T05:40:36.399 INFO:tasks.rados.rados.0.trial118.stdout:2998: writing trial11845692-25 from 1629171 to 2057878 tid 2 2026-02-17T05:40:36.403 INFO:tasks.rados.rados.0.trial118.stdout:2998: writing trial11845692-25 from 2680983 to 3245743 tid 3 2026-02-17T05:40:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2998: writing trial11845692-25 from 3798768 to 3849034 tid 4 2026-02-17T05:40:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2999: write (excl) oid 49 current snap is 318 2026-02-17T05:40:36.406 INFO:tasks.rados.rados.0.trial118.stdout:2999: seq_num 1063 ranges {665841=562754,1687653=572365,2708406=776032} 2026-02-17T05:40:36.410 INFO:tasks.rados.rados.0.trial118.stdout:2999: writing trial11845692-49 from 665841 to 1228595 tid 1 2026-02-17T05:40:36.414 INFO:tasks.rados.rados.0.trial118.stdout:2999: writing trial11845692-49 from 1687653 to 2260018 tid 2 2026-02-17T05:40:36.419 INFO:tasks.rados.rados.0.trial118.stdout:2999: writing trial11845692-49 from 2708406 to 3484438 tid 3 2026-02-17T05:40:36.419 INFO:tasks.rados.rados.0.trial118.stdout:3000: read oid 15 snap 290 2026-02-17T05:40:36.419 INFO:tasks.rados.rados.0.trial118.stdout:3000: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:36.419 INFO:tasks.rados.rados.0.trial118.stdout:3001: snap_remove snap 313 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:3001: done (10 left) 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:3002: rollback oid 34 current snap is 318 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 251 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:2989: finishing write tid 4 to trial11845692-42 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:2989: finishing write tid 5 to trial11845692-42 2026-02-17T05:40:37.371 INFO:tasks.rados.rados.0.trial118.stdout:2989: oid 42 updating version 0 to 1770 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2989: oid 42 updating version 1770 to 1773 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2989: oid 42 version 1773 is already newer than 1771 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2989: oid 42 version 1773 is already newer than 1772 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1773 (ObjNum 1056 snap 318 seq_num 1056) dirty exists 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2989: left oid 42 (ObjNum 1056 snap 318 seq_num 1056) 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2991: finishing write tid 1 to trial11845692-39 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2991: finishing write tid 2 to trial11845692-39 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2989: done (10 left) 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:3003: copy_from oid 19 from oid 24 current snap is 318 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2991: finishing write tid 3 to trial11845692-39 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2991: finishing write tid 4 to trial11845692-39 2026-02-17T05:40:37.372 INFO:tasks.rados.rados.0.trial118.stdout:2991: finishing write tid 5 to trial11845692-39 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2991: oid 39 updating version 0 to 1775 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2991: oid 39 version 1775 is already newer than 1774 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2991: oid 39 updating version 1775 to 1777 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2991: oid 39 version 1777 is already newer than 1776 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1777 (ObjNum 1057 snap 318 seq_num 1057) dirty exists 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2991: left oid 39 (ObjNum 1057 snap 318 seq_num 1057) 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2992: finishing write tid 1 to trial11845692-14 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2992: finishing write tid 2 to trial11845692-14 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2992: finishing write tid 3 to trial11845692-14 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2992: finishing write tid 4 to trial11845692-14 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2993: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:40:37.373 INFO:tasks.rados.rados.0.trial118.stdout:2992: finishing write tid 5 to trial11845692-14 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: oid 14 updating version 0 to 1296 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: oid 14 version 1296 is already newer than 1295 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: oid 14 updating version 1296 to 1297 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: oid 14 version 1297 is already newer than 1294 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1297 (ObjNum 1058 snap 318 seq_num 1058) dirty exists 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2992: left oid 14 (ObjNum 1058 snap 318 seq_num 1058) 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2993: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1669 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2994: finishing write tid 1 to trial11845692-46 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2994: finishing write tid 2 to trial11845692-46 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2994: finishing write tid 3 to trial11845692-46 2026-02-17T05:40:37.374 INFO:tasks.rados.rados.0.trial118.stdout:2994: finishing write tid 4 to trial11845692-46 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: finishing write tid 5 to trial11845692-46 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: oid 46 updating version 0 to 1478 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: oid 46 updating version 1478 to 1479 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: oid 46 updating version 1479 to 1481 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: oid 46 version 1481 is already newer than 1480 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1481 (ObjNum 1059 snap 318 seq_num 1059) dirty exists 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: left oid 46 (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2991: done (10 left) 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2992: done (9 left) 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2993: done (8 left) 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:2994: done (7 left) 2026-02-17T05:40:37.375 INFO:tasks.rados.rados.0.trial118.stdout:3004: write (excl) oid 2 current snap is 318 2026-02-17T05:40:37.376 INFO:tasks.rados.rados.0.trial118.stdout:3004: seq_num 1064 ranges {682648=638003,2029782=432376,3019476=587304} 2026-02-17T05:40:37.376 INFO:tasks.rados.rados.0.trial118.stdout:3004: writing trial11845692-2 from 682648 to 1320651 tid 1 2026-02-17T05:40:37.378 INFO:tasks.rados.rados.0.trial118.stdout:3004: writing trial11845692-2 from 2029782 to 2462158 tid 2 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:3004: writing trial11845692-2 from 3019476 to 3606780 tid 3 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:3005: rollback oid 38 current snap is 318 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 290 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:2996: finishing write tid 1 to trial11845692-6 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:2996: finishing write tid 2 to trial11845692-6 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:2996: finishing write tid 3 to trial11845692-6 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:2996: finishing write tid 4 to trial11845692-6 2026-02-17T05:40:37.384 INFO:tasks.rados.rados.0.trial118.stdout:2996: finishing write tid 5 to trial11845692-6 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: oid 6 updating version 0 to 1466 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: oid 6 updating version 1466 to 1468 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: oid 6 version 1468 is already newer than 1467 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: oid 6 version 1468 is already newer than 1465 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1468 (ObjNum 1060 snap 318 seq_num 1060) dirty exists 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: left oid 6 (ObjNum 1060 snap 318 seq_num 1060) 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2997: finishing write tid 1 to trial11845692-17 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2996: done (8 left) 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:3006: snap_create 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2997: finishing write tid 2 to trial11845692-17 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2997: finishing write tid 3 to trial11845692-17 2026-02-17T05:40:37.385 INFO:tasks.rados.rados.0.trial118.stdout:2997: finishing write tid 4 to trial11845692-17 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: finishing write tid 5 to trial11845692-17 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: oid 17 updating version 0 to 1485 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: oid 17 version 1485 is already newer than 1484 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: oid 17 version 1485 is already newer than 1482 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: oid 17 version 1485 is already newer than 1483 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1485 (ObjNum 1061 snap 318 seq_num 1061) dirty exists 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2997: left oid 17 (ObjNum 1061 snap 318 seq_num 1061) 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 1 to trial11845692-25 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 2 to trial11845692-25 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 3 to trial11845692-25 2026-02-17T05:40:37.386 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 4 to trial11845692-25 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 5 to trial11845692-25 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: finishing write tid 6 to trial11845692-25 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: oid 25 updating version 0 to 1812 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: oid 25 updating version 1812 to 1815 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: oid 25 version 1815 is already newer than 1814 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: oid 25 version 1815 is already newer than 1811 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: oid 25 version 1815 is already newer than 1813 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1815 (ObjNum 1062 snap 318 seq_num 1062) dirty exists 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2998: left oid 25 (ObjNum 1062 snap 318 seq_num 1062) 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2999: finishing write tid 1 to trial11845692-49 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2999: finishing write tid 2 to trial11845692-49 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2999: finishing write tid 3 to trial11845692-49 2026-02-17T05:40:37.387 INFO:tasks.rados.rados.0.trial118.stdout:2999: finishing write tid 4 to trial11845692-49 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: finishing write tid 5 to trial11845692-49 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: oid 49 updating version 0 to 1291 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: oid 49 updating version 1291 to 1292 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: oid 49 version 1292 is already newer than 1290 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: oid 49 version 1292 is already newer than 1289 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1292 (ObjNum 1063 snap 318 seq_num 1063) dirty exists 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:2999: left oid 49 (ObjNum 1063 snap 318 seq_num 1063) 2026-02-17T05:40:37.388 INFO:tasks.rados.rados.0.trial118.stdout:3000: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:37.393 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3483825 2026-02-17T05:40:37.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3288169 2026-02-17T05:40:37.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:37.443 INFO:tasks.rados.rados.0.trial118.stdout:3003: finishing copy_from to trial11845692-19 2026-02-17T05:40:37.443 INFO:tasks.rados.rados.0.trial118.stdout:3003: got expected ENOENT (src dne) 2026-02-17T05:40:37.443 INFO:tasks.rados.rados.0.trial118.stdout:3003: finishing copy_from racing read to trial11845692-19 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3002: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3002: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3002: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1558 (ObjNum 782 snap 229 seq_num 782) dirty exists 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: finishing write tid 1 to trial11845692-2 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: finishing write tid 2 to trial11845692-2 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: finishing write tid 3 to trial11845692-2 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: finishing write tid 4 to trial11845692-2 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: finishing write tid 5 to trial11845692-2 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: oid 2 updating version 0 to 1948 2026-02-17T05:40:37.444 INFO:tasks.rados.rados.0.trial118.stdout:3004: oid 2 updating version 1948 to 1950 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3004: oid 2 version 1950 is already newer than 1949 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3004: oid 2 version 1950 is already newer than 1947 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1950 (ObjNum 1064 snap 318 seq_num 1064) dirty exists 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3004: left oid 2 (ObjNum 1064 snap 318 seq_num 1064) 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3005: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3005: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:3005: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:40:37.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1780 (ObjNum 802 snap 242 seq_num 802) dirty exists 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:2997: done (8 left) 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:2998: done (7 left) 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:2999: done (6 left) 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:3000: done (5 left) 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:3002: done (4 left) 2026-02-17T05:40:38.372 INFO:tasks.rados.rados.0.trial118.stdout:3003: done (3 left) 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3004: done (2 left) 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3005: done (1 left) 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3006: done (0 left) 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3007: copy_from oid 17 from oid 30 current snap is 319 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3008: copy_from oid 4 from oid 26 current snap is 319 2026-02-17T05:40:38.373 INFO:tasks.rados.rados.0.trial118.stdout:3009: snap_remove snap 271 2026-02-17T05:40:39.373 INFO:tasks.rados.rados.0.trial118.stdout:3009: done (2 left) 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3010: rollback oid 33 current snap is 319 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 301 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3007: finishing copy_from to trial11845692-17 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3007: got expected ENOENT (src dne) 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3007: finishing copy_from racing read to trial11845692-17 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3008: finishing copy_from racing read to trial11845692-4 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3008: finishing copy_from to trial11845692-4 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1455 (ObjNum 977 snap 294 seq_num 977) dirty exists 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3007: done (2 left) 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3008: done (1 left) 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3011: rollback oid 3 current snap is 319 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 314 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3012: write (excl) oid 42 current snap is 319 2026-02-17T05:40:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3012: seq_num 1065 ranges {699455=429605,1804617=576034,3163252=514929} 2026-02-17T05:40:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3012: writing trial11845692-42 from 699455 to 1129060 tid 1 2026-02-17T05:40:39.383 INFO:tasks.rados.rados.0.trial118.stdout:3012: writing trial11845692-42 from 1804617 to 2380651 tid 2 2026-02-17T05:40:39.388 INFO:tasks.rados.rados.0.trial118.stdout:3012: writing trial11845692-42 from 3163252 to 3678181 tid 3 2026-02-17T05:40:39.388 INFO:tasks.rados.rados.0.trial118.stdout:3013: write (excl) oid 45 current snap is 319 2026-02-17T05:40:39.388 INFO:tasks.rados.rados.0.trial118.stdout:3011: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1667 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:3010: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:3010: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1819 (ObjNum 969 snap 292 seq_num 969) dirty exists 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:3012: finishing write tid 1 to trial11845692-42 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:3012: finishing write tid 2 to trial11845692-42 2026-02-17T05:40:39.389 INFO:tasks.rados.rados.0.trial118.stdout:3013: seq_num 1066 ranges {716262=504854,1863099=719692,3074322=726201} 2026-02-17T05:40:39.392 INFO:tasks.rados.rados.0.trial118.stdout:3013: writing trial11845692-45 from 716262 to 1221116 tid 1 2026-02-17T05:40:39.398 INFO:tasks.rados.rados.0.trial118.stdout:3013: writing trial11845692-45 from 1863099 to 2582791 tid 2 2026-02-17T05:40:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3013: writing trial11845692-45 from 3074322 to 3800523 tid 3 2026-02-17T05:40:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3010: done (3 left) 2026-02-17T05:40:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3011: done (2 left) 2026-02-17T05:40:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3014: write oid 11 current snap is 319 2026-02-17T05:40:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3014: seq_num 1067 ranges {733069=580103,1921581=579703,3218098=537473} 2026-02-17T05:40:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3014: writing trial11845692-11 from 733069 to 1313172 tid 1 2026-02-17T05:40:39.411 INFO:tasks.rados.rados.0.trial118.stdout:3014: writing trial11845692-11 from 1921581 to 2501284 tid 2 2026-02-17T05:40:39.416 INFO:tasks.rados.rados.0.trial118.stdout:3014: writing trial11845692-11 from 3218098 to 3755571 tid 3 2026-02-17T05:40:39.417 INFO:tasks.rados.rados.0.trial118.stdout:3015: write (excl) oid 33 current snap is 319 2026-02-17T05:40:39.417 INFO:tasks.rados.rados.0.trial118.stdout:3015: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2026-02-17T05:40:39.422 INFO:tasks.rados.rados.0.trial118.stdout:3015: writing trial11845692-33 from 749876 to 1405228 tid 1 2026-02-17T05:40:39.426 INFO:tasks.rados.rados.0.trial118.stdout:3015: writing trial11845692-33 from 1863710 to 2587071 tid 2 2026-02-17T05:40:39.430 INFO:tasks.rados.rados.0.trial118.stdout:3015: writing trial11845692-33 from 3012815 to 3761560 tid 3 2026-02-17T05:40:39.431 INFO:tasks.rados.rados.0.trial118.stdout:3016: snap_remove snap 293 2026-02-17T05:40:40.339 INFO:tasks.rados.rados.0.trial118.stdout:3016: done (4 left) 2026-02-17T05:40:40.339 INFO:tasks.rados.rados.0.trial118.stdout:3017: snap_remove snap 315 2026-02-17T05:40:41.343 INFO:tasks.rados.rados.0.trial118.stdout:3017: done (4 left) 2026-02-17T05:40:41.343 INFO:tasks.rados.rados.0.trial118.stdout:3018: copy_from oid 17 from oid 3 current snap is 319 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: finishing write tid 3 to trial11845692-42 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: finishing write tid 4 to trial11845692-42 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: finishing write tid 5 to trial11845692-42 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: oid 42 updating version 0 to 1782 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: oid 42 updating version 1782 to 1783 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: oid 42 updating version 1783 to 1784 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: oid 42 version 1784 is already newer than 1781 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1784 (ObjNum 1065 snap 319 seq_num 1065) dirty exists 2026-02-17T05:40:41.344 INFO:tasks.rados.rados.0.trial118.stdout:3012: left oid 42 (ObjNum 1065 snap 319 seq_num 1065) 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: finishing write tid 1 to trial11845692-45 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: finishing write tid 2 to trial11845692-45 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: finishing write tid 3 to trial11845692-45 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: finishing write tid 4 to trial11845692-45 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: finishing write tid 5 to trial11845692-45 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: oid 45 updating version 0 to 1670 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: oid 45 updating version 1670 to 1673 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: oid 45 version 1673 is already newer than 1671 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: oid 45 version 1673 is already newer than 1672 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1673 (ObjNum 1066 snap 319 seq_num 1066) dirty exists 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3013: left oid 45 (ObjNum 1066 snap 319 seq_num 1066) 2026-02-17T05:40:41.345 INFO:tasks.rados.rados.0.trial118.stdout:3012: done (4 left) 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3013: done (3 left) 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3019: read oid 20 snap 305 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3019: expect deleted 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3020: rollback oid 21 current snap is 319 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 311 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: finishing write tid 1 to trial11845692-11 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: finishing write tid 2 to trial11845692-11 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: finishing write tid 3 to trial11845692-11 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: finishing write tid 4 to trial11845692-11 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: finishing write tid 5 to trial11845692-11 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: oid 11 updating version 0 to 1962 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: oid 11 updating version 1962 to 1964 2026-02-17T05:40:41.346 INFO:tasks.rados.rados.0.trial118.stdout:3014: oid 11 version 1964 is already newer than 1961 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3014: oid 11 version 1964 is already newer than 1963 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1964 (ObjNum 1067 snap 319 seq_num 1067) dirty exists 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3014: left oid 11 (ObjNum 1067 snap 319 seq_num 1067) 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: finishing write tid 1 to trial11845692-33 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: finishing write tid 2 to trial11845692-33 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: finishing write tid 3 to trial11845692-33 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: finishing write tid 4 to trial11845692-33 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: finishing write tid 5 to trial11845692-33 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: oid 33 updating version 0 to 1830 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: oid 33 updating version 1830 to 1831 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: oid 33 updating version 1831 to 1832 2026-02-17T05:40:41.347 INFO:tasks.rados.rados.0.trial118.stdout:3015: oid 33 updating version 1832 to 1833 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1833 (ObjNum 1068 snap 319 seq_num 1068) dirty exists 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:3015: left oid 33 (ObjNum 1068 snap 319 seq_num 1068) 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:3014: done (4 left) 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:3015: done (3 left) 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:3021: rollback oid 45 current snap is 319 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 45 to 314 2026-02-17T05:40:41.348 INFO:tasks.rados.rados.0.trial118.stdout:3022: delete oid 29 current snap is 319 2026-02-17T05:40:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3018: finishing copy_from to trial11845692-17 2026-02-17T05:40:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3018: got expected ENOENT (src dne) 2026-02-17T05:40:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3018: finishing copy_from racing read to trial11845692-17 2026-02-17T05:40:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3018: done (4 left) 2026-02-17T05:40:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3019: done (3 left) 2026-02-17T05:40:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3022: done (2 left) 2026-02-17T05:40:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3023: write (excl) oid 26 current snap is 319 2026-02-17T05:40:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3023: seq_num 1070 ranges {783490=405850,1980674=727030,3184014=487642} 2026-02-17T05:40:41.351 INFO:tasks.rados.rados.0.trial118.stdout:3023: writing trial11845692-26 from 783490 to 1189340 tid 1 2026-02-17T05:40:41.356 INFO:tasks.rados.rados.0.trial118.stdout:3023: writing trial11845692-26 from 1980674 to 2707704 tid 2 2026-02-17T05:40:41.360 INFO:tasks.rados.rados.0.trial118.stdout:3023: writing trial11845692-26 from 3184014 to 3671656 tid 3 2026-02-17T05:40:41.360 INFO:tasks.rados.rados.0.trial118.stdout:3024: copy_from oid 11 from oid 41 current snap is 319 2026-02-17T05:40:41.360 INFO:tasks.rados.rados.0.trial118.stdout:3021: finishing rollback tid 0 to trial11845692-45 2026-02-17T05:40:41.361 INFO:tasks.rados.rados.0.trial118.stdout:3021: finishing rollback tid 1 to trial11845692-45 2026-02-17T05:40:41.361 INFO:tasks.rados.rados.0.trial118.stdout:3020: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:40:41.361 INFO:tasks.rados.rados.0.trial118.stdout:3025: copy_from oid 10 from oid 9 current snap is 319 2026-02-17T05:40:41.361 INFO:tasks.rados.rados.0.trial118.stdout:3021: finishing rollback tid 2 to trial11845692-45 2026-02-17T05:40:41.361 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1676 (ObjNum 763 snap 227 seq_num 763) dirty exists 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3020: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3020: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1845 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3023: finishing write tid 1 to trial11845692-26 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3020: done (4 left) 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3021: done (3 left) 2026-02-17T05:40:41.362 INFO:tasks.rados.rados.0.trial118.stdout:3026: rollback oid 43 current snap is 319 2026-02-17T05:40:41.363 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 318 2026-02-17T05:40:41.363 INFO:tasks.rados.rados.0.trial118.stdout:3023: finishing write tid 2 to trial11845692-26 2026-02-17T05:40:41.363 INFO:tasks.rados.rados.0.trial118.stdout:3027: write oid 7 current snap is 319 2026-02-17T05:40:41.363 INFO:tasks.rados.rados.0.trial118.stdout:3027: seq_num 1071 ranges {400297=481099,1639156=361141} 2026-02-17T05:40:41.364 INFO:tasks.rados.rados.0.trial118.stdout:3027: writing trial11845692-7 from 400297 to 881396 tid 1 2026-02-17T05:40:41.367 INFO:tasks.rados.rados.0.trial118.stdout:3027: writing trial11845692-7 from 1639156 to 2000297 tid 2 2026-02-17T05:40:41.367 INFO:tasks.rados.rados.0.trial118.stdout:3028: read oid 21 snap 290 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3028: expect deleted 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3029: delete oid 50 current snap is 319 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3026: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1471 (ObjNum 33 snap 0 seq_num 2) dirty dne 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: finishing write tid 3 to trial11845692-26 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: finishing write tid 4 to trial11845692-26 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: finishing write tid 5 to trial11845692-26 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: oid 26 updating version 0 to 1459 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: oid 26 version 1459 is already newer than 1457 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: oid 26 version 1459 is already newer than 1456 2026-02-17T05:40:41.368 INFO:tasks.rados.rados.0.trial118.stdout:3023: oid 26 version 1459 is already newer than 1458 2026-02-17T05:40:41.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1459 (ObjNum 1070 snap 319 seq_num 1070) dirty exists 2026-02-17T05:40:41.369 INFO:tasks.rados.rados.0.trial118.stdout:3023: left oid 26 (ObjNum 1070 snap 319 seq_num 1070) 2026-02-17T05:40:41.369 INFO:tasks.rados.rados.0.trial118.stdout:3023: done (6 left) 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3026: done (5 left) 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3028: done (4 left) 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3029: done (3 left) 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3030: rollback oid 15 current snap is 319 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 311 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3031: write (excl) oid 45 current snap is 319 2026-02-17T05:40:41.370 INFO:tasks.rados.rados.0.trial118.stdout:3031: seq_num 1073 ranges {433911=747950,1756120=277791} 2026-02-17T05:40:41.373 INFO:tasks.rados.rados.0.trial118.stdout:3031: writing trial11845692-45 from 433911 to 1181861 tid 1 2026-02-17T05:40:41.378 INFO:tasks.rados.rados.0.trial118.stdout:3031: writing trial11845692-45 from 1756120 to 2033911 tid 2 2026-02-17T05:40:41.379 INFO:tasks.rados.rados.0.trial118.stdout:3032: rollback oid 37 current snap is 319 2026-02-17T05:40:41.379 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 318 2026-02-17T05:40:41.379 INFO:tasks.rados.rados.0.trial118.stdout:3024: finishing copy_from racing read to trial11845692-11 2026-02-17T05:40:41.379 INFO:tasks.rados.rados.0.trial118.stdout:3024: finishing copy_from to trial11845692-11 2026-02-17T05:40:41.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 1697 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3025: finishing copy_from racing read to trial11845692-10 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3027: finishing write tid 1 to trial11845692-7 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3025: finishing copy_from to trial11845692-10 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1708 (ObjNum 1046 snap 314 seq_num 1046) dirty exists 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3027: finishing write tid 2 to trial11845692-7 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3027: finishing write tid 3 to trial11845692-7 2026-02-17T05:40:41.380 INFO:tasks.rados.rados.0.trial118.stdout:3027: finishing write tid 4 to trial11845692-7 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3027: oid 7 updating version 0 to 1778 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3027: oid 7 version 1778 is already newer than 1777 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3027: oid 7 updating version 1778 to 1779 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1779 (ObjNum 1071 snap 319 seq_num 1071) dirty exists 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3027: left oid 7 (ObjNum 1071 snap 319 seq_num 1071) 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3030: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:40:41.381 INFO:tasks.rados.rados.0.trial118.stdout:3024: done (5 left) 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3025: done (4 left) 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3027: done (3 left) 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3033: read oid 7 snap -1 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3033: expect (ObjNum 1071 snap 319 seq_num 1071) 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3034: read oid 10 snap -1 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3034: expect (ObjNum 1046 snap 314 seq_num 1046) 2026-02-17T05:40:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3035: snap_remove snap 317 2026-02-17T05:40:42.345 INFO:tasks.rados.rados.0.trial118.stdout:3035: done (5 left) 2026-02-17T05:40:42.345 INFO:tasks.rados.rados.0.trial118.stdout:3036: snap_create 2026-02-17T05:40:42.345 INFO:tasks.rados.rados.0.trial118.stdout:3030: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:40:42.345 INFO:tasks.rados.rados.0.trial118.stdout:3030: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:40:42.345 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1679 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: finishing write tid 1 to trial11845692-45 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3032: finishing rollback tid 0 to trial11845692-37 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3032: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: finishing write tid 2 to trial11845692-45 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3032: finishing rollback tid 2 to trial11845692-37 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1177 (ObjNum 1050 snap 316 seq_num 1050) dirty exists 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: finishing write tid 3 to trial11845692-45 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: finishing write tid 4 to trial11845692-45 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: oid 45 updating version 0 to 1680 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: oid 45 updating version 1680 to 1681 2026-02-17T05:40:42.346 INFO:tasks.rados.rados.0.trial118.stdout:3031: oid 45 updating version 1681 to 1682 2026-02-17T05:40:42.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1682 (ObjNum 1073 snap 319 seq_num 1073) dirty exists 2026-02-17T05:40:42.347 INFO:tasks.rados.rados.0.trial118.stdout:3031: left oid 45 (ObjNum 1073 snap 319 seq_num 1073) 2026-02-17T05:40:42.347 INFO:tasks.rados.rados.0.trial118.stdout:3033: expect (ObjNum 1071 snap 319 seq_num 1071) 2026-02-17T05:40:42.347 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:42.369 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:42.393 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:42.417 INFO:tasks.rados.rados.0.trial118.stdout:3034: expect (ObjNum 1046 snap 314 seq_num 1046) 2026-02-17T05:40:42.417 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:42.533 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 116915 2026-02-17T05:40:43.344 INFO:tasks.rados.rados.0.trial118.stdout:3030: done (5 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3031: done (4 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3032: done (3 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3033: done (2 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3034: done (1 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3036: done (0 left) 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3037: write oid 37 current snap is 320 2026-02-17T05:40:43.345 INFO:tasks.rados.rados.0.trial118.stdout:3037: seq_num 1074 ranges {450718=423199,1414602=636116} 2026-02-17T05:40:43.348 INFO:tasks.rados.rados.0.trial118.stdout:3037: writing trial11845692-37 from 450718 to 873917 tid 1 2026-02-17T05:40:43.353 INFO:tasks.rados.rados.0.trial118.stdout:3037: writing trial11845692-37 from 1414602 to 2050718 tid 2 2026-02-17T05:40:43.353 INFO:tasks.rados.rados.0.trial118.stdout:3038: write oid 50 current snap is 320 2026-02-17T05:40:43.353 INFO:tasks.rados.rados.0.trial118.stdout:3038: seq_num 1075 ranges {467525=498448,1473084=594379} 2026-02-17T05:40:43.356 INFO:tasks.rados.rados.0.trial118.stdout:3038: writing trial11845692-50 from 467525 to 965973 tid 1 2026-02-17T05:40:43.361 INFO:tasks.rados.rados.0.trial118.stdout:3038: writing trial11845692-50 from 1473084 to 2067463 tid 2 2026-02-17T05:40:43.361 INFO:tasks.rados.rados.0.trial118.stdout:3039: rollback oid 26 current snap is 320 2026-02-17T05:40:43.361 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 290 2026-02-17T05:40:43.361 INFO:tasks.rados.rados.0.trial118.stdout:3037: finishing write tid 1 to trial11845692-37 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: finishing write tid 2 to trial11845692-37 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: finishing write tid 3 to trial11845692-37 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: finishing write tid 4 to trial11845692-37 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: oid 37 updating version 0 to 1180 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: oid 37 version 1180 is already newer than 1178 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: oid 37 version 1180 is already newer than 1179 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1180 (ObjNum 1074 snap 320 seq_num 1074) dirty exists 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: left oid 37 (ObjNum 1074 snap 320 seq_num 1074) 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3038: finishing write tid 1 to trial11845692-50 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3037: done (2 left) 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3040: read oid 17 snap -1 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3040: expect (ObjNum 1061 snap 318 seq_num 1061) 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3041: rollback oid 47 current snap is 320 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 319 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3042: read oid 46 snap 305 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3042: expect (ObjNum 1001 snap 299 seq_num 1001) 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3043: write (excl) oid 30 current snap is 320 2026-02-17T05:40:43.362 INFO:tasks.rados.rados.0.trial118.stdout:3043: seq_num 1076 ranges {484332=573697,1531566=552766} 2026-02-17T05:40:43.365 INFO:tasks.rados.rados.0.trial118.stdout:3043: writing trial11845692-30 from 484332 to 1058029 tid 1 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3043: writing trial11845692-30 from 1531566 to 2084332 tid 2 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3044: read oid 19 snap -1 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3044: expect deleted 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3045: snap_remove snap 318 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3038: finishing write tid 2 to trial11845692-50 2026-02-17T05:40:43.369 INFO:tasks.rados.rados.0.trial118.stdout:3038: finishing write tid 3 to trial11845692-50 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3045: done (7 left) 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3046: copy_from oid 15 from oid 9 current snap is 320 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: finishing write tid 4 to trial11845692-50 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: oid 50 updating version 0 to 1481 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: oid 50 updating version 1481 to 1482 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: oid 50 version 1482 is already newer than 1480 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1482 (ObjNum 1075 snap 320 seq_num 1075) dirty exists 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: left oid 50 (ObjNum 1075 snap 320 seq_num 1075) 2026-02-17T05:40:44.352 INFO:tasks.rados.rados.0.trial118.stdout:3038: done (7 left) 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3047: rollback oid 6 current snap is 320 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 314 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3039: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3039: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3039: finishing rollback tid 2 to trial11845692-26 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1462 (ObjNum 948 snap 285 seq_num 948) dirty exists 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3039: done (7 left) 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3048: write (excl) oid 3 current snap is 320 2026-02-17T05:40:44.353 INFO:tasks.rados.rados.0.trial118.stdout:3048: seq_num 1077 ranges {501139=648946,1873695=227444} 2026-02-17T05:40:44.355 INFO:tasks.rados.rados.0.trial118.stdout:3048: writing trial11845692-3 from 501139 to 1150085 tid 1 2026-02-17T05:40:44.359 INFO:tasks.rados.rados.0.trial118.stdout:3048: writing trial11845692-3 from 1873695 to 2101139 tid 2 2026-02-17T05:40:44.359 INFO:tasks.rados.rados.0.trial118.stdout:3049: snap_remove snap 251 2026-02-17T05:40:45.352 INFO:tasks.rados.rados.0.trial118.stdout:3049: done (8 left) 2026-02-17T05:40:45.353 INFO:tasks.rados.rados.0.trial118.stdout:3050: copy_from oid 25 from oid 24 current snap is 320 2026-02-17T05:40:45.353 INFO:tasks.rados.rados.0.trial118.stdout:3043: finishing write tid 1 to trial11845692-30 2026-02-17T05:40:45.353 INFO:tasks.rados.rados.0.trial118.stdout:3040: expect (ObjNum 1061 snap 318 seq_num 1061) 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3041: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1417 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3043: finishing write tid 2 to trial11845692-30 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3043: finishing write tid 3 to trial11845692-30 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3040: done (8 left) 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3041: done (7 left) 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3044: done (6 left) 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3051: read oid 22 snap -1 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3051: expect deleted 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3052: delete oid 18 current snap is 320 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:3042: expect (ObjNum 1001 snap 299 seq_num 1001) 2026-02-17T05:40:45.602 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 93348 2026-02-17T05:40:45.622 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: finishing write tid 4 to trial11845692-30 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: oid 30 updating version 0 to 1854 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: oid 30 version 1854 is already newer than 1853 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: oid 30 version 1854 is already newer than 1852 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1854 (ObjNum 1076 snap 320 seq_num 1076) dirty exists 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: left oid 30 (ObjNum 1076 snap 320 seq_num 1076) 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3047: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3047: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1470 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: finishing write tid 1 to trial11845692-3 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3042: done (7 left) 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3043: done (6 left) 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3047: done (5 left) 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3052: done (4 left) 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3053: write oid 13 current snap is 320 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3046: finishing copy_from racing read to trial11845692-15 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: finishing write tid 2 to trial11845692-3 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: finishing write tid 3 to trial11845692-3 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: finishing write tid 4 to trial11845692-3 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: oid 3 updating version 0 to 1668 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: oid 3 updating version 1668 to 1669 2026-02-17T05:40:45.665 INFO:tasks.rados.rados.0.trial118.stdout:3048: oid 3 updating version 1669 to 1670 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1670 (ObjNum 1077 snap 320 seq_num 1077) dirty exists 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3048: left oid 3 (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3046: finishing copy_from to trial11845692-15 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1708 (ObjNum 1046 snap 314 seq_num 1046) dirty exists 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3050: finishing copy_from to trial11845692-25 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3050: got expected ENOENT (src dne) 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3050: finishing copy_from racing read to trial11845692-25 2026-02-17T05:40:45.666 INFO:tasks.rados.rados.0.trial118.stdout:3053: seq_num 1079 ranges {534753=799444,1990659=144094} 2026-02-17T05:40:45.670 INFO:tasks.rados.rados.0.trial118.stdout:3053: writing trial11845692-13 from 534753 to 1334197 tid 1 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3053: writing trial11845692-13 from 1990659 to 2134753 tid 2 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3046: done (4 left) 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3048: done (3 left) 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3050: done (2 left) 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3051: done (1 left) 2026-02-17T05:40:45.673 INFO:tasks.rados.rados.0.trial118.stdout:3054: snap_create 2026-02-17T05:40:45.675 INFO:tasks.rados.rados.0.trial118.stdout:3053: finishing write tid 1 to trial11845692-13 2026-02-17T05:40:45.675 INFO:tasks.rados.rados.0.trial118.stdout:3053: finishing write tid 2 to trial11845692-13 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: finishing write tid 3 to trial11845692-13 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: finishing write tid 4 to trial11845692-13 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: oid 13 updating version 0 to 1671 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: oid 13 updating version 1671 to 1673 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: oid 13 version 1673 is already newer than 1672 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1673 (ObjNum 1079 snap 320 seq_num 1079) dirty exists 2026-02-17T05:40:45.676 INFO:tasks.rados.rados.0.trial118.stdout:3053: left oid 13 (ObjNum 1079 snap 320 seq_num 1079) 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3053: done (1 left) 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3054: done (0 left) 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3055: copy_from oid 45 from oid 41 current snap is 321 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3056: read oid 16 snap -1 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3056: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3057: write (excl) oid 25 current snap is 321 2026-02-17T05:40:46.357 INFO:tasks.rados.rados.0.trial118.stdout:3057: seq_num 1080 ranges {551560=591046,1765494=386066} 2026-02-17T05:40:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3057: writing trial11845692-25 from 551560 to 1142606 tid 1 2026-02-17T05:40:46.365 INFO:tasks.rados.rados.0.trial118.stdout:3057: writing trial11845692-25 from 1765494 to 2151560 tid 2 2026-02-17T05:40:46.365 INFO:tasks.rados.rados.0.trial118.stdout:3058: rollback oid 34 current snap is 321 2026-02-17T05:40:46.365 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 305 2026-02-17T05:40:46.365 INFO:tasks.rados.rados.0.trial118.stdout:3056: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:40:46.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 192444 2026-02-17T05:40:46.433 INFO:tasks.rados.rados.0.trial118.stdout:3057: finishing write tid 1 to trial11845692-25 2026-02-17T05:40:46.434 INFO:tasks.rados.rados.0.trial118.stdout:3056: done (3 left) 2026-02-17T05:40:46.434 INFO:tasks.rados.rados.0.trial118.stdout:3059: write oid 28 current snap is 321 2026-02-17T05:40:46.434 INFO:tasks.rados.rados.0.trial118.stdout:3059: seq_num 1081 ranges {568367=666295,1707623=460744} 2026-02-17T05:40:46.438 INFO:tasks.rados.rados.0.trial118.stdout:3059: writing trial11845692-28 from 568367 to 1234662 tid 1 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3059: writing trial11845692-28 from 1707623 to 2168367 tid 2 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3060: copy_from oid 6 from oid 37 current snap is 321 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3055: finishing copy_from racing read to trial11845692-45 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: finishing write tid 2 to trial11845692-25 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: finishing write tid 3 to trial11845692-25 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: finishing write tid 4 to trial11845692-25 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: oid 25 updating version 0 to 1866 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: oid 25 updating version 1866 to 1867 2026-02-17T05:40:46.443 INFO:tasks.rados.rados.0.trial118.stdout:3057: oid 25 updating version 1867 to 1868 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 1868 (ObjNum 1080 snap 321 seq_num 1080) dirty exists 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3057: left oid 25 (ObjNum 1080 snap 321 seq_num 1080) 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3058: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3058: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3058: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1562 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3055: finishing copy_from to trial11845692-45 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1697 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3059: finishing write tid 1 to trial11845692-28 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3055: done (4 left) 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3057: done (3 left) 2026-02-17T05:40:46.444 INFO:tasks.rados.rados.0.trial118.stdout:3058: done (2 left) 2026-02-17T05:40:46.445 INFO:tasks.rados.rados.0.trial118.stdout:3061: rollback oid 7 current snap is 321 2026-02-17T05:40:46.445 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 305 2026-02-17T05:40:46.445 INFO:tasks.rados.rados.0.trial118.stdout:3062: delete oid 48 current snap is 321 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: finishing write tid 2 to trial11845692-28 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: finishing write tid 3 to trial11845692-28 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: finishing write tid 4 to trial11845692-28 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: oid 28 updating version 0 to 1565 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: oid 28 version 1565 is already newer than 1564 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: oid 28 version 1565 is already newer than 1563 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1565 (ObjNum 1081 snap 321 seq_num 1081) dirty exists 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: left oid 28 (ObjNum 1081 snap 321 seq_num 1081) 2026-02-17T05:40:46.446 INFO:tasks.rados.rados.0.trial118.stdout:3059: done (3 left) 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3062: done (2 left) 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3063: rollback oid 20 current snap is 321 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 311 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3064: read oid 46 snap 314 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3064: expect deleted 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3065: write (excl) oid 28 current snap is 321 2026-02-17T05:40:46.447 INFO:tasks.rados.rados.0.trial118.stdout:3065: seq_num 1083 ranges {601981=416793,1424587=492702} 2026-02-17T05:40:46.448 INFO:tasks.rados.rados.0.trial118.stdout:3065: writing trial11845692-28 from 601981 to 1018774 tid 1 2026-02-17T05:40:46.451 INFO:tasks.rados.rados.0.trial118.stdout:3065: writing trial11845692-28 from 1424587 to 1917289 tid 2 2026-02-17T05:40:46.452 INFO:tasks.rados.rados.0.trial118.stdout:3066: read oid 44 snap -1 2026-02-17T05:40:46.452 INFO:tasks.rados.rados.0.trial118.stdout:3066: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:46.452 INFO:tasks.rados.rados.0.trial118.stdout:3067: snap_remove snap 301 2026-02-17T05:40:47.361 INFO:tasks.rados.rados.0.trial118.stdout:3067: done (6 left) 2026-02-17T05:40:47.361 INFO:tasks.rados.rados.0.trial118.stdout:3068: snap_create 2026-02-17T05:40:47.361 INFO:tasks.rados.rados.0.trial118.stdout:3061: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3061: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3061: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1801 (ObjNum 951 snap 286 seq_num 951) dirty exists 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3060: finishing copy_from racing read to trial11845692-6 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3060: finishing copy_from to trial11845692-6 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1180 (ObjNum 1074 snap 320 seq_num 1074) dirty exists 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3063: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3063: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1986 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3065: finishing write tid 1 to trial11845692-28 2026-02-17T05:40:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3065: finishing write tid 2 to trial11845692-28 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: finishing write tid 3 to trial11845692-28 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: finishing write tid 4 to trial11845692-28 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: oid 28 updating version 0 to 1568 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: oid 28 version 1568 is already newer than 1566 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: oid 28 version 1568 is already newer than 1567 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1568 (ObjNum 1083 snap 321 seq_num 1083) dirty exists 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3065: left oid 28 (ObjNum 1083 snap 321 seq_num 1083) 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3066: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:47.363 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:47.388 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 361531 2026-02-17T05:40:48.363 INFO:tasks.rados.rados.0.trial118.stdout:3060: done (6 left) 2026-02-17T05:40:48.363 INFO:tasks.rados.rados.0.trial118.stdout:3061: done (5 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3063: done (4 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3064: done (3 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3065: done (2 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3066: done (1 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3068: done (0 left) 2026-02-17T05:40:48.364 INFO:tasks.rados.rados.0.trial118.stdout:3069: snap_create 2026-02-17T05:40:49.366 INFO:tasks.rados.rados.0.trial118.stdout:3069: done (0 left) 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3070: read oid 13 snap -1 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3070: expect (ObjNum 1079 snap 320 seq_num 1079) 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3071: read oid 2 snap -1 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3071: expect (ObjNum 1064 snap 318 seq_num 1064) 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3072: read oid 6 snap -1 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3072: expect (ObjNum 1074 snap 320 seq_num 1074) 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3073: copy_from oid 38 from oid 8 current snap is 323 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3074: write (excl) oid 44 current snap is 323 2026-02-17T05:40:49.367 INFO:tasks.rados.rados.0.trial118.stdout:3074: seq_num 1084 ranges {618788=492042,1883069=335719} 2026-02-17T05:40:49.370 INFO:tasks.rados.rados.0.trial118.stdout:3074: writing trial11845692-44 from 618788 to 1110830 tid 1 2026-02-17T05:40:49.374 INFO:tasks.rados.rados.0.trial118.stdout:3074: writing trial11845692-44 from 1883069 to 2218788 tid 2 2026-02-17T05:40:49.374 INFO:tasks.rados.rados.0.trial118.stdout:3075: rollback oid 21 current snap is 323 2026-02-17T05:40:49.375 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 305 2026-02-17T05:40:49.375 INFO:tasks.rados.rados.0.trial118.stdout:3070: expect (ObjNum 1079 snap 320 seq_num 1079) 2026-02-17T05:40:49.375 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:49.479 INFO:tasks.rados.rados.0.trial118.stdout:3071: expect (ObjNum 1064 snap 318 seq_num 1064) 2026-02-17T05:40:49.523 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1334611 2026-02-17T05:40:49.544 INFO:tasks.rados.rados.0.trial118.stdout:3072: expect (ObjNum 1074 snap 320 seq_num 1074) 2026-02-17T05:40:49.549 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 828122 2026-02-17T05:40:49.558 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 21451 2026-02-17T05:40:49.594 INFO:tasks.rados.rados.0.trial118.stdout:3074: finishing write tid 1 to trial11845692-44 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3070: done (5 left) 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3071: done (4 left) 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3072: done (3 left) 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3076: delete oid 48 current snap is 323 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3074: finishing write tid 2 to trial11845692-44 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3075: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3074: finishing write tid 3 to trial11845692-44 2026-02-17T05:40:49.595 INFO:tasks.rados.rados.0.trial118.stdout:3074: finishing write tid 4 to trial11845692-44 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3074: oid 44 updating version 0 to 1689 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3074: oid 44 version 1689 is already newer than 1688 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3074: oid 44 updating version 1689 to 1690 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1690 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3074: left oid 44 (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3075: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:3075: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:40:49.596 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1878 (ObjNum 976 snap 294 seq_num 976) dirty exists 2026-02-17T05:40:49.597 INFO:tasks.rados.rados.0.trial118.stdout:3073: finishing copy_from racing read to trial11845692-38 2026-02-17T05:40:49.597 INFO:tasks.rados.rados.0.trial118.stdout:3073: finishing copy_from to trial11845692-38 2026-02-17T05:40:49.597 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1283 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:40:49.598 INFO:tasks.rados.rados.0.trial118.stdout:3073: done (3 left) 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3074: done (2 left) 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3075: done (1 left) 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3076: done (0 left) 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3077: rollback oid 14 current snap is 323 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 322 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3078: read oid 36 snap -1 2026-02-17T05:40:49.599 INFO:tasks.rados.rados.0.trial118.stdout:3078: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:3079: snap_create 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:3077: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:3077: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:3077: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1300 (ObjNum 1058 snap 318 seq_num 1058) dirty exists 2026-02-17T05:40:49.600 INFO:tasks.rados.rados.0.trial118.stdout:3078: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:49.626 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:49.653 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:50.342 INFO:tasks.rados.rados.0.trial118.stdout:3077: done (2 left) 2026-02-17T05:40:50.342 INFO:tasks.rados.rados.0.trial118.stdout:3078: done (1 left) 2026-02-17T05:40:50.343 INFO:tasks.rados.rados.0.trial118.stdout:3079: done (0 left) 2026-02-17T05:40:50.343 INFO:tasks.rados.rados.0.trial118.stdout:3080: write oid 20 current snap is 324 2026-02-17T05:40:50.343 INFO:tasks.rados.rados.0.trial118.stdout:3080: seq_num 1086 ranges {652402=642540,1883680=368722} 2026-02-17T05:40:50.347 INFO:tasks.rados.rados.0.trial118.stdout:3080: writing trial11845692-20 from 652402 to 1294942 tid 1 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3080: writing trial11845692-20 from 1883680 to 2252402 tid 2 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3081: rollback oid 10 current snap is 324 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 10 to 314 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3080: finishing write tid 1 to trial11845692-20 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3082: write oid 26 current snap is 324 2026-02-17T05:40:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3082: seq_num 1087 ranges {669209=717789,1942162=327047} 2026-02-17T05:40:50.356 INFO:tasks.rados.rados.0.trial118.stdout:3082: writing trial11845692-26 from 669209 to 1386998 tid 1 2026-02-17T05:40:50.359 INFO:tasks.rados.rados.0.trial118.stdout:3082: writing trial11845692-26 from 1942162 to 2269209 tid 2 2026-02-17T05:40:50.359 INFO:tasks.rados.rados.0.trial118.stdout:3083: delete oid 41 current snap is 324 2026-02-17T05:40:50.359 INFO:tasks.rados.rados.0.trial118.stdout:3080: finishing write tid 2 to trial11845692-20 2026-02-17T05:40:50.359 INFO:tasks.rados.rados.0.trial118.stdout:3080: finishing write tid 3 to trial11845692-20 2026-02-17T05:40:50.359 INFO:tasks.rados.rados.0.trial118.stdout:3080: finishing write tid 4 to trial11845692-20 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3080: oid 20 updating version 0 to 1995 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3080: oid 20 version 1995 is already newer than 1994 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3080: oid 20 version 1995 is already newer than 1993 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1995 (ObjNum 1086 snap 324 seq_num 1086) dirty exists 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3080: left oid 20 (ObjNum 1086 snap 324 seq_num 1086) 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3081: finishing rollback tid 0 to trial11845692-10 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:3081: finishing rollback tid 1 to trial11845692-10 2026-02-17T05:40:50.360 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1710 (ObjNum 81 snap 0 seq_num 1) dirty dne 2026-02-17T05:40:50.361 INFO:tasks.rados.rados.0.trial118.stdout:3082: finishing write tid 1 to trial11845692-26 2026-02-17T05:40:50.361 INFO:tasks.rados.rados.0.trial118.stdout:3082: finishing write tid 2 to trial11845692-26 2026-02-17T05:40:50.361 INFO:tasks.rados.rados.0.trial118.stdout:3082: finishing write tid 3 to trial11845692-26 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: finishing write tid 4 to trial11845692-26 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: oid 26 updating version 0 to 1465 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: oid 26 version 1465 is already newer than 1464 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: oid 26 version 1465 is already newer than 1463 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1465 (ObjNum 1087 snap 324 seq_num 1087) dirty exists 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: left oid 26 (ObjNum 1087 snap 324 seq_num 1087) 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3080: done (3 left) 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3081: done (2 left) 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3082: done (1 left) 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3083: done (0 left) 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3084: copy_from oid 38 from oid 16 current snap is 324 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3085: write (excl) oid 39 current snap is 324 2026-02-17T05:40:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3085: seq_num 1089 ranges {702823=584640,2059126=243697} 2026-02-17T05:40:50.367 INFO:tasks.rados.rados.0.trial118.stdout:3085: writing trial11845692-39 from 702823 to 1287463 tid 1 2026-02-17T05:40:50.370 INFO:tasks.rados.rados.0.trial118.stdout:3085: writing trial11845692-39 from 2059126 to 2302823 tid 2 2026-02-17T05:40:50.371 INFO:tasks.rados.rados.0.trial118.stdout:3086: read oid 15 snap 323 2026-02-17T05:40:50.371 INFO:tasks.rados.rados.0.trial118.stdout:3086: expect (ObjNum 1046 snap 314 seq_num 1046) 2026-02-17T05:40:50.371 INFO:tasks.rados.rados.0.trial118.stdout:3087: write (excl) oid 37 current snap is 324 2026-02-17T05:40:50.371 INFO:tasks.rados.rados.0.trial118.stdout:3087: seq_num 1090 ranges {719630=659889,2117608=202022} 2026-02-17T05:40:50.376 INFO:tasks.rados.rados.0.trial118.stdout:3087: writing trial11845692-37 from 719630 to 1379519 tid 1 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3087: writing trial11845692-37 from 2117608 to 2319630 tid 2 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3088: copy_from oid 44 from oid 24 current snap is 324 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3084: finishing copy_from racing read to trial11845692-38 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3084: finishing copy_from to trial11845692-38 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1705 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: finishing write tid 1 to trial11845692-39 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: finishing write tid 2 to trial11845692-39 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: finishing write tid 3 to trial11845692-39 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: finishing write tid 4 to trial11845692-39 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: oid 39 updating version 0 to 1787 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: oid 39 version 1787 is already newer than 1785 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:3085: oid 39 version 1787 is already newer than 1786 2026-02-17T05:40:50.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1787 (ObjNum 1089 snap 324 seq_num 1089) dirty exists 2026-02-17T05:40:50.380 INFO:tasks.rados.rados.0.trial118.stdout:3085: left oid 39 (ObjNum 1089 snap 324 seq_num 1089) 2026-02-17T05:40:50.380 INFO:tasks.rados.rados.0.trial118.stdout:3086: expect (ObjNum 1046 snap 314 seq_num 1046) 2026-02-17T05:40:50.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 320273 2026-02-17T05:40:50.441 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 994554 2026-02-17T05:40:50.549 INFO:tasks.rados.rados.0.trial118.stdout:3087: finishing write tid 1 to trial11845692-37 2026-02-17T05:40:50.549 INFO:tasks.rados.rados.0.trial118.stdout:3084: done (4 left) 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3085: done (3 left) 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3086: done (2 left) 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3089: snap_create 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3088: finishing copy_from to trial11845692-44 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3088: got expected ENOENT (src dne) 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3088: finishing copy_from racing read to trial11845692-44 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3087: finishing write tid 2 to trial11845692-37 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3087: finishing write tid 3 to trial11845692-37 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3087: finishing write tid 4 to trial11845692-37 2026-02-17T05:40:50.550 INFO:tasks.rados.rados.0.trial118.stdout:3087: oid 37 updating version 0 to 1181 2026-02-17T05:40:50.551 INFO:tasks.rados.rados.0.trial118.stdout:3087: oid 37 updating version 1181 to 1182 2026-02-17T05:40:50.551 INFO:tasks.rados.rados.0.trial118.stdout:3087: oid 37 updating version 1182 to 1183 2026-02-17T05:40:50.551 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1183 (ObjNum 1090 snap 324 seq_num 1090) dirty exists 2026-02-17T05:40:50.551 INFO:tasks.rados.rados.0.trial118.stdout:3087: left oid 37 (ObjNum 1090 snap 324 seq_num 1090) 2026-02-17T05:40:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3087: done (2 left) 2026-02-17T05:40:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3088: done (1 left) 2026-02-17T05:40:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3089: done (0 left) 2026-02-17T05:40:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3090: snap_create 2026-02-17T05:40:52.372 INFO:tasks.rados.rados.0.trial118.stdout:3090: done (0 left) 2026-02-17T05:40:52.372 INFO:tasks.rados.rados.0.trial118.stdout:3091: snap_create 2026-02-17T05:40:53.374 INFO:tasks.rados.rados.0.trial118.stdout:3091: done (0 left) 2026-02-17T05:40:53.374 INFO:tasks.rados.rados.0.trial118.stdout:3092: delete oid 4 current snap is 327 2026-02-17T05:40:53.378 INFO:tasks.rados.rados.0.trial118.stdout:3092: done (0 left) 2026-02-17T05:40:53.379 INFO:tasks.rados.rados.0.trial118.stdout:3093: write (excl) oid 19 current snap is 327 2026-02-17T05:40:53.379 INFO:tasks.rados.rados.0.trial118.stdout:3093: seq_num 1092 ranges {753244=410387,1834572=518672} 2026-02-17T05:40:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3093: writing trial11845692-19 from 753244 to 1163631 tid 1 2026-02-17T05:40:53.388 INFO:tasks.rados.rados.0.trial118.stdout:3093: writing trial11845692-19 from 1834572 to 2353244 tid 2 2026-02-17T05:40:53.388 INFO:tasks.rados.rados.0.trial118.stdout:3094: snap_remove snap 321 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3094: done (1 left) 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3095: snap_create 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: finishing write tid 1 to trial11845692-19 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: finishing write tid 2 to trial11845692-19 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: finishing write tid 3 to trial11845692-19 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: finishing write tid 4 to trial11845692-19 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: oid 19 updating version 0 to 1675 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: oid 19 version 1675 is already newer than 1674 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: oid 19 updating version 1675 to 1676 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1676 (ObjNum 1092 snap 327 seq_num 1092) dirty exists 2026-02-17T05:40:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3093: left oid 19 (ObjNum 1092 snap 327 seq_num 1092) 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:3093: done (1 left) 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:3095: done (0 left) 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:3096: copy_from oid 21 from oid 31 current snap is 328 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:3097: rollback oid 46 current snap is 328 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 327 2026-02-17T05:40:55.343 INFO:tasks.rados.rados.0.trial118.stdout:3098: snap_create 2026-02-17T05:40:55.347 INFO:tasks.rados.rados.0.trial118.stdout:3097: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:40:55.347 INFO:tasks.rados.rados.0.trial118.stdout:3097: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:40:55.347 INFO:tasks.rados.rados.0.trial118.stdout:3097: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:40:55.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1488 (ObjNum 1059 snap 318 seq_num 1059) dirty exists 2026-02-17T05:40:55.352 INFO:tasks.rados.rados.0.trial118.stdout:3096: finishing copy_from racing read to trial11845692-21 2026-02-17T05:40:55.353 INFO:tasks.rados.rados.0.trial118.stdout:3096: finishing copy_from to trial11845692-21 2026-02-17T05:40:55.353 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 1464 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:40:56.345 INFO:tasks.rados.rados.0.trial118.stdout:3096: done (2 left) 2026-02-17T05:40:56.345 INFO:tasks.rados.rados.0.trial118.stdout:3097: done (1 left) 2026-02-17T05:40:56.345 INFO:tasks.rados.rados.0.trial118.stdout:3098: done (0 left) 2026-02-17T05:40:56.345 INFO:tasks.rados.rados.0.trial118.stdout:3099: copy_from oid 48 from oid 11 current snap is 329 2026-02-17T05:40:56.345 INFO:tasks.rados.rados.0.trial118.stdout:3100: snap_create 2026-02-17T05:40:56.354 INFO:tasks.rados.rados.0.trial118.stdout:3099: finishing copy_from racing read to trial11845692-48 2026-02-17T05:40:56.355 INFO:tasks.rados.rados.0.trial118.stdout:3099: finishing copy_from to trial11845692-48 2026-02-17T05:40:56.356 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1697 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:40:57.345 INFO:tasks.rados.rados.0.trial118.stdout:3099: done (1 left) 2026-02-17T05:40:57.346 INFO:tasks.rados.rados.0.trial118.stdout:3100: done (0 left) 2026-02-17T05:40:57.346 INFO:tasks.rados.rados.0.trial118.stdout:3101: write (excl) oid 23 current snap is 330 2026-02-17T05:40:57.346 INFO:tasks.rados.rados.0.trial118.stdout:3101: seq_num 1093 ranges {770051=485636,1776701=511047} 2026-02-17T05:40:57.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: writing trial11845692-23 from 770051 to 1255687 tid 1 2026-02-17T05:40:57.355 INFO:tasks.rados.rados.0.trial118.stdout:3101: writing trial11845692-23 from 1776701 to 2287748 tid 2 2026-02-17T05:40:57.355 INFO:tasks.rados.rados.0.trial118.stdout:3102: snap_remove snap 325 2026-02-17T05:40:58.350 INFO:tasks.rados.rados.0.trial118.stdout:3102: done (1 left) 2026-02-17T05:40:58.350 INFO:tasks.rados.rados.0.trial118.stdout:3103: read oid 19 snap -1 2026-02-17T05:40:58.350 INFO:tasks.rados.rados.0.trial118.stdout:3103: expect (ObjNum 1092 snap 327 seq_num 1092) 2026-02-17T05:40:58.350 INFO:tasks.rados.rados.0.trial118.stdout:3104: delete oid 16 current snap is 330 2026-02-17T05:40:58.350 INFO:tasks.rados.rados.0.trial118.stdout:3101: finishing write tid 1 to trial11845692-23 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: finishing write tid 2 to trial11845692-23 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: finishing write tid 3 to trial11845692-23 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: finishing write tid 4 to trial11845692-23 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: oid 23 updating version 0 to 1473 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: oid 23 version 1473 is already newer than 1472 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: oid 23 version 1473 is already newer than 1471 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1473 (ObjNum 1093 snap 330 seq_num 1093) dirty exists 2026-02-17T05:40:58.351 INFO:tasks.rados.rados.0.trial118.stdout:3101: left oid 23 (ObjNum 1093 snap 330 seq_num 1093) 2026-02-17T05:40:58.352 INFO:tasks.rados.rados.0.trial118.stdout:3101: done (2 left) 2026-02-17T05:40:58.352 INFO:tasks.rados.rados.0.trial118.stdout:3104: done (1 left) 2026-02-17T05:40:58.352 INFO:tasks.rados.rados.0.trial118.stdout:3105: delete oid 45 current snap is 330 2026-02-17T05:40:58.354 INFO:tasks.rados.rados.0.trial118.stdout:3105: done (1 left) 2026-02-17T05:40:58.355 INFO:tasks.rados.rados.0.trial118.stdout:3106: read oid 32 snap 314 2026-02-17T05:40:58.355 INFO:tasks.rados.rados.0.trial118.stdout:3106: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:58.355 INFO:tasks.rados.rados.0.trial118.stdout:3107: delete oid 30 current snap is 330 2026-02-17T05:40:58.355 INFO:tasks.rados.rados.0.trial118.stdout:3103: expect (ObjNum 1092 snap 327 seq_num 1092) 2026-02-17T05:40:58.356 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:40:58.407 INFO:tasks.rados.rados.0.trial118.stdout:3106: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:40:58.439 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3715414 2026-02-17T05:40:58.446 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1475744 2026-02-17T05:40:58.465 INFO:tasks.rados.rados.0.trial118.stdout:3103: done (2 left) 2026-02-17T05:40:58.466 INFO:tasks.rados.rados.0.trial118.stdout:3106: done (1 left) 2026-02-17T05:40:58.466 INFO:tasks.rados.rados.0.trial118.stdout:3107: done (0 left) 2026-02-17T05:40:58.466 INFO:tasks.rados.rados.0.trial118.stdout:3108: read oid 40 snap -1 2026-02-17T05:40:58.466 INFO:tasks.rados.rados.0.trial118.stdout:3108: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:40:58.466 INFO:tasks.rados.rados.0.trial118.stdout:3109: snap_remove snap 328 2026-02-17T05:40:59.352 INFO:tasks.rados.rados.0.trial118.stdout:3109: done (1 left) 2026-02-17T05:40:59.352 INFO:tasks.rados.rados.0.trial118.stdout:3110: delete oid 41 current snap is 330 2026-02-17T05:40:59.353 INFO:tasks.rados.rados.0.trial118.stdout:3108: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:40:59.353 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1225455 2026-02-17T05:40:59.381 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 638827 2026-02-17T05:40:59.432 INFO:tasks.rados.rados.0.trial118.stdout:3108: done (1 left) 2026-02-17T05:40:59.433 INFO:tasks.rados.rados.0.trial118.stdout:3110: done (0 left) 2026-02-17T05:40:59.433 INFO:tasks.rados.rados.0.trial118.stdout:3111: write (excl) oid 42 current snap is 330 2026-02-17T05:40:59.433 INFO:tasks.rados.rados.0.trial118.stdout:3111: seq_num 1098 ranges {454086=578234,1669111=662043} 2026-02-17T05:40:59.437 INFO:tasks.rados.rados.0.trial118.stdout:3111: writing trial11845692-42 from 454086 to 1032320 tid 1 2026-02-17T05:40:59.442 INFO:tasks.rados.rados.0.trial118.stdout:3111: writing trial11845692-42 from 1669111 to 2331154 tid 2 2026-02-17T05:40:59.443 INFO:tasks.rados.rados.0.trial118.stdout:3112: snap_create 2026-02-17T05:40:59.444 INFO:tasks.rados.rados.0.trial118.stdout:3111: finishing write tid 1 to trial11845692-42 2026-02-17T05:40:59.444 INFO:tasks.rados.rados.0.trial118.stdout:3111: finishing write tid 2 to trial11845692-42 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: finishing write tid 3 to trial11845692-42 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: finishing write tid 4 to trial11845692-42 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: oid 42 updating version 0 to 1788 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: oid 42 updating version 1788 to 1790 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: oid 42 version 1790 is already newer than 1789 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1790 (ObjNum 1098 snap 330 seq_num 1098) dirty exists 2026-02-17T05:40:59.445 INFO:tasks.rados.rados.0.trial118.stdout:3111: left oid 42 (ObjNum 1098 snap 330 seq_num 1098) 2026-02-17T05:41:00.343 INFO:tasks.rados.rados.0.trial118.stdout:3111: done (1 left) 2026-02-17T05:41:00.343 INFO:tasks.rados.rados.0.trial118.stdout:3112: done (0 left) 2026-02-17T05:41:00.343 INFO:tasks.rados.rados.0.trial118.stdout:3113: write oid 7 current snap is 331 2026-02-17T05:41:00.343 INFO:tasks.rados.rados.0.trial118.stdout:3113: seq_num 1099 ranges {470893=653483,1727593=522054} 2026-02-17T05:41:00.347 INFO:tasks.rados.rados.0.trial118.stdout:3113: writing trial11845692-7 from 470893 to 1124376 tid 1 2026-02-17T05:41:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3113: writing trial11845692-7 from 1727593 to 2249647 tid 2 2026-02-17T05:41:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3114: write oid 19 current snap is 331 2026-02-17T05:41:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3114: seq_num 1100 ranges {487700=728732,1786075=665712} 2026-02-17T05:41:00.356 INFO:tasks.rados.rados.0.trial118.stdout:3114: writing trial11845692-19 from 487700 to 1216432 tid 1 2026-02-17T05:41:00.360 INFO:tasks.rados.rados.0.trial118.stdout:3114: writing trial11845692-19 from 1786075 to 2451787 tid 2 2026-02-17T05:41:00.360 INFO:tasks.rados.rados.0.trial118.stdout:3115: copy_from oid 39 from oid 45 current snap is 331 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: finishing write tid 1 to trial11845692-7 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: finishing write tid 2 to trial11845692-7 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: finishing write tid 3 to trial11845692-7 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: finishing write tid 4 to trial11845692-7 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: oid 7 updating version 0 to 1830 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: oid 7 version 1830 is already newer than 1829 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: oid 7 version 1830 is already newer than 1828 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1830 (ObjNum 1099 snap 331 seq_num 1099) dirty exists 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: left oid 7 (ObjNum 1099 snap 331 seq_num 1099) 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3114: finishing write tid 1 to trial11845692-19 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3113: done (2 left) 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3116: read oid 30 snap -1 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3116: expect deleted 2026-02-17T05:41:00.361 INFO:tasks.rados.rados.0.trial118.stdout:3117: snap_remove snap 326 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3117: done (3 left) 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3118: rollback oid 24 current snap is 331 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 319 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3115: finishing copy_from to trial11845692-39 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3115: got expected ENOENT (src dne) 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3115: finishing copy_from racing read to trial11845692-39 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3114: finishing write tid 2 to trial11845692-19 2026-02-17T05:41:01.357 INFO:tasks.rados.rados.0.trial118.stdout:3114: finishing write tid 3 to trial11845692-19 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: finishing write tid 4 to trial11845692-19 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: oid 19 updating version 0 to 1677 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: oid 19 updating version 1677 to 1679 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: oid 19 version 1679 is already newer than 1678 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1679 (ObjNum 1100 snap 331 seq_num 1100) dirty exists 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: left oid 19 (ObjNum 1100 snap 331 seq_num 1100) 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3114: done (3 left) 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3115: done (2 left) 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3116: done (1 left) 2026-02-17T05:41:01.358 INFO:tasks.rados.rados.0.trial118.stdout:3119: snap_remove snap 327 2026-02-17T05:41:02.358 INFO:tasks.rados.rados.0.trial118.stdout:3119: done (1 left) 2026-02-17T05:41:02.358 INFO:tasks.rados.rados.0.trial118.stdout:3120: delete oid 27 current snap is 331 2026-02-17T05:41:02.358 INFO:tasks.rados.rados.0.trial118.stdout:3118: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:41:02.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1681 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:41:02.362 INFO:tasks.rados.rados.0.trial118.stdout:3118: done (1 left) 2026-02-17T05:41:02.362 INFO:tasks.rados.rados.0.trial118.stdout:3120: done (0 left) 2026-02-17T05:41:02.362 INFO:tasks.rados.rados.0.trial118.stdout:3121: read oid 42 snap -1 2026-02-17T05:41:02.362 INFO:tasks.rados.rados.0.trial118.stdout:3121: expect (ObjNum 1098 snap 330 seq_num 1098) 2026-02-17T05:41:02.362 INFO:tasks.rados.rados.0.trial118.stdout:3122: read oid 48 snap -1 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3122: expect (ObjNum 1019 snap 309 seq_num 1019) 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3123: read oid 35 snap 305 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3123: expect deleted 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3124: read oid 28 snap 290 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3124: expect deleted 2026-02-17T05:41:02.363 INFO:tasks.rados.rados.0.trial118.stdout:3125: snap_remove snap 330 2026-02-17T05:41:03.361 INFO:tasks.rados.rados.0.trial118.stdout:3125: done (4 left) 2026-02-17T05:41:03.362 INFO:tasks.rados.rados.0.trial118.stdout:3126: write (excl) oid 12 current snap is 331 2026-02-17T05:41:03.362 INFO:tasks.rados.rados.0.trial118.stdout:3126: seq_num 1102 ranges {521314=479230,1786686=669381} 2026-02-17T05:41:03.365 INFO:tasks.rados.rados.0.trial118.stdout:3126: writing trial11845692-12 from 521314 to 1000544 tid 1 2026-02-17T05:41:03.371 INFO:tasks.rados.rados.0.trial118.stdout:3126: writing trial11845692-12 from 1786686 to 2456067 tid 2 2026-02-17T05:41:03.371 INFO:tasks.rados.rados.0.trial118.stdout:3127: rollback oid 41 current snap is 331 2026-02-17T05:41:03.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 323 2026-02-17T05:41:03.372 INFO:tasks.rados.rados.0.trial118.stdout:3122: expect (ObjNum 1019 snap 309 seq_num 1019) 2026-02-17T05:41:03.402 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.434 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.466 INFO:tasks.rados.rados.0.trial118.stdout:3121: expect (ObjNum 1098 snap 330 seq_num 1098) 2026-02-17T05:41:03.498 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.533 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.569 INFO:tasks.rados.rados.0.trial118.stdout:3126: finishing write tid 1 to trial11845692-12 2026-02-17T05:41:03.569 INFO:tasks.rados.rados.0.trial118.stdout:3126: finishing write tid 2 to trial11845692-12 2026-02-17T05:41:03.569 INFO:tasks.rados.rados.0.trial118.stdout:3126: finishing write tid 3 to trial11845692-12 2026-02-17T05:41:03.569 INFO:tasks.rados.rados.0.trial118.stdout:3121: done (5 left) 2026-02-17T05:41:03.569 INFO:tasks.rados.rados.0.trial118.stdout:3122: done (4 left) 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3123: done (3 left) 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3124: done (2 left) 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3128: rollback oid 19 current snap is 331 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 323 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3126: finishing write tid 4 to trial11845692-12 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3126: oid 12 updating version 0 to 1484 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3126: oid 12 updating version 1484 to 1485 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3126: oid 12 version 1485 is already newer than 1483 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1485 (ObjNum 1102 snap 331 seq_num 1102) dirty exists 2026-02-17T05:41:03.570 INFO:tasks.rados.rados.0.trial118.stdout:3126: left oid 12 (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3127: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3127: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1842 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3126: done (2 left) 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3127: done (1 left) 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3129: read oid 47 snap -1 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3129: expect deleted 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3130: rollback oid 22 current snap is 331 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 322 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3131: copy_from oid 41 from oid 31 current snap is 331 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3132: read oid 4 snap 319 2026-02-17T05:41:03.571 INFO:tasks.rados.rados.0.trial118.stdout:3132: expect (ObjNum 977 snap 294 seq_num 977) 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3133: rollback oid 16 current snap is 331 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 16 to 305 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3134: copy_from oid 5 from oid 49 current snap is 331 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3135: read oid 38 snap -1 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3135: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3136: write (excl) oid 14 current snap is 331 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3136: seq_num 1103 ranges {538121=670832,1961521=413039} 2026-02-17T05:41:03.572 INFO:tasks.rados.rados.0.trial118.stdout:3136: writing trial11845692-14 from 538121 to 1208953 tid 1 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:3136: writing trial11845692-14 from 1961521 to 2374560 tid 2 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:3137: snap_create 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:3128: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:3130: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1669 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:3128: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:41:03.577 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1681 (ObjNum 177 snap 0 seq_num 11509360) dirty dne 2026-02-17T05:41:03.578 INFO:tasks.rados.rados.0.trial118.stdout:3132: expect (ObjNum 977 snap 294 seq_num 977) 2026-02-17T05:41:03.605 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 174823 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:3131: finishing copy_from racing read to trial11845692-41 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:3131: finishing copy_from to trial11845692-41 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1464 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:3133: finishing rollback tid 1 to trial11845692-16 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 1823 (ObjNum 33 snap 0 seq_num 13075424) dirty dne 2026-02-17T05:41:03.660 INFO:tasks.rados.rados.0.trial118.stdout:3135: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:41:03.681 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.705 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3134: finishing copy_from racing read to trial11845692-5 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: finishing write tid 1 to trial11845692-14 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3134: finishing copy_from to trial11845692-5 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1292 (ObjNum 1063 snap 318 seq_num 1063) dirty exists 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: finishing write tid 2 to trial11845692-14 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: finishing write tid 3 to trial11845692-14 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: finishing write tid 4 to trial11845692-14 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: oid 14 updating version 0 to 1301 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: oid 14 updating version 1301 to 1302 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:3136: oid 14 updating version 1302 to 1303 2026-02-17T05:41:03.729 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1303 (ObjNum 1103 snap 331 seq_num 1103) dirty exists 2026-02-17T05:41:03.730 INFO:tasks.rados.rados.0.trial118.stdout:3136: left oid 14 (ObjNum 1103 snap 331 seq_num 1103) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3128: done (9 left) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3129: done (8 left) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3130: done (7 left) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3131: done (6 left) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3132: done (5 left) 2026-02-17T05:41:04.366 INFO:tasks.rados.rados.0.trial118.stdout:3133: done (4 left) 2026-02-17T05:41:04.367 INFO:tasks.rados.rados.0.trial118.stdout:3134: done (3 left) 2026-02-17T05:41:04.367 INFO:tasks.rados.rados.0.trial118.stdout:3135: done (2 left) 2026-02-17T05:41:04.367 INFO:tasks.rados.rados.0.trial118.stdout:3136: done (1 left) 2026-02-17T05:41:04.367 INFO:tasks.rados.rados.0.trial118.stdout:3137: done (0 left) 2026-02-17T05:41:04.367 INFO:tasks.rados.rados.0.trial118.stdout:3138: delete oid 9 current snap is 332 2026-02-17T05:41:04.368 INFO:tasks.rados.rados.0.trial118.stdout:3138: done (0 left) 2026-02-17T05:41:04.368 INFO:tasks.rados.rados.0.trial118.stdout:3139: snap_remove snap 320 2026-02-17T05:41:05.344 INFO:tasks.rados.rados.0.trial118.stdout:3139: done (0 left) 2026-02-17T05:41:05.344 INFO:tasks.rados.rados.0.trial118.stdout:3140: write (excl) oid 11 current snap is 332 2026-02-17T05:41:05.344 INFO:tasks.rados.rados.0.trial118.stdout:3140: seq_num 1105 ranges {571735=421330,1562132=416708} 2026-02-17T05:41:05.348 INFO:tasks.rados.rados.0.trial118.stdout:3140: writing trial11845692-11 from 571735 to 993065 tid 1 2026-02-17T05:41:05.352 INFO:tasks.rados.rados.0.trial118.stdout:3140: writing trial11845692-11 from 1562132 to 1978840 tid 2 2026-02-17T05:41:05.352 INFO:tasks.rados.rados.0.trial118.stdout:3141: write oid 24 current snap is 332 2026-02-17T05:41:05.352 INFO:tasks.rados.rados.0.trial118.stdout:3141: seq_num 1106 ranges {588542=496579,1620614=676719} 2026-02-17T05:41:05.356 INFO:tasks.rados.rados.0.trial118.stdout:3141: writing trial11845692-24 from 588542 to 1085121 tid 1 2026-02-17T05:41:05.360 INFO:tasks.rados.rados.0.trial118.stdout:3141: writing trial11845692-24 from 1620614 to 2297333 tid 2 2026-02-17T05:41:05.361 INFO:tasks.rados.rados.0.trial118.stdout:3142: write (excl) oid 45 current snap is 332 2026-02-17T05:41:05.361 INFO:tasks.rados.rados.0.trial118.stdout:3142: seq_num 1107 ranges {605349=571828,1679096=420377} 2026-02-17T05:41:05.365 INFO:tasks.rados.rados.0.trial118.stdout:3142: writing trial11845692-45 from 605349 to 1177177 tid 1 2026-02-17T05:41:05.369 INFO:tasks.rados.rados.0.trial118.stdout:3142: writing trial11845692-45 from 1679096 to 2099473 tid 2 2026-02-17T05:41:05.369 INFO:tasks.rados.rados.0.trial118.stdout:3143: write (excl) oid 7 current snap is 332 2026-02-17T05:41:05.369 INFO:tasks.rados.rados.0.trial118.stdout:3140: finishing write tid 1 to trial11845692-11 2026-02-17T05:41:05.370 INFO:tasks.rados.rados.0.trial118.stdout:3143: seq_num 1108 ranges {622156=647077,1737578=680388} 2026-02-17T05:41:05.374 INFO:tasks.rados.rados.0.trial118.stdout:3143: writing trial11845692-7 from 622156 to 1269233 tid 1 2026-02-17T05:41:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3143: writing trial11845692-7 from 1737578 to 2417966 tid 2 2026-02-17T05:41:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3144: read oid 23 snap -1 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3144: expect (ObjNum 1093 snap 330 seq_num 1093) 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3145: rollback oid 20 current snap is 332 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 20 to 314 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: finishing write tid 2 to trial11845692-11 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: finishing write tid 3 to trial11845692-11 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: finishing write tid 4 to trial11845692-11 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: oid 11 updating version 0 to 2007 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: oid 11 version 2007 is already newer than 2001 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: oid 11 version 2007 is already newer than 2006 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2007 (ObjNum 1105 snap 332 seq_num 1105) dirty exists 2026-02-17T05:41:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3140: left oid 11 (ObjNum 1105 snap 332 seq_num 1105) 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: finishing write tid 1 to trial11845692-24 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: finishing write tid 2 to trial11845692-24 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: finishing write tid 3 to trial11845692-24 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: finishing write tid 4 to trial11845692-24 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: oid 24 updating version 0 to 1692 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: oid 24 version 1692 is already newer than 1691 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: oid 24 updating version 1692 to 1693 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1693 (ObjNum 1106 snap 332 seq_num 1106) dirty exists 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3141: left oid 24 (ObjNum 1106 snap 332 seq_num 1106) 2026-02-17T05:41:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3142: finishing write tid 1 to trial11845692-45 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: finishing write tid 2 to trial11845692-45 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: finishing write tid 3 to trial11845692-45 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: finishing write tid 4 to trial11845692-45 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: oid 45 updating version 0 to 1713 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: oid 45 version 1713 is already newer than 1712 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: oid 45 version 1713 is already newer than 1711 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1713 (ObjNum 1107 snap 332 seq_num 1107) dirty exists 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: left oid 45 (ObjNum 1107 snap 332 seq_num 1107) 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3143: finishing write tid 1 to trial11845692-7 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3140: done (5 left) 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3141: done (4 left) 2026-02-17T05:41:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3142: done (3 left) 2026-02-17T05:41:05.383 INFO:tasks.rados.rados.0.trial118.stdout:3146: write oid 33 current snap is 332 2026-02-17T05:41:05.383 INFO:tasks.rados.rados.0.trial118.stdout:3146: seq_num 1109 ranges {638963=722326,2079707=424046} 2026-02-17T05:41:05.384 INFO:tasks.rados.rados.0.trial118.stdout:3146: writing trial11845692-33 from 638963 to 1361289 tid 1 2026-02-17T05:41:05.388 INFO:tasks.rados.rados.0.trial118.stdout:3146: writing trial11845692-33 from 2079707 to 2503753 tid 2 2026-02-17T05:41:05.389 INFO:tasks.rados.rados.0.trial118.stdout:3147: write oid 50 current snap is 332 2026-02-17T05:41:05.389 INFO:tasks.rados.rados.0.trial118.stdout:3147: seq_num 1110 ranges {655770=513928,1854542=684057} 2026-02-17T05:41:05.393 INFO:tasks.rados.rados.0.trial118.stdout:3147: writing trial11845692-50 from 655770 to 1169698 tid 1 2026-02-17T05:41:05.398 INFO:tasks.rados.rados.0.trial118.stdout:3147: writing trial11845692-50 from 1854542 to 2538599 tid 2 2026-02-17T05:41:05.398 INFO:tasks.rados.rados.0.trial118.stdout:3148: snap_create 2026-02-17T05:41:05.398 INFO:tasks.rados.rados.0.trial118.stdout:3143: finishing write tid 2 to trial11845692-7 2026-02-17T05:41:05.398 INFO:tasks.rados.rados.0.trial118.stdout:3144: expect (ObjNum 1093 snap 330 seq_num 1093) 2026-02-17T05:41:05.463 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2332372 2026-02-17T05:41:05.466 INFO:tasks.rados.rados.0.trial118.stdout:3145: finishing rollback tid 0 to trial11845692-20 2026-02-17T05:41:05.466 INFO:tasks.rados.rados.0.trial118.stdout:3143: finishing write tid 3 to trial11845692-7 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:3145: finishing rollback tid 1 to trial11845692-20 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:3145: finishing rollback tid 2 to trial11845692-20 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2011 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:3143: finishing write tid 4 to trial11845692-7 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:3143: oid 7 updating version 0 to 1861 2026-02-17T05:41:05.467 INFO:tasks.rados.rados.0.trial118.stdout:3143: oid 7 updating version 1861 to 1862 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:3143: oid 7 version 1862 is already newer than 1860 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1862 (ObjNum 1108 snap 332 seq_num 1108) dirty exists 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:3143: left oid 7 (ObjNum 1108 snap 332 seq_num 1108) 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:3146: finishing write tid 1 to trial11845692-33 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:3146: finishing write tid 2 to trial11845692-33 2026-02-17T05:41:05.468 INFO:tasks.rados.rados.0.trial118.stdout:3146: finishing write tid 3 to trial11845692-33 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:3146: finishing write tid 4 to trial11845692-33 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:3146: oid 33 updating version 0 to 1904 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:3146: oid 33 updating version 1904 to 1905 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:3146: oid 33 updating version 1905 to 1906 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1906 (ObjNum 1109 snap 332 seq_num 1109) dirty exists 2026-02-17T05:41:05.469 INFO:tasks.rados.rados.0.trial118.stdout:3146: left oid 33 (ObjNum 1109 snap 332 seq_num 1109) 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: finishing write tid 1 to trial11845692-50 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: finishing write tid 2 to trial11845692-50 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: finishing write tid 3 to trial11845692-50 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: finishing write tid 4 to trial11845692-50 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: oid 50 updating version 0 to 1486 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: oid 50 updating version 1486 to 1487 2026-02-17T05:41:05.470 INFO:tasks.rados.rados.0.trial118.stdout:3147: oid 50 updating version 1487 to 1488 2026-02-17T05:41:05.471 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1488 (ObjNum 1110 snap 332 seq_num 1110) dirty exists 2026-02-17T05:41:05.471 INFO:tasks.rados.rados.0.trial118.stdout:3147: left oid 50 (ObjNum 1110 snap 332 seq_num 1110) 2026-02-17T05:41:06.367 INFO:tasks.rados.rados.0.trial118.stdout:3143: done (5 left) 2026-02-17T05:41:06.367 INFO:tasks.rados.rados.0.trial118.stdout:3144: done (4 left) 2026-02-17T05:41:06.367 INFO:tasks.rados.rados.0.trial118.stdout:3145: done (3 left) 2026-02-17T05:41:06.367 INFO:tasks.rados.rados.0.trial118.stdout:3146: done (2 left) 2026-02-17T05:41:06.367 INFO:tasks.rados.rados.0.trial118.stdout:3147: done (1 left) 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:3148: done (0 left) 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:3149: read oid 21 snap -1 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:3149: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:3150: rollback oid 29 current snap is 333 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 305 2026-02-17T05:41:06.368 INFO:tasks.rados.rados.0.trial118.stdout:3151: snap_create 2026-02-17T05:41:06.370 INFO:tasks.rados.rados.0.trial118.stdout:3150: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:41:06.370 INFO:tasks.rados.rados.0.trial118.stdout:3150: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:41:06.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1864 (ObjNum 970 snap 293 seq_num 970) dirty exists 2026-02-17T05:41:06.373 INFO:tasks.rados.rados.0.trial118.stdout:3149: expect (ObjNum 1012 snap 301 seq_num 1012) 2026-02-17T05:41:06.398 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2654920 2026-02-17T05:41:06.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1522062 2026-02-17T05:41:06.437 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:07.369 INFO:tasks.rados.rados.0.trial118.stdout:3149: done (2 left) 2026-02-17T05:41:07.369 INFO:tasks.rados.rados.0.trial118.stdout:3150: done (1 left) 2026-02-17T05:41:07.369 INFO:tasks.rados.rados.0.trial118.stdout:3151: done (0 left) 2026-02-17T05:41:07.369 INFO:tasks.rados.rados.0.trial118.stdout:3152: write oid 6 current snap is 334 2026-02-17T05:41:07.369 INFO:tasks.rados.rados.0.trial118.stdout:3152: seq_num 1111 ranges {672577=589177,1913024=427715} 2026-02-17T05:41:07.374 INFO:tasks.rados.rados.0.trial118.stdout:3152: writing trial11845692-6 from 672577 to 1261754 tid 1 2026-02-17T05:41:07.378 INFO:tasks.rados.rados.0.trial118.stdout:3152: writing trial11845692-6 from 1913024 to 2340739 tid 2 2026-02-17T05:41:07.378 INFO:tasks.rados.rados.0.trial118.stdout:3153: snap_create 2026-02-17T05:41:07.378 INFO:tasks.rados.rados.0.trial118.stdout:3152: finishing write tid 1 to trial11845692-6 2026-02-17T05:41:07.379 INFO:tasks.rados.rados.0.trial118.stdout:3152: finishing write tid 2 to trial11845692-6 2026-02-17T05:41:07.379 INFO:tasks.rados.rados.0.trial118.stdout:3152: finishing write tid 3 to trial11845692-6 2026-02-17T05:41:07.379 INFO:tasks.rados.rados.0.trial118.stdout:3152: finishing write tid 4 to trial11845692-6 2026-02-17T05:41:07.380 INFO:tasks.rados.rados.0.trial118.stdout:3152: oid 6 updating version 0 to 1474 2026-02-17T05:41:07.380 INFO:tasks.rados.rados.0.trial118.stdout:3152: oid 6 updating version 1474 to 1475 2026-02-17T05:41:07.380 INFO:tasks.rados.rados.0.trial118.stdout:3152: oid 6 updating version 1475 to 1476 2026-02-17T05:41:07.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1476 (ObjNum 1111 snap 334 seq_num 1111) dirty exists 2026-02-17T05:41:07.380 INFO:tasks.rados.rados.0.trial118.stdout:3152: left oid 6 (ObjNum 1111 snap 334 seq_num 1111) 2026-02-17T05:41:08.370 INFO:tasks.rados.rados.0.trial118.stdout:3152: done (1 left) 2026-02-17T05:41:08.371 INFO:tasks.rados.rados.0.trial118.stdout:3153: done (0 left) 2026-02-17T05:41:08.371 INFO:tasks.rados.rados.0.trial118.stdout:3154: write oid 1 current snap is 335 2026-02-17T05:41:08.371 INFO:tasks.rados.rados.0.trial118.stdout:3154: seq_num 1112 ranges {689384=664426,1971506=687726} 2026-02-17T05:41:08.375 INFO:tasks.rados.rados.0.trial118.stdout:3154: writing trial11845692-1 from 689384 to 1353810 tid 1 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3154: writing trial11845692-1 from 1971506 to 2659232 tid 2 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3155: read oid 10 snap 329 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3155: expect deleted 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3156: copy_from oid 28 from oid 9 current snap is 335 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3154: finishing write tid 1 to trial11845692-1 2026-02-17T05:41:08.381 INFO:tasks.rados.rados.0.trial118.stdout:3157: snap_remove snap 333 2026-02-17T05:41:08.761 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:41:08.761 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:41:08.762 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:41:08.762 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:41:08.780 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:41:08.780 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:41:08.780 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:41:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.842+0000 7fc65985b640 10 monclient: get_monmap_and_config 2026-02-17T05:41:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.842+0000 7fc65985b640 10 monclient: build_initial_monmap 2026-02-17T05:41:08.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.842+0000 7fc65985b640 10 monclient: monmap: 2026-02-17T05:41:08.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:08.844092+0000 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:08.844092+0000 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 1 Processor -- start 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 1 -- start start 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient: init 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-c con 0x7fc6540585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-b con 0x7fc6541631e0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-a con 0x7fc654184ce0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6540575d0 con 0x7fc654184ce0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6540578b0 con 0x7fc6540585c0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc654057b90 con 0x7fc6541631e0 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:08.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc65985b640 10 monclient(hunting): authenticate will time out at 1397.472620s 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc6537fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc654184ce0 0x7fc6541a50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40178/0 (socket says 10.20.193.106:40178) 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc6537fe640 1 -- 10.20.193.106:0/2641846672 learned_addr learned my addr 10.20.193.106:0/2641846672 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc6527fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc6541631e0 0x7fc6541835c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59334/0 (socket says 10.20.193.106:59334) 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933364788 0 0) 0x7fc654057b90 con 0x7fc6541631e0 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 10 monclient(hunting): my global_id is 5114 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.843+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6400035e0 con 0x7fc6541631e0 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200588326 0 0) 0x7fc6540578b0 con 0x7fc6540585c0 2026-02-17T05:41:08.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient(hunting): my global_id is 94345 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc654057b90 con 0x7fc6540585c0 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3412941707 0 0) 0x7fc6400035e0 con 0x7fc6541631e0 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 >> v1:10.20.193.118:6789/0 conn(0x7fc6540585c0 legacy=0x7fc65413f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 >> v1:10.20.193.106:6789/0 conn(0x7fc654184ce0 legacy=0x7fc6541a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 monclient: found mon.noname-b 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc654057e70 con 0x7fc6541631e0 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: _finish_auth 0 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc63c002dd0 con 0x7fc6541631e0 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 5 monclient: authenticate success, global_id 5114 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: dump: 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:08.857 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc63c003010 con 0x7fc6541631e0 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:08.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 1 -- 10.20.193.106:0/2641846672 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc63c003420 con 0x7fc6541631e0 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 4 set_mon_vals no callback set 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc651ffb640 10 monclient: dump: 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.859 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 10 monclient: shutdown 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 1 -- 10.20.193.106:0/2641846672 >> v1:10.20.193.106:6790/0 conn(0x7fc6541631e0 legacy=0x7fc6541835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 1 -- 10.20.193.106:0/2641846672 shutdown_connections 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 1 -- 10.20.193.106:0/2641846672 >> 10.20.193.106:0/2641846672 conn(0x7fc65405e410 msgr2=0x7fc654095420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 1 -- 10.20.193.106:0/2641846672 shutdown_connections 2026-02-17T05:41:08.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.844+0000 7fc65985b640 1 -- 10.20.193.106:0/2641846672 wait complete. 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient: build_initial_monmap 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient: monmap: 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:08.861 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 1 Processor -- start 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 1 -- start start 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient: init 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-c con 0x7fc6540585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-b con 0x7fc6541631e0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient(hunting): picked mon.noname-a con 0x7fc654184ce0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65408c680 con 0x7fc654184ce0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65415d570 con 0x7fc6541631e0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6541447c0 con 0x7fc6540585c0 2026-02-17T05:41:08.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc65985b640 10 monclient(hunting): authenticate will time out at 1397.474640s 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc6537fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc654184ce0 0x7fc65412e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40188/0 (socket says 10.20.193.106:40188) 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc6537fe640 1 -- 10.20.193.106:0/2690376828 learned_addr learned my addr 10.20.193.106:0/2690376828 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154350275 0 0) 0x7fc6541447c0 con 0x7fc6540585c0 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 10 monclient(hunting): my global_id is 5117 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.845+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6240035e0 con 0x7fc6540585c0 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215103853 0 0) 0x7fc65415d570 con 0x7fc6541631e0 2026-02-17T05:41:08.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): my global_id is 94348 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6541447c0 con 0x7fc6541631e0 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 711327121 0 0) 0x7fc6240035e0 con 0x7fc6540585c0 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc65415d570 con 0x7fc6540585c0 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc648003090 con 0x7fc6540585c0 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): dump: 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:08.864 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 968482536 0 0) 0x7fc6541447c0 con 0x7fc6541631e0 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6240035e0 con 0x7fc6541631e0 2026-02-17T05:41:08.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc63c002ce0 con 0x7fc6541631e0 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient(hunting): dump: 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:08.866 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 703689229 0 0) 0x7fc65415d570 con 0x7fc6540585c0 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 >> v1:10.20.193.118:6789/0 conn(0x7fc6541631e0 legacy=0x7fc65412cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 >> v1:10.20.193.106:6789/0 conn(0x7fc654184ce0 legacy=0x7fc65412e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 monclient: found mon.c 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65413fbc0 con 0x7fc6540585c0 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: _finish_auth 0 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:08.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 5 monclient: authenticate success, global_id 5117 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _renew_subs 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6541439b0 con 0x7fc6540585c0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _renew_subs 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6541431f0 con 0x7fc6540585c0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6480036d0 con 0x7fc6540585c0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc6480039f0 con 0x7fc6540585c0 2026-02-17T05:41:08.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc62bfff640 10 monclient: dump: 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:08.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc6517fa640 4 set_mon_vals no callback set 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.846+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc654058c70 con 0x7fc6540585c0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.847+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc648010990 con 0x7fc6540585c0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.847+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(681..681 src has 472..681) ==== 3931+0+0 (unknown 2209813772 0 0) 0x7fc64804eb20 con 0x7fc6540585c0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.847+0000 7fc6527fc640 10 monclient: get_auth_request con 0x7fc624040bf0 auth_method 0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.850+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fc6480161f0 con 0x7fc6540585c0 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.850+0000 7fc62bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:08.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.850+0000 7fc62bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:08.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc65985b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc65985b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc65985b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc65408f8a0 con 0x7fc6540585c0 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc62bfff640 1 -- 10.20.193.106:0/2690376828 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2580381551) 0x7fc6480159a0 con 0x7fc6540585c0 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc62bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:08.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.993+0000 7fc62bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:08.997 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:41:08.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 >> v1:10.20.193.118:6812/703720803 conn(0x7fc624040bf0 legacy=0x7fc6240610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 10 monclient: shutdown 2026-02-17T05:41:08.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:08.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 >> v1:10.20.193.106:6790/0 conn(0x7fc6540585c0 legacy=0x7fc65415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:08.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 shutdown_connections 2026-02-17T05:41:08.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 >> 10.20.193.106:0/2690376828 conn(0x7fc65405e410 msgr2=0x7fc65408d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:08.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 shutdown_connections 2026-02-17T05:41:08.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:08.994+0000 7fc65985b640 1 -- 10.20.193.106:0/2690376828 wait complete. 2026-02-17T05:41:09.004 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:41:09.004 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:41:09.004 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 10 monclient: get_monmap_and_config 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 10 monclient: monmap: 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:09.069822+0000 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:09.069822+0000 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:09.070 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:09.071 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 1 Processor -- start 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 1 -- start start 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.068+0000 7f8846207640 10 monclient: init 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient(hunting): picked mon.noname-b con 0x7f884005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient(hunting): picked mon.noname-a con 0x7f884005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient(hunting): picked mon.noname-c con 0x7f8840182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884008b060 con 0x7f884005dee0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884005dc90 con 0x7f8840182720 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884008d6a0 con 0x7f884005d1b0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 10 monclient(hunting): authenticate will time out at 1397.698393s 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f884005d1b0 0x7f884005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59356/0 (socket says 10.20.193.106:59356) 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883f7fe640 1 -- 10.20.193.106:0/2064594809 learned_addr learned my addr 10.20.193.106:0/2064594809 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359595504 0 0) 0x7f884008d6a0 con 0x7f884005d1b0 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient(hunting): my global_id is 5120 2026-02-17T05:41:09.072 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88240035e0 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 643731013 0 0) 0x7f88240035e0 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 >> v1:10.20.193.118:6789/0 conn(0x7f8840182720 legacy=0x7f88401a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 >> v1:10.20.193.106:6789/0 conn(0x7f884005dee0 legacy=0x7f8840181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 monclient: found mon.noname-b 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8840057960 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f882c002dd0 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 5 monclient: authenticate success, global_id 5120 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f883e7fc640 10 monclient: dump: 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.069+0000 7f8846207640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f882c003090 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 1 -- 10.20.193.106:0/2064594809 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f882c003460 con 0x7f884005d1b0 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 4 set_mon_vals no callback set 2026-02-17T05:41:09.073 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f883e7fc640 10 monclient: dump: 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 10 monclient: shutdown 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 1 -- 10.20.193.106:0/2064594809 >> v1:10.20.193.106:6790/0 conn(0x7f884005d1b0 legacy=0x7f884005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 1 -- 10.20.193.106:0/2064594809 shutdown_connections 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 1 -- 10.20.193.106:0/2064594809 >> 10.20.193.106:0/2064594809 conn(0x7f88400915f0 msgr2=0x7f88400919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 1 -- 10.20.193.106:0/2064594809 shutdown_connections 2026-02-17T05:41:09.074 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.070+0000 7f8846207640 1 -- 10.20.193.106:0/2064594809 wait complete. 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient: monmap: 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 1 Processor -- start 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 1 -- start start 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient: init 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.076 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient(hunting): picked mon.noname-b con 0x7f884005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient(hunting): picked mon.noname-c con 0x7f884005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient(hunting): picked mon.noname-a con 0x7f8840182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884005e950 con 0x7f8840182720 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884012e3f0 con 0x7f884005d1b0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884010e060 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f8846207640 10 monclient(hunting): authenticate will time out at 1397.700657s 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f883effd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f884005dee0 0x7f884012dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59372/0 (socket says 10.20.193.106:59372) 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f883effd640 1 -- 10.20.193.106:0/2792984743 learned_addr learned my addr 10.20.193.106:0/2792984743 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505876989 0 0) 0x7f884010e060 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f881bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f881bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f881bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.071+0000 7f881bfff640 10 monclient(hunting): my global_id is 5123 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88100035e0 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952561024 0 0) 0x7f884005dc90 con 0x7f8840182720 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): my global_id is 124098 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884010e060 con 0x7f8840182720 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2902495138 0 0) 0x7f88100035e0 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884005dc90 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8830003080 con 0x7f884005dee0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): dump: 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.077 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 426517737 0 0) 0x7f884010e060 con 0x7f8840182720 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88100035e0 con 0x7f8840182720 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8834004050 con 0x7f8840182720 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient(hunting): dump: 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 819210044 0 0) 0x7f884005dc90 con 0x7f884005dee0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.118:6789/0 conn(0x7f884005d1b0 legacy=0x7f884012d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6789/0 conn(0x7f8840182720 legacy=0x7f8840181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 monclient: found mon.c 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884010cb70 con 0x7f884005dee0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 5 monclient: authenticate success, global_id 5123 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 10 monclient: _renew_subs 2026-02-17T05:41:09.078 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f884010c520 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 10 monclient: _renew_subs 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f884010e630 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88300036d0 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8830003a70 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f881bfff640 10 monclient: dump: 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f883dffb640 4 set_mon_vals no callback set 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.072+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f884010ea50 con 0x7f884010d6d0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958724992 0 0) 0x7f884012e3f0 con 0x7f884010d6d0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient(hunting): my global_id is 124101 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884005dc90 con 0x7f884010d6d0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8830003bd0 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(681..681 src has 472..681) ==== 3931+0+0 (unknown 2209813772 0 0) 0x7f883004fe20 con 0x7f884005dee0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3961212096 0 0) 0x7f884005dc90 con 0x7f884010d6d0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884012e3f0 con 0x7f884010d6d0 2026-02-17T05:41:09.079 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f882c0029d0 con 0x7f884010d6d0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient: dump: 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f883ffff640 10 monclient: get_auth_request con 0x7f8810040c70 auth_method 0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2931542543 0 0) 0x7f884012e3f0 con 0x7f884010d6d0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8840057cd0 con 0x7f884010d6d0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f882c003470 con 0x7f884010d6d0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6789/0 conn(0x7f884010d6d0 legacy=0x7f88401076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.080 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.073+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6789/0 conn(0x7f884010d6d0 legacy=0x7f88401076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.076+0000 7f8846207640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.076+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f884012a930 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771235289 0 0) 0x7f884012a930 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient(hunting): my global_id is 124104 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884012e3f0 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2593586323 0 0) 0x7f884012e3f0 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884012a930 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f882c004e20 con 0x7f884012a560 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient: dump: 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.081 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 680393054 0 0) 0x7f884012a930 con 0x7f884012a560 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8840055570 con 0x7f884012a560 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 1126215192) 0x7f882c007060 con 0x7f884012a560 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6789/0 conn(0x7f884012a560 legacy=0x7f8840107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f881bfff640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6789/0 conn(0x7f884012a560 legacy=0x7f8840107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 241, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.082 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.083 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:09.084 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.085 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.086 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.118:6812/703720803 conn(0x7f8810040c70 legacy=0x7f8810061120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 10 monclient: shutdown 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 >> v1:10.20.193.106:6790/0 conn(0x7f884005dee0 legacy=0x7f884012dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f883ffff640 1 -- 10.20.193.106:0/2792984743 reap_dead start 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f883ffff640 1 -- 10.20.193.106:0/2792984743 reap_dead start 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 shutdown_connections 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 >> 10.20.193.106:0/2792984743 conn(0x7f88400915f0 msgr2=0x7f8840089710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 shutdown_connections 2026-02-17T05:41:09.087 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.077+0000 7f8846207640 1 -- 10.20.193.106:0/2792984743 wait complete. 2026-02-17T05:41:09.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:09.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:41:09.088 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:41:09.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 10 monclient: get_monmap_and_config 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 10 monclient: monmap: 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:09.152713+0000 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:09.152713+0000 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 1 Processor -- start 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 1 -- start start 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.151+0000 7f98fbfff640 10 monclient: init 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-c con 0x7f98fc08be90 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-a con 0x7f98fc08cc00 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-b con 0x7f98fc1824b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc08a6e0 con 0x7f98fc08cc00 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc08afe0 con 0x7f98fc08be90 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc08d3a0 con 0x7f98fc1824b0 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient(hunting): authenticate will time out at 1397.781099s 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fb7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f98fc1824b0 0x7f98fc1a2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59384/0 (socket says 10.20.193.106:59384) 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fa7fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f98fc08cc00 0x7f98fc180d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40234/0 (socket says 10.20.193.106:40234) 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fb7fe640 1 -- 10.20.193.106:0/2374523151 learned_addr learned my addr 10.20.193.106:0/2374523151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.162 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931685205 0 0) 0x7f98fc08d3a0 con 0x7f98fc1824b0 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): my global_id is 5126 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e80035e0 con 0x7f98fc1824b0 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220503890 0 0) 0x7f98fc08a6e0 con 0x7f98fc08cc00 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient(hunting): my global_id is 124107 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc08d3a0 con 0x7f98fc08cc00 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 733704400 0 0) 0x7f98e80035e0 con 0x7f98fc1824b0 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 >> v1:10.20.193.118:6789/0 conn(0x7f98fc08be90 legacy=0x7f98fc08c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 >> v1:10.20.193.106:6789/0 conn(0x7f98fc08cc00 legacy=0x7f98fc180d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.163 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 monclient: found mon.noname-b 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc0578b0 con 0x7f98fc1824b0 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 5 monclient: authenticate success, global_id 5126 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98ec003eb0 con 0x7f98fc1824b0 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: dump: 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.164 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98ec004130 con 0x7f98fc1824b0 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 1 -- 10.20.193.106:0/2374523151 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98ec004540 con 0x7f98fc1824b0 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 4 set_mon_vals no callback set 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.165 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98f9ffb640 10 monclient: dump: 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 10 monclient: shutdown 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.152+0000 7f98fbfff640 1 -- 10.20.193.106:0/2374523151 >> v1:10.20.193.106:6790/0 conn(0x7f98fc1824b0 legacy=0x7f98fc1a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- 10.20.193.106:0/2374523151 shutdown_connections 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- 10.20.193.106:0/2374523151 >> 10.20.193.106:0/2374523151 conn(0x7f98fc054d80 msgr2=0x7f98fc090ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.166 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- 10.20.193.106:0/2374523151 shutdown_connections 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- 10.20.193.106:0/2374523151 wait complete. 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient: monmap: 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 Processor -- start 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- start start 2026-02-17T05:41:09.167 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient: init 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-c con 0x7f98fc08be90 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-a con 0x7f98fc1824b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient(hunting): picked mon.noname-b con 0x7f98fc183cb0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc186580 con 0x7f98fc1824b0 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc185330 con 0x7f98fc183cb0 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc184e90 con 0x7f98fc08be90 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98fbfff640 10 monclient(hunting): authenticate will time out at 1397.782852s 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98faffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f98fc08be90 0x7f98fc19c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59386/0 (socket says 10.20.193.106:59386) 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.153+0000 7f98faffd640 1 -- 10.20.193.106:0/508611549 learned_addr learned my addr 10.20.193.106:0/508611549 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974979838 0 0) 0x7f98fc184e90 con 0x7f98fc08be90 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): my global_id is 5129 2026-02-17T05:41:09.168 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98c80035e0 con 0x7f98fc08be90 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792202218 0 0) 0x7f98fc186580 con 0x7f98fc1824b0 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): my global_id is 124110 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc184e90 con 0x7f98fc1824b0 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1496419797 0 0) 0x7f98c80035e0 con 0x7f98fc08be90 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc186580 con 0x7f98fc08be90 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98f0003170 con 0x7f98fc08be90 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): dump: 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.169 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890581255 0 0) 0x7f98fc185330 con 0x7f98fc183cb0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): my global_id is 94354 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98c80035e0 con 0x7f98fc183cb0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1073831059 0 0) 0x7f98fc184e90 con 0x7f98fc1824b0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc185330 con 0x7f98fc1824b0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98e4002fc0 con 0x7f98fc1824b0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.170 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient(hunting): dump: 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 81272606 0 0) 0x7f98fc186580 con 0x7f98fc08be90 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.118:6789/0 conn(0x7f98fc183cb0 legacy=0x7f98fc1709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6789/0 conn(0x7f98fc1824b0 legacy=0x7f98fc19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 monclient: found mon.c 2026-02-17T05:41:09.171 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc1862f0 con 0x7f98fc08be90 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 5 monclient: authenticate success, global_id 5129 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 10 monclient: _renew_subs 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc05cd10 con 0x7f98fc08be90 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 10 monclient: _renew_subs 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f98fc185fc0 con 0x7f98fc08be90 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98f0003340 con 0x7f98fc08be90 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98f0003b30 con 0x7f98fc08be90 2026-02-17T05:41:09.172 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98db7fe640 10 monclient: dump: 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98f97fa640 4 set_mon_vals no callback set 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.154+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98fc090010 con 0x7f98fc08cc00 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917111809 0 0) 0x7f98fc090010 con 0x7f98fc08cc00 2026-02-17T05:41:09.173 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient(hunting): my global_id is 5132 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc186580 con 0x7f98fc08cc00 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f98f0003c90 con 0x7f98fc08be90 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(681..681 src has 472..681) ==== 3931+0+0 (unknown 2209813772 0 0) 0x7f98f004fc30 con 0x7f98fc08be90 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3674075952 0 0) 0x7f98fc186580 con 0x7f98fc08cc00 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc090010 con 0x7f98fc08cc00 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98e4003500 con 0x7f98fc08cc00 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient: dump: 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.174 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98fb7fe640 10 monclient: get_auth_request con 0x7f98c8040d80 auth_method 0 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3599879214 0 0) 0x7f98fc090010 con 0x7f98fc08cc00 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98fc08a330 con 0x7f98fc08cc00 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f98e40069e0 con 0x7f98fc08cc00 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6790/0 conn(0x7f98fc08cc00 legacy=0x7f98fc19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.155+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6790/0 conn(0x7f98fc08cc00 legacy=0x7f98fc19e270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98fbfff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:09.175 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98fc1862a0 con 0x7f98fc19e980 2026-02-17T05:41:09.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3881236355 0 0) 0x7f98fc1862a0 con 0x7f98fc19e980 2026-02-17T05:41:09.176 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient(hunting): my global_id is 5135 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc090010 con 0x7f98fc19e980 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 248786256 0 0) 0x7f98fc090010 con 0x7f98fc19e980 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc1862a0 con 0x7f98fc19e980 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98e40050b0 con 0x7f98fc19e980 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient: dump: 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.177 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4061349473 0 0) 0x7f98fc1862a0 con 0x7f98fc19e980 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f98fc05a7e0 con 0x7f98fc19e980 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 1019841518) 0x7f98e4006bd0 con 0x7f98fc19e980 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6790/0 conn(0x7f98fc19e980 legacy=0x7f98fc173120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.159+0000 7f98db7fe640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6790/0 conn(0x7f98fc19e980 legacy=0x7f98fc173120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:09.178 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 793920, 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.179 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.180 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:09.181 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.182 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.183 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.184 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.185 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:09.186 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:09.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.118:6812/703720803 conn(0x7f98c8040d80 legacy=0x7f98c8061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 10 monclient: shutdown 2026-02-17T05:41:09.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 >> v1:10.20.193.106:6790/0 conn(0x7f98fc08be90 legacy=0x7f98fc19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fb7fe640 1 -- 10.20.193.106:0/508611549 reap_dead start 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fb7fe640 1 -- 10.20.193.106:0/508611549 reap_dead start 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 shutdown_connections 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 >> 10.20.193.106:0/508611549 conn(0x7f98fc054d80 msgr2=0x7f98fc058ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 shutdown_connections 2026-02-17T05:41:09.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.160+0000 7f98fbfff640 1 -- 10.20.193.106:0/508611549 wait complete. 2026-02-17T05:41:09.188 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:09.188 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:41:09.188 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 10 monclient: get_monmap_and_config 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 10 monclient: monmap: 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:09.254472+0000 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:09.254472+0000 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.255 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:09.256 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:09.256 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.261 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 1 Processor -- start 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 1 -- start start 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.253+0000 7f76a6a47640 10 monclient: init 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-c con 0x7f76a0141dc0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-b con 0x7f76a0142190 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-a con 0x7f76a0184340 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a00575f0 con 0x7f76a0184340 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a00578d0 con 0x7f76a0141dc0 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a0057bb0 con 0x7f76a0142190 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient(hunting): authenticate will time out at 1397.883119s 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769f7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f76a0142190 0x7f76a01425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59418/0 (socket says 10.20.193.106:59418) 2026-02-17T05:41:09.262 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a4fbd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f76a0184340 0x7f76a01a4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40254/0 (socket says 10.20.193.106:40254) 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769f7fe640 1 -- 10.20.193.106:0/2261493124 learned_addr learned my addr 10.20.193.106:0/2261493124 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379763184 0 0) 0x7f76a0057bb0 con 0x7f76a0142190 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): my global_id is 5138 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76840035e0 con 0x7f76a0142190 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494045936 0 0) 0x7f76a00575f0 con 0x7f76a0184340 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): my global_id is 124113 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a0057bb0 con 0x7f76a0184340 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724272972 0 0) 0x7f76a00578d0 con 0x7f76a0141dc0 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient(hunting): my global_id is 94357 2026-02-17T05:41:09.263 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a00575f0 con 0x7f76a0141dc0 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2856557475 0 0) 0x7f76840035e0 con 0x7f76a0142190 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 >> v1:10.20.193.118:6789/0 conn(0x7f76a0141dc0 legacy=0x7f76a008fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 >> v1:10.20.193.106:6789/0 conn(0x7f76a0184340 legacy=0x7f76a01a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 monclient: found mon.noname-b 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a0057e90 con 0x7f76a0142190 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7690002d50 con 0x7f76a0142190 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: dump: 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.264 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 5 monclient: authenticate success, global_id 5138 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7690002f50 con 0x7f76a0142190 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 1 -- 10.20.193.106:0/2261493124 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7690003360 con 0x7f76a0142190 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f769effd640 10 monclient: dump: 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.265 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.254+0000 7f76a6a47640 4 set_mon_vals no callback set 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 10 monclient: shutdown 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- 10.20.193.106:0/2261493124 >> v1:10.20.193.106:6790/0 conn(0x7f76a0142190 legacy=0x7f76a01425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- 10.20.193.106:0/2261493124 shutdown_connections 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- 10.20.193.106:0/2261493124 >> 10.20.193.106:0/2261493124 conn(0x7f76a005e3c0 msgr2=0x7f76a0095420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- 10.20.193.106:0/2261493124 shutdown_connections 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- 10.20.193.106:0/2261493124 wait complete. 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 10 monclient: monmap: 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:09.266 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 Processor -- start 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 1 -- start start 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.255+0000 7f76a6a47640 10 monclient: init 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-a con 0x7f76a0141dc0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-c con 0x7f76a0142190 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient(hunting): picked mon.noname-b con 0x7f76a0184340 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a01a1d70 con 0x7f76a0141dc0 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a01a14d0 con 0x7f76a0184340 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a01a17b0 con 0x7f76a0142190 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient(hunting): authenticate will time out at 1397.885203s 2026-02-17T05:41:09.267 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769ffff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f76a0141dc0 0x7f76a01a52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40258/0 (socket says 10.20.193.106:40258) 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769ffff640 1 -- 10.20.193.106:0/50246230 learned_addr learned my addr 10.20.193.106:0/50246230 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190176487 0 0) 0x7f76a01a17b0 con 0x7f76a0142190 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): my global_id is 5141 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76700035e0 con 0x7f76a0142190 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540774046 0 0) 0x7f76a01a1d70 con 0x7f76a0141dc0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): my global_id is 124116 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a01a17b0 con 0x7f76a0141dc0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1258798106 0 0) 0x7f76a01a17b0 con 0x7f76a0141dc0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76a01a1d70 con 0x7f76a0141dc0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 711901809 0 0) 0x7f76700035e0 con 0x7f76a0142190 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76a01a17b0 con 0x7f76a0142190 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f768c0030a0 con 0x7f76a0141dc0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.268 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): dump: 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7690003270 con 0x7f76a0142190 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient(hunting): dump: 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.270 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1776462997 0 0) 0x7f76a01a1d70 con 0x7f76a0141dc0 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.106:6790/0 conn(0x7f76a0142190 legacy=0x7f76a019af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6789/0 conn(0x7f76a0184340 legacy=0x7f76a0130ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 monclient: found mon.a 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a01a1a90 con 0x7f76a0141dc0 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 5 monclient: authenticate success, global_id 124116 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _renew_subs 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76a008b500 con 0x7f76a0141dc0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _renew_subs 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f76a01a0760 con 0x7f76a0141dc0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f768c003200 con 0x7f76a0141dc0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f768c003980 con 0x7f76a0141dc0 2026-02-17T05:41:09.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769cff9640 10 monclient: dump: 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.273 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.256+0000 7f769e7fc640 4 set_mon_vals no callback set 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f76a6a47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f76a00008d0 con 0x7f76a019b650 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f768c003ae0 con 0x7f76a0141dc0 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(681..681 src has 472..681) ==== 3931+0+0 (unknown 2209813772 0 0) 0x7f768c04fd40 con 0x7f76a0141dc0 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420955331 0 0) 0x7f76a00008d0 con 0x7f76a019b650 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient(hunting): my global_id is 94360 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a01a1d70 con 0x7f76a019b650 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1448315413 0 0) 0x7f76a01a1d70 con 0x7f76a019b650 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76a00008d0 con 0x7f76a019b650 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7690004ef0 con 0x7f76a019b650 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 10 monclient: dump: 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.275 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f76a4fbd640 10 monclient: get_auth_request con 0x7f7670040ad0 auth_method 0 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2728478235 0 0) 0x7f76a00008d0 con 0x7f76a019b650 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.257+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76a019dab0 con 0x7f76a019b650 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.258+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f76900051f0 con 0x7f76a019b650 2026-02-17T05:41:09.276 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.258+0000 7f769cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.258+0000 7f769cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:09.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.258+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6789/0 conn(0x7f76a019b650 legacy=0x7f76a01a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.258+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6789/0 conn(0x7f76a019b650 legacy=0x7f76a01a5af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.261+0000 7f76a6a47640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.261+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f76a0094410 con 0x7f76a019f1a0 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835556757 0 0) 0x7f76a0094410 con 0x7f76a019f1a0 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient(hunting): my global_id is 94363 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a00008d0 con 0x7f76a019f1a0 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1055447496 0 0) 0x7f76a00008d0 con 0x7f76a019f1a0 2026-02-17T05:41:09.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76a0094410 con 0x7f76a019f1a0 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7690005900 con 0x7f76a019f1a0 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient: dump: 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.280 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3415361923 0 0) 0x7f76a0094410 con 0x7f76a019f1a0 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76a00945a0 con 0x7f76a019f1a0 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 3448831513) 0x7f7690007d90 con 0x7f76a019f1a0 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6789/0 conn(0x7f76a019f1a0 legacy=0x7f76a01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f769cff9640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6789/0 conn(0x7f76a019f1a0 legacy=0x7f76a01321f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 321506, 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:09.282 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.283 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.284 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.285 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:09.286 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.287 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:09.288 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:09.289 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.290 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:09.291 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:09.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.118:6812/703720803 conn(0x7f7670040ad0 legacy=0x7f7670060f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 10 monclient: shutdown 2026-02-17T05:41:09.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 >> v1:10.20.193.106:6789/0 conn(0x7f76a0141dc0 legacy=0x7f76a01a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a4fbd640 1 -- 10.20.193.106:0/50246230 reap_dead start 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a4fbd640 1 -- 10.20.193.106:0/50246230 reap_dead start 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 shutdown_connections 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 >> 10.20.193.106:0/50246230 conn(0x7f76a005e3c0 msgr2=0x7f76a0090620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 shutdown_connections 2026-02-17T05:41:09.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.262+0000 7f76a6a47640 1 -- 10.20.193.106:0/50246230 wait complete. 2026-02-17T05:41:09.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:09.293 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:41:09.293 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:41:09.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 10 monclient: get_monmap_and_config 2026-02-17T05:41:09.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 10 monclient: monmap: 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:09.359739+0000 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:09.359739+0000 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 1 Processor -- start 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 1 -- start start 2026-02-17T05:41:09.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.358+0000 7f4fb1b4c640 10 monclient: init 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fac05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fac05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fac182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac08b060 con 0x7f4fac05dee0 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac05dc90 con 0x7f4fac05d1b0 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac08d6a0 con 0x7f4fac182720 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient(hunting): authenticate will time out at 1397.988121s 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fabfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4fac182720 0x7f4fac1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59430/0 (socket says 10.20.193.106:59430) 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fabfff640 1 -- 10.20.193.106:0/1883281744 learned_addr learned my addr 10.20.193.106:0/1883281744 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000532327 0 0) 0x7f4fac08d6a0 con 0x7f4fac182720 2026-02-17T05:41:09.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): my global_id is 5144 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f900035e0 con 0x7f4fac182720 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555804808 0 0) 0x7f4fac08b060 con 0x7f4fac05dee0 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient(hunting): my global_id is 124119 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fac08d6a0 con 0x7f4fac05dee0 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1047901811 0 0) 0x7f4f900035e0 con 0x7f4fac182720 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 >> v1:10.20.193.118:6789/0 conn(0x7f4fac05d1b0 legacy=0x7f4fac05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 >> v1:10.20.193.106:6789/0 conn(0x7f4fac05dee0 legacy=0x7f4fac181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 monclient: found mon.noname-b 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac057960 con 0x7f4fac182720 2026-02-17T05:41:09.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4fa0003de0 con 0x7f4fac182720 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: dump: 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 5 monclient: authenticate success, global_id 5144 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fa00040a0 con 0x7f4fac182720 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 4 set_mon_vals no callback set 2026-02-17T05:41:09.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 1 -- 10.20.193.106:0/1883281744 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4fa00044b0 con 0x7f4fac182720 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4faa7fc640 10 monclient: dump: 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 10 monclient: shutdown 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/1883281744 >> v1:10.20.193.106:6790/0 conn(0x7f4fac182720 legacy=0x7f4fac1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/1883281744 shutdown_connections 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/1883281744 >> 10.20.193.106:0/1883281744 conn(0x7f4fac0915f0 msgr2=0x7f4fac0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/1883281744 shutdown_connections 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.359+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/1883281744 wait complete. 2026-02-17T05:41:09.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient: build_initial_monmap 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient: monmap: 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 1 Processor -- start 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 1 -- start start 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient: init 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fac05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fac05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fac182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac13d930 con 0x7f4fac05d1b0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac10c160 con 0x7f4fac05dee0 2026-02-17T05:41:09.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac05e8e0 con 0x7f4fac182720 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fb1b4c640 10 monclient(hunting): authenticate will time out at 1397.989826s 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fab7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f4fac05d1b0 0x7f4fac13cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40280/0 (socket says 10.20.193.106:40280) 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fabfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4fac182720 0x7f4fac181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59440/0 (socket says 10.20.193.106:59440) 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.360+0000 7f4fab7fe640 1 -- 10.20.193.106:0/3013114694 learned_addr learned my addr 10.20.193.106:0/3013114694 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058301029 0 0) 0x7f4fac13d930 con 0x7f4fac05d1b0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): my global_id is 124122 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c0035e0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001274517 0 0) 0x7f4fac05e8e0 con 0x7f4fac182720 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): my global_id is 5147 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fac13d930 con 0x7f4fac182720 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4115013815 0 0) 0x7f4f7c0035e0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fac05e8e0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f980030e0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): dump: 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59550437 0 0) 0x7f4fac13d930 con 0x7f4fac182720 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f7c0035e0 con 0x7f4fac182720 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4fa0003da0 con 0x7f4fac182720 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient(hunting): dump: 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.372 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2839592386 0 0) 0x7f4fac05e8e0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 >> v1:10.20.193.106:6790/0 conn(0x7f4fac182720 legacy=0x7f4fac181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 >> v1:10.20.193.118:6789/0 conn(0x7f4fac05dee0 legacy=0x7f4fac13d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 monclient: found mon.a 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1289d0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: _finish_auth 0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 5 monclient: authenticate success, global_id 124122 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _renew_subs 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac10ac70 con 0x7f4fac05d1b0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _renew_subs 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fac10cfd0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f980032b0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f98003b30 con 0x7f4fac05d1b0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 10 monclient: dump: 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:09.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fa9ffb640 4 set_mon_vals no callback set 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac1286f0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.361+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4f98003c90 con 0x7f4fac05d1b0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.363+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(681..681 src has 472..681) ==== 3931+0+0 (unknown 2209813772 0 0) 0x7f4f9804fdb0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.363+0000 7f4faaffd640 10 monclient: get_auth_request con 0x7f4f7c040b60 auth_method 0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.364+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f4f980041b0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.364+0000 7f4f87fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:09.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.364+0000 7f4f87fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:09.376 INFO:tasks.rados.rados.0.trial118.stdout:3157: done (3 left) 2026-02-17T05:41:09.376 INFO:tasks.rados.rados.0.trial118.stdout:3158: read oid 3 snap -1 2026-02-17T05:41:09.376 INFO:tasks.rados.rados.0.trial118.stdout:3158: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:41:09.376 INFO:tasks.rados.rados.0.trial118.stdout:3159: write (excl) oid 33 current snap is 335 2026-02-17T05:41:09.376 INFO:tasks.rados.rados.0.trial118.stdout:3159: seq_num 1113 ranges {706191=739675,1913635=431384} 2026-02-17T05:41:09.381 INFO:tasks.rados.rados.0.trial118.stdout:3159: writing trial11845692-33 from 706191 to 1445866 tid 1 2026-02-17T05:41:09.384 INFO:tasks.rados.rados.0.trial118.stdout:3159: writing trial11845692-33 from 1913635 to 2345019 tid 2 2026-02-17T05:41:09.384 INFO:tasks.rados.rados.0.trial118.stdout:3160: snap_create 2026-02-17T05:41:09.384 INFO:tasks.rados.rados.0.trial118.stdout:3156: finishing copy_from to trial11845692-28 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3156: got expected ENOENT (src dne) 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3156: finishing copy_from racing read to trial11845692-28 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: finishing write tid 2 to trial11845692-1 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: finishing write tid 3 to trial11845692-1 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: finishing write tid 4 to trial11845692-1 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: oid 1 updating version 0 to 1909 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: oid 1 version 1909 is already newer than 1908 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: oid 1 updating version 1909 to 1910 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1910 (ObjNum 1112 snap 335 seq_num 1112) dirty exists 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3154: left oid 1 (ObjNum 1112 snap 335 seq_num 1112) 2026-02-17T05:41:09.385 INFO:tasks.rados.rados.0.trial118.stdout:3158: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:41:09.430 INFO:tasks.rados.rados.0.trial118.stdout:3159: finishing write tid 1 to trial11845692-33 2026-02-17T05:41:09.430 INFO:tasks.rados.rados.0.trial118.stdout:3159: finishing write tid 2 to trial11845692-33 2026-02-17T05:41:09.430 INFO:tasks.rados.rados.0.trial118.stdout:3159: finishing write tid 3 to trial11845692-33 2026-02-17T05:41:09.430 INFO:tasks.rados.rados.0.trial118.stdout:3159: finishing write tid 4 to trial11845692-33 2026-02-17T05:41:09.431 INFO:tasks.rados.rados.0.trial118.stdout:3159: oid 33 updating version 0 to 1916 2026-02-17T05:41:09.431 INFO:tasks.rados.rados.0.trial118.stdout:3159: oid 33 version 1916 is already newer than 1915 2026-02-17T05:41:09.431 INFO:tasks.rados.rados.0.trial118.stdout:3159: oid 33 version 1916 is already newer than 1914 2026-02-17T05:41:09.431 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1916 (ObjNum 1113 snap 335 seq_num 1113) dirty exists 2026-02-17T05:41:09.431 INFO:tasks.rados.rados.0.trial118.stdout:3159: left oid 33 (ObjNum 1113 snap 335 seq_num 1113) 2026-02-17T05:41:09.512 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.510+0000 7f4fb1b4c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:41:09.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.510+0000 7f4fb1b4c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:41:09.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.510+0000 7f4fb1b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:09.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.510+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4fac057cd0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=13,kv=10,logm=58} crc {auth=435342990,config=1618278320,health=2431850529,kv=4013621802,logm=3967105432}) 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=21,config=2,health=13,kv=10,logm=54} crc {auth=1603359740,config=1618278320,health=1416386374,kv=2916408492,logm=331763126}) 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=13,kv=10,logm=58} crc {auth=435342990,config=1618278320,health=2431850529,kv=4013621802,logm=3967105432}) 2026-02-17T05:41:09.514 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.511+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=11,kv=9,logm=57} crc {auth=1603359740,config=1618278320,health=2368207260,kv=4024942127,logm=4294055238}) 2026-02-17T05:41:09.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.511+0000 7f4f87fff640 1 -- 10.20.193.106:0/3013114694 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f4f98016bd0 con 0x7f4fac05d1b0 2026-02-17T05:41:09.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.511+0000 7f4f87fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:41:09.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.511+0000 7f4f87fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1518055845}) 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4058287817}) 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1518055845}) 2026-02-17T05:41:09.516 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1729664413}) 2026-02-17T05:41:09.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 >> v1:10.20.193.118:6812/703720803 conn(0x7f4f7c040b60 legacy=0x7f4f7c061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 10 monclient: shutdown 2026-02-17T05:41:09.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:09.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 >> v1:10.20.193.106:6789/0 conn(0x7f4fac05d1b0 legacy=0x7f4fac13cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:09.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 shutdown_connections 2026-02-17T05:41:09.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 >> 10.20.193.106:0/3013114694 conn(0x7f4fac0915f0 msgr2=0x7f4fac08c540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:09.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 shutdown_connections 2026-02-17T05:41:09.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:09.512+0000 7f4fb1b4c640 1 -- 10.20.193.106:0/3013114694 wait complete. 2026-02-17T05:41:09.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.512+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=839836422}) 2026-02-17T05:41:09.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=454710351}) 2026-02-17T05:41:09.523 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=839836422}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1708024597}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233661589}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2350556668}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233661589}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.513+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2683711658}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1436776599}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3086250312}) 2026-02-17T05:41:09.524 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1436776599}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2872117984}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=198692489}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3064832008}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=198692489}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.514+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2383684671}) 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.525 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3179802835}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1564626431}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3179802835}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2620964291}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=516950655}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272791183}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=516950655}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=514699134}) 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.526 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.515+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=337552559}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3876869038}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=337552559}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=580218500}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3408981351}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3481761985}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3408981351}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.516+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2602504839}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=764799240}) 2026-02-17T05:41:09.527 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2338010534}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=764799240}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2433924643}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=741283118}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241192493}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=741283118}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.517+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1204216416}) 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.528 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3170645209}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=974399675}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3170645209}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1879147937}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3510041605}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=563507046}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3510041605}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.518+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1897856568}) 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.529 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2176311584}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2629993430}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2176311584}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.519+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1504982288}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805725292}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480951439}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805725292}) 2026-02-17T05:41:09.530 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3931750775}) 2026-02-17T05:41:09.532 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=272931709}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2683371308}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=272931709}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.520+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1214513099}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1049185719}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615649217}) 2026-02-17T05:41:09.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1049185719}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3070980151}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1480188684}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032914991}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1480188684}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.521+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3806551936}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4167237034}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3902884269}) 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4167237034}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4074843836}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3373135762}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896849545}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3373135762}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.523+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=354385677}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364806794}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1804903153}) 2026-02-17T05:41:09.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364806794}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.524+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2383433296}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2462886914}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3482705672}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2462886914}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942142323}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3887048652}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913552000}) 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3887048652}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.525+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1390672571}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=539733035}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1962227249}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=539733035}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1535827445}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3856833087}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512389837}) 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3856833087}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.526+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2513723214}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.527+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2234230203}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3162732334}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2234230203}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4076438213}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=209580156}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1077546842}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=209580156}) 2026-02-17T05:41:09.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.528+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3928223679}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=66,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3} crc {logm=1514752456,mdsmap=568353036,mgr=1186266238,mgr_command_descs=1585555342,mgr_metadata=2028857887,mgrstat=1032481666,mon_config_key=192551032,monmap=1459694897}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=65,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=1} crc {logm=523813598,mdsmap=443047005,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1776605958,mon_config_key=597233681,monmap=251183023}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=66,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8,monmap=3} crc {logm=1514752456,mdsmap=568353036,mgr=1186266238,mgr_command_descs=1585555342,mgr_metadata=2028857887,mgrstat=1032481666,mon_config_key=192551032,monmap=1459694897}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=65,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=2} crc {logm=2599004578,mdsmap=443047005,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=3850777752,mon_config_key=597233681,monmap=2903182810}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=91} crc {nvmeofgw=3360707892,osd_metadata=1163265349,osd_pg_creating=4038643834,osd_snap=1769356775}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=90} crc {nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4038643834,osd_snap=70425510}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=91} crc {nvmeofgw=3360707892,osd_metadata=1163265349,osd_pg_creating=4038643834,osd_snap=1769356775}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=90} crc {nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4038643834,osd_snap=3344070793}) 2026-02-17T05:41:09.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3104303629}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2654025545}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.529+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3104303629}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4277676460}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3152996239}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4194725776}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3152996239}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.530+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=126252225}) 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=202602173}) 2026-02-17T05:41:09.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1020448652}) 2026-02-17T05:41:09.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:41:09.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=202602173}) 2026-02-17T05:41:09.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:41:09.531+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=671497163}) 2026-02-17T05:41:10.345 INFO:tasks.rados.rados.0.trial118.stdout:3154: done (5 left) 2026-02-17T05:41:10.345 INFO:tasks.rados.rados.0.trial118.stdout:3155: done (4 left) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3156: done (3 left) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3158: done (2 left) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3159: done (1 left) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3160: done (0 left) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3161: rollback oid 33 current snap is 336 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 319 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3162: rollback oid 9 current snap is 336 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 335 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3163: read oid 12 snap 334 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3163: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:10.346 INFO:tasks.rados.rados.0.trial118.stdout:3164: snap_create 2026-02-17T05:41:10.347 INFO:tasks.rados.rados.0.trial118.stdout:3162: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:41:10.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 1848 (ObjNum 81 snap 0 seq_num 11557894) dirty dne 2026-02-17T05:41:10.349 INFO:tasks.rados.rados.0.trial118.stdout:3161: finishing rollback tid 0 to trial11845692-33 2026-02-17T05:41:10.349 INFO:tasks.rados.rados.0.trial118.stdout:3161: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:41:10.349 INFO:tasks.rados.rados.0.trial118.stdout:3163: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:10.355 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 621699 2026-02-17T05:41:10.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:10.458 INFO:tasks.rados.rados.0.trial118.stdout:3161: finishing rollback tid 2 to trial11845692-33 2026-02-17T05:41:10.458 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 1920 (ObjNum 1068 snap 319 seq_num 1068) dirty exists 2026-02-17T05:41:10.533 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:41:10.533 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:41:10.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.599+0000 7f9c2c74c640 10 monclient: get_monmap_and_config 2026-02-17T05:41:10.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.599+0000 7f9c2c74c640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.599+0000 7f9c2c74c640 10 monclient: monmap: 2026-02-17T05:41:10.616 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:10.600955+0000 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:10.600955+0000 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.617 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.618 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:10.618 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:10.618 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.618 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.599+0000 7f9c2c74c640 1 Processor -- start 2026-02-17T05:41:10.618 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 1 -- start start 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient: init 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-c con 0x7f9c2405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-a con 0x7f9c2405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-b con 0x7f9c24182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2408b060 con 0x7f9c2405dee0 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2405dc90 con 0x7f9c2405d1b0 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2408d6a0 con 0x7f9c24182720 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 10 monclient(hunting): authenticate will time out at 1399.229372s 2026-02-17T05:41:10.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2acc2640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9c24182720 0x7f9c241a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59456/0 (socket says 10.20.193.106:59456) 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2acc2640 1 -- 10.20.193.106:0/4245074051 learned_addr learned my addr 10.20.193.106:0/4245074051 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985814400 0 0) 0x7f9c2408b060 con 0x7f9c2405dee0 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): my global_id is 124125 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c0c0035e0 con 0x7f9c2405dee0 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874626302 0 0) 0x7f9c2408d6a0 con 0x7f9c24182720 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient(hunting): my global_id is 5150 2026-02-17T05:41:10.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c2408b060 con 0x7f9c24182720 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941799041 0 0) 0x7f9c0c0035e0 con 0x7f9c2405dee0 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 >> v1:10.20.193.106:6790/0 conn(0x7f9c24182720 legacy=0x7f9c241a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 >> v1:10.20.193.118:6789/0 conn(0x7f9c2405d1b0 legacy=0x7f9c2405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 monclient: found mon.noname-a 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c24057960 con 0x7f9c2405dee0 2026-02-17T05:41:10.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9c18002dd0 con 0x7f9c2405dee0 2026-02-17T05:41:10.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 5 monclient: authenticate success, global_id 124125 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 10 monclient: dump: 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.625 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c2c74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.600+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c18003010 con 0x7f9c2405dee0 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c294bf640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 4 set_mon_vals no callback set 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c294bf640 1 -- 10.20.193.106:0/4245074051 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9c18003420 con 0x7f9c2405dee0 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c294bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c294bf640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c294bf640 10 monclient: dump: 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.627 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 10 monclient: shutdown 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- 10.20.193.106:0/4245074051 >> v1:10.20.193.106:6789/0 conn(0x7f9c2405dee0 legacy=0x7f9c24181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- 10.20.193.106:0/4245074051 shutdown_connections 2026-02-17T05:41:10.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- 10.20.193.106:0/4245074051 >> 10.20.193.106:0/4245074051 conn(0x7f9c240915f0 msgr2=0x7f9c240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- 10.20.193.106:0/4245074051 shutdown_connections 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- 10.20.193.106:0/4245074051 wait complete. 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 10 monclient: monmap: 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.629 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 Processor -- start 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 1 -- start start 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.601+0000 7f9c2c74c640 10 monclient: init 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-c con 0x7f9c2405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-b con 0x7f9c2405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient(hunting): picked mon.noname-a con 0x7f9c24182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2405e8e0 con 0x7f9c24182720 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c24089a60 con 0x7f9c2405dee0 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2408a040 con 0x7f9c2405d1b0 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient(hunting): authenticate will time out at 1399.231099s 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2a4c1640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f9c2405d1b0 0x7f9c2413cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59470/0 (socket says 10.20.193.106:59470) 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2a4c1640 1 -- 10.20.193.106:0/3824268837 learned_addr learned my addr 10.20.193.106:0/3824268837 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915520171 0 0) 0x7f9c2408a040 con 0x7f9c2405d1b0 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): my global_id is 5153 2026-02-17T05:41:10.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bf40035e0 con 0x7f9c2405d1b0 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269558799 0 0) 0x7f9c2405e8e0 con 0x7f9c24182720 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): my global_id is 124128 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c2408a040 con 0x7f9c24182720 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2071307723 0 0) 0x7f9c2408a040 con 0x7f9c24182720 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c2405e8e0 con 0x7f9c24182720 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9c200040a0 con 0x7f9c24182720 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:10.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): dump: 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:10.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1239115982 0 0) 0x7f9bf40035e0 con 0x7f9c2405d1b0 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c2408a040 con 0x7f9c2405d1b0 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9c140030f0 con 0x7f9c2405d1b0 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient(hunting): dump: 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.634 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1721416005 0 0) 0x7f9c2405e8e0 con 0x7f9c24182720 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 >> v1:10.20.193.106:6790/0 conn(0x7f9c2405d1b0 legacy=0x7f9c2413cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 >> v1:10.20.193.118:6789/0 conn(0x7f9c2405dee0 legacy=0x7f9c2413d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 monclient: found mon.a 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c241824f0 con 0x7f9c24182720 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 5 monclient: authenticate success, global_id 124128 2026-02-17T05:41:10.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _renew_subs 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2410f060 con 0x7f9c24182720 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _renew_subs 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c2410eaa0 con 0x7f9c24182720 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c200045c0 con 0x7f9c24182720 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9c20005b30 con 0x7f9c24182720 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c0affd640 10 monclient: dump: 2026-02-17T05:41:10.636 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.602+0000 7f9c28cbe640 4 set_mon_vals no callback set 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c2c74c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c2c74c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c2c74c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2410d600 con 0x7f9c24182720 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f9c20012ad0 con 0x7f9c24182720 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7f9c20050d00 con 0x7f9c24182720 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.603+0000 7f9c2a4c1640 10 monclient: get_auth_request con 0x7f9bf4040c30 auth_method 0 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.605+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f9c2410d600 con 0x7f9c24182720 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.605+0000 7f9c0affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.605+0000 7f9c0affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:10.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c2c74c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c2c74c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c2c74c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9c2410d600 con 0x7f9c24182720 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c0affd640 1 -- 10.20.193.106:0/3824268837 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2389640975) 0x7f9c2410d600 con 0x7f9c24182720 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c0affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:10.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.751+0000 7f9c0affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:10.755 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 >> v1:10.20.193.118:6812/703720803 conn(0x7f9bf4040c30 legacy=0x7f9bf40610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 10 monclient: shutdown 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 >> v1:10.20.193.106:6789/0 conn(0x7f9c24182720 legacy=0x7f9c24181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 shutdown_connections 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 >> 10.20.193.106:0/3824268837 conn(0x7f9c240915f0 msgr2=0x7f9c2408c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 shutdown_connections 2026-02-17T05:41:10.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.752+0000 7f9c2c74c640 1 -- 10.20.193.106:0/3824268837 wait complete. 2026-02-17T05:41:10.762 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:41:10.763 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:41:10.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:41:10.763 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.828+0000 7f30046cc640 10 monclient: get_monmap_and_config 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.828+0000 7f30046cc640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.828+0000 7f30046cc640 10 monclient: monmap: 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:10.829943+0000 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:10.829943+0000 2026-02-17T05:41:10.838 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.828+0000 7f30046cc640 1 Processor -- start 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 1 -- start start 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient: init 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:10.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2ffc13ec40 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2ffc13f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2ffc1811f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc08a7d0 con 0x7f2ffc13f010 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc08d5c0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc08d800 con 0x7f2ffc1811f0 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient(hunting): authenticate will time out at 1399.458348s 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f3002c42640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2ffc1811f0 0x7f2ffc1a15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59480/0 (socket says 10.20.193.106:59480) 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f3002c42640 1 -- 10.20.193.106:0/2392571784 learned_addr learned my addr 10.20.193.106:0/2392571784 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645991142 0 0) 0x7f2ffc08d800 con 0x7f2ffc1811f0 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): my global_id is 5156 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe4005870 con 0x7f2ffc1811f0 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401037307 0 0) 0x7f2ffc08a7d0 con 0x7f2ffc13f010 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient(hunting): my global_id is 124131 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc08d800 con 0x7f2ffc13f010 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3191469078 0 0) 0x7f2fe4005870 con 0x7f2ffc1811f0 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 >> v1:10.20.193.118:6789/0 conn(0x7f2ffc13ec40 legacy=0x7f2ffc08ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc13f010 legacy=0x7f2ffc13f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 monclient: found mon.noname-b 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc08a180 con 0x7f2ffc1811f0 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ff8003de0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 5 monclient: authenticate success, global_id 5156 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: dump: 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.843 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ff8003fe0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 1 -- 10.20.193.106:0/2392571784 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ff80043f0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f300143f640 10 monclient: dump: 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.844 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.829+0000 7f30046cc640 4 set_mon_vals no callback set 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 10 monclient: shutdown 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- 10.20.193.106:0/2392571784 >> v1:10.20.193.106:6790/0 conn(0x7f2ffc1811f0 legacy=0x7f2ffc1a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- 10.20.193.106:0/2392571784 shutdown_connections 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- 10.20.193.106:0/2392571784 >> 10.20.193.106:0/2392571784 conn(0x7f2ffc0915f0 msgr2=0x7f2ffc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- 10.20.193.106:0/2392571784 shutdown_connections 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- 10.20.193.106:0/2392571784 wait complete. 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 10 monclient: monmap: 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:10.846 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 Processor -- start 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 1 -- start start 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.830+0000 7f30046cc640 10 monclient: init 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2ffc13ec40 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2ffc13f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2ffc1811f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc13d120 con 0x7f2ffc13ec40 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc05a9e0 con 0x7f2ffc13f010 2026-02-17T05:41:10.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc05e8e0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient(hunting): authenticate will time out at 1399.460056s 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f3002c42640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2ffc1811f0 0x7f2ffc05a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59492/0 (socket says 10.20.193.106:59492) 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f3002441640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2ffc13ec40 0x7f2ffc12a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40340/0 (socket says 10.20.193.106:40340) 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f3002c42640 1 -- 10.20.193.106:0/933786430 learned_addr learned my addr 10.20.193.106:0/933786430 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816523396 0 0) 0x7f2ffc13d120 con 0x7f2ffc13ec40 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): my global_id is 124134 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fcc0035e0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146479544 0 0) 0x7f2ffc05e8e0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): my global_id is 5159 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc13d120 con 0x7f2ffc1811f0 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1198604418 0 0) 0x7f2fcc0035e0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ffc05e8e0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2fec003030 con 0x7f2ffc13ec40 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): dump: 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.849 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2170560524 0 0) 0x7f2ffc13d120 con 0x7f2ffc1811f0 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fcc0035e0 con 0x7f2ffc1811f0 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ff8004300 con 0x7f2ffc1811f0 2026-02-17T05:41:10.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient(hunting): dump: 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.851 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2983362594 0 0) 0x7f2ffc05e8e0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6790/0 conn(0x7f2ffc1811f0 legacy=0x7f2ffc05a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.118:6789/0 conn(0x7f2ffc13f010 legacy=0x7f2ffc059bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 monclient: found mon.a 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc05b5e0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 5 monclient: authenticate success, global_id 124134 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _renew_subs 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc05d0a0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _renew_subs 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ffc05c140 con 0x7f2ffc13ec40 2026-02-17T05:41:10.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fec0036d0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2fec003a70 con 0x7f2ffc13ec40 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f2fe2ffd640 10 monclient: dump: 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.854 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f3000c3e640 4 set_mon_vals no callback set 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.831+0000 7f30046cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ffc0008d0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2fec003bd0 con 0x7f2ffc13ec40 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160545003 0 0) 0x7f2ffc0008d0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient(hunting): my global_id is 124137 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc05e8e0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7f2fec04fd80 con 0x7f2ffc13ec40 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 981678999 0 0) 0x7f2ffc05e8e0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ffc0008d0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ff0002e30 con 0x7f2ffc08ba10 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 10 monclient: dump: 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.856 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f3002c42640 10 monclient: get_auth_request con 0x7f2fcc040bb0 auth_method 0 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 714040851 0 0) 0x7f2ffc0008d0 con 0x7f2ffc08ba10 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ffc12b530 con 0x7f2ffc08ba10 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.832+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2ff0004450 con 0x7f2ffc08ba10 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.833+0000 7f2fe2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.833+0000 7f2fe2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:10.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.833+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc08ba10 legacy=0x7f2ffc11ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.833+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc08ba10 legacy=0x7f2ffc11ca50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:10.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f30046cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:10.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ffc090010 con 0x7f2ffc11d160 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622009559 0 0) 0x7f2ffc090010 con 0x7f2ffc11d160 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient(hunting): my global_id is 124140 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc0008d0 con 0x7f2ffc11d160 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3765323579 0 0) 0x7f2ffc0008d0 con 0x7f2ffc11d160 2026-02-17T05:41:10.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ffc090010 con 0x7f2ffc11d160 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2ff00034c0 con 0x7f2ffc11d160 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.836+0000 7f2fe2ffd640 10 monclient: dump: 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.861 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3648988337 0 0) 0x7f2ffc090010 con 0x7f2ffc11d160 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ffc0901a0 con 0x7f2ffc11d160 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 3077736733) 0x7f2ff0003820 con 0x7f2ffc11d160 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc11d160 legacy=0x7f2ffc10dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f2fe2ffd640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc11d160 legacy=0x7f2ffc10dcf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 2001, 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.864 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 1, 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.865 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.866 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:10.867 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.868 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.869 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.870 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:10.871 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.872 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.873 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:10.874 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:10.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.118:6812/703720803 conn(0x7f2fcc040bb0 legacy=0x7f2fcc061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 10 monclient: shutdown 2026-02-17T05:41:10.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 >> v1:10.20.193.106:6789/0 conn(0x7f2ffc13ec40 legacy=0x7f2ffc12a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.875 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f3002c42640 1 -- 10.20.193.106:0/933786430 reap_dead start 2026-02-17T05:41:10.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f3002c42640 1 -- 10.20.193.106:0/933786430 reap_dead start 2026-02-17T05:41:10.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 shutdown_connections 2026-02-17T05:41:10.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 >> 10.20.193.106:0/933786430 conn(0x7f2ffc0915f0 msgr2=0x7f2ffc11ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 shutdown_connections 2026-02-17T05:41:10.876 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.837+0000 7f30046cc640 1 -- 10.20.193.106:0/933786430 wait complete. 2026-02-17T05:41:10.876 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:10.876 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:41:10.876 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:41:10.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.939+0000 7f4f81252640 10 monclient: get_monmap_and_config 2026-02-17T05:41:10.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.939+0000 7f4f81252640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.939+0000 7f4f81252640 10 monclient: monmap: 2026-02-17T05:41:10.941 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:10.941254+0000 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:10.941254+0000 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 1 Processor -- start 2026-02-17T05:41:10.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 1 -- start start 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient: init 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-b con 0x7f4f7c13bb70 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-c con 0x7f4f7c08d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-a con 0x7f4f7c1849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c05cca0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c13c650 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c05e010 con 0x7f4f7c13bb70 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f81252640 10 monclient(hunting): authenticate will time out at 1399.569785s 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f7ad76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4f7c13bb70 0x7f4f7c13bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59502/0 (socket says 10.20.193.106:59502) 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f7b577640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f4f7c1849f0 0x7f4f7c1a4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40364/0 (socket says 10.20.193.106:40364) 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.940+0000 7f4f7ad76640 1 -- 10.20.193.106:0/1264822935 learned_addr learned my addr 10.20.193.106:0/1264822935 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296018544 0 0) 0x7f4f7c05cca0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): my global_id is 124143 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f680035e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838400374 0 0) 0x7f4f7c05e010 con 0x7f4f7c13bb70 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient(hunting): my global_id is 5162 2026-02-17T05:41:10.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c05cca0 con 0x7f4f7c13bb70 2026-02-17T05:41:10.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 434100064 0 0) 0x7f4f680035e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c13bb70 legacy=0x7f4f7c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 >> v1:10.20.193.118:6789/0 conn(0x7f4f7c08d4f0 legacy=0x7f4f7c1832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 monclient: found mon.noname-a 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c08d950 con 0x7f4f7c1849f0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f6c003eb0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 5 monclient: authenticate success, global_id 124143 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: dump: 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f6c004080 con 0x7f4f7c1849f0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 1 -- 10.20.193.106:0/1264822935 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f6c004490 con 0x7f4f7c1849f0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f79d74640 10 monclient: dump: 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.946 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 4 set_mon_vals no callback set 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 10 monclient: shutdown 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 1 -- 10.20.193.106:0/1264822935 >> v1:10.20.193.106:6789/0 conn(0x7f4f7c1849f0 legacy=0x7f4f7c1a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 1 -- 10.20.193.106:0/1264822935 shutdown_connections 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 1 -- 10.20.193.106:0/1264822935 >> 10.20.193.106:0/1264822935 conn(0x7f4f7c0915f0 msgr2=0x7f4f7c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 1 -- 10.20.193.106:0/1264822935 shutdown_connections 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.941+0000 7f4f81252640 1 -- 10.20.193.106:0/1264822935 wait complete. 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient: build_initial_monmap 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient: monmap: 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 1 Processor -- start 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 1 -- start start 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient: init 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-c con 0x7f4f7c08d4f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-b con 0x7f4f7c13bb70 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient(hunting): picked mon.noname-a con 0x7f4f7c1849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c192e80 con 0x7f4f7c1849f0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c08a7a0 con 0x7f4f7c13bb70 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c05e8e0 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:10.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f81252640 10 monclient(hunting): authenticate will time out at 1399.571542s 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f7ad76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f4f7c08d4f0 0x7f4f7c1a03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59508/0 (socket says 10.20.193.106:59508) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f7b577640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f4f7c1849f0 0x7f4f7c181260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40374/0 (socket says 10.20.193.106:40374) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f7ad76640 1 -- 10.20.193.106:0/114947505 learned_addr learned my addr 10.20.193.106:0/114947505 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632728029 0 0) 0x7f4f7c192e80 con 0x7f4f7c1849f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): my global_id is 124146 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f480035e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972993594 0 0) 0x7f4f7c05e8e0 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): my global_id is 5165 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c192e80 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3801827935 0 0) 0x7f4f480035e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f7c05e8e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f6c003c10 con 0x7f4f7c1849f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): dump: 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3455239193 0 0) 0x7f4f7c192e80 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f480035e0 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f70003090 con 0x7f4f7c08d4f0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.942+0000 7f4f5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): dump: 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2287819206 0 0) 0x7f4f7c05e8e0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c08d4f0 legacy=0x7f4f7c1a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.118:6789/0 conn(0x7f4f7c13bb70 legacy=0x7f4f7c17fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 monclient: found mon.a 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c12a420 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: _finish_auth 0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 5 monclient: authenticate success, global_id 124146 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 10 monclient: _renew_subs 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c08a250 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 10 monclient: _renew_subs 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f7c128c20 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f6c003ef0 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f6c003a80 con 0x7f4f7c1849f0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient: dump: 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.949 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f79573640 4 set_mon_vals no callback set 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f7c1a5740 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214074024 0 0) 0x7f4f7c1a5740 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 10 monclient(hunting): my global_id is 5168 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c05e8e0 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.943+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4f6c012c20 con 0x7f4f7c1849f0 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7f4f6c050e90 con 0x7f4f7c1849f0 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2841732779 0 0) 0x7f4f7c05e8e0 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f7c1a5740 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f700048a0 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 10 monclient: dump: 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f7a575640 10 monclient: get_auth_request con 0x7f4f48040b70 auth_method 0 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1891490619 0 0) 0x7f4f7c1a5740 con 0x7f4f7c1a5370 2026-02-17T05:41:10.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c05d940 con 0x7f4f7c1a5370 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4f70005990 con 0x7f4f7c1a5370 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c1a5370 legacy=0x7f4f7c1a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.944+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c1a5370 legacy=0x7f4f7c1a10a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f81252640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f7c1a0e80 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992032524 0 0) 0x7f4f7c1a0e80 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient(hunting): my global_id is 5171 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c1a5740 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 454287737 0 0) 0x7f4f7c1a5740 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f7c1a0e80 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4f70005200 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:10.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.947+0000 7f4f5b7fe640 10 monclient: dump: 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2803929452 0 0) 0x7f4f7c1a0e80 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f7c08e3d0 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 1091639404) 0x7f4f700055d0 con 0x7f4f7c1a0ab0 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c1a0ab0 legacy=0x7f4f7c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f5b7fe640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6790/0 conn(0x7f4f7c1a0ab0 legacy=0x7f4f7c1a17b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 795709, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:41:10.952 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:10.953 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:10.954 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:10.955 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:10.956 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.118:6812/703720803 conn(0x7f4f48040b70 legacy=0x7f4f48061020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 10 monclient: shutdown 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 >> v1:10.20.193.106:6789/0 conn(0x7f4f7c1849f0 legacy=0x7f4f7c181260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f7b577640 1 -- 10.20.193.106:0/114947505 reap_dead start 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f7b577640 1 -- 10.20.193.106:0/114947505 reap_dead start 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 shutdown_connections 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 >> 10.20.193.106:0/114947505 conn(0x7f4f7c0915f0 msgr2=0x7f4f7c054bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 shutdown_connections 2026-02-17T05:41:10.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:10.948+0000 7f4f81252640 1 -- 10.20.193.106:0/114947505 wait complete. 2026-02-17T05:41:10.957 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:10.957 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:41:10.958 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:41:11.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: get_monmap_and_config 2026-02-17T05:41:11.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: build_initial_monmap 2026-02-17T05:41:11.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: monmap: 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:11.021504+0000 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:11.021504+0000 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 1 Processor -- start 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 1 -- start start 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: init 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-a con 0x7f3d9405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-b con 0x7f3d9405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:11.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-c con 0x7f3d94182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9408b060 con 0x7f3d9405d1b0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9405dc90 con 0x7f3d94182720 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9408d6a0 con 0x7f3d9405dee0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.020+0000 7f3d9ae5b640 10 monclient(hunting): authenticate will time out at 1399.649900s 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3d9405dee0 0x7f3d94181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59528/0 (socket says 10.20.193.106:59528) 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8bfff640 1 -- 10.20.193.106:0/371719866 learned_addr learned my addr 10.20.193.106:0/371719866 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d98bd0640 1 --1- 10.20.193.106:0/371719866 >> v1:10.20.193.106:6789/0 conn(0x7f3d9405d1b0 0x7f3d9405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40386/0 (socket says 10.20.193.106:40386) 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188479983 0 0) 0x7f3d9408d6a0 con 0x7f3d9405dee0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): my global_id is 5174 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d800035e0 con 0x7f3d9405dee0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900790697 0 0) 0x7f3d9408b060 con 0x7f3d9405d1b0 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): my global_id is 124149 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9408d6a0 con 0x7f3d9405d1b0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790474337 0 0) 0x7f3d9405dc90 con 0x7f3d94182720 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient(hunting): my global_id is 94390 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9408b060 con 0x7f3d94182720 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1905953674 0 0) 0x7f3d800035e0 con 0x7f3d9405dee0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 >> v1:10.20.193.118:6789/0 conn(0x7f3d94182720 legacy=0x7f3d941a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 >> v1:10.20.193.106:6789/0 conn(0x7f3d9405d1b0 legacy=0x7f3d9405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 monclient: found mon.noname-b 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d94057960 con 0x7f3d9405dee0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: _finish_auth 0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d7c002dd0 con 0x7f3d9405dee0 2026-02-17T05:41:11.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 5 monclient: authenticate success, global_id 5174 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: dump: 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d7c002fd0 con 0x7f3d9405dee0 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 1 -- 10.20.193.106:0/371719866 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d7c0033a0 con 0x7f3d9405dee0 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:11.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 4 set_mon_vals no callback set 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d8b7fe640 10 monclient: dump: 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 10 monclient: shutdown 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/371719866 >> v1:10.20.193.106:6790/0 conn(0x7f3d9405dee0 legacy=0x7f3d94181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/371719866 shutdown_connections 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/371719866 >> 10.20.193.106:0/371719866 conn(0x7f3d940915f0 msgr2=0x7f3d940919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/371719866 shutdown_connections 2026-02-17T05:41:11.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.021+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/371719866 wait complete. 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient: build_initial_monmap 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient: monmap: 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 1 Processor -- start 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 1 -- start start 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient: init 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:41:11.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-c con 0x7f3d9405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-a con 0x7f3d9405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient(hunting): picked mon.noname-b con 0x7f3d94182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9410eed0 con 0x7f3d9405dee0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9412ae00 con 0x7f3d94182720 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d94089a60 con 0x7f3d9405d1b0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d9ae5b640 10 monclient(hunting): authenticate will time out at 1399.651604s 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d98bd0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f3d9405d1b0 0x7f3d94129fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59540/0 (socket says 10.20.193.106:59540) 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d98bd0640 1 -- 10.20.193.106:0/2071943872 learned_addr learned my addr 10.20.193.106:0/2071943872 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678424127 0 0) 0x7f3d9410eed0 con 0x7f3d9405dee0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): my global_id is 124152 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d640035e0 con 0x7f3d9405dee0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123800266 0 0) 0x7f3d94089a60 con 0x7f3d9405d1b0 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): my global_id is 5177 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9410eed0 con 0x7f3d9405d1b0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3301677772 0 0) 0x7f3d640035e0 con 0x7f3d9405dee0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d94089a60 con 0x7f3d9405dee0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d7c002b30 con 0x7f3d9405dee0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): dump: 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.022+0000 7f3d897fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:11.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 848997386 0 0) 0x7f3d9410eed0 con 0x7f3d9405d1b0 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d640035e0 con 0x7f3d9405d1b0 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d84003240 con 0x7f3d9405d1b0 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient(hunting): dump: 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1177941785 0 0) 0x7f3d94089a60 con 0x7f3d9405dee0 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.106:6790/0 conn(0x7f3d9405d1b0 legacy=0x7f3d94129fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6789/0 conn(0x7f3d94182720 legacy=0x7f3d94181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: _finish_hunting 0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 monclient: found mon.a 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9413f690 con 0x7f3d9405dee0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: _finish_auth 0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: _check_auth_tickets 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 5 monclient: authenticate success, global_id 124152 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 10 monclient: _renew_subs 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9405e8e0 con 0x7f3d9405dee0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 10 monclient: _renew_subs 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d9410ebf0 con 0x7f3d9405dee0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d7c004b50 con 0x7f3d9405dee0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d7c002d80 con 0x7f3d9405dee0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d8affd640 4 set_mon_vals no callback set 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 10 monclient: dump: 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d9412d950 con 0x7f3d9412d580 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3d7c011cb0 con 0x7f3d9405dee0 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.023+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7f3d7c04fdf0 con 0x7f3d9405dee0 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d993d1640 10 monclient: get_auth_request con 0x7f3d64040bb0 auth_method 0 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087461166 0 0) 0x7f3d9412d950 con 0x7f3d9412d580 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient(hunting): my global_id is 94396 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d94089a60 con 0x7f3d9412d580 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3412463218 0 0) 0x7f3d94089a60 con 0x7f3d9412d580 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d9412d950 con 0x7f3d9412d580 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d84004a50 con 0x7f3d9412d580 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 10 monclient: dump: 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2830685255 0 0) 0x7f3d9412d950 con 0x7f3d9412d580 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.024+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d94057ca0 con 0x7f3d9412d580 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.025+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3d84004e90 con 0x7f3d9412d580 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.025+0000 7f3d897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.025+0000 7f3d897fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.025+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6789/0 conn(0x7f3d9412d580 legacy=0x7f3d94059140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.025+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6789/0 conn(0x7f3d9412d580 legacy=0x7f3d94059140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.028+0000 7f3d9ae5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.028+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d9410da80 con 0x7f3d94059850 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74513954 0 0) 0x7f3d9410da80 con 0x7f3d94059850 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient(hunting): my global_id is 94399 2026-02-17T05:41:11.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9412d950 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1898560038 0 0) 0x7f3d9412d950 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d9410da80 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3d84005420 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 10 monclient: dump: 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3901828699 0 0) 0x7f3d9410da80 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.029+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d94055570 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 2861868940) 0x7f3d84006940 con 0x7f3d94059850 2026-02-17T05:41:11.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d897fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6789/0 conn(0x7f3d94059850 legacy=0x7f3d9411b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d897fa640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6789/0 conn(0x7f3d94059850 legacy=0x7f3d9411b4b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 44, 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 323273, 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:11.043 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.044 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:11.045 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:11.046 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:11.047 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:11.048 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:11.049 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:11.050 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "num": 4 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:11.051 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:11.052 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.118:6812/703720803 conn(0x7f3d64040bb0 legacy=0x7f3d64061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 10 monclient: shutdown 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 >> v1:10.20.193.106:6789/0 conn(0x7f3d9405dee0 legacy=0x7f3d9412a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d993d1640 1 -- 10.20.193.106:0/2071943872 reap_dead start 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d993d1640 1 -- 10.20.193.106:0/2071943872 reap_dead start 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 shutdown_connections 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 >> 10.20.193.106:0/2071943872 conn(0x7f3d940915f0 msgr2=0x7f3d9408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 shutdown_connections 2026-02-17T05:41:11.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.030+0000 7f3d9ae5b640 1 -- 10.20.193.106:0/2071943872 wait complete. 2026-02-17T05:41:11.054 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:41:11.054 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T05:41:11.054 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:41:11.054 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T05:41:11.054 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T05:41:11.054 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T05:41:11.054 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:41:11.066 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T05:41:11.066 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:41:11.066 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.127+0000 7fbd4cc83640 10 monclient: get_monmap_and_config 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.127+0000 7fbd4cc83640 10 monclient: build_initial_monmap 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.127+0000 7fbd4cc83640 10 monclient: monmap: 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:11.128975+0000 2026-02-17T05:41:11.134 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:11.128975+0000 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.127+0000 7fbd4cc83640 1 Processor -- start 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 1 -- start start 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient: init 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-a con 0x7fbd4808be90 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-c con 0x7fbd4808cc00 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-b con 0x7fbd481824b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4808a6e0 con 0x7fbd4808be90 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4808afe0 con 0x7fbd4808cc00 2026-02-17T05:41:11.135 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4808d3a0 con 0x7fbd481824b0 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient(hunting): authenticate will time out at 1399.757360s 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd46ffd640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7fbd4808cc00 legacy=0x7fbd48180d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd477fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fbd4808be90 0x7fbd4808c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40410/0 (socket says 10.20.193.106:40410) 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd477fe640 1 -- 10.20.193.106:0/3204346976 learned_addr learned my addr 10.20.193.106:0/3204346976 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353611857 0 0) 0x7fbd4808d3a0 con 0x7fbd481824b0 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): my global_id is 5180 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd2c0035e0 con 0x7fbd481824b0 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211397628 0 0) 0x7fbd4808a6e0 con 0x7fbd4808be90 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient(hunting): my global_id is 124155 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd4808d3a0 con 0x7fbd4808be90 2026-02-17T05:41:11.136 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3300654392 0 0) 0x7fbd2c0035e0 con 0x7fbd481824b0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 >> v1:10.20.193.118:6789/0 conn(0x7fbd4808cc00 legacy=0x7fbd48180d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 >> v1:10.20.193.106:6789/0 conn(0x7fbd4808be90 legacy=0x7fbd4808c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: _finish_hunting 0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 monclient: found mon.noname-b 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd480578b0 con 0x7fbd481824b0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: _finish_auth 0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: _check_auth_tickets 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd3c003eb0 con 0x7fbd481824b0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: dump: 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.137 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 5 monclient: authenticate success, global_id 5180 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd3c0040b0 con 0x7fbd481824b0 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 1 -- 10.20.193.106:0/3204346976 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd3c0044c0 con 0x7fbd481824b0 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd467fc640 10 monclient: dump: 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.138 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.128+0000 7fbd4cc83640 4 set_mon_vals no callback set 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 10 monclient: shutdown 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- 10.20.193.106:0/3204346976 >> v1:10.20.193.106:6790/0 conn(0x7fbd481824b0 legacy=0x7fbd481a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- 10.20.193.106:0/3204346976 shutdown_connections 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- 10.20.193.106:0/3204346976 >> 10.20.193.106:0/3204346976 conn(0x7fbd48054d80 msgr2=0x7fbd48090ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- 10.20.193.106:0/3204346976 shutdown_connections 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- 10.20.193.106:0/3204346976 wait complete. 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 10 monclient: build_initial_monmap 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 10 monclient: monmap: 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:11.139 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 Processor -- start 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 1 -- start start 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.129+0000 7fbd4cc83640 10 monclient: init 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-c con 0x7fbd4808be90 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-b con 0x7fbd481824b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient(hunting): picked mon.noname-a con 0x7fbd48131190 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd48089730 con 0x7fbd48131190 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4805a560 con 0x7fbd481824b0 2026-02-17T05:41:11.140 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd48188700 con 0x7fbd4808be90 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient(hunting): authenticate will time out at 1399.759061s 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd477fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbd4808be90 0x7fbd4819cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:59554/0 (socket says 10.20.193.106:59554) 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd46ffd640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7fbd481824b0 legacy=0x7fbd48171980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd477fe640 1 -- 10.20.193.106:0/4157363319 learned_addr learned my addr 10.20.193.106:0/4157363319 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156683914 0 0) 0x7fbd48188700 con 0x7fbd4808be90 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): my global_id is 5183 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd180035e0 con 0x7fbd4808be90 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007012073 0 0) 0x7fbd48089730 con 0x7fbd48131190 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): my global_id is 124158 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd48188700 con 0x7fbd48131190 2026-02-17T05:41:11.141 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1224129094 0 0) 0x7fbd48188700 con 0x7fbd48131190 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd48089730 con 0x7fbd48131190 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd3c0043d0 con 0x7fbd48131190 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): dump: 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3410675297 0 0) 0x7fbd180035e0 con 0x7fbd4808be90 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd48188700 con 0x7fbd4808be90 2026-02-17T05:41:11.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd340031f0 con 0x7fbd4808be90 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient(hunting): dump: 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3437315616 0 0) 0x7fbd48089730 con 0x7fbd48131190 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 >> v1:10.20.193.106:6790/0 conn(0x7fbd4808be90 legacy=0x7fbd4819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 >> v1:10.20.193.118:6789/0 conn(0x7fbd481824b0 legacy=0x7fbd48171980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 monclient: found mon.a 2026-02-17T05:41:11.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4805cc00 con 0x7fbd48131190 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: _finish_auth 0 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 5 monclient: authenticate success, global_id 124158 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _renew_subs 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4805e6e0 con 0x7fbd48131190 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _renew_subs 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd4819d470 con 0x7fbd48131190 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd3c0039f0 con 0x7fbd48131190 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd3c004b90 con 0x7fbd48131190 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:11.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd23fff640 10 monclient: dump: 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd45ffb640 4 set_mon_vals no callback set 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.130+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd48187ff0 con 0x7fbd48131190 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.131+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fbd3c011b30 con 0x7fbd48131190 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.131+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7fbd3c04fc70 con 0x7fbd48131190 2026-02-17T05:41:11.145 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.131+0000 7fbd477fe640 10 monclient: get_auth_request con 0x7fbd18040b60 auth_method 0 2026-02-17T05:41:11.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.133+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fbd3c017390 con 0x7fbd48131190 2026-02-17T05:41:11.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.133+0000 7fbd23fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:11.146 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.133+0000 7fbd23fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:11.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd4cc83640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd4cc83640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd4cc83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd48090010 con 0x7fbd48131190 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd23fff640 1 -- 10.20.193.106:0/4157363319 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3062468527) 0x7fbd3c016b40 con 0x7fbd48131190 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd23fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:11.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.278+0000 7fbd23fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:11.282 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:41:11.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 >> v1:10.20.193.118:6812/703720803 conn(0x7fbd18040b60 legacy=0x7fbd18061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 10 monclient: shutdown 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 >> v1:10.20.193.106:6789/0 conn(0x7fbd48131190 legacy=0x7fbd481730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 shutdown_connections 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 >> 10.20.193.106:0/4157363319 conn(0x7fbd48054d80 msgr2=0x7fbd48058ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 shutdown_connections 2026-02-17T05:41:11.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:11.279+0000 7fbd4cc83640 1 -- 10.20.193.106:0/4157363319 wait complete. 2026-02-17T05:41:14.289 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.352+0000 7f650a65b640 10 monclient: get_monmap_and_config 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.352+0000 7f650a65b640 10 monclient: build_initial_monmap 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.352+0000 7f650a65b640 10 monclient: monmap: 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:14.354031+0000 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:14.354031+0000 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:14.359 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 1 Processor -- start 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 1 -- start start 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient: init 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f650413bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f650408d4f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f65041849f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650405cca0 con 0x7f650413bb70 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650413c650 con 0x7f650408d4f0 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650405e010 con 0x7f65041849f0 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 10 monclient(hunting): authenticate will time out at 1402.982422s 2026-02-17T05:41:14.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f65037fe640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f650408d4f0 legacy=0x7f65041832d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6503fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f650413bb70 0x7f650413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:44104/0 (socket says 10.20.193.106:44104) 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6503fff640 1 -- 10.20.193.106:0/245383662 learned_addr learned my addr 10.20.193.106:0/245383662 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686650693 0 0) 0x7f650405e010 con 0x7f65041849f0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient(hunting): my global_id is 5186 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64e80035e0 con 0x7f65041849f0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2194192684 0 0) 0x7f64e80035e0 con 0x7f65041849f0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 >> v1:10.20.193.118:6789/0 conn(0x7f650408d4f0 legacy=0x7f65041832d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 >> v1:10.20.193.106:6789/0 conn(0x7f650413bb70 legacy=0x7f650413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 monclient: found mon.noname-b 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650408d950 con 0x7f65041849f0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: _finish_auth 0 2026-02-17T05:41:14.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f64f8003eb0 con 0x7f65041849f0 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f6502ffd640 10 monclient: dump: 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:14.362 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 5 monclient: authenticate success, global_id 5186 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.353+0000 7f650a65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64f8004080 con 0x7f65041849f0 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 1 -- 10.20.193.106:0/245383662 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f64f8004490 con 0x7f65041849f0 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:14.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f6502ffd640 10 monclient: dump: 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 4 set_mon_vals no callback set 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 10 monclient: shutdown 2026-02-17T05:41:14.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- 10.20.193.106:0/245383662 >> v1:10.20.193.106:6790/0 conn(0x7f65041849f0 legacy=0x7f65041a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- 10.20.193.106:0/245383662 shutdown_connections 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- 10.20.193.106:0/245383662 >> 10.20.193.106:0/245383662 conn(0x7f65040915f0 msgr2=0x7f65040919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- 10.20.193.106:0/245383662 shutdown_connections 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- 10.20.193.106:0/245383662 wait complete. 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 10 monclient: build_initial_monmap 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 10 monclient: monmap: 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:14.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 Processor -- start 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 1 -- start start 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.354+0000 7f650a65b640 10 monclient: init 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f650408d4f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f650413bb70 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f65041849f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650410d740 con 0x7f650413bb70 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650405e8e0 con 0x7f65041849f0 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65041299e0 con 0x7f650408d4f0 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient(hunting): authenticate will time out at 1402.984209s 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f65037fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f650413bb70 0x7f650413b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:44116/0 (socket says 10.20.193.106:44116) 2026-02-17T05:41:14.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f65037fe640 1 -- 10.20.193.106:0/3072735379 learned_addr learned my addr 10.20.193.106:0/3072735379 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6503fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f650408d4f0 0x7f650413aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:53418/0 (socket says 10.20.193.106:53418) 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6508bd1640 1 -- 10.20.193.106:0/3072735379 >> v1:10.20.193.118:6789/0 conn(0x7f65041849f0 legacy=0x7f6504180b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299512004 0 0) 0x7f65041299e0 con 0x7f650408d4f0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): my global_id is 5189 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64d40035e0 con 0x7f650408d4f0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3107618061 0 0) 0x7f64d40035e0 con 0x7f650408d4f0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65041299e0 con 0x7f650408d4f0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f64f0002f30 con 0x7f650408d4f0 2026-02-17T05:41:14.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): dump: 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:14.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2642175931 0 0) 0x7f65041299e0 con 0x7f650408d4f0 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 >> v1:10.20.193.118:6789/0 conn(0x7f65041849f0 legacy=0x7f6504180b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 >> v1:10.20.193.106:6789/0 conn(0x7f650413bb70 legacy=0x7f650413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 monclient: found mon.c 2026-02-17T05:41:14.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650410bc80 con 0x7f650408d4f0 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: _finish_auth 0 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 5 monclient: authenticate success, global_id 5189 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _renew_subs 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f650410dfe0 con 0x7f650408d4f0 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _renew_subs 2026-02-17T05:41:14.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6504129e30 con 0x7f650408d4f0 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64f0003100 con 0x7f650408d4f0 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f64f0004a90 con 0x7f650408d4f0 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f6500ff9640 10 monclient: dump: 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:14.371 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.355+0000 7f65027fc640 4 set_mon_vals no callback set 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f650a65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:14.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f650a65b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:14.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f650a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650412a0e0 con 0x7f650408d4f0 2026-02-17T05:41:14.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f64f0004bf0 con 0x7f650408d4f0 2026-02-17T05:41:14.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(683..683 src has 472..683) ==== 3947+0+0 (unknown 1824173881 0 0) 0x7f64f004fdb0 con 0x7f650408d4f0 2026-02-17T05:41:14.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.356+0000 7f65037fe640 10 monclient: get_auth_request con 0x7f64d4040740 auth_method 0 2026-02-17T05:41:14.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.359+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f64f0016da0 con 0x7f650408d4f0 2026-02-17T05:41:14.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.359+0000 7f6500ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:14.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.359+0000 7f6500ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.504+0000 7f650a65b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.504+0000 7f650a65b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.504+0000 7f650a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.504+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6504055570 con 0x7f650408d4f0 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.505+0000 7f6500ff9640 1 -- 10.20.193.106:0/3072735379 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3504793231) 0x7f64f0016bc0 con 0x7f650408d4f0 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.505+0000 7f6500ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.505+0000 7f6500ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:14.507 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 >> v1:10.20.193.118:6812/703720803 conn(0x7f64d4040740 legacy=0x7f64d4060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 10 monclient: shutdown 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 >> v1:10.20.193.106:6790/0 conn(0x7f650408d4f0 legacy=0x7f650413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 shutdown_connections 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 >> 10.20.193.106:0/3072735379 conn(0x7f65040915f0 msgr2=0x7f6504054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 shutdown_connections 2026-02-17T05:41:14.508 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:14.506+0000 7f650a65b640 1 -- 10.20.193.106:0/3072735379 wait complete. 2026-02-17T05:41:17.516 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 10 monclient: get_monmap_and_config 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 10 monclient: build_initial_monmap 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 10 monclient: monmap: 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:17.584 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:17.581763+0000 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:17.581763+0000 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 1 Processor -- start 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 1 -- start start 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.581+0000 7f6f39e5b640 10 monclient: init 2026-02-17T05:41:17.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f3405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f3405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f34182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3408b060 con 0x7f6f3405dee0 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3405dc90 con 0x7f6f3405d1b0 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3408d6a0 con 0x7f6f34182720 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f39e5b640 10 monclient(hunting): authenticate will time out at 1406.210110s 2026-02-17T05:41:17.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f337fe640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3405d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f32ffd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f6f3405dee0 0x7f6f34181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:44118/0 (socket says 10.20.193.106:44118) 2026-02-17T05:41:17.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.582+0000 7f6f32ffd640 1 -- 10.20.193.106:0/4001786717 learned_addr learned my addr 10.20.193.106:0/4001786717 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:17.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:17.783+0000 7f6f337fe640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3405d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:18.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:18.184+0000 7f6f337fe640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3405d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:18.986 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:18.985+0000 7f6f337fe640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3405d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): tick 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 monclient(hunting): continuing hunt 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6790/0 conn(0x7f6f34182720 legacy=0x7f6f341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:20.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3405d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6789/0 conn(0x7f6f3405dee0 legacy=0x7f6f34181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-a con 0x7f6f3405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-c con 0x7f6f3405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-b con 0x7f6f34182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f34057960 con 0x7f6f3405dee0 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3405dc90 con 0x7f6f3405d1b0 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f10069f50 con 0x7f6f34182720 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f317fa640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:20.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.582+0000 7f6f32ffd640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:20.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:20.783+0000 7f6f32ffd640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:21.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:21.184+0000 7f6f32ffd640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:21.987 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:21.986+0000 7f6f32ffd640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): tick 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 monclient(hunting): continuing hunt 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6790/0 conn(0x7f6f34182720 legacy=0x7f6f10066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:23.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6789/0 conn(0x7f6f3405dee0 legacy=0x7f6f10023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-a con 0x7f6f10067f20 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-b con 0x7f6f34182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): picked mon.noname-c con 0x7f6f3405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1006b1b0 con 0x7f6f10067f20 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3405dc90 con 0x7f6f3405d1b0 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1006aae0 con 0x7f6f34182720 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f317fa640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:23.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.582+0000 7f6f33fff640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:23.784 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:23.783+0000 7f6f33fff640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:24.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:24.184+0000 7f6f33fff640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:24.986 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:24.985+0000 7f6f33fff640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118137428 0 0) 0x7f6f1006b1b0 con 0x7f6f10067f20 2026-02-17T05:41:25.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient(hunting): my global_id is 124161 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f180035e0 con 0x7f6f10067f20 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126042819 0 0) 0x7f6f180035e0 con 0x7f6f10067f20 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6790/0 conn(0x7f6f34182720 legacy=0x7f6f10066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.118:6789/0 conn(0x7f6f3405d1b0 legacy=0x7f6f10044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 monclient: found mon.noname-a 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:41:25.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1006ad30 con 0x7f6f10067f20 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6f200041e0 con 0x7f6f10067f20 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: dump: 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.395 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f39e5b640 5 monclient: authenticate success, global_id 124161 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f39e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f200043b0 con 0x7f6f10067f20 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 1 -- 10.20.193.106:0/4001786717 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6f20004790 con 0x7f6f10067f20 2026-02-17T05:41:25.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f39e5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f39e5b640 4 set_mon_vals no callback set 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.385+0000 7f6f327fc640 10 monclient: dump: 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.397 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 10 monclient: shutdown 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 1 -- 10.20.193.106:0/4001786717 >> v1:10.20.193.106:6789/0 conn(0x7f6f10067f20 legacy=0x7f6f1006a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 1 -- 10.20.193.106:0/4001786717 shutdown_connections 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 1 -- 10.20.193.106:0/4001786717 >> 10.20.193.106:0/4001786717 conn(0x7f6f340915f0 msgr2=0x7f6f340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 1 -- 10.20.193.106:0/4001786717 shutdown_connections 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.386+0000 7f6f39e5b640 1 -- 10.20.193.106:0/4001786717 wait complete. 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.387+0000 7f6f39e5b640 10 monclient: build_initial_monmap 2026-02-17T05:41:25.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.387+0000 7f6f39e5b640 10 monclient: monmap: 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.387+0000 7f6f39e5b640 1 Processor -- start 2026-02-17T05:41:25.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.387+0000 7f6f39e5b640 1 -- start start 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.387+0000 7f6f39e5b640 10 monclient: init 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f10067f20 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f3405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f34182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3405e8e0 con 0x7f6f10067f20 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3413f6a0 con 0x7f6f34182720 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f341302c0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient(hunting): authenticate will time out at 1414.016173s 2026-02-17T05:41:25.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f337fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f6f10067f20 0x7f6f34151ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42238/0 (socket says 10.20.193.106:42238) 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f337fe640 1 -- 10.20.193.106:0/832736790 learned_addr learned my addr 10.20.193.106:0/832736790 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f33fff640 1 -- 10.20.193.106:0/832736790 >> v1:10.20.193.118:6789/0 conn(0x7f6f34182720 legacy=0x7f6f34174240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314526260 0 0) 0x7f6f341302c0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): my global_id is 5192 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f040035e0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505020545 0 0) 0x7f6f3405e8e0 con 0x7f6f10067f20 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): my global_id is 124164 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f341302c0 con 0x7f6f10067f20 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 805318469 0 0) 0x7f6f040035e0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f3405e8e0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6f24003010 con 0x7f6f3405d1b0 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): dump: 2026-02-17T05:41:25.402 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:25.403 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3543841592 0 0) 0x7f6f341302c0 con 0x7f6f10067f20 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f040035e0 con 0x7f6f10067f20 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6f20004520 con 0x7f6f10067f20 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient(hunting): dump: 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.404 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1503051010 0 0) 0x7f6f3405e8e0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 >> v1:10.20.193.118:6789/0 conn(0x7f6f34182720 legacy=0x7f6f34174240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 >> v1:10.20.193.106:6789/0 conn(0x7f6f10067f20 legacy=0x7f6f34151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 monclient: found mon.c 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f341305a0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.405 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 5 monclient: authenticate success, global_id 5192 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _renew_subs 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3412ee00 con 0x7f6f3405d1b0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _renew_subs 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f3413d290 con 0x7f6f3405d1b0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f240048a0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.406 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6f24004bc0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f31ffb640 4 set_mon_vals no callback set 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.388+0000 7f6f0ffff640 10 monclient: dump: 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.407 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6f24011b60 con 0x7f6f3405d1b0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f39e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f39e5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f39e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3412fea0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(684..684 src has 472..684) ==== 3947+0+0 (unknown 2525390318 0 0) 0x7f6f2404fc50 con 0x7f6f3405d1b0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.389+0000 7f6f337fe640 10 monclient: get_auth_request con 0x7f6f04040ac0 auth_method 0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.392+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f6f240172b0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.392+0000 7f6f0ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.408 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.392+0000 7f6f0ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:25.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f39e5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:41:25.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f39e5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:25.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f39e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6f340008d0 con 0x7f6f3405d1b0 2026-02-17T05:41:25.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f0ffff640 1 -- 10.20.193.106:0/832736790 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 500001842) 0x7f6f24016a60 con 0x7f6f3405d1b0 2026-02-17T05:41:25.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f0ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:41:25.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.544+0000 7f6f0ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:25.547 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":48,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:41:25.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 >> v1:10.20.193.118:6812/703720803 conn(0x7f6f04040ac0 legacy=0x7f6f04060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 10 monclient: shutdown 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 >> v1:10.20.193.106:6790/0 conn(0x7f6f3405d1b0 legacy=0x7f6f3413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 shutdown_connections 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 >> 10.20.193.106:0/832736790 conn(0x7f6f340915f0 msgr2=0x7f6f3408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 shutdown_connections 2026-02-17T05:41:25.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.545+0000 7f6f39e5b640 1 -- 10.20.193.106:0/832736790 wait complete. 2026-02-17T05:41:25.555 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:41:25.555 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T05:41:25.555 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:41:25.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.626+0000 7f68bf847640 10 monclient: get_monmap_and_config 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.626+0000 7f68bf847640 10 monclient: build_initial_monmap 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.626+0000 7f68bf847640 10 monclient: monmap: 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:25.627350+0000 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:25.627350+0000 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:25.648 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 1 Processor -- start 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 1 -- start start 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient: init 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-a con 0x7f68b805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-c con 0x7f68b805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-b con 0x7f68b8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:25.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b808b060 con 0x7f68b805d1b0 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b805dc90 con 0x7f68b805dee0 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b808d6a0 con 0x7f68b8182720 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bf847640 10 monclient(hunting): authenticate will time out at 1414.255754s 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bd5bc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f68b805d1b0 0x7f68b805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42248/0 (socket says 10.20.193.106:42248) 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bd5bc640 1 -- 10.20.193.106:0/2559865568 learned_addr learned my addr 10.20.193.106:0/2559865568 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.627+0000 7f68bcdbb640 1 -- 10.20.193.106:0/2559865568 >> v1:10.20.193.118:6789/0 conn(0x7f68b805dee0 legacy=0x7f68b8181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273686359 0 0) 0x7f68b808d6a0 con 0x7f68b8182720 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): my global_id is 5195 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a00035e0 con 0x7f68b8182720 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831023468 0 0) 0x7f68b808b060 con 0x7f68b805d1b0 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient(hunting): my global_id is 124167 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b808d6a0 con 0x7f68b805d1b0 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2995483817 0 0) 0x7f68a00035e0 con 0x7f68b8182720 2026-02-17T05:41:25.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 >> v1:10.20.193.118:6789/0 conn(0x7f68b805dee0 legacy=0x7f68b8181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 >> v1:10.20.193.106:6789/0 conn(0x7f68b805d1b0 legacy=0x7f68b805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 monclient: found mon.noname-b 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b8057960 con 0x7f68b8182720 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 5 monclient: authenticate success, global_id 5195 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68b4003eb0 con 0x7f68b8182720 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: dump: 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.653 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68b4004170 con 0x7f68b8182720 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 1 -- 10.20.193.106:0/2559865568 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68b4004580 con 0x7f68b8182720 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 4 set_mon_vals no callback set 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68a7fff640 10 monclient: dump: 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.655 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.656 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.656 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 10 monclient: shutdown 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 1 -- 10.20.193.106:0/2559865568 >> v1:10.20.193.106:6790/0 conn(0x7f68b8182720 legacy=0x7f68b81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 1 -- 10.20.193.106:0/2559865568 shutdown_connections 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 1 -- 10.20.193.106:0/2559865568 >> 10.20.193.106:0/2559865568 conn(0x7f68b80915f0 msgr2=0x7f68b80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 1 -- 10.20.193.106:0/2559865568 shutdown_connections 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 1 -- 10.20.193.106:0/2559865568 wait complete. 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.628+0000 7f68bf847640 10 monclient: build_initial_monmap 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient: monmap: 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:25.657 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 1 Processor -- start 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 1 -- start start 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient: init 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:25.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-a con 0x7f68b805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-b con 0x7f68b805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient(hunting): picked mon.noname-c con 0x7f68b8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b810bda0 con 0x7f68b805d1b0 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b805e8e0 con 0x7f68b805dee0 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b810a8b0 con 0x7f68b8182720 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bf847640 10 monclient(hunting): authenticate will time out at 1414.257586s 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bd5bc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f68b805d1b0 0x7f68b8128270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42250/0 (socket says 10.20.193.106:42250) 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bd5bc640 1 -- 10.20.193.106:0/1612716854 learned_addr learned my addr 10.20.193.106:0/1612716854 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:25.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68bcdbb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.118:6789/0 conn(0x7f68b805dee0 legacy=0x7f68b8180dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256489044 0 0) 0x7f68b810a8b0 con 0x7f68b8182720 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): my global_id is 5198 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68880035e0 con 0x7f68b8182720 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367040348 0 0) 0x7f68b810bda0 con 0x7f68b805d1b0 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): my global_id is 124170 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b810a8b0 con 0x7f68b805d1b0 2026-02-17T05:41:25.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2061717637 0 0) 0x7f68880035e0 con 0x7f68b8182720 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68b810bda0 con 0x7f68b8182720 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68b4004490 con 0x7f68b8182720 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): dump: 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.661 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3210047287 0 0) 0x7f68b810a8b0 con 0x7f68b805d1b0 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68880035e0 con 0x7f68b805d1b0 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68a80030d0 con 0x7f68b805d1b0 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.629+0000 7f68a5ffb640 10 monclient(hunting): dump: 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 927459434 0 0) 0x7f68b810bda0 con 0x7f68b8182720 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.118:6789/0 conn(0x7f68b805dee0 legacy=0x7f68b8180dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6789/0 conn(0x7f68b805d1b0 legacy=0x7f68b8128270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 monclient: found mon.c 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b81824f0 con 0x7f68b8182720 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 5 monclient: authenticate success, global_id 5198 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 10 monclient: _renew_subs 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68b810cc10 con 0x7f68b8182720 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 10 monclient: _renew_subs 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f68b810b640 con 0x7f68b8182720 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68b4004630 con 0x7f68b8182720 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68b4003910 con 0x7f68b8182720 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient: dump: 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a77fe640 4 set_mon_vals no callback set 2026-02-17T05:41:25.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68b8057ca0 con 0x7f68b8128980 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f68b4011af0 con 0x7f68b8182720 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(684..684 src has 472..684) ==== 3947+0+0 (unknown 2525390318 0 0) 0x7f68b404fca0 con 0x7f68b8182720 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117965948 0 0) 0x7f68b8057ca0 con 0x7f68b8128980 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 10 monclient(hunting): my global_id is 124173 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.630+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b810bda0 con 0x7f68b8128980 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68bcdbb640 10 monclient: get_auth_request con 0x7f6888040b10 auth_method 0 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1961241839 0 0) 0x7f68b810bda0 con 0x7f68b8128980 2026-02-17T05:41:25.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68b8057ca0 con 0x7f68b8128980 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68a80048a0 con 0x7f68b8128980 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 10 monclient: dump: 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.668 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 142801969 0 0) 0x7f68b8057ca0 con 0x7f68b8128980 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b80008d0 con 0x7f68b8128980 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f68a8005990 con 0x7f68b8128980 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6789/0 conn(0x7f68b8128980 legacy=0x7f68b8059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.631+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6789/0 conn(0x7f68b8128980 legacy=0x7f68b8059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68bf847640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68b808e3d0 con 0x7f68b804d200 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325649916 0 0) 0x7f68b808e3d0 con 0x7f68b804d200 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 10 monclient(hunting): my global_id is 124176 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b8057ca0 con 0x7f68b804d200 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.634+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1676849249 0 0) 0x7f68b8057ca0 con 0x7f68b804d200 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68b808e3d0 con 0x7f68b804d200 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f68a8005270 con 0x7f68b804d200 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 10 monclient: dump: 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.670 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 944557440 0 0) 0x7f68b808e3d0 con 0x7f68b804d200 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68b808e560 con 0x7f68b804d200 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 4007125030) 0x7f68a8005650 con 0x7f68b804d200 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6789/0 conn(0x7f68b804d200 legacy=0x7f68b81168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68a5ffb640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6789/0 conn(0x7f68b804d200 legacy=0x7f68b81168d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 48, 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 16799, 2026-02-17T05:41:25.672 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.673 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.674 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:25.675 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.676 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.677 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.678 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:25.679 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:25.680 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.681 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:25.682 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.118:6812/703720803 conn(0x7f6888040b10 legacy=0x7f6888060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 10 monclient: shutdown 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 >> v1:10.20.193.106:6790/0 conn(0x7f68b8182720 legacy=0x7f68b81141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bddbd640 1 -- 10.20.193.106:0/1612716854 reap_dead start 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bddbd640 1 -- 10.20.193.106:0/1612716854 reap_dead start 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 shutdown_connections 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 >> 10.20.193.106:0/1612716854 conn(0x7f68b80915f0 msgr2=0x7f68b81a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 shutdown_connections 2026-02-17T05:41:25.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.635+0000 7f68bf847640 1 -- 10.20.193.106:0/1612716854 wait complete. 2026-02-17T05:41:25.684 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:41:25.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:41:25.684 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:41:25.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 10 monclient: get_monmap_and_config 2026-02-17T05:41:25.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 10 monclient: build_initial_monmap 2026-02-17T05:41:25.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 10 monclient: monmap: 2026-02-17T05:41:25.763 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:25.763 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:41:25.753843+0000 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:41:25.753843+0000 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 1 Processor -- start 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 1 -- start start 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.753+0000 7f874cbe5640 10 monclient: init 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-c con 0x7f874805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-b con 0x7f874805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:25.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-a con 0x7f8748182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874808b060 con 0x7f8748182720 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874805dc90 con 0x7f874805d1b0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874808d6a0 con 0x7f874805dee0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient(hunting): authenticate will time out at 1414.382263s 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8746575640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f874805d1b0 legacy=0x7f874805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8746d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f8748182720 0x7f87481a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:42282/0 (socket says 10.20.193.106:42282) 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8746d76640 1 -- 10.20.193.106:0/2013987069 learned_addr learned my addr 10.20.193.106:0/2013987069 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745d74640 1 --1- 10.20.193.106:0/2013987069 >> v1:10.20.193.106:6790/0 conn(0x7f874805dee0 0x7f8748181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:54324/0 (socket says 10.20.193.106:54324) 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169826281 0 0) 0x7f874808d6a0 con 0x7f874805dee0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): my global_id is 5201 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87340035e0 con 0x7f874805dee0 2026-02-17T05:41:25.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491150526 0 0) 0x7f874808b060 con 0x7f8748182720 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient(hunting): my global_id is 124179 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f874808d6a0 con 0x7f8748182720 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3126342858 0 0) 0x7f87340035e0 con 0x7f874805dee0 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 >> v1:10.20.193.118:6789/0 conn(0x7f874805d1b0 legacy=0x7f874805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 >> v1:10.20.193.106:6789/0 conn(0x7f8748182720 legacy=0x7f87481a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 monclient: found mon.noname-b 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8748057960 con 0x7f874805dee0 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8730002dd0 con 0x7f874805dee0 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: dump: 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 5 monclient: authenticate success, global_id 5201 2026-02-17T05:41:25.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8730003090 con 0x7f874805dee0 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient: get_monmap_and_config success 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 4 set_mon_vals no callback set 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 1 -- 10.20.193.106:0/2013987069 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f87300034a0 con 0x7f874805dee0 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f8745573640 10 monclient: dump: 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.768 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 10 monclient: shutdown 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 1 -- 10.20.193.106:0/2013987069 >> v1:10.20.193.106:6790/0 conn(0x7f874805dee0 legacy=0x7f8748181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.754+0000 7f874cbe5640 1 -- 10.20.193.106:0/2013987069 shutdown_connections 2026-02-17T05:41:25.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- 10.20.193.106:0/2013987069 >> 10.20.193.106:0/2013987069 conn(0x7f87480915f0 msgr2=0x7f87480919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- 10.20.193.106:0/2013987069 shutdown_connections 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- 10.20.193.106:0/2013987069 wait complete. 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient: build_initial_monmap 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient: monmap: 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 Processor -- start 2026-02-17T05:41:25.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- start start 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient: init 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient: _reopen_session rank -1 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-b con 0x7f874805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-a con 0x7f874805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient(hunting): picked mon.noname-c con 0x7f8748182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8748089a60 con 0x7f874805dee0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874805e8e0 con 0x7f874805d1b0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874810d9e0 con 0x7f8748182720 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient(hunting): _renew_subs 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f874cbe5640 10 monclient(hunting): authenticate will time out at 1414.383835s 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f8746575640 1 -- >> v1:10.20.193.118:6789/0 conn(0x7f874805d1b0 legacy=0x7f874812a000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.118:6789/0 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f8746d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8748182720 0x7f8748181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:54328/0 (socket says 10.20.193.106:54328) 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.755+0000 7f8746d76640 1 -- 10.20.193.106:0/1839785912 learned_addr learned my addr 10.20.193.106:0/1839785912 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868304819 0 0) 0x7f874810d9e0 con 0x7f8748182720 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): my global_id is 5204 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87140035e0 con 0x7f8748182720 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734105778 0 0) 0x7f8748089a60 con 0x7f874805dee0 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): my global_id is 124182 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f874810d9e0 con 0x7f874805dee0 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 233379834 0 0) 0x7f87140035e0 con 0x7f8748182720 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8748089a60 con 0x7f8748182720 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8738004170 con 0x7f8748182720 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): dump: 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.772 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 950211398 0 0) 0x7f874810d9e0 con 0x7f874805dee0 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87140035e0 con 0x7f874805dee0 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f87300033b0 con 0x7f874805dee0 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): dump: 2026-02-17T05:41:25.773 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2993309219 0 0) 0x7f8748089a60 con 0x7f8748182720 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.118:6789/0 conn(0x7f874805d1b0 legacy=0x7f874812a000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6789/0 conn(0x7f874805dee0 legacy=0x7f874812a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: _finish_hunting 0 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 monclient: found mon.c 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874810ee80 con 0x7f8748182720 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: _finish_auth 0 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: _check_auth_tickets 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 5 monclient: authenticate success, global_id 5204 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 10 monclient: _renew_subs 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f874812ae20 con 0x7f8748182720 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 10 monclient: _renew_subs 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8748089ff0 con 0x7f8748182720 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8738005980 con 0x7f8748182720 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:41:25.775 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8738005d20 con 0x7f8748182720 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient: dump: 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.776 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f8744d72640 4 set_mon_vals no callback set 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8748182550 con 0x7f874812d540 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051657051 0 0) 0x7f8748182550 con 0x7f874812d540 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 10 monclient(hunting): my global_id is 5207 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.756+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8748089a60 con 0x7f874812d540 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8738012cc0 con 0x7f8748182720 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(684..684 src has 472..684) ==== 3947+0+0 (unknown 2525390318 0 0) 0x7f8738050ee0 con 0x7f8748182720 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1576914907 0 0) 0x7f8748089a60 con 0x7f874812d540 2026-02-17T05:41:25.777 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8748182550 con 0x7f874812d540 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f873c003ef0 con 0x7f874812d540 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 10 monclient: dump: 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f8745d74640 10 monclient: get_auth_request con 0x7f8714040b70 auth_method 0 2026-02-17T05:41:25.778 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1205648551 0 0) 0x7f8748182550 con 0x7f874812d540 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8748057cd0 con 0x7f874812d540 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f873c006220 con 0x7f874812d540 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6790/0 conn(0x7f874812d540 legacy=0x7f8748059e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.757+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6790/0 conn(0x7f874812d540 legacy=0x7f8748059e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.760+0000 7f874cbe5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.760+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8748055570 con 0x7f874804d200 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745055891 0 0) 0x7f8748055570 con 0x7f874804d200 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient(hunting): _negotiate 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient(hunting): my global_id is 5210 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8748182550 con 0x7f874804d200 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 454181476 0 0) 0x7f8748182550 con 0x7f874804d200 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8748055570 con 0x7f874804d200 2026-02-17T05:41:25.779 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f873c0048d0 con 0x7f874804d200 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient: dump: 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1763796673 0 0) 0x7f8748055570 con 0x7f874804d200 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f874808e3d0 con 0x7f874804d200 2026-02-17T05:41:25.780 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 2499941533) 0x7f873c005e70 con 0x7f874804d200 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6790/0 conn(0x7f874804d200 legacy=0x7f874811b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f872effd640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6790/0 conn(0x7f874804d200 legacy=0x7f874811b440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 48, 2026-02-17T05:41:25.781 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 810522, 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.782 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.783 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:41:25.784 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:41:25.785 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:41:25.786 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:41:25.787 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:41:25.788 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.789 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:41:25.790 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:41:25.791 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:41:25.791 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:41:25.791 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:41:25.791 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.118:6812/703720803 conn(0x7f8714040b70 legacy=0x7f8714061020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 10 monclient: shutdown 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 >> v1:10.20.193.106:6790/0 conn(0x7f8748182720 legacy=0x7f8748181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f8746d76640 1 -- 10.20.193.106:0/1839785912 reap_dead start 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f8746d76640 1 -- 10.20.193.106:0/1839785912 reap_dead start 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 shutdown_connections 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 >> 10.20.193.106:0/1839785912 conn(0x7f87480915f0 msgr2=0x7f874805bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 shutdown_connections 2026-02-17T05:41:25.792 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:41:25.761+0000 7f874cbe5640 1 -- 10.20.193.106:0/1839785912 wait complete. 2026-02-17T05:41:25.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:41:25.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:41:26.387 INFO:tasks.rados.rados.0.trial118.stdout:3161: done (3 left) 2026-02-17T05:41:26.387 INFO:tasks.rados.rados.0.trial118.stdout:3162: done (2 left) 2026-02-17T05:41:26.387 INFO:tasks.rados.rados.0.trial118.stdout:3163: done (1 left) 2026-02-17T05:41:26.387 INFO:tasks.rados.rados.0.trial118.stdout:3164: done (0 left) 2026-02-17T05:41:26.387 INFO:tasks.rados.rados.0.trial118.stdout:3165: snap_create 2026-02-17T05:41:27.390 INFO:tasks.rados.rados.0.trial118.stdout:3165: done (0 left) 2026-02-17T05:41:27.390 INFO:tasks.rados.rados.0.trial118.stdout:3166: snap_remove snap 334 2026-02-17T05:41:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3166: done (0 left) 2026-02-17T05:41:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3167: write (excl) oid 30 current snap is 338 2026-02-17T05:41:28.392 INFO:tasks.rados.rados.0.trial118.stdout:3167: seq_num 1114 ranges {722998=414924,1572117=575042} 2026-02-17T05:41:28.396 INFO:tasks.rados.rados.0.trial118.stdout:3167: writing trial11845692-30 from 722998 to 1137922 tid 1 2026-02-17T05:41:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3167: writing trial11845692-30 from 1572117 to 2147159 tid 2 2026-02-17T05:41:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3168: rollback oid 46 current snap is 338 2026-02-17T05:41:28.400 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 323 2026-02-17T05:41:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3169: snap_create 2026-02-17T05:41:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3168: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:41:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3168: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:41:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3168: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:41:28.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1491 (ObjNum 1059 snap 318 seq_num 1059) dirty exists 2026-02-17T05:41:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3167: finishing write tid 1 to trial11845692-30 2026-02-17T05:41:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3167: finishing write tid 2 to trial11845692-30 2026-02-17T05:41:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3167: finishing write tid 3 to trial11845692-30 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:3167: finishing write tid 4 to trial11845692-30 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:3167: oid 30 updating version 0 to 1923 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:3167: oid 30 version 1923 is already newer than 1921 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:3167: oid 30 version 1923 is already newer than 1922 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1923 (ObjNum 1114 snap 338 seq_num 1114) dirty exists 2026-02-17T05:41:28.405 INFO:tasks.rados.rados.0.trial118.stdout:3167: left oid 30 (ObjNum 1114 snap 338 seq_num 1114) 2026-02-17T05:41:29.396 INFO:tasks.rados.rados.0.trial118.stdout:3167: done (2 left) 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3168: done (1 left) 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3169: done (0 left) 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3170: read oid 40 snap -1 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3170: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3171: rollback oid 1 current snap is 339 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 337 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3172: write (excl) oid 11 current snap is 339 2026-02-17T05:41:29.397 INFO:tasks.rados.rados.0.trial118.stdout:3172: seq_num 1115 ranges {739805=490173,1630599=435053,2636284=103521} 2026-02-17T05:41:29.402 INFO:tasks.rados.rados.0.trial118.stdout:3172: writing trial11845692-11 from 739805 to 1229978 tid 1 2026-02-17T05:41:29.405 INFO:tasks.rados.rados.0.trial118.stdout:3172: writing trial11845692-11 from 1630599 to 2065652 tid 2 2026-02-17T05:41:29.408 INFO:tasks.rados.rados.0.trial118.stdout:3172: writing trial11845692-11 from 2636284 to 2739805 tid 3 2026-02-17T05:41:29.408 INFO:tasks.rados.rados.0.trial118.stdout:3173: read oid 18 snap -1 2026-02-17T05:41:29.408 INFO:tasks.rados.rados.0.trial118.stdout:3173: expect deleted 2026-02-17T05:41:29.408 INFO:tasks.rados.rados.0.trial118.stdout:3174: copy_from oid 6 from oid 38 current snap is 339 2026-02-17T05:41:29.408 INFO:tasks.rados.rados.0.trial118.stdout:3170: expect (ObjNum 883 snap 266 seq_num 883) 2026-02-17T05:41:29.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1748229 2026-02-17T05:41:29.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:29.491 INFO:tasks.rados.rados.0.trial118.stdout:3171: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:41:29.492 INFO:tasks.rados.rados.0.trial118.stdout:3171: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:41:29.492 INFO:tasks.rados.rados.0.trial118.stdout:3170: done (4 left) 2026-02-17T05:41:29.492 INFO:tasks.rados.rados.0.trial118.stdout:3175: snap_remove snap 331 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:3175: done (4 left) 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:3176: copy_from oid 42 from oid 4 current snap is 339 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:3171: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1931 (ObjNum 1112 snap 335 seq_num 1112) dirty exists 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:3172: finishing write tid 1 to trial11845692-11 2026-02-17T05:41:30.347 INFO:tasks.rados.rados.0.trial118.stdout:3172: finishing write tid 2 to trial11845692-11 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: finishing write tid 3 to trial11845692-11 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: finishing write tid 4 to trial11845692-11 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: finishing write tid 5 to trial11845692-11 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: oid 11 updating version 0 to 2014 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: oid 11 version 2014 is already newer than 2013 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: oid 11 updating version 2014 to 2016 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: oid 11 version 2016 is already newer than 2015 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2016 (ObjNum 1115 snap 339 seq_num 1115) dirty exists 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3172: left oid 11 (ObjNum 1115 snap 339 seq_num 1115) 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3174: finishing copy_from racing read to trial11845692-6 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:3174: finishing copy_from to trial11845692-6 2026-02-17T05:41:30.348 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1705 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3171: done (4 left) 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3172: done (3 left) 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3173: done (2 left) 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3174: done (1 left) 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3177: write oid 2 current snap is 339 2026-02-17T05:41:30.349 INFO:tasks.rados.rados.0.trial118.stdout:3177: seq_num 1116 ranges {756612=565422,2089081=578711} 2026-02-17T05:41:30.352 INFO:tasks.rados.rados.0.trial118.stdout:3177: writing trial11845692-2 from 756612 to 1322034 tid 1 2026-02-17T05:41:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3177: writing trial11845692-2 from 2089081 to 2667792 tid 2 2026-02-17T05:41:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3178: write oid 48 current snap is 339 2026-02-17T05:41:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3178: seq_num 1117 ranges {773419=640671,2147563=438722} 2026-02-17T05:41:30.362 INFO:tasks.rados.rados.0.trial118.stdout:3178: writing trial11845692-48 from 773419 to 1414090 tid 1 2026-02-17T05:41:30.367 INFO:tasks.rados.rados.0.trial118.stdout:3178: writing trial11845692-48 from 2147563 to 2586285 tid 2 2026-02-17T05:41:30.367 INFO:tasks.rados.rados.0.trial118.stdout:3179: read oid 44 snap -1 2026-02-17T05:41:30.367 INFO:tasks.rados.rados.0.trial118.stdout:3179: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:41:30.367 INFO:tasks.rados.rados.0.trial118.stdout:3180: snap_remove snap 290 2026-02-17T05:41:31.350 INFO:tasks.rados.rados.0.trial118.stdout:3180: done (4 left) 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3181: copy_from oid 36 from oid 12 current snap is 339 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3176: finishing copy_from to trial11845692-42 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3176: got expected ENOENT (src dne) 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3176: finishing copy_from racing read to trial11845692-42 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: finishing write tid 1 to trial11845692-2 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: finishing write tid 2 to trial11845692-2 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: finishing write tid 3 to trial11845692-2 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: finishing write tid 4 to trial11845692-2 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: oid 2 updating version 0 to 2022 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: oid 2 updating version 2022 to 2023 2026-02-17T05:41:31.351 INFO:tasks.rados.rados.0.trial118.stdout:3177: oid 2 updating version 2023 to 2024 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2024 (ObjNum 1116 snap 339 seq_num 1116) dirty exists 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3177: left oid 2 (ObjNum 1116 snap 339 seq_num 1116) 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: finishing write tid 1 to trial11845692-48 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: finishing write tid 2 to trial11845692-48 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: finishing write tid 3 to trial11845692-48 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: finishing write tid 4 to trial11845692-48 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: oid 48 updating version 0 to 1716 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: oid 48 version 1716 is already newer than 1714 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: oid 48 version 1716 is already newer than 1715 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1716 (ObjNum 1117 snap 339 seq_num 1117) dirty exists 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3178: left oid 48 (ObjNum 1117 snap 339 seq_num 1117) 2026-02-17T05:41:31.352 INFO:tasks.rados.rados.0.trial118.stdout:3179: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:41:31.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1203554 2026-02-17T05:41:31.410 INFO:tasks.rados.rados.0.trial118.stdout:3181: finishing copy_from racing read to trial11845692-36 2026-02-17T05:41:31.410 INFO:tasks.rados.rados.0.trial118.stdout:3181: finishing copy_from to trial11845692-36 2026-02-17T05:41:31.410 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1485 (ObjNum 1102 snap 331 seq_num 1102) dirty exists 2026-02-17T05:41:31.410 INFO:tasks.rados.rados.0.trial118.stdout:3176: done (4 left) 2026-02-17T05:41:31.411 INFO:tasks.rados.rados.0.trial118.stdout:3177: done (3 left) 2026-02-17T05:41:31.411 INFO:tasks.rados.rados.0.trial118.stdout:3178: done (2 left) 2026-02-17T05:41:31.411 INFO:tasks.rados.rados.0.trial118.stdout:3179: done (1 left) 2026-02-17T05:41:31.411 INFO:tasks.rados.rados.0.trial118.stdout:3181: done (0 left) 2026-02-17T05:41:31.411 INFO:tasks.rados.rados.0.trial118.stdout:3182: snap_remove snap 336 2026-02-17T05:41:32.401 INFO:tasks.rados.rados.0.trial118.stdout:3182: done (0 left) 2026-02-17T05:41:32.401 INFO:tasks.rados.rados.0.trial118.stdout:3183: copy_from oid 30 from oid 50 current snap is 339 2026-02-17T05:41:32.401 INFO:tasks.rados.rados.0.trial118.stdout:3184: write (excl) oid 22 current snap is 339 2026-02-17T05:41:32.401 INFO:tasks.rados.rados.0.trial118.stdout:3184: seq_num 1118 ranges {790226=432273,1806045=582380} 2026-02-17T05:41:32.406 INFO:tasks.rados.rados.0.trial118.stdout:3184: writing trial11845692-22 from 790226 to 1222499 tid 1 2026-02-17T05:41:32.411 INFO:tasks.rados.rados.0.trial118.stdout:3184: writing trial11845692-22 from 1806045 to 2388425 tid 2 2026-02-17T05:41:32.411 INFO:tasks.rados.rados.0.trial118.stdout:3185: rollback oid 24 current snap is 339 2026-02-17T05:41:32.411 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 324 2026-02-17T05:41:32.411 INFO:tasks.rados.rados.0.trial118.stdout:3184: finishing write tid 1 to trial11845692-22 2026-02-17T05:41:32.411 INFO:tasks.rados.rados.0.trial118.stdout:3186: snap_create 2026-02-17T05:41:32.412 INFO:tasks.rados.rados.0.trial118.stdout:3183: finishing copy_from racing read to trial11845692-30 2026-02-17T05:41:32.412 INFO:tasks.rados.rados.0.trial118.stdout:3183: finishing copy_from to trial11845692-30 2026-02-17T05:41:32.412 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 1488 (ObjNum 1110 snap 332 seq_num 1110) dirty exists 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: finishing write tid 2 to trial11845692-22 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: finishing write tid 3 to trial11845692-22 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3185: finishing rollback tid 0 to trial11845692-24 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: finishing write tid 4 to trial11845692-22 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: oid 22 updating version 0 to 1719 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: oid 22 version 1719 is already newer than 1718 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: oid 22 version 1719 is already newer than 1717 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1719 (ObjNum 1118 snap 339 seq_num 1118) dirty exists 2026-02-17T05:41:32.413 INFO:tasks.rados.rados.0.trial118.stdout:3184: left oid 22 (ObjNum 1118 snap 339 seq_num 1118) 2026-02-17T05:41:32.414 INFO:tasks.rados.rados.0.trial118.stdout:3185: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:41:32.414 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1695 (ObjNum 129 snap 0 seq_num 11412472) dirty dne 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3183: done (3 left) 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3184: done (2 left) 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3185: done (1 left) 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3186: done (0 left) 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3187: read oid 49 snap -1 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3187: expect (ObjNum 1063 snap 318 seq_num 1063) 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3188: read oid 16 snap -1 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3188: expect deleted 2026-02-17T05:41:33.403 INFO:tasks.rados.rados.0.trial118.stdout:3189: snap_create 2026-02-17T05:41:33.407 INFO:tasks.rados.rados.0.trial118.stdout:3187: expect (ObjNum 1063 snap 318 seq_num 1063) 2026-02-17T05:41:33.499 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 643661 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3187: done (2 left) 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3188: done (1 left) 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3189: done (0 left) 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3190: read oid 9 snap -1 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3190: expect deleted 2026-02-17T05:41:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3191: snap_create 2026-02-17T05:41:35.408 INFO:tasks.rados.rados.0.trial118.stdout:3190: done (1 left) 2026-02-17T05:41:35.408 INFO:tasks.rados.rados.0.trial118.stdout:3191: done (0 left) 2026-02-17T05:41:35.408 INFO:tasks.rados.rados.0.trial118.stdout:3192: write oid 15 current snap is 342 2026-02-17T05:41:35.408 INFO:tasks.rados.rados.0.trial118.stdout:3192: seq_num 1119 ranges {407033=507522,1464527=442391,2345976=461057} 2026-02-17T05:41:35.412 INFO:tasks.rados.rados.0.trial118.stdout:3192: writing trial11845692-15 from 407033 to 914555 tid 1 2026-02-17T05:41:35.415 INFO:tasks.rados.rados.0.trial118.stdout:3192: writing trial11845692-15 from 1464527 to 1906918 tid 2 2026-02-17T05:41:35.419 INFO:tasks.rados.rados.0.trial118.stdout:3192: writing trial11845692-15 from 2345976 to 2807033 tid 3 2026-02-17T05:41:35.419 INFO:tasks.rados.rados.0.trial118.stdout:3193: snap_create 2026-02-17T05:41:35.419 INFO:tasks.rados.rados.0.trial118.stdout:3192: finishing write tid 1 to trial11845692-15 2026-02-17T05:41:35.419 INFO:tasks.rados.rados.0.trial118.stdout:3192: finishing write tid 2 to trial11845692-15 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: finishing write tid 3 to trial11845692-15 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: finishing write tid 4 to trial11845692-15 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: finishing write tid 5 to trial11845692-15 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: oid 15 updating version 0 to 1723 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: oid 15 version 1723 is already newer than 1721 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: oid 15 version 1723 is already newer than 1722 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: oid 15 version 1723 is already newer than 1720 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1723 (ObjNum 1119 snap 342 seq_num 1119) dirty exists 2026-02-17T05:41:35.421 INFO:tasks.rados.rados.0.trial118.stdout:3192: left oid 15 (ObjNum 1119 snap 342 seq_num 1119) 2026-02-17T05:41:36.411 INFO:tasks.rados.rados.0.trial118.stdout:3192: done (1 left) 2026-02-17T05:41:36.412 INFO:tasks.rados.rados.0.trial118.stdout:3193: done (0 left) 2026-02-17T05:41:36.412 INFO:tasks.rados.rados.0.trial118.stdout:3194: write (excl) oid 4 current snap is 343 2026-02-17T05:41:36.412 INFO:tasks.rados.rados.0.trial118.stdout:3194: seq_num 1120 ranges {423840=582771,1523009=586049,2657046=166794} 2026-02-17T05:41:36.416 INFO:tasks.rados.rados.0.trial118.stdout:3194: writing trial11845692-4 from 423840 to 1006611 tid 1 2026-02-17T05:41:36.420 INFO:tasks.rados.rados.0.trial118.stdout:3194: writing trial11845692-4 from 1523009 to 2109058 tid 2 2026-02-17T05:41:36.423 INFO:tasks.rados.rados.0.trial118.stdout:3194: writing trial11845692-4 from 2657046 to 2823840 tid 3 2026-02-17T05:41:36.424 INFO:tasks.rados.rados.0.trial118.stdout:3195: write (excl) oid 50 current snap is 343 2026-02-17T05:41:36.424 INFO:tasks.rados.rados.0.trial118.stdout:3195: seq_num 1121 ranges {440647=658020,1581491=446060,2800822=39825} 2026-02-17T05:41:36.427 INFO:tasks.rados.rados.0.trial118.stdout:3195: writing trial11845692-50 from 440647 to 1098667 tid 1 2026-02-17T05:41:36.431 INFO:tasks.rados.rados.0.trial118.stdout:3195: writing trial11845692-50 from 1581491 to 2027551 tid 2 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3195: writing trial11845692-50 from 2800822 to 2840647 tid 3 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3196: write (excl) oid 47 current snap is 343 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: finishing write tid 1 to trial11845692-4 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: finishing write tid 2 to trial11845692-4 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: finishing write tid 3 to trial11845692-4 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: finishing write tid 4 to trial11845692-4 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: finishing write tid 5 to trial11845692-4 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: oid 4 updating version 0 to 1885 2026-02-17T05:41:36.435 INFO:tasks.rados.rados.0.trial118.stdout:3194: oid 4 version 1885 is already newer than 1882 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3194: oid 4 version 1885 is already newer than 1883 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3194: oid 4 version 1885 is already newer than 1884 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 1885 (ObjNum 1120 snap 343 seq_num 1120) dirty exists 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3194: left oid 4 (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3195: finishing write tid 1 to trial11845692-50 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3195: finishing write tid 2 to trial11845692-50 2026-02-17T05:41:36.436 INFO:tasks.rados.rados.0.trial118.stdout:3196: seq_num 1122 ranges {457454=733269,1923620=589718} 2026-02-17T05:41:36.438 INFO:tasks.rados.rados.0.trial118.stdout:3196: writing trial11845692-47 from 457454 to 1190723 tid 1 2026-02-17T05:41:36.444 INFO:tasks.rados.rados.0.trial118.stdout:3196: writing trial11845692-47 from 1923620 to 2513338 tid 2 2026-02-17T05:41:36.444 INFO:tasks.rados.rados.0.trial118.stdout:3194: done (2 left) 2026-02-17T05:41:36.444 INFO:tasks.rados.rados.0.trial118.stdout:3197: delete oid 11 current snap is 343 2026-02-17T05:41:36.444 INFO:tasks.rados.rados.0.trial118.stdout:3195: finishing write tid 3 to trial11845692-50 2026-02-17T05:41:36.444 INFO:tasks.rados.rados.0.trial118.stdout:3195: finishing write tid 4 to trial11845692-50 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: finishing write tid 5 to trial11845692-50 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: oid 50 updating version 0 to 1490 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: oid 50 updating version 1490 to 1492 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: oid 50 version 1492 is already newer than 1491 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: oid 50 version 1492 is already newer than 1489 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1492 (ObjNum 1121 snap 343 seq_num 1121) dirty exists 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3195: left oid 50 (ObjNum 1121 snap 343 seq_num 1121) 2026-02-17T05:41:36.445 INFO:tasks.rados.rados.0.trial118.stdout:3196: finishing write tid 1 to trial11845692-47 2026-02-17T05:41:36.446 INFO:tasks.rados.rados.0.trial118.stdout:3196: finishing write tid 2 to trial11845692-47 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3196: finishing write tid 3 to trial11845692-47 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3195: done (2 left) 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3197: done (1 left) 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3198: copy_from oid 42 from oid 9 current snap is 343 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3199: read oid 12 snap -1 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3199: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3200: copy_from oid 39 from oid 16 current snap is 343 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3196: finishing write tid 4 to trial11845692-47 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3196: oid 47 updating version 0 to 1792 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3196: oid 47 updating version 1792 to 1793 2026-02-17T05:41:36.447 INFO:tasks.rados.rados.0.trial118.stdout:3196: oid 47 version 1793 is already newer than 1791 2026-02-17T05:41:36.448 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1793 (ObjNum 1122 snap 343 seq_num 1122) dirty exists 2026-02-17T05:41:36.448 INFO:tasks.rados.rados.0.trial118.stdout:3196: left oid 47 (ObjNum 1122 snap 343 seq_num 1122) 2026-02-17T05:41:36.448 INFO:tasks.rados.rados.0.trial118.stdout:3196: done (3 left) 2026-02-17T05:41:36.448 INFO:tasks.rados.rados.0.trial118.stdout:3201: snap_remove snap 314 2026-02-17T05:41:37.413 INFO:tasks.rados.rados.0.trial118.stdout:3201: done (3 left) 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3202: rollback oid 23 current snap is 343 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 23 to 335 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3198: finishing copy_from to trial11845692-42 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3198: got expected ENOENT (src dne) 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3198: finishing copy_from racing read to trial11845692-42 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3200: finishing copy_from to trial11845692-39 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3200: got expected ENOENT (src dne) 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3200: finishing copy_from racing read to trial11845692-39 2026-02-17T05:41:37.414 INFO:tasks.rados.rados.0.trial118.stdout:3199: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:37.415 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3198: done (3 left) 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3199: done (2 left) 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3200: done (1 left) 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3203: read oid 6 snap 335 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3203: expect (ObjNum 1111 snap 334 seq_num 1111) 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3204: write oid 22 current snap is 343 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3202: finishing rollback tid 0 to trial11845692-23 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3202: finishing rollback tid 1 to trial11845692-23 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3202: finishing rollback tid 2 to trial11845692-23 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1708 (ObjNum 1093 snap 330 seq_num 1093) dirty exists 2026-02-17T05:41:37.517 INFO:tasks.rados.rados.0.trial118.stdout:3204: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2026-02-17T05:41:37.520 INFO:tasks.rados.rados.0.trial118.stdout:3204: writing trial11845692-22 from 491068 to 974835 tid 1 2026-02-17T05:41:37.525 INFO:tasks.rados.rados.0.trial118.stdout:3204: writing trial11845692-22 from 1640584 to 2233971 tid 2 2026-02-17T05:41:37.527 INFO:tasks.rados.rados.0.trial118.stdout:3204: writing trial11845692-22 from 2650385 to 2891068 tid 3 2026-02-17T05:41:37.528 INFO:tasks.rados.rados.0.trial118.stdout:3202: done (2 left) 2026-02-17T05:41:37.528 INFO:tasks.rados.rados.0.trial118.stdout:3205: read oid 12 snap -1 2026-02-17T05:41:37.528 INFO:tasks.rados.rados.0.trial118.stdout:3205: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:37.528 INFO:tasks.rados.rados.0.trial118.stdout:3206: copy_from oid 50 from oid 21 current snap is 343 2026-02-17T05:41:37.528 INFO:tasks.rados.rados.0.trial118.stdout:3203: expect (ObjNum 1111 snap 334 seq_num 1111) 2026-02-17T05:41:37.603 INFO:tasks.rados.rados.0.trial118.stdout:3204: finishing write tid 1 to trial11845692-22 2026-02-17T05:41:37.603 INFO:tasks.rados.rados.0.trial118.stdout:3204: finishing write tid 2 to trial11845692-22 2026-02-17T05:41:37.603 INFO:tasks.rados.rados.0.trial118.stdout:3203: done (3 left) 2026-02-17T05:41:37.603 INFO:tasks.rados.rados.0.trial118.stdout:3207: write (excl) oid 48 current snap is 343 2026-02-17T05:41:37.603 INFO:tasks.rados.rados.0.trial118.stdout:3207: seq_num 1125 ranges {507875=559016,1699066=737045} 2026-02-17T05:41:37.607 INFO:tasks.rados.rados.0.trial118.stdout:3207: writing trial11845692-48 from 507875 to 1066891 tid 1 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3207: writing trial11845692-48 from 1699066 to 2436111 tid 2 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3208: copy_from oid 26 from oid 14 current snap is 343 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: finishing write tid 3 to trial11845692-22 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: finishing write tid 4 to trial11845692-22 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: finishing write tid 5 to trial11845692-22 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: oid 22 updating version 0 to 1725 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: oid 22 updating version 1725 to 1726 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: oid 22 version 1726 is already newer than 1724 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: oid 22 updating version 1726 to 1727 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1727 (ObjNum 1124 snap 343 seq_num 1124) dirty exists 2026-02-17T05:41:37.613 INFO:tasks.rados.rados.0.trial118.stdout:3204: left oid 22 (ObjNum 1124 snap 343 seq_num 1124) 2026-02-17T05:41:37.614 INFO:tasks.rados.rados.0.trial118.stdout:3205: expect (ObjNum 1102 snap 331 seq_num 1102) 2026-02-17T05:41:37.649 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:37.717 INFO:tasks.rados.rados.0.trial118.stdout:3206: finishing copy_from racing read to trial11845692-50 2026-02-17T05:41:37.717 INFO:tasks.rados.rados.0.trial118.stdout:3206: finishing copy_from to trial11845692-50 2026-02-17T05:41:37.717 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1464 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3207: finishing write tid 1 to trial11845692-48 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3207: finishing write tid 2 to trial11845692-48 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3204: done (4 left) 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3205: done (3 left) 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3206: done (2 left) 2026-02-17T05:41:37.718 INFO:tasks.rados.rados.0.trial118.stdout:3209: rollback oid 40 current snap is 343 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 340 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:3207: finishing write tid 3 to trial11845692-48 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:3207: finishing write tid 4 to trial11845692-48 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:3207: oid 48 updating version 0 to 1729 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:3207: oid 48 version 1729 is already newer than 1728 2026-02-17T05:41:37.719 INFO:tasks.rados.rados.0.trial118.stdout:3207: oid 48 updating version 1729 to 1730 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1730 (ObjNum 1125 snap 343 seq_num 1125) dirty exists 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:3207: left oid 48 (ObjNum 1125 snap 343 seq_num 1125) 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:3208: finishing copy_from racing read to trial11845692-26 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:3208: finishing copy_from to trial11845692-26 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1303 (ObjNum 1103 snap 331 seq_num 1103) dirty exists 2026-02-17T05:41:37.720 INFO:tasks.rados.rados.0.trial118.stdout:3207: done (2 left) 2026-02-17T05:41:37.721 INFO:tasks.rados.rados.0.trial118.stdout:3208: done (1 left) 2026-02-17T05:41:37.721 INFO:tasks.rados.rados.0.trial118.stdout:3210: write (excl) oid 41 current snap is 343 2026-02-17T05:41:37.721 INFO:tasks.rados.rados.0.trial118.stdout:3210: seq_num 1126 ranges {524682=750618,1757548=597056} 2026-02-17T05:41:37.722 INFO:tasks.rados.rados.0.trial118.stdout:3210: writing trial11845692-41 from 524682 to 1275300 tid 1 2026-02-17T05:41:37.725 INFO:tasks.rados.rados.0.trial118.stdout:3210: writing trial11845692-41 from 1757548 to 2354604 tid 2 2026-02-17T05:41:37.726 INFO:tasks.rados.rados.0.trial118.stdout:3211: read oid 45 snap -1 2026-02-17T05:41:37.726 INFO:tasks.rados.rados.0.trial118.stdout:3211: expect (ObjNum 1107 snap 332 seq_num 1107) 2026-02-17T05:41:37.726 INFO:tasks.rados.rados.0.trial118.stdout:3212: snap_remove snap 323 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3212: done (3 left) 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3213: delete oid 26 current snap is 343 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3209: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3209: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3209: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1957 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: finishing write tid 1 to trial11845692-41 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: finishing write tid 2 to trial11845692-41 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: finishing write tid 3 to trial11845692-41 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: finishing write tid 4 to trial11845692-41 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: oid 41 updating version 0 to 1898 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: oid 41 updating version 1898 to 1899 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: oid 41 version 1899 is already newer than 1897 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 1899 (ObjNum 1126 snap 343 seq_num 1126) dirty exists 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3210: left oid 41 (ObjNum 1126 snap 343 seq_num 1126) 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:3211: expect (ObjNum 1107 snap 332 seq_num 1107) 2026-02-17T05:41:38.418 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:38.464 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2322722 2026-02-17T05:41:38.469 INFO:tasks.rados.rados.0.trial118.stdout:3209: done (3 left) 2026-02-17T05:41:38.469 INFO:tasks.rados.rados.0.trial118.stdout:3210: done (2 left) 2026-02-17T05:41:38.470 INFO:tasks.rados.rados.0.trial118.stdout:3211: done (1 left) 2026-02-17T05:41:38.470 INFO:tasks.rados.rados.0.trial118.stdout:3213: done (0 left) 2026-02-17T05:41:38.470 INFO:tasks.rados.rados.0.trial118.stdout:3214: write oid 19 current snap is 343 2026-02-17T05:41:38.470 INFO:tasks.rados.rados.0.trial118.stdout:3214: seq_num 1128 ranges {558296=501116,1474512=600725,2760077=198219} 2026-02-17T05:41:38.473 INFO:tasks.rados.rados.0.trial118.stdout:3214: writing trial11845692-19 from 558296 to 1059412 tid 1 2026-02-17T05:41:38.477 INFO:tasks.rados.rados.0.trial118.stdout:3214: writing trial11845692-19 from 1474512 to 2075237 tid 2 2026-02-17T05:41:38.481 INFO:tasks.rados.rados.0.trial118.stdout:3214: writing trial11845692-19 from 2760077 to 2958296 tid 3 2026-02-17T05:41:38.481 INFO:tasks.rados.rados.0.trial118.stdout:3215: read oid 4 snap 311 2026-02-17T05:41:38.481 INFO:tasks.rados.rados.0.trial118.stdout:3215: expect (ObjNum 956 snap 288 seq_num 956) 2026-02-17T05:41:38.481 INFO:tasks.rados.rados.0.trial118.stdout:3216: rollback oid 35 current snap is 343 2026-02-17T05:41:38.482 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 332 2026-02-17T05:41:38.482 INFO:tasks.rados.rados.0.trial118.stdout:3214: finishing write tid 1 to trial11845692-19 2026-02-17T05:41:38.482 INFO:tasks.rados.rados.0.trial118.stdout:3214: finishing write tid 2 to trial11845692-19 2026-02-17T05:41:38.482 INFO:tasks.rados.rados.0.trial118.stdout:3217: snap_create 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: finishing write tid 3 to trial11845692-19 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: finishing write tid 4 to trial11845692-19 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: finishing write tid 5 to trial11845692-19 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: oid 19 updating version 0 to 1683 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: oid 19 updating version 1683 to 1685 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: oid 19 version 1685 is already newer than 1684 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:3214: oid 19 version 1685 is already newer than 1682 2026-02-17T05:41:38.483 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:41:38.484 INFO:tasks.rados.rados.0.trial118.stdout:3214: left oid 19 (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:41:38.484 INFO:tasks.rados.rados.0.trial118.stdout:3215: expect (ObjNum 956 snap 288 seq_num 956) 2026-02-17T05:41:38.505 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1792840 2026-02-17T05:41:38.521 INFO:tasks.rados.rados.0.trial118.stdout:3216: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:41:38.522 INFO:tasks.rados.rados.0.trial118.stdout:3216: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:41:38.522 INFO:tasks.rados.rados.0.trial118.stdout:3216: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:41:38.522 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1698 (ObjNum 1053 snap 316 seq_num 1053) dirty exists 2026-02-17T05:41:39.420 INFO:tasks.rados.rados.0.trial118.stdout:3214: done (3 left) 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:3215: done (2 left) 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:3216: done (1 left) 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:3217: done (0 left) 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:3218: rollback oid 2 current snap is 344 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 332 2026-02-17T05:41:39.421 INFO:tasks.rados.rados.0.trial118.stdout:3219: snap_remove snap 343 2026-02-17T05:41:40.347 INFO:tasks.rados.rados.0.trial118.stdout:3219: done (1 left) 2026-02-17T05:41:40.347 INFO:tasks.rados.rados.0.trial118.stdout:3220: read oid 38 snap 339 2026-02-17T05:41:40.347 INFO:tasks.rados.rados.0.trial118.stdout:3220: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:41:40.347 INFO:tasks.rados.rados.0.trial118.stdout:3221: write (excl) oid 7 current snap is 344 2026-02-17T05:41:40.347 INFO:tasks.rados.rados.0.trial118.stdout:3221: seq_num 1129 ranges {575103=576365,1932994=744383} 2026-02-17T05:41:40.352 INFO:tasks.rados.rados.0.trial118.stdout:3221: writing trial11845692-7 from 575103 to 1151468 tid 1 2026-02-17T05:41:40.358 INFO:tasks.rados.rados.0.trial118.stdout:3221: writing trial11845692-7 from 1932994 to 2677377 tid 2 2026-02-17T05:41:40.358 INFO:tasks.rados.rados.0.trial118.stdout:3222: snap_remove snap 324 2026-02-17T05:41:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3222: done (3 left) 2026-02-17T05:41:41.349 INFO:tasks.rados.rados.0.trial118.stdout:3223: write oid 6 current snap is 344 2026-02-17T05:41:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3218: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:41:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3218: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:41:41.350 INFO:tasks.rados.rados.0.trial118.stdout:3223: seq_num 1130 ranges {591910=651614,1875123=604394} 2026-02-17T05:41:41.353 INFO:tasks.rados.rados.0.trial118.stdout:3223: writing trial11845692-6 from 591910 to 1243524 tid 1 2026-02-17T05:41:41.358 INFO:tasks.rados.rados.0.trial118.stdout:3223: writing trial11845692-6 from 1875123 to 2479517 tid 2 2026-02-17T05:41:41.358 INFO:tasks.rados.rados.0.trial118.stdout:3224: snap_create 2026-02-17T05:41:41.359 INFO:tasks.rados.rados.0.trial118.stdout:3218: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:41:41.359 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2052 (ObjNum 1064 snap 318 seq_num 1064) dirty exists 2026-02-17T05:41:41.359 INFO:tasks.rados.rados.0.trial118.stdout:3220: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:41:41.380 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1053093 2026-02-17T05:41:41.404 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2128795 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: finishing write tid 1 to trial11845692-7 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: finishing write tid 2 to trial11845692-7 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: finishing write tid 3 to trial11845692-7 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: finishing write tid 4 to trial11845692-7 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: oid 7 updating version 0 to 1911 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: oid 7 updating version 1911 to 1912 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: oid 7 updating version 1912 to 1913 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1913 (ObjNum 1129 snap 344 seq_num 1129) dirty exists 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3221: left oid 7 (ObjNum 1129 snap 344 seq_num 1129) 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3223: finishing write tid 1 to trial11845692-6 2026-02-17T05:41:41.415 INFO:tasks.rados.rados.0.trial118.stdout:3223: finishing write tid 2 to trial11845692-6 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: finishing write tid 3 to trial11845692-6 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: finishing write tid 4 to trial11845692-6 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: oid 6 updating version 0 to 1711 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: oid 6 version 1711 is already newer than 1710 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: oid 6 version 1711 is already newer than 1709 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1711 (ObjNum 1130 snap 344 seq_num 1130) dirty exists 2026-02-17T05:41:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3223: left oid 6 (ObjNum 1130 snap 344 seq_num 1130) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3218: done (4 left) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3220: done (3 left) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3221: done (2 left) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3223: done (1 left) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3224: done (0 left) 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:3225: rollback oid 12 current snap is 345 2026-02-17T05:41:42.350 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 12 to 329 2026-02-17T05:41:42.351 INFO:tasks.rados.rados.0.trial118.stdout:3226: rollback oid 15 current snap is 345 2026-02-17T05:41:42.351 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 15 to 305 2026-02-17T05:41:42.351 INFO:tasks.rados.rados.0.trial118.stdout:3227: write (excl) oid 18 current snap is 345 2026-02-17T05:41:42.351 INFO:tasks.rados.rados.0.trial118.stdout:3227: seq_num 1131 ranges {608717=726863,1933605=748052} 2026-02-17T05:41:42.355 INFO:tasks.rados.rados.0.trial118.stdout:3227: writing trial11845692-18 from 608717 to 1335580 tid 1 2026-02-17T05:41:42.360 INFO:tasks.rados.rados.0.trial118.stdout:3227: writing trial11845692-18 from 1933605 to 2681657 tid 2 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3228: snap_create 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3225: finishing rollback tid 0 to trial11845692-12 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3225: finishing rollback tid 1 to trial11845692-12 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3226: finishing rollback tid 0 to trial11845692-15 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3226: finishing rollback tid 1 to trial11845692-15 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3226: finishing rollback tid 2 to trial11845692-15 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1733 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3225: finishing rollback tid 2 to trial11845692-12 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1495 (ObjNum 1052 snap 316 seq_num 1052) dirty exists 2026-02-17T05:41:42.361 INFO:tasks.rados.rados.0.trial118.stdout:3227: finishing write tid 1 to trial11845692-18 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: finishing write tid 2 to trial11845692-18 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: finishing write tid 3 to trial11845692-18 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: finishing write tid 4 to trial11845692-18 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: oid 18 updating version 0 to 1569 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: oid 18 updating version 1569 to 1570 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: oid 18 updating version 1570 to 1571 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1571 (ObjNum 1131 snap 345 seq_num 1131) dirty exists 2026-02-17T05:41:42.363 INFO:tasks.rados.rados.0.trial118.stdout:3227: left oid 18 (ObjNum 1131 snap 345 seq_num 1131) 2026-02-17T05:41:43.352 INFO:tasks.rados.rados.0.trial118.stdout:3225: done (3 left) 2026-02-17T05:41:43.352 INFO:tasks.rados.rados.0.trial118.stdout:3226: done (2 left) 2026-02-17T05:41:43.352 INFO:tasks.rados.rados.0.trial118.stdout:3227: done (1 left) 2026-02-17T05:41:43.352 INFO:tasks.rados.rados.0.trial118.stdout:3228: done (0 left) 2026-02-17T05:41:43.352 INFO:tasks.rados.rados.0.trial118.stdout:3229: snap_create 2026-02-17T05:41:44.354 INFO:tasks.rados.rados.0.trial118.stdout:3229: done (0 left) 2026-02-17T05:41:44.354 INFO:tasks.rados.rados.0.trial118.stdout:3230: write oid 7 current snap is 347 2026-02-17T05:41:44.354 INFO:tasks.rados.rados.0.trial118.stdout:3230: seq_num 1132 ranges {625524=402112,1592087=608063,2869769=155755} 2026-02-17T05:41:44.358 INFO:tasks.rados.rados.0.trial118.stdout:3230: writing trial11845692-7 from 625524 to 1027636 tid 1 2026-02-17T05:41:44.362 INFO:tasks.rados.rados.0.trial118.stdout:3230: writing trial11845692-7 from 1592087 to 2200150 tid 2 2026-02-17T05:41:44.366 INFO:tasks.rados.rados.0.trial118.stdout:3230: writing trial11845692-7 from 2869769 to 3025524 tid 3 2026-02-17T05:41:44.366 INFO:tasks.rados.rados.0.trial118.stdout:3231: delete oid 45 current snap is 347 2026-02-17T05:41:44.366 INFO:tasks.rados.rados.0.trial118.stdout:3230: finishing write tid 1 to trial11845692-7 2026-02-17T05:41:44.366 INFO:tasks.rados.rados.0.trial118.stdout:3230: finishing write tid 2 to trial11845692-7 2026-02-17T05:41:44.367 INFO:tasks.rados.rados.0.trial118.stdout:3230: finishing write tid 3 to trial11845692-7 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: finishing write tid 4 to trial11845692-7 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: finishing write tid 5 to trial11845692-7 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: oid 7 updating version 0 to 1923 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: oid 7 updating version 1923 to 1926 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: oid 7 version 1926 is already newer than 1924 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:3230: oid 7 version 1926 is already newer than 1925 2026-02-17T05:41:44.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1926 (ObjNum 1132 snap 347 seq_num 1132) dirty exists 2026-02-17T05:41:44.369 INFO:tasks.rados.rados.0.trial118.stdout:3230: left oid 7 (ObjNum 1132 snap 347 seq_num 1132) 2026-02-17T05:41:44.369 INFO:tasks.rados.rados.0.trial118.stdout:3230: done (1 left) 2026-02-17T05:41:44.369 INFO:tasks.rados.rados.0.trial118.stdout:3231: done (0 left) 2026-02-17T05:41:44.369 INFO:tasks.rados.rados.0.trial118.stdout:3232: copy_from oid 37 from oid 30 current snap is 347 2026-02-17T05:41:44.369 INFO:tasks.rados.rados.0.trial118.stdout:3233: snap_remove snap 346 2026-02-17T05:41:45.359 INFO:tasks.rados.rados.0.trial118.stdout:3233: done (1 left) 2026-02-17T05:41:45.360 INFO:tasks.rados.rados.0.trial118.stdout:3234: read oid 7 snap -1 2026-02-17T05:41:45.360 INFO:tasks.rados.rados.0.trial118.stdout:3234: expect (ObjNum 1132 snap 347 seq_num 1132) 2026-02-17T05:41:45.360 INFO:tasks.rados.rados.0.trial118.stdout:3235: write (excl) oid 23 current snap is 347 2026-02-17T05:41:45.360 INFO:tasks.rados.rados.0.trial118.stdout:3235: seq_num 1134 ranges {659138=668963,2109051=611732} 2026-02-17T05:41:45.365 INFO:tasks.rados.rados.0.trial118.stdout:3235: writing trial11845692-23 from 659138 to 1328101 tid 1 2026-02-17T05:41:45.370 INFO:tasks.rados.rados.0.trial118.stdout:3235: writing trial11845692-23 from 2109051 to 2720783 tid 2 2026-02-17T05:41:45.370 INFO:tasks.rados.rados.0.trial118.stdout:3236: snap_create 2026-02-17T05:41:45.371 INFO:tasks.rados.rados.0.trial118.stdout:3232: finishing copy_from racing read to trial11845692-37 2026-02-17T05:41:45.371 INFO:tasks.rados.rados.0.trial118.stdout:3232: finishing copy_from to trial11845692-37 2026-02-17T05:41:45.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1488 (ObjNum 1110 snap 332 seq_num 1110) dirty exists 2026-02-17T05:41:45.371 INFO:tasks.rados.rados.0.trial118.stdout:3234: expect (ObjNum 1132 snap 347 seq_num 1132) 2026-02-17T05:41:45.371 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 79700 2026-02-17T05:41:45.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:45.508 INFO:tasks.rados.rados.0.trial118.stdout:3235: finishing write tid 1 to trial11845692-23 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: finishing write tid 2 to trial11845692-23 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: finishing write tid 3 to trial11845692-23 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: finishing write tid 4 to trial11845692-23 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: oid 23 updating version 0 to 1713 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: oid 23 version 1713 is already newer than 1712 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: oid 23 updating version 1713 to 1714 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1714 (ObjNum 1134 snap 347 seq_num 1134) dirty exists 2026-02-17T05:41:45.509 INFO:tasks.rados.rados.0.trial118.stdout:3235: left oid 23 (ObjNum 1134 snap 347 seq_num 1134) 2026-02-17T05:41:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3232: done (3 left) 2026-02-17T05:41:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3234: done (2 left) 2026-02-17T05:41:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3235: done (1 left) 2026-02-17T05:41:46.362 INFO:tasks.rados.rados.0.trial118.stdout:3236: done (0 left) 2026-02-17T05:41:46.362 INFO:tasks.rados.rados.0.trial118.stdout:3237: copy_from oid 10 from oid 37 current snap is 348 2026-02-17T05:41:46.362 INFO:tasks.rados.rados.0.trial118.stdout:3238: snap_create 2026-02-17T05:41:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3237: finishing copy_from racing read to trial11845692-10 2026-02-17T05:41:46.372 INFO:tasks.rados.rados.0.trial118.stdout:3237: finishing copy_from to trial11845692-10 2026-02-17T05:41:46.372 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1488 (ObjNum 1110 snap 332 seq_num 1110) dirty exists 2026-02-17T05:41:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3237: done (1 left) 2026-02-17T05:41:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3238: done (0 left) 2026-02-17T05:41:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3239: rollback oid 50 current snap is 349 2026-02-17T05:41:47.362 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 344 2026-02-17T05:41:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3240: delete oid 45 current snap is 349 2026-02-17T05:41:47.365 INFO:tasks.rados.rados.0.trial118.stdout:3240: done (1 left) 2026-02-17T05:41:47.365 INFO:tasks.rados.rados.0.trial118.stdout:3241: snap_create 2026-02-17T05:41:47.367 INFO:tasks.rados.rados.0.trial118.stdout:3239: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:41:47.367 INFO:tasks.rados.rados.0.trial118.stdout:3239: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:41:47.367 INFO:tasks.rados.rados.0.trial118.stdout:3239: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:41:47.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1498 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:41:48.366 INFO:tasks.rados.rados.0.trial118.stdout:3239: done (1 left) 2026-02-17T05:41:48.367 INFO:tasks.rados.rados.0.trial118.stdout:3241: done (0 left) 2026-02-17T05:41:48.367 INFO:tasks.rados.rados.0.trial118.stdout:3242: read oid 46 snap 349 2026-02-17T05:41:48.367 INFO:tasks.rados.rados.0.trial118.stdout:3242: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:41:48.367 INFO:tasks.rados.rados.0.trial118.stdout:3243: snap_remove snap 329 2026-02-17T05:41:49.368 INFO:tasks.rados.rados.0.trial118.stdout:3243: done (1 left) 2026-02-17T05:41:49.368 INFO:tasks.rados.rados.0.trial118.stdout:3244: snap_remove snap 305 2026-02-17T05:41:50.350 INFO:tasks.rados.rados.0.trial118.stdout:3244: done (1 left) 2026-02-17T05:41:50.350 INFO:tasks.rados.rados.0.trial118.stdout:3245: snap_create 2026-02-17T05:41:50.351 INFO:tasks.rados.rados.0.trial118.stdout:3242: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:41:50.368 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:50.395 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 238391 2026-02-17T05:41:51.353 INFO:tasks.rados.rados.0.trial118.stdout:3242: done (1 left) 2026-02-17T05:41:51.353 INFO:tasks.rados.rados.0.trial118.stdout:3245: done (0 left) 2026-02-17T05:41:51.353 INFO:tasks.rados.rados.0.trial118.stdout:3246: rollback oid 42 current snap is 351 2026-02-17T05:41:51.353 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 348 2026-02-17T05:41:51.353 INFO:tasks.rados.rados.0.trial118.stdout:3247: snap_create 2026-02-17T05:41:51.357 INFO:tasks.rados.rados.0.trial118.stdout:3246: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:41:51.358 INFO:tasks.rados.rados.0.trial118.stdout:3246: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:41:51.358 INFO:tasks.rados.rados.0.trial118.stdout:3246: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:41:51.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1796 (ObjNum 1098 snap 330 seq_num 1098) dirty exists 2026-02-17T05:41:52.353 INFO:tasks.rados.rados.0.trial118.stdout:3246: done (1 left) 2026-02-17T05:41:52.354 INFO:tasks.rados.rados.0.trial118.stdout:3247: done (0 left) 2026-02-17T05:41:52.354 INFO:tasks.rados.rados.0.trial118.stdout:3248: read oid 22 snap -1 2026-02-17T05:41:52.354 INFO:tasks.rados.rados.0.trial118.stdout:3248: expect (ObjNum 1124 snap 343 seq_num 1124) 2026-02-17T05:41:52.354 INFO:tasks.rados.rados.0.trial118.stdout:3249: write oid 42 current snap is 352 2026-02-17T05:41:52.354 INFO:tasks.rados.rados.0.trial118.stdout:3249: seq_num 1136 ranges {692752=419461,1826015=615401,2979461=113291} 2026-02-17T05:41:52.357 INFO:tasks.rados.rados.0.trial118.stdout:3249: writing trial11845692-42 from 692752 to 1112213 tid 1 2026-02-17T05:41:52.362 INFO:tasks.rados.rados.0.trial118.stdout:3249: writing trial11845692-42 from 1826015 to 2441416 tid 2 2026-02-17T05:41:52.365 INFO:tasks.rados.rados.0.trial118.stdout:3249: writing trial11845692-42 from 2979461 to 3092752 tid 3 2026-02-17T05:41:52.365 INFO:tasks.rados.rados.0.trial118.stdout:3250: snap_remove snap 341 2026-02-17T05:41:53.355 INFO:tasks.rados.rados.0.trial118.stdout:3250: done (2 left) 2026-02-17T05:41:53.355 INFO:tasks.rados.rados.0.trial118.stdout:3251: copy_from oid 5 from oid 47 current snap is 352 2026-02-17T05:41:53.355 INFO:tasks.rados.rados.0.trial118.stdout:3248: expect (ObjNum 1124 snap 343 seq_num 1124) 2026-02-17T05:41:53.355 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:53.439 INFO:tasks.rados.rados.0.trial118.stdout:3249: finishing write tid 1 to trial11845692-42 2026-02-17T05:41:53.439 INFO:tasks.rados.rados.0.trial118.stdout:3248: done (2 left) 2026-02-17T05:41:53.439 INFO:tasks.rados.rados.0.trial118.stdout:3252: snap_remove snap 347 2026-02-17T05:41:54.358 INFO:tasks.rados.rados.0.trial118.stdout:3252: done (2 left) 2026-02-17T05:41:54.359 INFO:tasks.rados.rados.0.trial118.stdout:3253: write (excl) oid 36 current snap is 352 2026-02-17T05:41:54.359 INFO:tasks.rados.rados.0.trial118.stdout:3253: seq_num 1137 ranges {709559=494710,1884497=759059} 2026-02-17T05:41:54.363 INFO:tasks.rados.rados.0.trial118.stdout:3253: writing trial11845692-36 from 709559 to 1204269 tid 1 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3253: writing trial11845692-36 from 1884497 to 2643556 tid 2 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3254: copy_from oid 14 from oid 44 current snap is 352 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: finishing write tid 2 to trial11845692-42 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: finishing write tid 3 to trial11845692-42 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: finishing write tid 4 to trial11845692-42 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: finishing write tid 5 to trial11845692-42 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: oid 42 updating version 0 to 1798 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: oid 42 updating version 1798 to 1800 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: oid 42 version 1800 is already newer than 1797 2026-02-17T05:41:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3249: oid 42 version 1800 is already newer than 1799 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1800 (ObjNum 1136 snap 352 seq_num 1136) dirty exists 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3249: left oid 42 (ObjNum 1136 snap 352 seq_num 1136) 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3249: done (3 left) 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3255: copy_from oid 7 from oid 39 current snap is 352 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3251: finishing copy_from racing read to trial11845692-5 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3251: finishing copy_from to trial11845692-5 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1793 (ObjNum 1122 snap 343 seq_num 1122) dirty exists 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3253: finishing write tid 1 to trial11845692-36 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3251: done (3 left) 2026-02-17T05:41:54.371 INFO:tasks.rados.rados.0.trial118.stdout:3256: read oid 16 snap -1 2026-02-17T05:41:54.372 INFO:tasks.rados.rados.0.trial118.stdout:3256: expect deleted 2026-02-17T05:41:54.372 INFO:tasks.rados.rados.0.trial118.stdout:3257: snap_create 2026-02-17T05:41:54.372 INFO:tasks.rados.rados.0.trial118.stdout:3253: finishing write tid 2 to trial11845692-36 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: finishing write tid 3 to trial11845692-36 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: finishing write tid 4 to trial11845692-36 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: oid 36 updating version 0 to 1736 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: oid 36 updating version 1736 to 1737 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: oid 36 version 1737 is already newer than 1735 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1737 (ObjNum 1137 snap 352 seq_num 1137) dirty exists 2026-02-17T05:41:54.373 INFO:tasks.rados.rados.0.trial118.stdout:3253: left oid 36 (ObjNum 1137 snap 352 seq_num 1137) 2026-02-17T05:41:54.374 INFO:tasks.rados.rados.0.trial118.stdout:3254: finishing copy_from racing read to trial11845692-14 2026-02-17T05:41:54.375 INFO:tasks.rados.rados.0.trial118.stdout:3254: finishing copy_from to trial11845692-14 2026-02-17T05:41:54.375 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1690 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:41:54.376 INFO:tasks.rados.rados.0.trial118.stdout:3255: finishing copy_from racing read to trial11845692-7 2026-02-17T05:41:54.378 INFO:tasks.rados.rados.0.trial118.stdout:3255: finishing copy_from to trial11845692-7 2026-02-17T05:41:54.378 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1787 (ObjNum 1089 snap 324 seq_num 1089) dirty exists 2026-02-17T05:41:55.361 INFO:tasks.rados.rados.0.trial118.stdout:3253: done (4 left) 2026-02-17T05:41:55.361 INFO:tasks.rados.rados.0.trial118.stdout:3254: done (3 left) 2026-02-17T05:41:55.362 INFO:tasks.rados.rados.0.trial118.stdout:3255: done (2 left) 2026-02-17T05:41:55.362 INFO:tasks.rados.rados.0.trial118.stdout:3256: done (1 left) 2026-02-17T05:41:55.362 INFO:tasks.rados.rados.0.trial118.stdout:3257: done (0 left) 2026-02-17T05:41:55.362 INFO:tasks.rados.rados.0.trial118.stdout:3258: write oid 32 current snap is 353 2026-02-17T05:41:55.362 INFO:tasks.rados.rados.0.trial118.stdout:3258: seq_num 1138 ranges {726366=569959,1826626=502717,2801601=324765} 2026-02-17T05:41:55.366 INFO:tasks.rados.rados.0.trial118.stdout:3258: writing trial11845692-32 from 726366 to 1296325 tid 1 2026-02-17T05:41:55.371 INFO:tasks.rados.rados.0.trial118.stdout:3258: writing trial11845692-32 from 1826626 to 2329343 tid 2 2026-02-17T05:41:55.374 INFO:tasks.rados.rados.0.trial118.stdout:3258: writing trial11845692-32 from 2801601 to 3126366 tid 3 2026-02-17T05:41:55.374 INFO:tasks.rados.rados.0.trial118.stdout:3259: snap_remove snap 332 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3259: done (1 left) 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3260: snap_create 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: finishing write tid 1 to trial11845692-32 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: finishing write tid 2 to trial11845692-32 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: finishing write tid 3 to trial11845692-32 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: finishing write tid 4 to trial11845692-32 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: finishing write tid 5 to trial11845692-32 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: oid 32 updating version 0 to 1712 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: oid 32 updating version 1712 to 1714 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: oid 32 version 1714 is already newer than 1713 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: oid 32 version 1714 is already newer than 1711 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1714 (ObjNum 1138 snap 353 seq_num 1138) dirty exists 2026-02-17T05:41:56.363 INFO:tasks.rados.rados.0.trial118.stdout:3258: left oid 32 (ObjNum 1138 snap 353 seq_num 1138) 2026-02-17T05:41:57.364 INFO:tasks.rados.rados.0.trial118.stdout:3258: done (1 left) 2026-02-17T05:41:57.364 INFO:tasks.rados.rados.0.trial118.stdout:3260: done (0 left) 2026-02-17T05:41:57.364 INFO:tasks.rados.rados.0.trial118.stdout:3261: delete oid 44 current snap is 354 2026-02-17T05:41:57.368 INFO:tasks.rados.rados.0.trial118.stdout:3261: done (0 left) 2026-02-17T05:41:57.368 INFO:tasks.rados.rados.0.trial118.stdout:3262: delete oid 8 current snap is 354 2026-02-17T05:41:57.372 INFO:tasks.rados.rados.0.trial118.stdout:3262: done (0 left) 2026-02-17T05:41:57.372 INFO:tasks.rados.rados.0.trial118.stdout:3263: read oid 3 snap 344 2026-02-17T05:41:57.372 INFO:tasks.rados.rados.0.trial118.stdout:3263: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:41:57.372 INFO:tasks.rados.rados.0.trial118.stdout:3264: snap_create 2026-02-17T05:41:57.375 INFO:tasks.rados.rados.0.trial118.stdout:3263: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:41:57.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:41:58.368 INFO:tasks.rados.rados.0.trial118.stdout:3263: done (1 left) 2026-02-17T05:41:58.368 INFO:tasks.rados.rados.0.trial118.stdout:3264: done (0 left) 2026-02-17T05:41:58.368 INFO:tasks.rados.rados.0.trial118.stdout:3265: write (excl) oid 26 current snap is 355 2026-02-17T05:41:58.368 INFO:tasks.rados.rados.0.trial118.stdout:3265: seq_num 1141 ranges {776787=512059,1718425=766397,3000223=176564} 2026-02-17T05:41:58.373 INFO:tasks.rados.rados.0.trial118.stdout:3265: writing trial11845692-26 from 776787 to 1288846 tid 1 2026-02-17T05:41:58.377 INFO:tasks.rados.rados.0.trial118.stdout:3265: writing trial11845692-26 from 1718425 to 2484822 tid 2 2026-02-17T05:41:58.380 INFO:tasks.rados.rados.0.trial118.stdout:3265: writing trial11845692-26 from 3000223 to 3176787 tid 3 2026-02-17T05:41:58.380 INFO:tasks.rados.rados.0.trial118.stdout:3266: write (excl) oid 2 current snap is 355 2026-02-17T05:41:58.380 INFO:tasks.rados.rados.0.trial118.stdout:3266: seq_num 1142 ranges {793594=587308,2060554=510055} 2026-02-17T05:41:58.385 INFO:tasks.rados.rados.0.trial118.stdout:3266: writing trial11845692-2 from 793594 to 1380902 tid 1 2026-02-17T05:41:58.389 INFO:tasks.rados.rados.0.trial118.stdout:3266: writing trial11845692-2 from 2060554 to 2570609 tid 2 2026-02-17T05:41:58.389 INFO:tasks.rados.rados.0.trial118.stdout:3267: snap_remove snap 319 2026-02-17T05:41:59.370 INFO:tasks.rados.rados.0.trial118.stdout:3267: done (2 left) 2026-02-17T05:41:59.370 INFO:tasks.rados.rados.0.trial118.stdout:3268: write (excl) oid 23 current snap is 355 2026-02-17T05:41:59.370 INFO:tasks.rados.rados.0.trial118.stdout:3265: finishing write tid 1 to trial11845692-26 2026-02-17T05:41:59.370 INFO:tasks.rados.rados.0.trial118.stdout:3268: seq_num 1143 ranges {410401=662557,1719036=770066,2938716=271685} 2026-02-17T05:41:59.375 INFO:tasks.rados.rados.0.trial118.stdout:3268: writing trial11845692-23 from 410401 to 1072958 tid 1 2026-02-17T05:41:59.380 INFO:tasks.rados.rados.0.trial118.stdout:3268: writing trial11845692-23 from 1719036 to 2489102 tid 2 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3268: writing trial11845692-23 from 2938716 to 3210401 tid 3 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3269: delete oid 36 current snap is 355 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: finishing write tid 2 to trial11845692-26 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: finishing write tid 3 to trial11845692-26 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: finishing write tid 4 to trial11845692-26 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: finishing write tid 5 to trial11845692-26 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: oid 26 updating version 0 to 1468 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: oid 26 updating version 1468 to 1470 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: oid 26 version 1470 is already newer than 1467 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: oid 26 version 1470 is already newer than 1469 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1470 (ObjNum 1141 snap 355 seq_num 1141) dirty exists 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3265: left oid 26 (ObjNum 1141 snap 355 seq_num 1141) 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: finishing write tid 1 to trial11845692-2 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: finishing write tid 2 to trial11845692-2 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: finishing write tid 3 to trial11845692-2 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: finishing write tid 4 to trial11845692-2 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: oid 2 updating version 0 to 2088 2026-02-17T05:41:59.383 INFO:tasks.rados.rados.0.trial118.stdout:3266: oid 2 version 2088 is already newer than 2086 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3266: oid 2 version 2088 is already newer than 2087 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2088 (ObjNum 1142 snap 355 seq_num 1142) dirty exists 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3266: left oid 2 (ObjNum 1142 snap 355 seq_num 1142) 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: finishing write tid 1 to trial11845692-23 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: finishing write tid 2 to trial11845692-23 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: finishing write tid 3 to trial11845692-23 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: finishing write tid 4 to trial11845692-23 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: finishing write tid 5 to trial11845692-23 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: oid 23 updating version 0 to 1717 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: oid 23 version 1717 is already newer than 1716 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: oid 23 updating version 1717 to 1718 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: oid 23 version 1718 is already newer than 1715 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1718 (ObjNum 1143 snap 355 seq_num 1143) dirty exists 2026-02-17T05:41:59.384 INFO:tasks.rados.rados.0.trial118.stdout:3268: left oid 23 (ObjNum 1143 snap 355 seq_num 1143) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3265: done (3 left) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3266: done (2 left) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3268: done (1 left) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3269: done (0 left) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3270: read oid 23 snap -1 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3270: expect (ObjNum 1143 snap 355 seq_num 1143) 2026-02-17T05:41:59.385 INFO:tasks.rados.rados.0.trial118.stdout:3271: snap_remove snap 338 2026-02-17T05:42:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3271: done (1 left) 2026-02-17T05:42:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3272: write (excl) oid 49 current snap is 355 2026-02-17T05:42:00.351 INFO:tasks.rados.rados.0.trial118.stdout:3272: seq_num 1145 ranges {444015=413055,1436000=773735,2709915=534100} 2026-02-17T05:42:00.354 INFO:tasks.rados.rados.0.trial118.stdout:3272: writing trial11845692-49 from 444015 to 857070 tid 1 2026-02-17T05:42:00.359 INFO:tasks.rados.rados.0.trial118.stdout:3272: writing trial11845692-49 from 1436000 to 2209735 tid 2 2026-02-17T05:42:00.363 INFO:tasks.rados.rados.0.trial118.stdout:3272: writing trial11845692-49 from 2709915 to 3244015 tid 3 2026-02-17T05:42:00.363 INFO:tasks.rados.rados.0.trial118.stdout:3273: write (excl) oid 18 current snap is 355 2026-02-17T05:42:00.363 INFO:tasks.rados.rados.0.trial118.stdout:3273: seq_num 1146 ranges {460822=488304,1378129=517393,2504632=405962} 2026-02-17T05:42:00.366 INFO:tasks.rados.rados.0.trial118.stdout:3273: writing trial11845692-18 from 460822 to 949126 tid 1 2026-02-17T05:42:00.370 INFO:tasks.rados.rados.0.trial118.stdout:3273: writing trial11845692-18 from 1378129 to 1895522 tid 2 2026-02-17T05:42:00.374 INFO:tasks.rados.rados.0.trial118.stdout:3273: writing trial11845692-18 from 2504632 to 2910594 tid 3 2026-02-17T05:42:00.374 INFO:tasks.rados.rados.0.trial118.stdout:3274: delete oid 33 current snap is 355 2026-02-17T05:42:00.374 INFO:tasks.rados.rados.0.trial118.stdout:3270: expect (ObjNum 1143 snap 355 seq_num 1143) 2026-02-17T05:42:00.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 682622 2026-02-17T05:42:00.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2637818 2026-02-17T05:42:00.457 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1974653 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: finishing write tid 1 to trial11845692-49 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: finishing write tid 2 to trial11845692-49 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3270: done (3 left) 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3274: done (2 left) 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3275: copy_from oid 1 from oid 20 current snap is 355 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: finishing write tid 3 to trial11845692-49 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: finishing write tid 4 to trial11845692-49 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: finishing write tid 5 to trial11845692-49 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: oid 49 updating version 0 to 1715 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: oid 49 updating version 1715 to 1717 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: oid 49 updating version 1717 to 1718 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: oid 49 version 1718 is already newer than 1716 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1718 (ObjNum 1145 snap 355 seq_num 1145) dirty exists 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3272: left oid 49 (ObjNum 1145 snap 355 seq_num 1145) 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3273: finishing write tid 1 to trial11845692-18 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3273: finishing write tid 2 to trial11845692-18 2026-02-17T05:42:00.481 INFO:tasks.rados.rados.0.trial118.stdout:3273: finishing write tid 3 to trial11845692-18 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: finishing write tid 4 to trial11845692-18 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: finishing write tid 5 to trial11845692-18 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: oid 18 updating version 0 to 1573 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: oid 18 updating version 1573 to 1574 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: oid 18 updating version 1574 to 1575 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: oid 18 version 1575 is already newer than 1572 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1575 (ObjNum 1146 snap 355 seq_num 1146) dirty exists 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: left oid 18 (ObjNum 1146 snap 355 seq_num 1146) 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3272: done (2 left) 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3273: done (1 left) 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3276: copy_from oid 37 from oid 34 current snap is 355 2026-02-17T05:42:00.482 INFO:tasks.rados.rados.0.trial118.stdout:3277: snap_create 2026-02-17T05:42:00.490 INFO:tasks.rados.rados.0.trial118.stdout:3276: finishing copy_from racing read to trial11845692-37 2026-02-17T05:42:00.492 INFO:tasks.rados.rados.0.trial118.stdout:3275: finishing copy_from racing read to trial11845692-1 2026-02-17T05:42:00.492 INFO:tasks.rados.rados.0.trial118.stdout:3276: finishing copy_from to trial11845692-37 2026-02-17T05:42:00.492 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1562 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-17T05:42:00.493 INFO:tasks.rados.rados.0.trial118.stdout:3275: finishing copy_from to trial11845692-1 2026-02-17T05:42:00.493 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 2011 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:42:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3275: done (2 left) 2026-02-17T05:42:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3276: done (1 left) 2026-02-17T05:42:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3277: done (0 left) 2026-02-17T05:42:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3278: snap_remove snap 344 2026-02-17T05:42:02.379 INFO:tasks.rados.rados.0.trial118.stdout:3278: done (0 left) 2026-02-17T05:42:02.379 INFO:tasks.rados.rados.0.trial118.stdout:3279: delete oid 29 current snap is 356 2026-02-17T05:42:02.384 INFO:tasks.rados.rados.0.trial118.stdout:3279: done (0 left) 2026-02-17T05:42:02.384 INFO:tasks.rados.rados.0.trial118.stdout:3280: snap_create 2026-02-17T05:42:03.380 INFO:tasks.rados.rados.0.trial118.stdout:3280: done (0 left) 2026-02-17T05:42:03.380 INFO:tasks.rados.rados.0.trial118.stdout:3281: snap_create 2026-02-17T05:42:04.384 INFO:tasks.rados.rados.0.trial118.stdout:3281: done (0 left) 2026-02-17T05:42:04.384 INFO:tasks.rados.rados.0.trial118.stdout:3282: snap_create 2026-02-17T05:42:05.385 INFO:tasks.rados.rados.0.trial118.stdout:3282: done (0 left) 2026-02-17T05:42:05.385 INFO:tasks.rados.rados.0.trial118.stdout:3283: read oid 19 snap -1 2026-02-17T05:42:05.385 INFO:tasks.rados.rados.0.trial118.stdout:3283: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:05.385 INFO:tasks.rados.rados.0.trial118.stdout:3284: snap_create 2026-02-17T05:42:05.392 INFO:tasks.rados.rados.0.trial118.stdout:3283: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:05.392 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:05.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2906271 2026-02-17T05:42:06.388 INFO:tasks.rados.rados.0.trial118.stdout:3283: done (1 left) 2026-02-17T05:42:06.388 INFO:tasks.rados.rados.0.trial118.stdout:3284: done (0 left) 2026-02-17T05:42:06.388 INFO:tasks.rados.rados.0.trial118.stdout:3285: delete oid 43 current snap is 360 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3285: done (0 left) 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3286: copy_from oid 31 from oid 19 current snap is 360 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3287: copy_from oid 3 from oid 29 current snap is 360 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3288: copy_from oid 13 from oid 36 current snap is 360 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3289: read oid 22 snap 339 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3289: expect (ObjNum 1118 snap 339 seq_num 1118) 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3290: write oid 8 current snap is 360 2026-02-17T05:42:06.391 INFO:tasks.rados.rados.0.trial118.stdout:3290: seq_num 1150 ranges {528050=505653,1612057=524731,2614324=567403} 2026-02-17T05:42:06.395 INFO:tasks.rados.rados.0.trial118.stdout:3290: writing trial11845692-8 from 528050 to 1033703 tid 1 2026-02-17T05:42:06.400 INFO:tasks.rados.rados.0.trial118.stdout:3290: writing trial11845692-8 from 1612057 to 2136788 tid 2 2026-02-17T05:42:06.405 INFO:tasks.rados.rados.0.trial118.stdout:3290: writing trial11845692-8 from 2614324 to 3181727 tid 3 2026-02-17T05:42:06.405 INFO:tasks.rados.rados.0.trial118.stdout:3291: rollback oid 14 current snap is 360 2026-02-17T05:42:06.405 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 352 2026-02-17T05:42:06.405 INFO:tasks.rados.rados.0.trial118.stdout:3287: finishing copy_from to trial11845692-3 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3287: got expected ENOENT (src dne) 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3287: finishing copy_from racing read to trial11845692-3 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3288: finishing copy_from to trial11845692-13 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3288: got expected ENOENT (src dne) 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3288: finishing copy_from racing read to trial11845692-13 2026-02-17T05:42:06.406 INFO:tasks.rados.rados.0.trial118.stdout:3289: expect (ObjNum 1118 snap 339 seq_num 1118) 2026-02-17T05:42:06.407 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 857493 2026-02-17T05:42:06.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1096026 2026-02-17T05:42:06.437 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:06.458 INFO:tasks.rados.rados.0.trial118.stdout:3286: finishing copy_from racing read to trial11845692-31 2026-02-17T05:42:06.458 INFO:tasks.rados.rados.0.trial118.stdout:3286: finishing copy_from to trial11845692-31 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3290: finishing write tid 1 to trial11845692-8 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3290: finishing write tid 2 to trial11845692-8 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3286: done (5 left) 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3287: done (4 left) 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3288: done (3 left) 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3289: done (2 left) 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3292: read oid 45 snap -1 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3292: expect deleted 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3293: snap_create 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3290: finishing write tid 3 to trial11845692-8 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3290: finishing write tid 4 to trial11845692-8 2026-02-17T05:42:06.459 INFO:tasks.rados.rados.0.trial118.stdout:3290: finishing write tid 5 to trial11845692-8 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3290: oid 8 updating version 0 to 2114 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3290: oid 8 version 2114 is already newer than 2113 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3290: oid 8 version 2114 is already newer than 2112 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3290: oid 8 version 2114 is already newer than 2111 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2114 (ObjNum 1150 snap 360 seq_num 1150) dirty exists 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3290: left oid 8 (ObjNum 1150 snap 360 seq_num 1150) 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3291: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3291: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:3291: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:42:06.460 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1796 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:42:07.390 INFO:tasks.rados.rados.0.trial118.stdout:3290: done (3 left) 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3291: done (2 left) 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3292: done (1 left) 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3293: done (0 left) 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3294: rollback oid 35 current snap is 361 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 355 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3295: write oid 13 current snap is 361 2026-02-17T05:42:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3295: seq_num 1151 ranges {544857=580902,1670539=668389,3041747=303110} 2026-02-17T05:42:07.394 INFO:tasks.rados.rados.0.trial118.stdout:3295: writing trial11845692-13 from 544857 to 1125759 tid 1 2026-02-17T05:42:07.399 INFO:tasks.rados.rados.0.trial118.stdout:3295: writing trial11845692-13 from 1670539 to 2338928 tid 2 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3295: writing trial11845692-13 from 3041747 to 3344857 tid 3 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3296: read oid 44 snap -1 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3296: expect deleted 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3297: read oid 9 snap -1 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3297: expect deleted 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3298: read oid 12 snap 354 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3298: expect (ObjNum 1052 snap 316 seq_num 1052) 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3299: write oid 23 current snap is 361 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3294: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3294: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:42:07.404 INFO:tasks.rados.rados.0.trial118.stdout:3294: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:42:07.405 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1702 (ObjNum 1053 snap 316 seq_num 1053) dirty exists 2026-02-17T05:42:07.405 INFO:tasks.rados.rados.0.trial118.stdout:3295: finishing write tid 1 to trial11845692-13 2026-02-17T05:42:07.405 INFO:tasks.rados.rados.0.trial118.stdout:3299: seq_num 1152 ranges {561664=656151,1729021=528400,2669170=692494} 2026-02-17T05:42:07.409 INFO:tasks.rados.rados.0.trial118.stdout:3299: writing trial11845692-23 from 561664 to 1217815 tid 1 2026-02-17T05:42:07.413 INFO:tasks.rados.rados.0.trial118.stdout:3299: writing trial11845692-23 from 1729021 to 2257421 tid 2 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3299: writing trial11845692-23 from 2669170 to 3361664 tid 3 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3294: done (5 left) 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3300: read oid 26 snap -1 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3300: expect (ObjNum 1141 snap 355 seq_num 1141) 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3301: copy_from oid 43 from oid 34 current snap is 361 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3295: finishing write tid 2 to trial11845692-13 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3295: finishing write tid 3 to trial11845692-13 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3295: finishing write tid 4 to trial11845692-13 2026-02-17T05:42:07.417 INFO:tasks.rados.rados.0.trial118.stdout:3295: finishing write tid 5 to trial11845692-13 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3295: oid 13 updating version 0 to 1689 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3295: oid 13 version 1689 is already newer than 1688 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3295: oid 13 version 1689 is already newer than 1686 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3295: oid 13 version 1689 is already newer than 1687 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1689 (ObjNum 1151 snap 361 seq_num 1151) dirty exists 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3295: left oid 13 (ObjNum 1151 snap 361 seq_num 1151) 2026-02-17T05:42:07.418 INFO:tasks.rados.rados.0.trial118.stdout:3298: expect (ObjNum 1052 snap 316 seq_num 1052) 2026-02-17T05:42:07.438 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2056455 2026-02-17T05:42:07.459 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: finishing write tid 1 to trial11845692-23 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3295: done (6 left) 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3296: done (5 left) 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3297: done (4 left) 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3298: done (3 left) 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3302: copy_from oid 29 from oid 31 current snap is 361 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: finishing write tid 2 to trial11845692-23 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: finishing write tid 3 to trial11845692-23 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: finishing write tid 4 to trial11845692-23 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: finishing write tid 5 to trial11845692-23 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: oid 23 updating version 0 to 1719 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: oid 23 updating version 1719 to 1720 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: oid 23 updating version 1720 to 1722 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: oid 23 version 1722 is already newer than 1721 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 23 v 1722 (ObjNum 1152 snap 361 seq_num 1152) dirty exists 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3299: left oid 23 (ObjNum 1152 snap 361 seq_num 1152) 2026-02-17T05:42:07.554 INFO:tasks.rados.rados.0.trial118.stdout:3300: expect (ObjNum 1141 snap 355 seq_num 1141) 2026-02-17T05:42:07.562 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2209595 2026-02-17T05:42:07.614 INFO:tasks.rados.rados.0.trial118.stdout:3301: finishing copy_from racing read to trial11845692-43 2026-02-17T05:42:07.614 INFO:tasks.rados.rados.0.trial118.stdout:3299: done (3 left) 2026-02-17T05:42:07.614 INFO:tasks.rados.rados.0.trial118.stdout:3300: done (2 left) 2026-02-17T05:42:07.614 INFO:tasks.rados.rados.0.trial118.stdout:3303: write (excl) oid 28 current snap is 361 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:3301: finishing copy_from to trial11845692-43 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 1562 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:3302: finishing copy_from racing read to trial11845692-29 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:3302: finishing copy_from to trial11845692-29 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:07.615 INFO:tasks.rados.rados.0.trial118.stdout:3303: seq_num 1153 ranges {578471=731400,1787503=672058,3096593=281878} 2026-02-17T05:42:07.619 INFO:tasks.rados.rados.0.trial118.stdout:3303: writing trial11845692-28 from 578471 to 1309871 tid 1 2026-02-17T05:42:07.623 INFO:tasks.rados.rados.0.trial118.stdout:3303: writing trial11845692-28 from 1787503 to 2459561 tid 2 2026-02-17T05:42:07.627 INFO:tasks.rados.rados.0.trial118.stdout:3303: writing trial11845692-28 from 3096593 to 3378471 tid 3 2026-02-17T05:42:07.627 INFO:tasks.rados.rados.0.trial118.stdout:3301: done (2 left) 2026-02-17T05:42:07.627 INFO:tasks.rados.rados.0.trial118.stdout:3302: done (1 left) 2026-02-17T05:42:07.627 INFO:tasks.rados.rados.0.trial118.stdout:3304: write (excl) oid 37 current snap is 361 2026-02-17T05:42:07.627 INFO:tasks.rados.rados.0.trial118.stdout:3304: seq_num 1154 ranges {595278=406649,1729632=532069,3007663=387615} 2026-02-17T05:42:07.630 INFO:tasks.rados.rados.0.trial118.stdout:3304: writing trial11845692-37 from 595278 to 1001927 tid 1 2026-02-17T05:42:07.635 INFO:tasks.rados.rados.0.trial118.stdout:3304: writing trial11845692-37 from 1729632 to 2261701 tid 2 2026-02-17T05:42:07.639 INFO:tasks.rados.rados.0.trial118.stdout:3304: writing trial11845692-37 from 3007663 to 3395278 tid 3 2026-02-17T05:42:07.640 INFO:tasks.rados.rados.0.trial118.stdout:3305: copy_from oid 50 from oid 19 current snap is 361 2026-02-17T05:42:07.640 INFO:tasks.rados.rados.0.trial118.stdout:3303: finishing write tid 1 to trial11845692-28 2026-02-17T05:42:07.640 INFO:tasks.rados.rados.0.trial118.stdout:3306: write (excl) oid 18 current snap is 361 2026-02-17T05:42:07.640 INFO:tasks.rados.rados.0.trial118.stdout:3306: seq_num 1155 ranges {612085=481898,1788114=675727,3035086=376999} 2026-02-17T05:42:07.643 INFO:tasks.rados.rados.0.trial118.stdout:3306: writing trial11845692-18 from 612085 to 1093983 tid 1 2026-02-17T05:42:07.649 INFO:tasks.rados.rados.0.trial118.stdout:3306: writing trial11845692-18 from 1788114 to 2463841 tid 2 2026-02-17T05:42:07.652 INFO:tasks.rados.rados.0.trial118.stdout:3306: writing trial11845692-18 from 3035086 to 3412085 tid 3 2026-02-17T05:42:07.652 INFO:tasks.rados.rados.0.trial118.stdout:3307: snap_remove snap 349 2026-02-17T05:42:08.395 INFO:tasks.rados.rados.0.trial118.stdout:3307: done (4 left) 2026-02-17T05:42:08.395 INFO:tasks.rados.rados.0.trial118.stdout:3308: write oid 45 current snap is 361 2026-02-17T05:42:08.395 INFO:tasks.rados.rados.0.trial118.stdout:3308: seq_num 1156 ranges {628892=673500,1962949=535738,3178862=250030} 2026-02-17T05:42:08.401 INFO:tasks.rados.rados.0.trial118.stdout:3308: writing trial11845692-45 from 628892 to 1302392 tid 1 2026-02-17T05:42:08.405 INFO:tasks.rados.rados.0.trial118.stdout:3308: writing trial11845692-45 from 1962949 to 2498687 tid 2 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3308: writing trial11845692-45 from 3178862 to 3428892 tid 3 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3309: read oid 4 snap -1 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3309: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3310: read oid 8 snap 311 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3310: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3311: write oid 47 current snap is 361 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3303: finishing write tid 2 to trial11845692-28 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3303: finishing write tid 3 to trial11845692-28 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3303: finishing write tid 4 to trial11845692-28 2026-02-17T05:42:08.409 INFO:tasks.rados.rados.0.trial118.stdout:3311: seq_num 1157 ranges {645699=748749,2021431=679396,3206285=239414} 2026-02-17T05:42:08.414 INFO:tasks.rados.rados.0.trial118.stdout:3311: writing trial11845692-47 from 645699 to 1394448 tid 1 2026-02-17T05:42:08.419 INFO:tasks.rados.rados.0.trial118.stdout:3311: writing trial11845692-47 from 2021431 to 2700827 tid 2 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3311: writing trial11845692-47 from 3206285 to 3445699 tid 3 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3312: read oid 25 snap -1 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3312: expect (ObjNum 1080 snap 321 seq_num 1080) 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3313: read oid 9 snap -1 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3313: expect deleted 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3314: rollback oid 39 current snap is 361 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3303: finishing write tid 5 to trial11845692-28 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3303: oid 28 updating version 0 to 1576 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3303: oid 28 updating version 1576 to 1577 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3303: oid 28 updating version 1577 to 1579 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:3303: oid 28 version 1579 is already newer than 1578 2026-02-17T05:42:08.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1579 (ObjNum 1153 snap 361 seq_num 1153) dirty exists 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3303: left oid 28 (ObjNum 1153 snap 361 seq_num 1153) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: finishing write tid 1 to trial11845692-37 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: finishing write tid 2 to trial11845692-37 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: finishing write tid 3 to trial11845692-37 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 358 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: finishing write tid 4 to trial11845692-37 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: finishing write tid 5 to trial11845692-37 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: oid 37 updating version 0 to 1565 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: oid 37 version 1565 is already newer than 1563 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: oid 37 version 1565 is already newer than 1564 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: oid 37 updating version 1565 to 1566 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1566 (ObjNum 1154 snap 361 seq_num 1154) dirty exists 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: left oid 37 (ObjNum 1154 snap 361 seq_num 1154) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3305: finishing copy_from racing read to trial11845692-50 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: finishing write tid 1 to trial11845692-18 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3303: done (10 left) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3304: done (9 left) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3315: copy_from oid 49 from oid 11 current snap is 361 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3305: finishing copy_from to trial11845692-50 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: finishing write tid 2 to trial11845692-18 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: finishing write tid 3 to trial11845692-18 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: finishing write tid 4 to trial11845692-18 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: finishing write tid 5 to trial11845692-18 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: oid 18 updating version 0 to 1582 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: oid 18 version 1582 is already newer than 1580 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: oid 18 version 1582 is already newer than 1581 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: oid 18 updating version 1582 to 1583 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 1583 (ObjNum 1155 snap 361 seq_num 1155) dirty exists 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: left oid 18 (ObjNum 1155 snap 361 seq_num 1155) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3308: finishing write tid 1 to trial11845692-45 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3308: finishing write tid 2 to trial11845692-45 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3305: done (9 left) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3306: done (8 left) 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3316: write oid 44 current snap is 361 2026-02-17T05:42:08.423 INFO:tasks.rados.rados.0.trial118.stdout:3316: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2026-02-17T05:42:08.426 INFO:tasks.rados.rados.0.trial118.stdout:3316: writing trial11845692-44 from 662506 to 1086504 tid 1 2026-02-17T05:42:08.429 INFO:tasks.rados.rados.0.trial118.stdout:3316: writing trial11845692-44 from 1563560 to 2102967 tid 2 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3316: writing trial11845692-44 from 2717355 to 3207640 tid 3 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3317: snap_create 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: finishing write tid 3 to trial11845692-45 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: finishing write tid 4 to trial11845692-45 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: finishing write tid 5 to trial11845692-45 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: oid 45 updating version 0 to 1741 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: oid 45 updating version 1741 to 1742 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: oid 45 version 1742 is already newer than 1740 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: oid 45 version 1742 is already newer than 1739 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1742 (ObjNum 1156 snap 361 seq_num 1156) dirty exists 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3308: left oid 45 (ObjNum 1156 snap 361 seq_num 1156) 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:3309: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:42:08.434 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:08.453 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:08.493 INFO:tasks.rados.rados.0.trial118.stdout:3310: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:42:08.497 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 972923 2026-02-17T05:42:08.516 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3311: finishing write tid 1 to trial11845692-47 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3311: finishing write tid 2 to trial11845692-47 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3315: finishing copy_from to trial11845692-49 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3315: got expected ENOENT (src dne) 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3315: finishing copy_from racing read to trial11845692-49 2026-02-17T05:42:08.564 INFO:tasks.rados.rados.0.trial118.stdout:3312: expect (ObjNum 1080 snap 321 seq_num 1080) 2026-02-17T05:42:08.565 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: finishing write tid 3 to trial11845692-47 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: finishing write tid 4 to trial11845692-47 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: finishing write tid 5 to trial11845692-47 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: oid 47 updating version 0 to 1803 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: oid 47 version 1803 is already newer than 1801 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: oid 47 updating version 1803 to 1804 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: oid 47 version 1804 is already newer than 1802 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1804 (ObjNum 1157 snap 361 seq_num 1157) dirty exists 2026-02-17T05:42:08.629 INFO:tasks.rados.rados.0.trial118.stdout:3311: left oid 47 (ObjNum 1157 snap 361 seq_num 1157) 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3314: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3314: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3314: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 1807 (ObjNum 1089 snap 324 seq_num 1089) dirty exists 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: finishing write tid 1 to trial11845692-44 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: finishing write tid 2 to trial11845692-44 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: finishing write tid 3 to trial11845692-44 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: finishing write tid 4 to trial11845692-44 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: finishing write tid 5 to trial11845692-44 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: oid 44 updating version 0 to 1706 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: oid 44 version 1706 is already newer than 1703 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: oid 44 version 1706 is already newer than 1704 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: oid 44 version 1706 is already newer than 1705 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1706 (ObjNum 1158 snap 361 seq_num 1158) dirty exists 2026-02-17T05:42:08.630 INFO:tasks.rados.rados.0.trial118.stdout:3316: left oid 44 (ObjNum 1158 snap 361 seq_num 1158) 2026-02-17T05:42:09.399 INFO:tasks.rados.rados.0.trial118.stdout:3308: done (9 left) 2026-02-17T05:42:09.399 INFO:tasks.rados.rados.0.trial118.stdout:3309: done (8 left) 2026-02-17T05:42:09.399 INFO:tasks.rados.rados.0.trial118.stdout:3310: done (7 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3311: done (6 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3312: done (5 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3313: done (4 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3314: done (3 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3315: done (2 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3316: done (1 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3317: done (0 left) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3318: read oid 32 snap 355 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3318: expect (ObjNum 1138 snap 353 seq_num 1138) 2026-02-17T05:42:09.400 INFO:tasks.rados.rados.0.trial118.stdout:3319: rollback oid 44 current snap is 362 2026-02-17T05:42:09.401 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 44 to 351 2026-02-17T05:42:09.401 INFO:tasks.rados.rados.0.trial118.stdout:3320: write oid 35 current snap is 362 2026-02-17T05:42:09.401 INFO:tasks.rados.rados.0.trial118.stdout:3320: seq_num 1159 ranges {679313=499247,1622042=683065,2744778=701557} 2026-02-17T05:42:09.403 INFO:tasks.rados.rados.0.trial118.stdout:3320: writing trial11845692-35 from 679313 to 1178560 tid 1 2026-02-17T05:42:09.407 INFO:tasks.rados.rados.0.trial118.stdout:3320: writing trial11845692-35 from 1622042 to 2305107 tid 2 2026-02-17T05:42:09.411 INFO:tasks.rados.rados.0.trial118.stdout:3320: writing trial11845692-35 from 2744778 to 3446335 tid 3 2026-02-17T05:42:09.412 INFO:tasks.rados.rados.0.trial118.stdout:3321: read oid 39 snap 353 2026-02-17T05:42:09.412 INFO:tasks.rados.rados.0.trial118.stdout:3321: expect (ObjNum 1089 snap 324 seq_num 1089) 2026-02-17T05:42:09.412 INFO:tasks.rados.rados.0.trial118.stdout:3322: write (excl) oid 47 current snap is 362 2026-02-17T05:42:09.412 INFO:tasks.rados.rados.0.trial118.stdout:3322: seq_num 1160 ranges {696120=574496,1680524=543076,2888554=512829} 2026-02-17T05:42:09.416 INFO:tasks.rados.rados.0.trial118.stdout:3322: writing trial11845692-47 from 696120 to 1270616 tid 1 2026-02-17T05:42:09.419 INFO:tasks.rados.rados.0.trial118.stdout:3322: writing trial11845692-47 from 1680524 to 2223600 tid 2 2026-02-17T05:42:09.424 INFO:tasks.rados.rados.0.trial118.stdout:3322: writing trial11845692-47 from 2888554 to 3401383 tid 3 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3323: read oid 37 snap -1 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3323: expect (ObjNum 1154 snap 361 seq_num 1154) 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3324: snap_create 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3319: finishing rollback tid 0 to trial11845692-44 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3319: finishing rollback tid 1 to trial11845692-44 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3319: finishing rollback tid 2 to trial11845692-44 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1709 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:42:09.425 INFO:tasks.rados.rados.0.trial118.stdout:3318: expect (ObjNum 1138 snap 353 seq_num 1138) 2026-02-17T05:42:09.432 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2019666 2026-02-17T05:42:09.439 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 211761 2026-02-17T05:42:09.483 INFO:tasks.rados.rados.0.trial118.stdout:3320: finishing write tid 1 to trial11845692-35 2026-02-17T05:42:09.483 INFO:tasks.rados.rados.0.trial118.stdout:3320: finishing write tid 2 to trial11845692-35 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: finishing write tid 3 to trial11845692-35 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: finishing write tid 4 to trial11845692-35 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: finishing write tid 5 to trial11845692-35 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: oid 35 updating version 0 to 1711 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: oid 35 updating version 1711 to 1713 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: oid 35 version 1713 is already newer than 1710 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: oid 35 version 1713 is already newer than 1712 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1713 (ObjNum 1159 snap 362 seq_num 1159) dirty exists 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3320: left oid 35 (ObjNum 1159 snap 362 seq_num 1159) 2026-02-17T05:42:09.484 INFO:tasks.rados.rados.0.trial118.stdout:3321: expect (ObjNum 1089 snap 324 seq_num 1089) 2026-02-17T05:42:09.543 INFO:tasks.rados.rados.0.trial118.stdout:3322: finishing write tid 1 to trial11845692-47 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: finishing write tid 2 to trial11845692-47 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: finishing write tid 3 to trial11845692-47 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: finishing write tid 4 to trial11845692-47 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: finishing write tid 5 to trial11845692-47 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: oid 47 updating version 0 to 1811 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: oid 47 version 1811 is already newer than 1810 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: oid 47 version 1811 is already newer than 1808 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:3322: oid 47 version 1811 is already newer than 1809 2026-02-17T05:42:09.544 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1811 (ObjNum 1160 snap 362 seq_num 1160) dirty exists 2026-02-17T05:42:09.545 INFO:tasks.rados.rados.0.trial118.stdout:3322: left oid 47 (ObjNum 1160 snap 362 seq_num 1160) 2026-02-17T05:42:09.545 INFO:tasks.rados.rados.0.trial118.stdout:3323: expect (ObjNum 1154 snap 361 seq_num 1154) 2026-02-17T05:42:09.545 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:09.596 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:09.693 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3324505 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3318: done (6 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3319: done (5 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3320: done (4 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3321: done (3 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3322: done (2 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3323: done (1 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3324: done (0 left) 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3325: write oid 24 current snap is 363 2026-02-17T05:42:10.354 INFO:tasks.rados.rados.0.trial118.stdout:3325: seq_num 1161 ranges {712927=649745,2139006=686734} 2026-02-17T05:42:10.359 INFO:tasks.rados.rados.0.trial118.stdout:3325: writing trial11845692-24 from 712927 to 1362672 tid 1 2026-02-17T05:42:10.365 INFO:tasks.rados.rados.0.trial118.stdout:3325: writing trial11845692-24 from 2139006 to 2825740 tid 2 2026-02-17T05:42:10.365 INFO:tasks.rados.rados.0.trial118.stdout:3326: snap_remove snap 339 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3326: done (1 left) 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3327: delete oid 25 current snap is 363 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: finishing write tid 1 to trial11845692-24 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: finishing write tid 2 to trial11845692-24 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: finishing write tid 3 to trial11845692-24 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: finishing write tid 4 to trial11845692-24 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: oid 24 updating version 0 to 1715 2026-02-17T05:42:11.357 INFO:tasks.rados.rados.0.trial118.stdout:3325: oid 24 updating version 1715 to 1716 2026-02-17T05:42:11.358 INFO:tasks.rados.rados.0.trial118.stdout:3325: oid 24 version 1716 is already newer than 1714 2026-02-17T05:42:11.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1716 (ObjNum 1161 snap 363 seq_num 1161) dirty exists 2026-02-17T05:42:11.358 INFO:tasks.rados.rados.0.trial118.stdout:3325: left oid 24 (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:42:11.360 INFO:tasks.rados.rados.0.trial118.stdout:3325: done (1 left) 2026-02-17T05:42:11.360 INFO:tasks.rados.rados.0.trial118.stdout:3327: done (0 left) 2026-02-17T05:42:11.360 INFO:tasks.rados.rados.0.trial118.stdout:3328: write oid 20 current snap is 363 2026-02-17T05:42:11.361 INFO:tasks.rados.rados.0.trial118.stdout:3328: seq_num 1163 ranges {746541=400243,1739617=690403,3138117=408424} 2026-02-17T05:42:11.364 INFO:tasks.rados.rados.0.trial118.stdout:3328: writing trial11845692-20 from 746541 to 1146784 tid 1 2026-02-17T05:42:11.369 INFO:tasks.rados.rados.0.trial118.stdout:3328: writing trial11845692-20 from 1739617 to 2430020 tid 2 2026-02-17T05:42:11.374 INFO:tasks.rados.rados.0.trial118.stdout:3328: writing trial11845692-20 from 3138117 to 3546541 tid 3 2026-02-17T05:42:11.374 INFO:tasks.rados.rados.0.trial118.stdout:3329: write (excl) oid 13 current snap is 363 2026-02-17T05:42:11.374 INFO:tasks.rados.rados.0.trial118.stdout:3328: finishing write tid 1 to trial11845692-20 2026-02-17T05:42:11.375 INFO:tasks.rados.rados.0.trial118.stdout:3328: finishing write tid 2 to trial11845692-20 2026-02-17T05:42:11.375 INFO:tasks.rados.rados.0.trial118.stdout:3329: seq_num 1164 ranges {763348=591845,1914452=434061,2881893=674270} 2026-02-17T05:42:11.379 INFO:tasks.rados.rados.0.trial118.stdout:3329: writing trial11845692-13 from 763348 to 1355193 tid 1 2026-02-17T05:42:11.383 INFO:tasks.rados.rados.0.trial118.stdout:3329: writing trial11845692-13 from 1914452 to 2348513 tid 2 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3329: writing trial11845692-13 from 2881893 to 3556163 tid 3 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3330: snap_create 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: finishing write tid 3 to trial11845692-20 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: finishing write tid 4 to trial11845692-20 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: finishing write tid 5 to trial11845692-20 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: oid 20 updating version 0 to 2132 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: oid 20 version 2132 is already newer than 2130 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: oid 20 version 2132 is already newer than 2131 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3328: oid 20 updating version 2132 to 2133 2026-02-17T05:42:11.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2133 (ObjNum 1163 snap 363 seq_num 1163) dirty exists 2026-02-17T05:42:11.389 INFO:tasks.rados.rados.0.trial118.stdout:3328: left oid 20 (ObjNum 1163 snap 363 seq_num 1163) 2026-02-17T05:42:11.389 INFO:tasks.rados.rados.0.trial118.stdout:3329: finishing write tid 1 to trial11845692-13 2026-02-17T05:42:11.389 INFO:tasks.rados.rados.0.trial118.stdout:3329: finishing write tid 2 to trial11845692-13 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: finishing write tid 3 to trial11845692-13 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: finishing write tid 4 to trial11845692-13 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: finishing write tid 5 to trial11845692-13 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: oid 13 updating version 0 to 1691 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: oid 13 updating version 1691 to 1693 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: oid 13 version 1693 is already newer than 1692 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: oid 13 version 1693 is already newer than 1690 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1693 (ObjNum 1164 snap 363 seq_num 1164) dirty exists 2026-02-17T05:42:11.390 INFO:tasks.rados.rados.0.trial118.stdout:3329: left oid 13 (ObjNum 1164 snap 363 seq_num 1164) 2026-02-17T05:42:12.357 INFO:tasks.rados.rados.0.trial118.stdout:3328: done (2 left) 2026-02-17T05:42:12.357 INFO:tasks.rados.rados.0.trial118.stdout:3329: done (1 left) 2026-02-17T05:42:12.357 INFO:tasks.rados.rados.0.trial118.stdout:3330: done (0 left) 2026-02-17T05:42:12.357 INFO:tasks.rados.rados.0.trial118.stdout:3331: snap_create 2026-02-17T05:42:13.357 INFO:tasks.rados.rados.0.trial118.stdout:3331: done (0 left) 2026-02-17T05:42:13.357 INFO:tasks.rados.rados.0.trial118.stdout:3332: read oid 12 snap -1 2026-02-17T05:42:13.357 INFO:tasks.rados.rados.0.trial118.stdout:3332: expect (ObjNum 1052 snap 316 seq_num 1052) 2026-02-17T05:42:13.358 INFO:tasks.rados.rados.0.trial118.stdout:3333: copy_from oid 8 from oid 37 current snap is 365 2026-02-17T05:42:13.358 INFO:tasks.rados.rados.0.trial118.stdout:3334: rollback oid 22 current snap is 365 2026-02-17T05:42:13.358 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 348 2026-02-17T05:42:13.358 INFO:tasks.rados.rados.0.trial118.stdout:3335: write (excl) oid 30 current snap is 365 2026-02-17T05:42:13.358 INFO:tasks.rados.rados.0.trial118.stdout:3335: seq_num 1165 ranges {780155=667094,1972934=694072,3309316=270839} 2026-02-17T05:42:13.363 INFO:tasks.rados.rados.0.trial118.stdout:3335: writing trial11845692-30 from 780155 to 1447249 tid 1 2026-02-17T05:42:13.368 INFO:tasks.rados.rados.0.trial118.stdout:3335: writing trial11845692-30 from 1972934 to 2667006 tid 2 2026-02-17T05:42:13.371 INFO:tasks.rados.rados.0.trial118.stdout:3335: writing trial11845692-30 from 3309316 to 3580155 tid 3 2026-02-17T05:42:13.372 INFO:tasks.rados.rados.0.trial118.stdout:3336: snap_remove snap 335 2026-02-17T05:42:14.362 INFO:tasks.rados.rados.0.trial118.stdout:3336: done (4 left) 2026-02-17T05:42:14.362 INFO:tasks.rados.rados.0.trial118.stdout:3337: write (excl) oid 42 current snap is 365 2026-02-17T05:42:14.362 INFO:tasks.rados.rados.0.trial118.stdout:3337: seq_num 1166 ranges {796962=742343,2031416=437730,2936739=413167} 2026-02-17T05:42:14.368 INFO:tasks.rados.rados.0.trial118.stdout:3337: writing trial11845692-42 from 796962 to 1539305 tid 1 2026-02-17T05:42:14.371 INFO:tasks.rados.rados.0.trial118.stdout:3337: writing trial11845692-42 from 2031416 to 2469146 tid 2 2026-02-17T05:42:14.374 INFO:tasks.rados.rados.0.trial118.stdout:3337: writing trial11845692-42 from 2936739 to 3349906 tid 3 2026-02-17T05:42:14.375 INFO:tasks.rados.rados.0.trial118.stdout:3338: delete oid 23 current snap is 365 2026-02-17T05:42:14.375 INFO:tasks.rados.rados.0.trial118.stdout:3332: expect (ObjNum 1052 snap 316 seq_num 1052) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3334: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3334: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3334: finishing rollback tid 2 to trial11845692-22 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1745 (ObjNum 1124 snap 343 seq_num 1124) dirty exists 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3333: finishing copy_from racing read to trial11845692-8 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3333: finishing copy_from to trial11845692-8 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 1566 (ObjNum 1154 snap 361 seq_num 1154) dirty exists 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3335: finishing write tid 1 to trial11845692-30 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3335: finishing write tid 2 to trial11845692-30 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3332: done (5 left) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3333: done (4 left) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3334: done (3 left) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3338: done (2 left) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3339: read oid 46 snap -1 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3339: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3340: write oid 17 current snap is 365 2026-02-17T05:42:14.505 INFO:tasks.rados.rados.0.trial118.stdout:3340: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2026-02-17T05:42:14.508 INFO:tasks.rados.rados.0.trial118.stdout:3340: writing trial11845692-17 from 430576 to 923417 tid 1 2026-02-17T05:42:14.513 INFO:tasks.rados.rados.0.trial118.stdout:3340: writing trial11845692-17 from 1632027 to 2073426 tid 2 2026-02-17T05:42:14.516 INFO:tasks.rados.rados.0.trial118.stdout:3340: writing trial11845692-17 from 2475232 to 2910943 tid 3 2026-02-17T05:42:14.518 INFO:tasks.rados.rados.0.trial118.stdout:3340: writing trial11845692-17 from 3365397 to 3630576 tid 4 2026-02-17T05:42:14.519 INFO:tasks.rados.rados.0.trial118.stdout:3341: snap_remove snap 358 2026-02-17T05:42:15.364 INFO:tasks.rados.rados.0.trial118.stdout:3341: done (4 left) 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3342: copy_from oid 5 from oid 12 current snap is 365 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: finishing write tid 3 to trial11845692-30 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: finishing write tid 4 to trial11845692-30 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: finishing write tid 5 to trial11845692-30 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: oid 30 updating version 0 to 2042 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: oid 30 version 2042 is already newer than 2041 2026-02-17T05:42:15.365 INFO:tasks.rados.rados.0.trial118.stdout:3335: oid 30 updating version 2042 to 2044 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3335: oid 30 version 2044 is already newer than 2043 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2044 (ObjNum 1165 snap 365 seq_num 1165) dirty exists 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3335: left oid 30 (ObjNum 1165 snap 365 seq_num 1165) 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: finishing write tid 1 to trial11845692-42 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: finishing write tid 2 to trial11845692-42 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: finishing write tid 3 to trial11845692-42 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: finishing write tid 4 to trial11845692-42 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: finishing write tid 5 to trial11845692-42 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: oid 42 updating version 0 to 1814 2026-02-17T05:42:15.366 INFO:tasks.rados.rados.0.trial118.stdout:3337: oid 42 updating version 1814 to 1815 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:3337: oid 42 version 1815 is already newer than 1812 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:3337: oid 42 version 1815 is already newer than 1813 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1815 (ObjNum 1166 snap 365 seq_num 1166) dirty exists 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:3337: left oid 42 (ObjNum 1166 snap 365 seq_num 1166) 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:3339: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:42:15.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1522575 2026-02-17T05:42:15.388 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1282737 2026-02-17T05:42:15.435 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 1 to trial11845692-17 2026-02-17T05:42:15.435 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 2 to trial11845692-17 2026-02-17T05:42:15.435 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 3 to trial11845692-17 2026-02-17T05:42:15.435 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 4 to trial11845692-17 2026-02-17T05:42:15.436 INFO:tasks.rados.rados.0.trial118.stdout:3335: done (4 left) 2026-02-17T05:42:15.436 INFO:tasks.rados.rados.0.trial118.stdout:3337: done (3 left) 2026-02-17T05:42:15.436 INFO:tasks.rados.rados.0.trial118.stdout:3339: done (2 left) 2026-02-17T05:42:15.436 INFO:tasks.rados.rados.0.trial118.stdout:3343: write oid 49 current snap is 365 2026-02-17T05:42:15.436 INFO:tasks.rados.rados.0.trial118.stdout:3343: seq_num 1169 ranges {447383=568090,1690509=701410,2902655=646983} 2026-02-17T05:42:15.439 INFO:tasks.rados.rados.0.trial118.stdout:3343: writing trial11845692-49 from 447383 to 1015473 tid 1 2026-02-17T05:42:15.444 INFO:tasks.rados.rados.0.trial118.stdout:3343: writing trial11845692-49 from 1690509 to 2391919 tid 2 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3343: writing trial11845692-49 from 2902655 to 3549638 tid 3 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3344: copy_from oid 19 from oid 16 current snap is 365 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 5 to trial11845692-17 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: finishing write tid 6 to trial11845692-17 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: oid 17 updating version 0 to 1494 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: oid 17 version 1494 is already newer than 1492 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: oid 17 updating version 1494 to 1496 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: oid 17 version 1496 is already newer than 1493 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: oid 17 version 1496 is already newer than 1495 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1496 (ObjNum 1168 snap 365 seq_num 1168) dirty exists 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: left oid 17 (ObjNum 1168 snap 365 seq_num 1168) 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3342: finishing copy_from racing read to trial11845692-5 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3342: finishing copy_from to trial11845692-5 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1495 (ObjNum 1052 snap 316 seq_num 1052) dirty exists 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3343: finishing write tid 1 to trial11845692-49 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3343: finishing write tid 2 to trial11845692-49 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3340: done (3 left) 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3342: done (2 left) 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3345: rollback oid 46 current snap is 365 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 46 to 348 2026-02-17T05:42:15.449 INFO:tasks.rados.rados.0.trial118.stdout:3346: delete oid 30 current snap is 365 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3344: finishing copy_from to trial11845692-19 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3344: got expected ENOENT (src dne) 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3344: finishing copy_from racing read to trial11845692-19 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3343: finishing write tid 3 to trial11845692-49 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3343: finishing write tid 4 to trial11845692-49 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3343: finishing write tid 5 to trial11845692-49 2026-02-17T05:42:15.450 INFO:tasks.rados.rados.0.trial118.stdout:3343: oid 49 updating version 0 to 1722 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3343: oid 49 version 1722 is already newer than 1721 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3343: oid 49 version 1722 is already newer than 1720 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3343: oid 49 version 1722 is already newer than 1719 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3343: left oid 49 (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3343: done (3 left) 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3344: done (2 left) 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3346: done (1 left) 2026-02-17T05:42:15.451 INFO:tasks.rados.rados.0.trial118.stdout:3347: snap_remove snap 311 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:3347: done (1 left) 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:3348: delete oid 34 current snap is 365 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:3345: finishing rollback tid 0 to trial11845692-46 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:3345: finishing rollback tid 1 to trial11845692-46 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:3345: finishing rollback tid 2 to trial11845692-46 2026-02-17T05:42:16.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 46 v 1499 (ObjNum 1059 snap 318 seq_num 1059) dirty exists 2026-02-17T05:42:16.374 INFO:tasks.rados.rados.0.trial118.stdout:3345: done (1 left) 2026-02-17T05:42:16.374 INFO:tasks.rados.rados.0.trial118.stdout:3348: done (0 left) 2026-02-17T05:42:16.374 INFO:tasks.rados.rados.0.trial118.stdout:3349: write oid 42 current snap is 365 2026-02-17T05:42:16.374 INFO:tasks.rados.rados.0.trial118.stdout:3349: seq_num 1172 ranges {497804=510190,1465955=448737,2584924=597152} 2026-02-17T05:42:16.377 INFO:tasks.rados.rados.0.trial118.stdout:3349: writing trial11845692-42 from 497804 to 1007994 tid 1 2026-02-17T05:42:16.381 INFO:tasks.rados.rados.0.trial118.stdout:3349: writing trial11845692-42 from 1465955 to 1914692 tid 2 2026-02-17T05:42:16.386 INFO:tasks.rados.rados.0.trial118.stdout:3349: writing trial11845692-42 from 2584924 to 3182076 tid 3 2026-02-17T05:42:16.386 INFO:tasks.rados.rados.0.trial118.stdout:3350: snap_create 2026-02-17T05:42:16.386 INFO:tasks.rados.rados.0.trial118.stdout:3349: finishing write tid 1 to trial11845692-42 2026-02-17T05:42:16.386 INFO:tasks.rados.rados.0.trial118.stdout:3349: finishing write tid 2 to trial11845692-42 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: finishing write tid 3 to trial11845692-42 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: finishing write tid 4 to trial11845692-42 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: finishing write tid 5 to trial11845692-42 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: oid 42 updating version 0 to 1816 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: oid 42 updating version 1816 to 1818 2026-02-17T05:42:16.388 INFO:tasks.rados.rados.0.trial118.stdout:3349: oid 42 updating version 1818 to 1819 2026-02-17T05:42:16.389 INFO:tasks.rados.rados.0.trial118.stdout:3349: oid 42 version 1819 is already newer than 1817 2026-02-17T05:42:16.389 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1819 (ObjNum 1172 snap 365 seq_num 1172) dirty exists 2026-02-17T05:42:16.389 INFO:tasks.rados.rados.0.trial118.stdout:3349: left oid 42 (ObjNum 1172 snap 365 seq_num 1172) 2026-02-17T05:42:17.372 INFO:tasks.rados.rados.0.trial118.stdout:3349: done (1 left) 2026-02-17T05:42:17.373 INFO:tasks.rados.rados.0.trial118.stdout:3350: done (0 left) 2026-02-17T05:42:17.373 INFO:tasks.rados.rados.0.trial118.stdout:3351: snap_remove snap 360 2026-02-17T05:42:18.375 INFO:tasks.rados.rados.0.trial118.stdout:3351: done (0 left) 2026-02-17T05:42:18.375 INFO:tasks.rados.rados.0.trial118.stdout:3352: delete oid 48 current snap is 366 2026-02-17T05:42:18.380 INFO:tasks.rados.rados.0.trial118.stdout:3352: done (0 left) 2026-02-17T05:42:18.380 INFO:tasks.rados.rados.0.trial118.stdout:3353: rollback oid 35 current snap is 366 2026-02-17T05:42:18.380 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 363 2026-02-17T05:42:18.380 INFO:tasks.rados.rados.0.trial118.stdout:3354: snap_remove snap 362 2026-02-17T05:42:19.380 INFO:tasks.rados.rados.0.trial118.stdout:3354: done (1 left) 2026-02-17T05:42:19.381 INFO:tasks.rados.rados.0.trial118.stdout:3355: write (excl) oid 9 current snap is 366 2026-02-17T05:42:19.381 INFO:tasks.rados.rados.0.trial118.stdout:3355: seq_num 1174 ranges {531418=660688,1982919=452406,3039770=691648} 2026-02-17T05:42:19.385 INFO:tasks.rados.rados.0.trial118.stdout:3355: writing trial11845692-9 from 531418 to 1192106 tid 1 2026-02-17T05:42:19.389 INFO:tasks.rados.rados.0.trial118.stdout:3355: writing trial11845692-9 from 1982919 to 2435325 tid 2 2026-02-17T05:42:19.395 INFO:tasks.rados.rados.0.trial118.stdout:3355: writing trial11845692-9 from 3039770 to 3731418 tid 3 2026-02-17T05:42:19.395 INFO:tasks.rados.rados.0.trial118.stdout:3356: rollback oid 7 current snap is 366 2026-02-17T05:42:19.395 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 7 to 364 2026-02-17T05:42:19.395 INFO:tasks.rados.rados.0.trial118.stdout:3353: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3353: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3353: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1719 (ObjNum 1159 snap 362 seq_num 1159) dirty exists 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3355: finishing write tid 1 to trial11845692-9 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3355: finishing write tid 2 to trial11845692-9 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3353: done (2 left) 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3357: rollback oid 22 current snap is 366 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 22 to 361 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3358: read oid 14 snap -1 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3358: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3359: read oid 16 snap -1 2026-02-17T05:42:19.396 INFO:tasks.rados.rados.0.trial118.stdout:3359: expect deleted 2026-02-17T05:42:19.397 INFO:tasks.rados.rados.0.trial118.stdout:3360: snap_remove snap 365 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:3360: done (5 left) 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:3361: rollback oid 8 current snap is 366 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 351 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:3357: finishing rollback tid 0 to trial11845692-22 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:3357: finishing rollback tid 1 to trial11845692-22 2026-02-17T05:42:20.356 INFO:tasks.rados.rados.0.trial118.stdout:3357: finishing rollback tid 2 to trial11845692-22 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1749 (ObjNum 1124 snap 343 seq_num 1124) dirty exists 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: finishing write tid 3 to trial11845692-9 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: finishing write tid 4 to trial11845692-9 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: finishing write tid 5 to trial11845692-9 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: oid 9 updating version 0 to 1998 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: oid 9 updating version 1998 to 1999 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: oid 9 updating version 1999 to 2000 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: oid 9 updating version 2000 to 2001 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2001 (ObjNum 1174 snap 366 seq_num 1174) dirty exists 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3355: left oid 9 (ObjNum 1174 snap 366 seq_num 1174) 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3356: finishing rollback tid 0 to trial11845692-7 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3356: finishing rollback tid 1 to trial11845692-7 2026-02-17T05:42:20.357 INFO:tasks.rados.rados.0.trial118.stdout:3356: finishing rollback tid 2 to trial11845692-7 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2005 (ObjNum 1089 snap 324 seq_num 1089) dirty exists 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:3355: done (5 left) 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:3356: done (4 left) 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:3357: done (3 left) 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:3359: done (2 left) 2026-02-17T05:42:20.358 INFO:tasks.rados.rados.0.trial118.stdout:3362: snap_remove snap 352 2026-02-17T05:42:21.357 INFO:tasks.rados.rados.0.trial118.stdout:3362: done (2 left) 2026-02-17T05:42:21.358 INFO:tasks.rados.rados.0.trial118.stdout:3363: copy_from oid 10 from oid 16 current snap is 366 2026-02-17T05:42:21.358 INFO:tasks.rados.rados.0.trial118.stdout:3358: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:42:21.372 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2121848 2026-02-17T05:42:21.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 628136 2026-02-17T05:42:21.392 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:21.415 INFO:tasks.rados.rados.0.trial118.stdout:3361: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:42:21.415 INFO:tasks.rados.rados.0.trial118.stdout:3361: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:42:21.415 INFO:tasks.rados.rados.0.trial118.stdout:3358: done (2 left) 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3364: read oid 31 snap -1 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3364: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3365: rollback oid 4 current snap is 366 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 322 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3361: finishing rollback tid 2 to trial11845692-8 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2168 (ObjNum 939 snap 281 seq_num 939) dirty exists 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3363: finishing copy_from to trial11845692-10 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3363: got expected ENOENT (src dne) 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3363: finishing copy_from racing read to trial11845692-10 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3361: done (3 left) 2026-02-17T05:42:21.416 INFO:tasks.rados.rados.0.trial118.stdout:3363: done (2 left) 2026-02-17T05:42:21.417 INFO:tasks.rados.rados.0.trial118.stdout:3366: snap_remove snap 351 2026-02-17T05:42:22.385 INFO:tasks.rados.rados.0.trial118.stdout:3366: done (2 left) 2026-02-17T05:42:22.385 INFO:tasks.rados.rados.0.trial118.stdout:3367: copy_from oid 10 from oid 50 current snap is 366 2026-02-17T05:42:22.385 INFO:tasks.rados.rados.0.trial118.stdout:3364: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:22.390 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2342947 2026-02-17T05:42:22.398 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:22.440 INFO:tasks.rados.rados.0.trial118.stdout:3365: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3365: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3365: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 2015 (ObjNum 977 snap 294 seq_num 977) dirty exists 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3367: finishing copy_from racing read to trial11845692-10 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3367: finishing copy_from to trial11845692-10 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3364: done (2 left) 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3365: done (1 left) 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3367: done (0 left) 2026-02-17T05:42:22.441 INFO:tasks.rados.rados.0.trial118.stdout:3368: snap_create 2026-02-17T05:42:23.386 INFO:tasks.rados.rados.0.trial118.stdout:3368: done (0 left) 2026-02-17T05:42:23.386 INFO:tasks.rados.rados.0.trial118.stdout:3369: read oid 46 snap -1 2026-02-17T05:42:23.386 INFO:tasks.rados.rados.0.trial118.stdout:3369: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:42:23.386 INFO:tasks.rados.rados.0.trial118.stdout:3370: copy_from oid 6 from oid 3 current snap is 367 2026-02-17T05:42:23.386 INFO:tasks.rados.rados.0.trial118.stdout:3371: snap_create 2026-02-17T05:42:23.396 INFO:tasks.rados.rados.0.trial118.stdout:3369: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:42:23.396 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:23.430 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2783761 2026-02-17T05:42:23.466 INFO:tasks.rados.rados.0.trial118.stdout:3370: finishing copy_from racing read to trial11845692-6 2026-02-17T05:42:23.466 INFO:tasks.rados.rados.0.trial118.stdout:3370: finishing copy_from to trial11845692-6 2026-02-17T05:42:23.466 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1670 (ObjNum 1077 snap 320 seq_num 1077) dirty exists 2026-02-17T05:42:24.390 INFO:tasks.rados.rados.0.trial118.stdout:3369: done (2 left) 2026-02-17T05:42:24.390 INFO:tasks.rados.rados.0.trial118.stdout:3370: done (1 left) 2026-02-17T05:42:24.391 INFO:tasks.rados.rados.0.trial118.stdout:3371: done (0 left) 2026-02-17T05:42:24.391 INFO:tasks.rados.rados.0.trial118.stdout:3372: read oid 13 snap -1 2026-02-17T05:42:24.391 INFO:tasks.rados.rados.0.trial118.stdout:3372: expect (ObjNum 1164 snap 363 seq_num 1164) 2026-02-17T05:42:24.391 INFO:tasks.rados.rados.0.trial118.stdout:3373: snap_remove snap 345 2026-02-17T05:42:25.355 INFO:tasks.rados.rados.0.trial118.stdout:3373: done (1 left) 2026-02-17T05:42:25.355 INFO:tasks.rados.rados.0.trial118.stdout:3374: copy_from oid 35 from oid 50 current snap is 368 2026-02-17T05:42:25.355 INFO:tasks.rados.rados.0.trial118.stdout:3372: expect (ObjNum 1164 snap 363 seq_num 1164) 2026-02-17T05:42:25.389 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2842594 2026-02-17T05:42:25.475 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1635594 2026-02-17T05:42:25.508 INFO:tasks.rados.rados.0.trial118.stdout:3374: finishing copy_from racing read to trial11845692-35 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3374: finishing copy_from to trial11845692-35 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3372: done (1 left) 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3374: done (0 left) 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3375: rollback oid 3 current snap is 368 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 363 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3376: copy_from oid 28 from oid 31 current snap is 368 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3377: copy_from oid 47 from oid 23 current snap is 368 2026-02-17T05:42:25.509 INFO:tasks.rados.rados.0.trial118.stdout:3378: delete oid 39 current snap is 368 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3377: finishing copy_from to trial11845692-47 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3377: got expected ENOENT (src dne) 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3377: finishing copy_from racing read to trial11845692-47 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3377: done (3 left) 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3378: done (2 left) 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3379: snap_create 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3375: finishing rollback tid 0 to trial11845692-3 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3375: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:42:25.511 INFO:tasks.rados.rados.0.trial118.stdout:3375: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:42:25.512 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 1696 (ObjNum 1077 snap 320 seq_num 1077) dirty exists 2026-02-17T05:42:25.514 INFO:tasks.rados.rados.0.trial118.stdout:3376: finishing copy_from racing read to trial11845692-28 2026-02-17T05:42:25.514 INFO:tasks.rados.rados.0.trial118.stdout:3376: finishing copy_from to trial11845692-28 2026-02-17T05:42:25.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3375: done (2 left) 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3376: done (1 left) 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3379: done (0 left) 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3380: rollback oid 48 current snap is 369 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 337 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3381: read oid 47 snap -1 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3381: expect (ObjNum 1160 snap 362 seq_num 1160) 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3382: rollback oid 6 current snap is 369 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 342 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3383: write oid 41 current snap is 369 2026-02-17T05:42:26.393 INFO:tasks.rados.rados.0.trial118.stdout:3383: seq_num 1176 ranges {565032=411186,1583530=456075,2578263=758593} 2026-02-17T05:42:26.398 INFO:tasks.rados.rados.0.trial118.stdout:3383: writing trial11845692-41 from 565032 to 976218 tid 1 2026-02-17T05:42:26.402 INFO:tasks.rados.rados.0.trial118.stdout:3383: writing trial11845692-41 from 1583530 to 2039605 tid 2 2026-02-17T05:42:26.408 INFO:tasks.rados.rados.0.trial118.stdout:3383: writing trial11845692-41 from 2578263 to 3336856 tid 3 2026-02-17T05:42:26.408 INFO:tasks.rados.rados.0.trial118.stdout:3384: rollback oid 38 current snap is 369 2026-02-17T05:42:26.408 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 359 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3380: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3380: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1772 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3382: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3382: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3382: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1726 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3380: done (4 left) 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3382: done (3 left) 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3385: delete oid 4 current snap is 369 2026-02-17T05:42:26.409 INFO:tasks.rados.rados.0.trial118.stdout:3383: finishing write tid 1 to trial11845692-41 2026-02-17T05:42:26.410 INFO:tasks.rados.rados.0.trial118.stdout:3381: expect (ObjNum 1160 snap 362 seq_num 1160) 2026-02-17T05:42:26.544 INFO:tasks.rados.rados.0.trial118.stdout:3383: finishing write tid 2 to trial11845692-41 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: finishing write tid 3 to trial11845692-41 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: finishing write tid 4 to trial11845692-41 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: finishing write tid 5 to trial11845692-41 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: oid 41 updating version 0 to 2030 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: oid 41 updating version 2030 to 2032 2026-02-17T05:42:26.545 INFO:tasks.rados.rados.0.trial118.stdout:3383: oid 41 version 2032 is already newer than 2029 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3383: oid 41 version 2032 is already newer than 2031 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2032 (ObjNum 1176 snap 369 seq_num 1176) dirty exists 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3383: left oid 41 (ObjNum 1176 snap 369 seq_num 1176) 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3384: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3384: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3381: done (3 left) 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3383: done (2 left) 2026-02-17T05:42:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3385: done (1 left) 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3386: read oid 17 snap -1 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3386: expect (ObjNum 1168 snap 365 seq_num 1168) 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3387: read oid 18 snap -1 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3387: expect (ObjNum 1155 snap 361 seq_num 1155) 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3388: copy_from oid 15 from oid 35 current snap is 369 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3384: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1823 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:42:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3384: done (3 left) 2026-02-17T05:42:26.548 INFO:tasks.rados.rados.0.trial118.stdout:3389: write (excl) oid 42 current snap is 369 2026-02-17T05:42:26.548 INFO:tasks.rados.rados.0.trial118.stdout:3389: seq_num 1178 ranges {598646=561684,1700494=459744,2633109=781137} 2026-02-17T05:42:26.549 INFO:tasks.rados.rados.0.trial118.stdout:3389: writing trial11845692-42 from 598646 to 1160330 tid 1 2026-02-17T05:42:26.551 INFO:tasks.rados.rados.0.trial118.stdout:3389: writing trial11845692-42 from 1700494 to 2160238 tid 2 2026-02-17T05:42:26.556 INFO:tasks.rados.rados.0.trial118.stdout:3389: writing trial11845692-42 from 2633109 to 3414246 tid 3 2026-02-17T05:42:26.556 INFO:tasks.rados.rados.0.trial118.stdout:3390: snap_remove snap 361 2026-02-17T05:42:27.396 INFO:tasks.rados.rados.0.trial118.stdout:3390: done (4 left) 2026-02-17T05:42:27.396 INFO:tasks.rados.rados.0.trial118.stdout:3391: write (excl) oid 28 current snap is 369 2026-02-17T05:42:27.396 INFO:tasks.rados.rados.0.trial118.stdout:3391: seq_num 1179 ranges {615453=753286,2158976=603402,3460532=354921} 2026-02-17T05:42:27.402 INFO:tasks.rados.rados.0.trial118.stdout:3391: writing trial11845692-28 from 615453 to 1368739 tid 1 2026-02-17T05:42:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3391: writing trial11845692-28 from 2158976 to 2762378 tid 2 2026-02-17T05:42:27.411 INFO:tasks.rados.rados.0.trial118.stdout:3391: writing trial11845692-28 from 3460532 to 3815453 tid 3 2026-02-17T05:42:27.411 INFO:tasks.rados.rados.0.trial118.stdout:3392: write (excl) oid 9 current snap is 369 2026-02-17T05:42:27.411 INFO:tasks.rados.rados.0.trial118.stdout:3392: seq_num 1180 ranges {632260=428535,1817458=463413,2687955=520034,3709324=122936} 2026-02-17T05:42:27.415 INFO:tasks.rados.rados.0.trial118.stdout:3392: writing trial11845692-9 from 632260 to 1060795 tid 1 2026-02-17T05:42:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3392: writing trial11845692-9 from 1817458 to 2280871 tid 2 2026-02-17T05:42:27.423 INFO:tasks.rados.rados.0.trial118.stdout:3392: writing trial11845692-9 from 2687955 to 3207989 tid 3 2026-02-17T05:42:27.426 INFO:tasks.rados.rados.0.trial118.stdout:3392: writing trial11845692-9 from 3709324 to 3832260 tid 4 2026-02-17T05:42:27.426 INFO:tasks.rados.rados.0.trial118.stdout:3393: delete oid 5 current snap is 369 2026-02-17T05:42:27.426 INFO:tasks.rados.rados.0.trial118.stdout:3386: expect (ObjNum 1168 snap 365 seq_num 1168) 2026-02-17T05:42:27.564 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3562498 2026-02-17T05:42:27.637 INFO:tasks.rados.rados.0.trial118.stdout:3389: finishing write tid 1 to trial11845692-42 2026-02-17T05:42:27.637 INFO:tasks.rados.rados.0.trial118.stdout:3389: finishing write tid 2 to trial11845692-42 2026-02-17T05:42:27.638 INFO:tasks.rados.rados.0.trial118.stdout:3387: expect (ObjNum 1155 snap 361 seq_num 1155) 2026-02-17T05:42:27.763 INFO:tasks.rados.rados.0.trial118.stdout:3388: finishing copy_from racing read to trial11845692-15 2026-02-17T05:42:27.763 INFO:tasks.rados.rados.0.trial118.stdout:3388: finishing copy_from to trial11845692-15 2026-02-17T05:42:27.763 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1685 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:27.763 INFO:tasks.rados.rados.0.trial118.stdout:3389: finishing write tid 3 to trial11845692-42 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: finishing write tid 4 to trial11845692-42 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3386: done (6 left) 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3387: done (5 left) 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3388: done (4 left) 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3393: done (3 left) 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3394: snap_create 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: finishing write tid 5 to trial11845692-42 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: oid 42 updating version 0 to 1827 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: oid 42 version 1827 is already newer than 1824 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: oid 42 version 1827 is already newer than 1825 2026-02-17T05:42:27.764 INFO:tasks.rados.rados.0.trial118.stdout:3389: oid 42 version 1827 is already newer than 1826 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1827 (ObjNum 1178 snap 369 seq_num 1178) dirty exists 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3389: left oid 42 (ObjNum 1178 snap 369 seq_num 1178) 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: finishing write tid 1 to trial11845692-28 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: finishing write tid 2 to trial11845692-28 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: finishing write tid 3 to trial11845692-28 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: finishing write tid 4 to trial11845692-28 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: finishing write tid 5 to trial11845692-28 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: oid 28 updating version 0 to 1688 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: oid 28 version 1688 is already newer than 1687 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: oid 28 updating version 1688 to 1689 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: oid 28 version 1689 is already newer than 1686 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1689 (ObjNum 1179 snap 369 seq_num 1179) dirty exists 2026-02-17T05:42:27.765 INFO:tasks.rados.rados.0.trial118.stdout:3391: left oid 28 (ObjNum 1179 snap 369 seq_num 1179) 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 1 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 2 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 3 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 4 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 5 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: finishing write tid 6 to trial11845692-9 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: oid 9 updating version 0 to 2046 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: oid 9 version 2046 is already newer than 2044 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: oid 9 version 2046 is already newer than 2045 2026-02-17T05:42:27.766 INFO:tasks.rados.rados.0.trial118.stdout:3392: oid 9 version 2046 is already newer than 2043 2026-02-17T05:42:27.767 INFO:tasks.rados.rados.0.trial118.stdout:3392: oid 9 version 2046 is already newer than 2042 2026-02-17T05:42:27.767 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2046 (ObjNum 1180 snap 369 seq_num 1180) dirty exists 2026-02-17T05:42:27.767 INFO:tasks.rados.rados.0.trial118.stdout:3392: left oid 9 (ObjNum 1180 snap 369 seq_num 1180) 2026-02-17T05:42:28.399 INFO:tasks.rados.rados.0.trial118.stdout:3389: done (3 left) 2026-02-17T05:42:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3391: done (2 left) 2026-02-17T05:42:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3392: done (1 left) 2026-02-17T05:42:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3394: done (0 left) 2026-02-17T05:42:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3395: snap_create 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3395: done (0 left) 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3396: read oid 24 snap -1 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3396: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3397: copy_from oid 13 from oid 42 current snap is 371 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3398: copy_from oid 1 from oid 36 current snap is 371 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3399: read oid 38 snap -1 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3399: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3400: write (excl) oid 17 current snap is 371 2026-02-17T05:42:29.400 INFO:tasks.rados.rados.0.trial118.stdout:3400: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2026-02-17T05:42:29.405 INFO:tasks.rados.rados.0.trial118.stdout:3400: writing trial11845692-17 from 665874 to 1244907 tid 1 2026-02-17T05:42:29.409 INFO:tasks.rados.rados.0.trial118.stdout:3400: writing trial11845692-17 from 1934422 to 2401504 tid 2 2026-02-17T05:42:29.415 INFO:tasks.rados.rados.0.trial118.stdout:3400: writing trial11845692-17 from 3142801 to 3685379 tid 3 2026-02-17T05:42:29.415 INFO:tasks.rados.rados.0.trial118.stdout:3401: write oid 9 current snap is 371 2026-02-17T05:42:29.415 INFO:tasks.rados.rados.0.trial118.stdout:3398: finishing copy_from to trial11845692-1 2026-02-17T05:42:29.415 INFO:tasks.rados.rados.0.trial118.stdout:3398: got expected ENOENT (src dne) 2026-02-17T05:42:29.415 INFO:tasks.rados.rados.0.trial118.stdout:3398: finishing copy_from racing read to trial11845692-1 2026-02-17T05:42:29.416 INFO:tasks.rados.rados.0.trial118.stdout:3401: seq_num 1183 ranges {682681=654282,1876551=610740,3053871=470203} 2026-02-17T05:42:29.421 INFO:tasks.rados.rados.0.trial118.stdout:3401: writing trial11845692-9 from 682681 to 1336963 tid 1 2026-02-17T05:42:29.425 INFO:tasks.rados.rados.0.trial118.stdout:3401: writing trial11845692-9 from 1876551 to 2487291 tid 2 2026-02-17T05:42:29.429 INFO:tasks.rados.rados.0.trial118.stdout:3401: writing trial11845692-9 from 3053871 to 3524074 tid 3 2026-02-17T05:42:29.429 INFO:tasks.rados.rados.0.trial118.stdout:3398: done (5 left) 2026-02-17T05:42:29.429 INFO:tasks.rados.rados.0.trial118.stdout:3402: write (excl) oid 36 current snap is 371 2026-02-17T05:42:29.429 INFO:tasks.rados.rados.0.trial118.stdout:3402: seq_num 1184 ranges {699488=729531,1935033=470751,3081294=681475} 2026-02-17T05:42:29.435 INFO:tasks.rados.rados.0.trial118.stdout:3402: writing trial11845692-36 from 699488 to 1429019 tid 1 2026-02-17T05:42:29.438 INFO:tasks.rados.rados.0.trial118.stdout:3402: writing trial11845692-36 from 1935033 to 2405784 tid 2 2026-02-17T05:42:29.444 INFO:tasks.rados.rados.0.trial118.stdout:3402: writing trial11845692-36 from 3081294 to 3762769 tid 3 2026-02-17T05:42:29.444 INFO:tasks.rados.rados.0.trial118.stdout:3403: snap_remove snap 354 2026-02-17T05:42:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3403: done (6 left) 2026-02-17T05:42:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3404: write oid 5 current snap is 371 2026-02-17T05:42:30.357 INFO:tasks.rados.rados.0.trial118.stdout:3404: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2026-02-17T05:42:30.362 INFO:tasks.rados.rados.0.trial118.stdout:3404: writing trial11845692-5 from 716295 to 1121075 tid 1 2026-02-17T05:42:30.367 INFO:tasks.rados.rados.0.trial118.stdout:3404: writing trial11845692-5 from 1593515 to 2207924 tid 2 2026-02-17T05:42:30.370 INFO:tasks.rados.rados.0.trial118.stdout:3404: writing trial11845692-5 from 2708717 to 3201464 tid 3 2026-02-17T05:42:30.373 INFO:tasks.rados.rados.0.trial118.stdout:3404: writing trial11845692-5 from 3640519 to 3916295 tid 4 2026-02-17T05:42:30.373 INFO:tasks.rados.rados.0.trial118.stdout:3405: snap_remove snap 369 2026-02-17T05:42:31.360 INFO:tasks.rados.rados.0.trial118.stdout:3405: done (7 left) 2026-02-17T05:42:31.360 INFO:tasks.rados.rados.0.trial118.stdout:3406: copy_from oid 45 from oid 27 current snap is 371 2026-02-17T05:42:31.360 INFO:tasks.rados.rados.0.trial118.stdout:3399: expect (ObjNum 1031 snap 312 seq_num 1031) 2026-02-17T05:42:31.387 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2636491 2026-02-17T05:42:31.407 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2911126 2026-02-17T05:42:31.410 INFO:tasks.rados.rados.0.trial118.stdout:3396: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:42:31.410 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 496860 2026-02-17T05:42:31.441 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3475272 2026-02-17T05:42:31.472 INFO:tasks.rados.rados.0.trial118.stdout:3400: finishing write tid 1 to trial11845692-17 2026-02-17T05:42:31.472 INFO:tasks.rados.rados.0.trial118.stdout:3396: done (7 left) 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3399: done (6 left) 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3407: snap_create 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: finishing write tid 2 to trial11845692-17 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3397: finishing copy_from racing read to trial11845692-13 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: finishing write tid 3 to trial11845692-17 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: finishing write tid 4 to trial11845692-17 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: finishing write tid 5 to trial11845692-17 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: oid 17 updating version 0 to 1501 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: oid 17 updating version 1501 to 1503 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: oid 17 version 1503 is already newer than 1502 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: oid 17 version 1503 is already newer than 1500 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1503 (ObjNum 1182 snap 371 seq_num 1182) dirty exists 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3400: left oid 17 (ObjNum 1182 snap 371 seq_num 1182) 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3397: finishing copy_from to trial11845692-13 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1827 (ObjNum 1178 snap 369 seq_num 1178) dirty exists 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: finishing write tid 1 to trial11845692-9 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: finishing write tid 2 to trial11845692-9 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: finishing write tid 3 to trial11845692-9 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: finishing write tid 4 to trial11845692-9 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: finishing write tid 5 to trial11845692-9 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: oid 9 updating version 0 to 2051 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: oid 9 version 2051 is already newer than 2048 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: oid 9 version 2051 is already newer than 2050 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: oid 9 version 2051 is already newer than 2049 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2051 (ObjNum 1183 snap 371 seq_num 1183) dirty exists 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3401: left oid 9 (ObjNum 1183 snap 371 seq_num 1183) 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: finishing write tid 1 to trial11845692-36 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: finishing write tid 2 to trial11845692-36 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: finishing write tid 3 to trial11845692-36 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: finishing write tid 4 to trial11845692-36 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: finishing write tid 5 to trial11845692-36 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: oid 36 updating version 0 to 1782 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: oid 36 updating version 1782 to 1783 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: oid 36 updating version 1783 to 1784 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: oid 36 version 1784 is already newer than 1781 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1784 (ObjNum 1184 snap 371 seq_num 1184) dirty exists 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3402: left oid 36 (ObjNum 1184 snap 371 seq_num 1184) 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 1 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 2 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 3 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 4 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 5 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: finishing write tid 6 to trial11845692-5 2026-02-17T05:42:31.473 INFO:tasks.rados.rados.0.trial118.stdout:3404: oid 5 updating version 0 to 1800 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3404: oid 5 updating version 1800 to 1801 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3404: oid 5 version 1801 is already newer than 1798 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3404: oid 5 version 1801 is already newer than 1799 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3404: oid 5 updating version 1801 to 1802 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1802 (ObjNum 1185 snap 371 seq_num 1185) dirty exists 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3404: left oid 5 (ObjNum 1185 snap 371 seq_num 1185) 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3406: finishing copy_from to trial11845692-45 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3406: got expected ENOENT (src dne) 2026-02-17T05:42:31.474 INFO:tasks.rados.rados.0.trial118.stdout:3406: finishing copy_from racing read to trial11845692-45 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3397: done (6 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3400: done (5 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3401: done (4 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3402: done (3 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3404: done (2 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3406: done (1 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3407: done (0 left) 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3408: rollback oid 41 current snap is 372 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 371 2026-02-17T05:42:32.407 INFO:tasks.rados.rados.0.trial118.stdout:3409: snap_remove snap 356 2026-02-17T05:42:33.407 INFO:tasks.rados.rados.0.trial118.stdout:3409: done (1 left) 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3410: read oid 15 snap -1 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3410: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3411: snap_create 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3408: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3408: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:3408: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:42:33.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2065 (ObjNum 1176 snap 369 seq_num 1176) dirty exists 2026-02-17T05:42:33.415 INFO:tasks.rados.rados.0.trial118.stdout:3410: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:42:34.413 INFO:tasks.rados.rados.0.trial118.stdout:3408: done (2 left) 2026-02-17T05:42:34.413 INFO:tasks.rados.rados.0.trial118.stdout:3410: done (1 left) 2026-02-17T05:42:34.413 INFO:tasks.rados.rados.0.trial118.stdout:3411: done (0 left) 2026-02-17T05:42:34.413 INFO:tasks.rados.rados.0.trial118.stdout:3412: read oid 49 snap 372 2026-02-17T05:42:34.414 INFO:tasks.rados.rados.0.trial118.stdout:3412: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:42:34.414 INFO:tasks.rados.rados.0.trial118.stdout:3413: snap_create 2026-02-17T05:42:34.420 INFO:tasks.rados.rados.0.trial118.stdout:3412: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:42:34.420 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:34.496 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2235673 2026-02-17T05:42:34.539 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1522025 2026-02-17T05:42:35.357 INFO:tasks.rados.rados.0.trial118.stdout:3412: done (1 left) 2026-02-17T05:42:35.357 INFO:tasks.rados.rados.0.trial118.stdout:3413: done (0 left) 2026-02-17T05:42:35.357 INFO:tasks.rados.rados.0.trial118.stdout:3414: snap_remove snap 353 2026-02-17T05:42:36.359 INFO:tasks.rados.rados.0.trial118.stdout:3414: done (0 left) 2026-02-17T05:42:36.360 INFO:tasks.rados.rados.0.trial118.stdout:3415: read oid 22 snap -1 2026-02-17T05:42:36.360 INFO:tasks.rados.rados.0.trial118.stdout:3415: expect (ObjNum 1124 snap 343 seq_num 1124) 2026-02-17T05:42:36.360 INFO:tasks.rados.rados.0.trial118.stdout:3416: write (excl) oid 9 current snap is 374 2026-02-17T05:42:36.360 INFO:tasks.rados.rados.0.trial118.stdout:3416: seq_num 1186 ranges {733102=596382,1768350=758067,3136140=704019} 2026-02-17T05:42:36.365 INFO:tasks.rados.rados.0.trial118.stdout:3416: writing trial11845692-9 from 733102 to 1329484 tid 1 2026-02-17T05:42:36.370 INFO:tasks.rados.rados.0.trial118.stdout:3416: writing trial11845692-9 from 1768350 to 2526417 tid 2 2026-02-17T05:42:36.376 INFO:tasks.rados.rados.0.trial118.stdout:3416: writing trial11845692-9 from 3136140 to 3840159 tid 3 2026-02-17T05:42:36.376 INFO:tasks.rados.rados.0.trial118.stdout:3417: write oid 16 current snap is 374 2026-02-17T05:42:36.377 INFO:tasks.rados.rados.0.trial118.stdout:3417: seq_num 1187 ranges {749909=671631,2110479=618078,3163563=515291} 2026-02-17T05:42:36.382 INFO:tasks.rados.rados.0.trial118.stdout:3417: writing trial11845692-16 from 749909 to 1421540 tid 1 2026-02-17T05:42:36.388 INFO:tasks.rados.rados.0.trial118.stdout:3417: writing trial11845692-16 from 2110479 to 2728557 tid 2 2026-02-17T05:42:36.391 INFO:tasks.rados.rados.0.trial118.stdout:3417: writing trial11845692-16 from 3163563 to 3678854 tid 3 2026-02-17T05:42:36.392 INFO:tasks.rados.rados.0.trial118.stdout:3418: snap_remove snap 373 2026-02-17T05:42:37.361 INFO:tasks.rados.rados.0.trial118.stdout:3418: done (3 left) 2026-02-17T05:42:37.361 INFO:tasks.rados.rados.0.trial118.stdout:3419: rollback oid 41 current snap is 374 2026-02-17T05:42:37.361 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 359 2026-02-17T05:42:37.362 INFO:tasks.rados.rados.0.trial118.stdout:3415: expect (ObjNum 1124 snap 343 seq_num 1124) 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2849080 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3416: finishing write tid 1 to trial11845692-9 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3416: finishing write tid 2 to trial11845692-9 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3416: finishing write tid 3 to trial11845692-9 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3415: done (3 left) 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3420: read oid 2 snap -1 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3420: expect (ObjNum 1142 snap 355 seq_num 1142) 2026-02-17T05:42:37.437 INFO:tasks.rados.rados.0.trial118.stdout:3421: read oid 34 snap -1 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3421: expect deleted 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3422: rollback oid 13 current snap is 374 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 368 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: finishing write tid 4 to trial11845692-9 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: finishing write tid 5 to trial11845692-9 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: oid 9 updating version 0 to 2082 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: oid 9 updating version 2082 to 2084 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: oid 9 version 2084 is already newer than 2083 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: oid 9 version 2084 is already newer than 2073 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2084 (ObjNum 1186 snap 374 seq_num 1186) dirty exists 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: left oid 9 (ObjNum 1186 snap 374 seq_num 1186) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: finishing write tid 1 to trial11845692-16 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: finishing write tid 2 to trial11845692-16 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: finishing write tid 3 to trial11845692-16 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: finishing write tid 4 to trial11845692-16 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: finishing write tid 5 to trial11845692-16 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: oid 16 updating version 0 to 2088 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: oid 16 version 2088 is already newer than 2086 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: oid 16 version 2088 is already newer than 2087 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: oid 16 version 2088 is already newer than 2085 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 2088 (ObjNum 1187 snap 374 seq_num 1187) dirty exists 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: left oid 16 (ObjNum 1187 snap 374 seq_num 1187) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3419: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3419: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3419: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2092 (ObjNum 1126 snap 343 seq_num 1126) dirty exists 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3416: done (5 left) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3417: done (4 left) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3419: done (3 left) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3423: read oid 24 snap -1 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3423: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3424: write oid 11 current snap is 374 2026-02-17T05:42:37.438 INFO:tasks.rados.rados.0.trial118.stdout:3424: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2026-02-17T05:42:37.443 INFO:tasks.rados.rados.0.trial118.stdout:3424: writing trial11845692-11 from 766716 to 1513596 tid 1 2026-02-17T05:42:37.448 INFO:tasks.rados.rados.0.trial118.stdout:3424: writing trial11845692-11 from 2168961 to 2930697 tid 2 2026-02-17T05:42:37.453 INFO:tasks.rados.rados.0.trial118.stdout:3424: writing trial11845692-11 from 3474633 to 3917549 tid 3 2026-02-17T05:42:37.453 INFO:tasks.rados.rados.0.trial118.stdout:3425: copy_from oid 38 from oid 26 current snap is 374 2026-02-17T05:42:37.454 INFO:tasks.rados.rados.0.trial118.stdout:3420: expect (ObjNum 1142 snap 355 seq_num 1142) 2026-02-17T05:42:37.470 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2378522 2026-02-17T05:42:37.514 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:37.549 INFO:tasks.rados.rados.0.trial118.stdout:3422: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:42:37.549 INFO:tasks.rados.rados.0.trial118.stdout:3420: done (5 left) 2026-02-17T05:42:37.549 INFO:tasks.rados.rados.0.trial118.stdout:3421: done (4 left) 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:3426: rollback oid 19 current snap is 374 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 322 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:3422: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:3422: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1830 (ObjNum 1164 snap 363 seq_num 1164) dirty exists 2026-02-17T05:42:37.550 INFO:tasks.rados.rados.0.trial118.stdout:3423: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:42:37.601 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: finishing write tid 1 to trial11845692-11 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: finishing write tid 2 to trial11845692-11 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: finishing write tid 3 to trial11845692-11 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: finishing write tid 4 to trial11845692-11 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: finishing write tid 5 to trial11845692-11 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: oid 11 updating version 0 to 2215 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: oid 11 updating version 2215 to 2216 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: oid 11 updating version 2216 to 2217 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: oid 11 updating version 2217 to 2218 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2218 (ObjNum 1188 snap 374 seq_num 1188) dirty exists 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: left oid 11 (ObjNum 1188 snap 374 seq_num 1188) 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3425: finishing copy_from racing read to trial11845692-38 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3425: finishing copy_from to trial11845692-38 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 1470 (ObjNum 1141 snap 355 seq_num 1141) dirty exists 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3426: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3426: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 1832 (ObjNum 129 snap 0 seq_num 11469000) dirty dne 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3422: done (4 left) 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3423: done (3 left) 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3424: done (2 left) 2026-02-17T05:42:37.627 INFO:tasks.rados.rados.0.trial118.stdout:3425: done (1 left) 2026-02-17T05:42:37.628 INFO:tasks.rados.rados.0.trial118.stdout:3426: done (0 left) 2026-02-17T05:42:37.628 INFO:tasks.rados.rados.0.trial118.stdout:3427: write (excl) oid 36 current snap is 374 2026-02-17T05:42:37.628 INFO:tasks.rados.rados.0.trial118.stdout:3427: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2026-02-17T05:42:37.631 INFO:tasks.rados.rados.0.trial118.stdout:3427: writing trial11845692-36 from 783523 to 1205652 tid 1 2026-02-17T05:42:37.636 INFO:tasks.rados.rados.0.trial118.stdout:3427: writing trial11845692-36 from 1827443 to 2449190 tid 2 2026-02-17T05:42:37.641 INFO:tasks.rados.rados.0.trial118.stdout:3427: writing trial11845692-36 from 3218409 to 3872597 tid 3 2026-02-17T05:42:37.642 INFO:tasks.rados.rados.0.trial118.stdout:3428: write (excl) oid 25 current snap is 374 2026-02-17T05:42:37.642 INFO:tasks.rados.rados.0.trial118.stdout:3427: finishing write tid 1 to trial11845692-36 2026-02-17T05:42:37.642 INFO:tasks.rados.rados.0.trial118.stdout:3428: seq_num 1190 ranges {400330=497378,1485925=514405} 2026-02-17T05:42:37.645 INFO:tasks.rados.rados.0.trial118.stdout:3428: writing trial11845692-25 from 400330 to 897708 tid 1 2026-02-17T05:42:37.649 INFO:tasks.rados.rados.0.trial118.stdout:3428: writing trial11845692-25 from 1485925 to 2000330 tid 2 2026-02-17T05:42:37.649 INFO:tasks.rados.rados.0.trial118.stdout:3429: snap_remove snap 337 2026-02-17T05:42:38.366 INFO:tasks.rados.rados.0.trial118.stdout:3429: done (2 left) 2026-02-17T05:42:38.366 INFO:tasks.rados.rados.0.trial118.stdout:3430: snap_create 2026-02-17T05:42:38.366 INFO:tasks.rados.rados.0.trial118.stdout:3427: finishing write tid 2 to trial11845692-36 2026-02-17T05:42:38.366 INFO:tasks.rados.rados.0.trial118.stdout:3427: finishing write tid 3 to trial11845692-36 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: finishing write tid 4 to trial11845692-36 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: finishing write tid 5 to trial11845692-36 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: oid 36 updating version 0 to 1810 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: oid 36 version 1810 is already newer than 1808 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: oid 36 version 1810 is already newer than 1809 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: oid 36 updating version 1810 to 1811 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1811 (ObjNum 1189 snap 374 seq_num 1189) dirty exists 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3427: left oid 36 (ObjNum 1189 snap 374 seq_num 1189) 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: finishing write tid 1 to trial11845692-25 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: finishing write tid 2 to trial11845692-25 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: finishing write tid 3 to trial11845692-25 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: finishing write tid 4 to trial11845692-25 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: oid 25 updating version 0 to 2125 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: oid 25 updating version 2125 to 2126 2026-02-17T05:42:38.367 INFO:tasks.rados.rados.0.trial118.stdout:3428: oid 25 version 2126 is already newer than 2124 2026-02-17T05:42:38.368 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 2126 (ObjNum 1190 snap 374 seq_num 1190) dirty exists 2026-02-17T05:42:38.368 INFO:tasks.rados.rados.0.trial118.stdout:3428: left oid 25 (ObjNum 1190 snap 374 seq_num 1190) 2026-02-17T05:42:39.369 INFO:tasks.rados.rados.0.trial118.stdout:3427: done (2 left) 2026-02-17T05:42:39.369 INFO:tasks.rados.rados.0.trial118.stdout:3428: done (1 left) 2026-02-17T05:42:39.369 INFO:tasks.rados.rados.0.trial118.stdout:3430: done (0 left) 2026-02-17T05:42:39.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: write oid 1 current snap is 375 2026-02-17T05:42:39.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: seq_num 1191 ranges {417137=572627,1428054=589083} 2026-02-17T05:42:39.374 INFO:tasks.rados.rados.0.trial118.stdout:3431: writing trial11845692-1 from 417137 to 989764 tid 1 2026-02-17T05:42:39.377 INFO:tasks.rados.rados.0.trial118.stdout:3431: writing trial11845692-1 from 1428054 to 2017137 tid 2 2026-02-17T05:42:39.377 INFO:tasks.rados.rados.0.trial118.stdout:3432: write (excl) oid 2 current snap is 375 2026-02-17T05:42:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3432: seq_num 1192 ranges {433944=647876,1486536=547408} 2026-02-17T05:42:39.382 INFO:tasks.rados.rados.0.trial118.stdout:3432: writing trial11845692-2 from 433944 to 1081820 tid 1 2026-02-17T05:42:39.385 INFO:tasks.rados.rados.0.trial118.stdout:3432: writing trial11845692-2 from 1486536 to 2033944 tid 2 2026-02-17T05:42:39.386 INFO:tasks.rados.rados.0.trial118.stdout:3433: read oid 5 snap -1 2026-02-17T05:42:39.386 INFO:tasks.rados.rados.0.trial118.stdout:3433: expect (ObjNum 1185 snap 371 seq_num 1185) 2026-02-17T05:42:39.386 INFO:tasks.rados.rados.0.trial118.stdout:3434: snap_remove snap 342 2026-02-17T05:42:40.359 INFO:tasks.rados.rados.0.trial118.stdout:3434: done (3 left) 2026-02-17T05:42:40.359 INFO:tasks.rados.rados.0.trial118.stdout:3435: write (excl) oid 13 current snap is 375 2026-02-17T05:42:40.359 INFO:tasks.rados.rados.0.trial118.stdout:3435: seq_num 1193 ranges {450751=723125,1945018=105733} 2026-02-17T05:42:40.364 INFO:tasks.rados.rados.0.trial118.stdout:3435: writing trial11845692-13 from 450751 to 1173876 tid 1 2026-02-17T05:42:40.368 INFO:tasks.rados.rados.0.trial118.stdout:3435: writing trial11845692-13 from 1945018 to 2050751 tid 2 2026-02-17T05:42:40.368 INFO:tasks.rados.rados.0.trial118.stdout:3436: rollback oid 47 current snap is 375 2026-02-17T05:42:40.368 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 363 2026-02-17T05:42:40.368 INFO:tasks.rados.rados.0.trial118.stdout:3431: finishing write tid 1 to trial11845692-1 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: finishing write tid 2 to trial11845692-1 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: finishing write tid 3 to trial11845692-1 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: finishing write tid 4 to trial11845692-1 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: oid 1 updating version 0 to 2136 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: oid 1 updating version 2136 to 2137 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: oid 1 updating version 2137 to 2138 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 2138 (ObjNum 1191 snap 375 seq_num 1191) dirty exists 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3431: left oid 1 (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3432: finishing write tid 1 to trial11845692-2 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3432: finishing write tid 2 to trial11845692-2 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3432: finishing write tid 3 to trial11845692-2 2026-02-17T05:42:40.369 INFO:tasks.rados.rados.0.trial118.stdout:3432: finishing write tid 4 to trial11845692-2 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:3432: oid 2 updating version 0 to 2231 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:3432: oid 2 updating version 2231 to 2232 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:3432: oid 2 version 2232 is already newer than 2230 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2232 (ObjNum 1192 snap 375 seq_num 1192) dirty exists 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:3432: left oid 2 (ObjNum 1192 snap 375 seq_num 1192) 2026-02-17T05:42:40.370 INFO:tasks.rados.rados.0.trial118.stdout:3433: expect (ObjNum 1185 snap 371 seq_num 1185) 2026-02-17T05:42:40.395 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: finishing write tid 1 to trial11845692-13 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: finishing write tid 2 to trial11845692-13 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: finishing write tid 3 to trial11845692-13 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: finishing write tid 4 to trial11845692-13 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: oid 13 updating version 0 to 1833 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: oid 13 updating version 1833 to 1834 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: oid 13 updating version 1834 to 1835 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1835 (ObjNum 1193 snap 375 seq_num 1193) dirty exists 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: left oid 13 (ObjNum 1193 snap 375 seq_num 1193) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3436: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3436: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3436: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1830 (ObjNum 1160 snap 362 seq_num 1160) dirty exists 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3431: done (4 left) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3432: done (3 left) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3433: done (2 left) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3435: done (1 left) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3436: done (0 left) 2026-02-17T05:42:40.451 INFO:tasks.rados.rados.0.trial118.stdout:3437: delete oid 5 current snap is 375 2026-02-17T05:42:40.452 INFO:tasks.rados.rados.0.trial118.stdout:3437: done (0 left) 2026-02-17T05:42:40.452 INFO:tasks.rados.rados.0.trial118.stdout:3438: write (excl) oid 22 current snap is 375 2026-02-17T05:42:40.452 INFO:tasks.rados.rados.0.trial118.stdout:3438: seq_num 1195 ranges {484365=589976,1661982=422383} 2026-02-17T05:42:40.456 INFO:tasks.rados.rados.0.trial118.stdout:3438: writing trial11845692-22 from 484365 to 1074341 tid 1 2026-02-17T05:42:40.460 INFO:tasks.rados.rados.0.trial118.stdout:3438: writing trial11845692-22 from 1661982 to 2084365 tid 2 2026-02-17T05:42:40.460 INFO:tasks.rados.rados.0.trial118.stdout:3439: snap_create 2026-02-17T05:42:40.460 INFO:tasks.rados.rados.0.trial118.stdout:3438: finishing write tid 1 to trial11845692-22 2026-02-17T05:42:40.461 INFO:tasks.rados.rados.0.trial118.stdout:3438: finishing write tid 2 to trial11845692-22 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: finishing write tid 3 to trial11845692-22 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: finishing write tid 4 to trial11845692-22 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: oid 22 updating version 0 to 1833 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: oid 22 version 1833 is already newer than 1831 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: oid 22 version 1833 is already newer than 1832 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1833 (ObjNum 1195 snap 375 seq_num 1195) dirty exists 2026-02-17T05:42:40.462 INFO:tasks.rados.rados.0.trial118.stdout:3438: left oid 22 (ObjNum 1195 snap 375 seq_num 1195) 2026-02-17T05:42:41.375 INFO:tasks.rados.rados.0.trial118.stdout:3438: done (1 left) 2026-02-17T05:42:41.375 INFO:tasks.rados.rados.0.trial118.stdout:3439: done (0 left) 2026-02-17T05:42:41.375 INFO:tasks.rados.rados.0.trial118.stdout:3440: snap_create 2026-02-17T05:42:42.375 INFO:tasks.rados.rados.0.trial118.stdout:3440: done (0 left) 2026-02-17T05:42:42.375 INFO:tasks.rados.rados.0.trial118.stdout:3441: write (excl) oid 28 current snap is 377 2026-02-17T05:42:42.376 INFO:tasks.rados.rados.0.trial118.stdout:3441: seq_num 1196 ranges {501172=665225,1720464=380708} 2026-02-17T05:42:42.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: writing trial11845692-28 from 501172 to 1166397 tid 1 2026-02-17T05:42:42.384 INFO:tasks.rados.rados.0.trial118.stdout:3441: writing trial11845692-28 from 1720464 to 2101172 tid 2 2026-02-17T05:42:42.385 INFO:tasks.rados.rados.0.trial118.stdout:3442: rollback oid 32 current snap is 377 2026-02-17T05:42:42.385 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 357 2026-02-17T05:42:42.385 INFO:tasks.rados.rados.0.trial118.stdout:3443: snap_remove snap 359 2026-02-17T05:42:43.380 INFO:tasks.rados.rados.0.trial118.stdout:3443: done (2 left) 2026-02-17T05:42:43.380 INFO:tasks.rados.rados.0.trial118.stdout:3444: snap_create 2026-02-17T05:42:43.380 INFO:tasks.rados.rados.0.trial118.stdout:3441: finishing write tid 1 to trial11845692-28 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: finishing write tid 2 to trial11845692-28 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: finishing write tid 3 to trial11845692-28 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: finishing write tid 4 to trial11845692-28 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: oid 28 updating version 0 to 1692 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: oid 28 version 1692 is already newer than 1691 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: oid 28 version 1692 is already newer than 1690 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1692 (ObjNum 1196 snap 377 seq_num 1196) dirty exists 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3441: left oid 28 (ObjNum 1196 snap 377 seq_num 1196) 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3442: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3442: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:42:43.381 INFO:tasks.rados.rados.0.trial118.stdout:3442: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:42:43.382 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1725 (ObjNum 1138 snap 353 seq_num 1138) dirty exists 2026-02-17T05:42:44.380 INFO:tasks.rados.rados.0.trial118.stdout:3441: done (2 left) 2026-02-17T05:42:44.380 INFO:tasks.rados.rados.0.trial118.stdout:3442: done (1 left) 2026-02-17T05:42:44.381 INFO:tasks.rados.rados.0.trial118.stdout:3444: done (0 left) 2026-02-17T05:42:44.381 INFO:tasks.rados.rados.0.trial118.stdout:3445: read oid 16 snap -1 2026-02-17T05:42:44.381 INFO:tasks.rados.rados.0.trial118.stdout:3445: expect (ObjNum 1187 snap 374 seq_num 1187) 2026-02-17T05:42:44.381 INFO:tasks.rados.rados.0.trial118.stdout:3446: snap_remove snap 322 2026-02-17T05:42:45.358 INFO:tasks.rados.rados.0.trial118.stdout:3446: done (1 left) 2026-02-17T05:42:45.358 INFO:tasks.rados.rados.0.trial118.stdout:3447: snap_create 2026-02-17T05:42:45.358 INFO:tasks.rados.rados.0.trial118.stdout:3445: expect (ObjNum 1187 snap 374 seq_num 1187) 2026-02-17T05:42:45.367 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2298534 2026-02-17T05:42:45.378 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:45.419 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3779344 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3445: done (1 left) 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3447: done (0 left) 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3448: rollback oid 35 current snap is 379 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 368 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3449: copy_from oid 18 from oid 9 current snap is 379 2026-02-17T05:42:46.361 INFO:tasks.rados.rados.0.trial118.stdout:3450: write oid 30 current snap is 379 2026-02-17T05:42:46.362 INFO:tasks.rados.rados.0.trial118.stdout:3450: seq_num 1197 ranges {517979=740474,1778946=339033} 2026-02-17T05:42:46.367 INFO:tasks.rados.rados.0.trial118.stdout:3450: writing trial11845692-30 from 517979 to 1258453 tid 1 2026-02-17T05:42:46.370 INFO:tasks.rados.rados.0.trial118.stdout:3450: writing trial11845692-30 from 1778946 to 2117979 tid 2 2026-02-17T05:42:46.370 INFO:tasks.rados.rados.0.trial118.stdout:3451: rollback oid 4 current snap is 379 2026-02-17T05:42:46.370 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 357 2026-02-17T05:42:46.370 INFO:tasks.rados.rados.0.trial118.stdout:3448: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:42:46.370 INFO:tasks.rados.rados.0.trial118.stdout:3448: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3448: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1722 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3450: finishing write tid 1 to trial11845692-30 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3448: done (3 left) 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3452: rollback oid 32 current snap is 379 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 370 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3453: rollback oid 47 current snap is 379 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 364 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3454: rollback oid 11 current snap is 379 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 372 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3455: rollback oid 36 current snap is 379 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 371 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3456: write oid 5 current snap is 379 2026-02-17T05:42:46.371 INFO:tasks.rados.rados.0.trial118.stdout:3456: seq_num 1198 ranges {534786=415723,1437428=697358} 2026-02-17T05:42:46.374 INFO:tasks.rados.rados.0.trial118.stdout:3456: writing trial11845692-5 from 534786 to 950509 tid 1 2026-02-17T05:42:46.379 INFO:tasks.rados.rados.0.trial118.stdout:3456: writing trial11845692-5 from 1437428 to 2134786 tid 2 2026-02-17T05:42:46.379 INFO:tasks.rados.rados.0.trial118.stdout:3457: snap_remove snap 375 2026-02-17T05:42:47.362 INFO:tasks.rados.rados.0.trial118.stdout:3457: done (8 left) 2026-02-17T05:42:47.363 INFO:tasks.rados.rados.0.trial118.stdout:3458: snap_remove snap 376 2026-02-17T05:42:48.366 INFO:tasks.rados.rados.0.trial118.stdout:3458: done (8 left) 2026-02-17T05:42:48.366 INFO:tasks.rados.rados.0.trial118.stdout:3459: read oid 14 snap -1 2026-02-17T05:42:48.366 INFO:tasks.rados.rados.0.trial118.stdout:3459: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:42:48.366 INFO:tasks.rados.rados.0.trial118.stdout:3460: write (excl) oid 13 current snap is 379 2026-02-17T05:42:48.367 INFO:tasks.rados.rados.0.trial118.stdout:3460: seq_num 1199 ranges {551593=490972,1779557=372036} 2026-02-17T05:42:48.370 INFO:tasks.rados.rados.0.trial118.stdout:3460: writing trial11845692-13 from 551593 to 1042565 tid 1 2026-02-17T05:42:48.374 INFO:tasks.rados.rados.0.trial118.stdout:3460: writing trial11845692-13 from 1779557 to 2151593 tid 2 2026-02-17T05:42:48.374 INFO:tasks.rados.rados.0.trial118.stdout:3461: write oid 26 current snap is 379 2026-02-17T05:42:48.374 INFO:tasks.rados.rados.0.trial118.stdout:3461: seq_num 1200 ranges {568400=566221,1838039=330361} 2026-02-17T05:42:48.378 INFO:tasks.rados.rados.0.trial118.stdout:3461: writing trial11845692-26 from 568400 to 1134621 tid 1 2026-02-17T05:42:48.382 INFO:tasks.rados.rados.0.trial118.stdout:3461: writing trial11845692-26 from 1838039 to 2168400 tid 2 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3462: rollback oid 35 current snap is 379 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 367 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3451: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3451: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 2124 (ObjNum 1120 snap 343 seq_num 1120) dirty exists 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: finishing write tid 2 to trial11845692-30 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: finishing write tid 3 to trial11845692-30 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: finishing write tid 4 to trial11845692-30 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: oid 30 updating version 0 to 2168 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: oid 30 version 2168 is already newer than 2167 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: oid 30 updating version 2168 to 2169 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2169 (ObjNum 1197 snap 379 seq_num 1197) dirty exists 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: left oid 30 (ObjNum 1197 snap 379 seq_num 1197) 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3454: finishing rollback tid 0 to trial11845692-11 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3452: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3452: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3452: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1728 (ObjNum 1138 snap 353 seq_num 1138) dirty exists 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3453: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3454: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2261 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3453: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3455: finishing rollback tid 0 to trial11845692-36 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3450: done (11 left) 2026-02-17T05:42:48.383 INFO:tasks.rados.rados.0.trial118.stdout:3451: done (10 left) 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3452: done (9 left) 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3454: done (8 left) 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3463: read oid 42 snap 378 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3463: expect (ObjNum 1178 snap 369 seq_num 1178) 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3464: write oid 17 current snap is 379 2026-02-17T05:42:48.384 INFO:tasks.rados.rados.0.trial118.stdout:3464: seq_num 1201 ranges {585207=641470,1896521=288686} 2026-02-17T05:42:48.387 INFO:tasks.rados.rados.0.trial118.stdout:3464: writing trial11845692-17 from 585207 to 1226677 tid 1 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:3464: writing trial11845692-17 from 1896521 to 2185207 tid 2 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:3465: snap_create 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:3455: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:3453: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1833 (ObjNum 1160 snap 362 seq_num 1160) dirty exists 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:3455: finishing rollback tid 2 to trial11845692-36 2026-02-17T05:42:48.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1849 (ObjNum 1184 snap 371 seq_num 1184) dirty exists 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3449: finishing copy_from racing read to trial11845692-18 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: finishing write tid 1 to trial11845692-5 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3449: finishing copy_from to trial11845692-18 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2084 (ObjNum 1186 snap 374 seq_num 1186) dirty exists 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: finishing write tid 2 to trial11845692-5 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: finishing write tid 3 to trial11845692-5 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: finishing write tid 4 to trial11845692-5 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: oid 5 updating version 0 to 1804 2026-02-17T05:42:48.392 INFO:tasks.rados.rados.0.trial118.stdout:3456: oid 5 updating version 1804 to 1806 2026-02-17T05:42:48.393 INFO:tasks.rados.rados.0.trial118.stdout:3456: oid 5 version 1806 is already newer than 1805 2026-02-17T05:42:48.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1806 (ObjNum 1198 snap 379 seq_num 1198) dirty exists 2026-02-17T05:42:48.393 INFO:tasks.rados.rados.0.trial118.stdout:3456: left oid 5 (ObjNum 1198 snap 379 seq_num 1198) 2026-02-17T05:42:48.393 INFO:tasks.rados.rados.0.trial118.stdout:3459: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:42:48.397 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1039551 2026-02-17T05:42:48.410 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:48.449 INFO:tasks.rados.rados.0.trial118.stdout:3460: finishing write tid 1 to trial11845692-13 2026-02-17T05:42:48.449 INFO:tasks.rados.rados.0.trial118.stdout:3460: finishing write tid 2 to trial11845692-13 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: finishing write tid 3 to trial11845692-13 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: finishing write tid 4 to trial11845692-13 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: oid 13 updating version 0 to 1838 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: oid 13 version 1838 is already newer than 1837 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: oid 13 version 1838 is already newer than 1836 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1838 (ObjNum 1199 snap 379 seq_num 1199) dirty exists 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3460: left oid 13 (ObjNum 1199 snap 379 seq_num 1199) 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3461: finishing write tid 1 to trial11845692-26 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3461: finishing write tid 2 to trial11845692-26 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3461: finishing write tid 3 to trial11845692-26 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3461: finishing write tid 4 to trial11845692-26 2026-02-17T05:42:48.450 INFO:tasks.rados.rados.0.trial118.stdout:3461: oid 26 updating version 0 to 1471 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3461: oid 26 updating version 1471 to 1472 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3461: oid 26 updating version 1472 to 1473 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1473 (ObjNum 1200 snap 379 seq_num 1200) dirty exists 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3461: left oid 26 (ObjNum 1200 snap 379 seq_num 1200) 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3462: finishing rollback tid 0 to trial11845692-35 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3462: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:42:48.451 INFO:tasks.rados.rados.0.trial118.stdout:3462: finishing rollback tid 2 to trial11845692-35 2026-02-17T05:42:48.452 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1725 (ObjNum 1159 snap 362 seq_num 1159) dirty exists 2026-02-17T05:42:48.452 INFO:tasks.rados.rados.0.trial118.stdout:3463: expect (ObjNum 1178 snap 369 seq_num 1178) 2026-02-17T05:42:48.529 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 948893 2026-02-17T05:42:48.631 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3281870 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: finishing write tid 1 to trial11845692-17 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: finishing write tid 2 to trial11845692-17 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: finishing write tid 3 to trial11845692-17 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: finishing write tid 4 to trial11845692-17 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: oid 17 updating version 0 to 1506 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: oid 17 version 1506 is already newer than 1504 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: oid 17 version 1506 is already newer than 1505 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1506 (ObjNum 1201 snap 379 seq_num 1201) dirty exists 2026-02-17T05:42:48.657 INFO:tasks.rados.rados.0.trial118.stdout:3464: left oid 17 (ObjNum 1201 snap 379 seq_num 1201) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3449: done (10 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3453: done (9 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3455: done (8 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3456: done (7 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3459: done (6 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3460: done (5 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3461: done (4 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3462: done (3 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3463: done (2 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3464: done (1 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3465: done (0 left) 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3466: rollback oid 32 current snap is 380 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 367 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3467: copy_from oid 50 from oid 20 current snap is 380 2026-02-17T05:42:49.371 INFO:tasks.rados.rados.0.trial118.stdout:3468: delete oid 27 current snap is 380 2026-02-17T05:42:49.374 INFO:tasks.rados.rados.0.trial118.stdout:3466: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:42:49.374 INFO:tasks.rados.rados.0.trial118.stdout:3466: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:42:49.374 INFO:tasks.rados.rados.0.trial118.stdout:3466: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:42:49.374 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1731 (ObjNum 1138 snap 353 seq_num 1138) dirty exists 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3466: done (2 left) 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3468: done (1 left) 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3469: read oid 23 snap 370 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3469: expect deleted 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3470: read oid 8 snap -1 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3470: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3471: write oid 17 current snap is 380 2026-02-17T05:42:49.379 INFO:tasks.rados.rados.0.trial118.stdout:3471: seq_num 1203 ranges {618821=508321,1613485=531077} 2026-02-17T05:42:49.383 INFO:tasks.rados.rados.0.trial118.stdout:3471: writing trial11845692-17 from 618821 to 1127142 tid 1 2026-02-17T05:42:49.387 INFO:tasks.rados.rados.0.trial118.stdout:3471: writing trial11845692-17 from 1613485 to 2144562 tid 2 2026-02-17T05:42:49.387 INFO:tasks.rados.rados.0.trial118.stdout:3472: read oid 5 snap -1 2026-02-17T05:42:49.387 INFO:tasks.rados.rados.0.trial118.stdout:3472: expect (ObjNum 1198 snap 379 seq_num 1198) 2026-02-17T05:42:49.387 INFO:tasks.rados.rados.0.trial118.stdout:3473: write oid 47 current snap is 380 2026-02-17T05:42:49.387 INFO:tasks.rados.rados.0.trial118.stdout:3473: seq_num 1204 ranges {635628=583570,1671967=563661} 2026-02-17T05:42:49.392 INFO:tasks.rados.rados.0.trial118.stdout:3473: writing trial11845692-47 from 635628 to 1219198 tid 1 2026-02-17T05:42:49.395 INFO:tasks.rados.rados.0.trial118.stdout:3473: writing trial11845692-47 from 1671967 to 2235628 tid 2 2026-02-17T05:42:49.396 INFO:tasks.rados.rados.0.trial118.stdout:3474: write oid 21 current snap is 380 2026-02-17T05:42:49.396 INFO:tasks.rados.rados.0.trial118.stdout:3474: seq_num 1205 ranges {652435=658819,1730449=521986} 2026-02-17T05:42:49.400 INFO:tasks.rados.rados.0.trial118.stdout:3474: writing trial11845692-21 from 652435 to 1311254 tid 1 2026-02-17T05:42:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3474: writing trial11845692-21 from 1730449 to 2252435 tid 2 2026-02-17T05:42:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3475: delete oid 35 current snap is 380 2026-02-17T05:42:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3467: finishing copy_from racing read to trial11845692-50 2026-02-17T05:42:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3470: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:42:49.406 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1660165 2026-02-17T05:42:49.428 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 859887 2026-02-17T05:42:49.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3467: finishing copy_from to trial11845692-50 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2133 (ObjNum 1163 snap 363 seq_num 1163) dirty exists 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3471: finishing write tid 1 to trial11845692-17 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3467: done (7 left) 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3469: done (6 left) 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3470: done (5 left) 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3475: done (4 left) 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3476: write (excl) oid 28 current snap is 380 2026-02-17T05:42:49.475 INFO:tasks.rados.rados.0.trial118.stdout:3476: seq_num 1207 ranges {686049=409317,1847413=438636} 2026-02-17T05:42:49.479 INFO:tasks.rados.rados.0.trial118.stdout:3476: writing trial11845692-28 from 686049 to 1095366 tid 1 2026-02-17T05:42:49.483 INFO:tasks.rados.rados.0.trial118.stdout:3476: writing trial11845692-28 from 1847413 to 2286049 tid 2 2026-02-17T05:42:49.483 INFO:tasks.rados.rados.0.trial118.stdout:3477: snap_remove snap 355 2026-02-17T05:42:50.361 INFO:tasks.rados.rados.0.trial118.stdout:3477: done (5 left) 2026-02-17T05:42:50.361 INFO:tasks.rados.rados.0.trial118.stdout:3478: snap_create 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: finishing write tid 2 to trial11845692-17 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: finishing write tid 3 to trial11845692-17 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: finishing write tid 4 to trial11845692-17 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: oid 17 updating version 0 to 1509 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: oid 17 version 1509 is already newer than 1507 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: oid 17 version 1509 is already newer than 1508 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1509 (ObjNum 1203 snap 380 seq_num 1203) dirty exists 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3471: left oid 17 (ObjNum 1203 snap 380 seq_num 1203) 2026-02-17T05:42:50.362 INFO:tasks.rados.rados.0.trial118.stdout:3472: expect (ObjNum 1198 snap 379 seq_num 1198) 2026-02-17T05:42:50.363 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:50.378 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:42:50.405 INFO:tasks.rados.rados.0.trial118.stdout:3473: finishing write tid 1 to trial11845692-47 2026-02-17T05:42:50.405 INFO:tasks.rados.rados.0.trial118.stdout:3473: finishing write tid 2 to trial11845692-47 2026-02-17T05:42:50.405 INFO:tasks.rados.rados.0.trial118.stdout:3473: finishing write tid 3 to trial11845692-47 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3473: finishing write tid 4 to trial11845692-47 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3473: oid 47 updating version 0 to 1836 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3473: oid 47 version 1836 is already newer than 1834 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3473: oid 47 version 1836 is already newer than 1835 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1836 (ObjNum 1204 snap 380 seq_num 1204) dirty exists 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3473: left oid 47 (ObjNum 1204 snap 380 seq_num 1204) 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3474: finishing write tid 1 to trial11845692-21 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3474: finishing write tid 2 to trial11845692-21 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3474: finishing write tid 3 to trial11845692-21 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3474: finishing write tid 4 to trial11845692-21 2026-02-17T05:42:50.406 INFO:tasks.rados.rados.0.trial118.stdout:3474: oid 21 updating version 0 to 2171 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3474: oid 21 updating version 2171 to 2173 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3474: oid 21 version 2173 is already newer than 2172 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2173 (ObjNum 1205 snap 380 seq_num 1205) dirty exists 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3474: left oid 21 (ObjNum 1205 snap 380 seq_num 1205) 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: finishing write tid 1 to trial11845692-28 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: finishing write tid 2 to trial11845692-28 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: finishing write tid 3 to trial11845692-28 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: finishing write tid 4 to trial11845692-28 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: oid 28 updating version 0 to 2087 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: oid 28 version 2087 is already newer than 2085 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:3476: oid 28 version 2087 is already newer than 2086 2026-02-17T05:42:50.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2087 (ObjNum 1207 snap 380 seq_num 1207) dirty exists 2026-02-17T05:42:50.408 INFO:tasks.rados.rados.0.trial118.stdout:3476: left oid 28 (ObjNum 1207 snap 380 seq_num 1207) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3471: done (5 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3472: done (4 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3473: done (3 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3474: done (2 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3476: done (1 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3478: done (0 left) 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3479: write oid 41 current snap is 381 2026-02-17T05:42:51.360 INFO:tasks.rados.rados.0.trial118.stdout:3479: seq_num 1208 ranges {702856=484566,1789542=513314} 2026-02-17T05:42:51.365 INFO:tasks.rados.rados.0.trial118.stdout:3479: writing trial11845692-41 from 702856 to 1187422 tid 1 2026-02-17T05:42:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3479: writing trial11845692-41 from 1789542 to 2302856 tid 2 2026-02-17T05:42:51.369 INFO:tasks.rados.rados.0.trial118.stdout:3480: snap_remove snap 340 2026-02-17T05:42:52.362 INFO:tasks.rados.rados.0.trial118.stdout:3480: done (1 left) 2026-02-17T05:42:52.362 INFO:tasks.rados.rados.0.trial118.stdout:3481: snap_remove snap 380 2026-02-17T05:42:53.362 INFO:tasks.rados.rados.0.trial118.stdout:3481: done (1 left) 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3482: copy_from oid 5 from oid 38 current snap is 381 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: finishing write tid 1 to trial11845692-41 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: finishing write tid 2 to trial11845692-41 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: finishing write tid 3 to trial11845692-41 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: finishing write tid 4 to trial11845692-41 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: oid 41 updating version 0 to 2136 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: oid 41 version 2136 is already newer than 2135 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: oid 41 version 2136 is already newer than 2134 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2136 (ObjNum 1208 snap 381 seq_num 1208) dirty exists 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: left oid 41 (ObjNum 1208 snap 381 seq_num 1208) 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3479: done (1 left) 2026-02-17T05:42:53.363 INFO:tasks.rados.rados.0.trial118.stdout:3483: delete oid 45 current snap is 381 2026-02-17T05:42:53.365 INFO:tasks.rados.rados.0.trial118.stdout:3483: done (1 left) 2026-02-17T05:42:53.365 INFO:tasks.rados.rados.0.trial118.stdout:3484: write oid 50 current snap is 381 2026-02-17T05:42:53.365 INFO:tasks.rados.rados.0.trial118.stdout:3484: seq_num 1210 ranges {736470=751417,2022859=313611} 2026-02-17T05:42:53.371 INFO:tasks.rados.rados.0.trial118.stdout:3484: writing trial11845692-50 from 736470 to 1487887 tid 1 2026-02-17T05:42:53.375 INFO:tasks.rados.rados.0.trial118.stdout:3484: writing trial11845692-50 from 2022859 to 2336470 tid 2 2026-02-17T05:42:53.375 INFO:tasks.rados.rados.0.trial118.stdout:3485: write (excl) oid 12 current snap is 381 2026-02-17T05:42:53.375 INFO:tasks.rados.rados.0.trial118.stdout:3485: seq_num 1211 ranges {753277=426666,1681341=545753} 2026-02-17T05:42:53.379 INFO:tasks.rados.rados.0.trial118.stdout:3485: writing trial11845692-12 from 753277 to 1179943 tid 1 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3485: writing trial11845692-12 from 1681341 to 2227094 tid 2 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3486: snap_create 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3482: finishing copy_from racing read to trial11845692-5 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3482: finishing copy_from to trial11845692-5 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1470 (ObjNum 1141 snap 355 seq_num 1141) dirty exists 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: finishing write tid 1 to trial11845692-50 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: finishing write tid 2 to trial11845692-50 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: finishing write tid 3 to trial11845692-50 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: finishing write tid 4 to trial11845692-50 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: oid 50 updating version 0 to 2134 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: oid 50 updating version 2134 to 2136 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:3484: oid 50 version 2136 is already newer than 2135 2026-02-17T05:42:53.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2136 (ObjNum 1210 snap 381 seq_num 1210) dirty exists 2026-02-17T05:42:53.384 INFO:tasks.rados.rados.0.trial118.stdout:3484: left oid 50 (ObjNum 1210 snap 381 seq_num 1210) 2026-02-17T05:42:53.384 INFO:tasks.rados.rados.0.trial118.stdout:3485: finishing write tid 1 to trial11845692-12 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: finishing write tid 2 to trial11845692-12 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: finishing write tid 3 to trial11845692-12 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: finishing write tid 4 to trial11845692-12 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: oid 12 updating version 0 to 2139 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: oid 12 version 2139 is already newer than 2138 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: oid 12 version 2139 is already newer than 2137 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 2139 (ObjNum 1211 snap 381 seq_num 1211) dirty exists 2026-02-17T05:42:53.385 INFO:tasks.rados.rados.0.trial118.stdout:3485: left oid 12 (ObjNum 1211 snap 381 seq_num 1211) 2026-02-17T05:42:54.369 INFO:tasks.rados.rados.0.trial118.stdout:3482: done (3 left) 2026-02-17T05:42:54.369 INFO:tasks.rados.rados.0.trial118.stdout:3484: done (2 left) 2026-02-17T05:42:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3485: done (1 left) 2026-02-17T05:42:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3486: done (0 left) 2026-02-17T05:42:54.370 INFO:tasks.rados.rados.0.trial118.stdout:3487: snap_create 2026-02-17T05:42:55.361 INFO:tasks.rados.rados.0.trial118.stdout:3487: done (0 left) 2026-02-17T05:42:55.361 INFO:tasks.rados.rados.0.trial118.stdout:3488: copy_from oid 40 from oid 44 current snap is 383 2026-02-17T05:42:55.361 INFO:tasks.rados.rados.0.trial118.stdout:3489: snap_remove snap 379 2026-02-17T05:42:55.794 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:42:55.794 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T05:42:55.794 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T05:42:55.794 DEBUG:teuthology.orchestra.run.trial118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T05:42:55.797 INFO:tasks.ceph.mon.b:Started 2026-02-17T05:42:55.797 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:42:55.798 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:42:55.877 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.874+0000 7fd9ccd0c640 10 monclient: get_monmap_and_config 2026-02-17T05:42:55.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.874+0000 7fd9ccd0c640 10 monclient: build_initial_monmap 2026-02-17T05:42:55.878 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.874+0000 7fd9ccd0c640 10 monclient: monmap: 2026-02-17T05:42:55.878 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:55.878 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:55.878 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:55.876339+0000 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:55.876339+0000 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:55.879 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:55.880 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 1 Processor -- start 2026-02-17T05:42:55.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 1 -- start start 2026-02-17T05:42:55.880 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient: init 2026-02-17T05:42:55.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:55.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd9c813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd9c813f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd9c81811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c808a7d0 con 0x7fd9c81811f0 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c808d5c0 con 0x7fd9c813f010 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c808d800 con 0x7fd9c813ec40 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:55.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.875+0000 7fd9ccd0c640 10 monclient(hunting): authenticate will time out at 1504.504990s 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c6575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd9c813ec40 0x7fd9c808ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46758/0 (socket says 10.20.193.106:46758) 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c6575640 1 -- 10.20.193.106:0/1364485898 learned_addr learned my addr 10.20.193.106:0/1364485898 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174999012 0 0) 0x7fd9c808a7d0 con 0x7fd9c81811f0 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient(hunting): _negotiate 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient(hunting): my global_id is 124185 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9b40035e0 con 0x7fd9c81811f0 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3868051090 0 0) 0x7fd9b40035e0 con 0x7fd9c81811f0 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 >> v1:10.20.193.106:6790/0 conn(0x7fd9c813ec40 legacy=0x7fd9c808ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:55.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 >> v1:10.20.193.118:6789/0 conn(0x7fd9c813f010 legacy=0x7fd9c813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: _finish_hunting 0 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 monclient: found mon.noname-a 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c808a180 con 0x7fd9c81811f0 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: _finish_auth 0 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: _check_auth_tickets 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd9b8003eb0 con 0x7fd9c81811f0 2026-02-17T05:42:55.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: dump: 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9ccd0c640 5 monclient: authenticate success, global_id 124185 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9ccd0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9b80040f0 con 0x7fd9c81811f0 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 1 -- 10.20.193.106:0/1364485898 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd9b80044c0 con 0x7fd9c81811f0 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9c5573640 10 monclient: dump: 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:55.892 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9ccd0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.876+0000 7fd9ccd0c640 4 set_mon_vals no callback set 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: shutdown 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/1364485898 >> v1:10.20.193.106:6789/0 conn(0x7fd9c81811f0 legacy=0x7fd9c81a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/1364485898 shutdown_connections 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/1364485898 >> 10.20.193.106:0/1364485898 conn(0x7fd9c80915f0 msgr2=0x7fd9c80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/1364485898 shutdown_connections 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/1364485898 wait complete. 2026-02-17T05:42:55.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: build_initial_monmap 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: monmap: 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 Processor -- start 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 1 -- start start 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: init 2026-02-17T05:42:55.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd9c813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.877+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd9c813f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd9c81811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c819df20 con 0x7fd9c813f010 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c819d140 con 0x7fd9c81811f0 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c819d3c0 con 0x7fd9c813ec40 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9ccd0c640 10 monclient(hunting): authenticate will time out at 1504.507015s 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9c6575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd9c813ec40 0x7fd9c819d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46774/0 (socket says 10.20.193.106:46774) 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.878+0000 7fd9c6575640 1 -- 10.20.193.106:0/118621231 learned_addr learned my addr 10.20.193.106:0/118621231 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453457349 0 0) 0x7fd9c819d3c0 con 0x7fd9c813ec40 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:55.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 10 monclient(hunting): my global_id is 5213 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9940035e0 con 0x7fd9c813ec40 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 592400551 0 0) 0x7fd9940035e0 con 0x7fd9c813ec40 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.879+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9c819d3c0 con 0x7fd9c813ec40 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd9bc002ff0 con 0x7fd9c813ec40 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): dump: 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:55.896 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134636658 0 0) 0x7fd9c819df20 con 0x7fd9c813f010 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient(hunting): my global_id is 124188 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9940035e0 con 0x7fd9c813f010 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4267101723 0 0) 0x7fd9c819d3c0 con 0x7fd9c813ec40 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 >> v1:10.20.193.118:6789/0 conn(0x7fd9c81811f0 legacy=0x7fd9c812c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:55.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 >> v1:10.20.193.106:6789/0 conn(0x7fd9c813f010 legacy=0x7fd9c8198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient: _finish_hunting 0 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 monclient: found mon.c 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c805c900 con 0x7fd9c813ec40 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient: _finish_auth 0 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 10 monclient: _check_auth_tickets 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 5 monclient: authenticate success, global_id 5213 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _renew_subs 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c819f4d0 con 0x7fd9c813ec40 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _renew_subs 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd9c813c950 con 0x7fd9c813ec40 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:55.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.880+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c80008d0 con 0x7fd9c813ec40 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9bc0031c0 con 0x7fd9c813ec40 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd9bc004b10 con 0x7fd9c813ec40 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9c4d72640 4 set_mon_vals no callback set 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 10 monclient: dump: 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:55.899 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.881+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd9bc004c70 con 0x7fd9c813ec40 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.882+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(774..774 src has 522..774) ==== 4007+0+0 (unknown 3158963191 0 0) 0x7fd9bc04fe50 con 0x7fd9c813ec40 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.882+0000 7fd9c5d74640 10 monclient: get_auth_request con 0x7fd994040940 auth_method 0 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.884+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fd9bc016e00 con 0x7fd9c813ec40 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.884+0000 7fd9aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:55.884+0000 7fd9aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:56.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9ccd0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9ccd0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9ccd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd9c819a620 con 0x7fd9c813ec40 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9aeffd640 1 -- 10.20.193.106:0/118621231 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2784269807) 0x7fd9bc04cc10 con 0x7fd9c813ec40 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.030+0000 7fd9aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:56.033 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 >> v1:10.20.193.118:6812/703720803 conn(0x7fd994040940 legacy=0x7fd994060df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 10 monclient: shutdown 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 >> v1:10.20.193.106:6790/0 conn(0x7fd9c813ec40 legacy=0x7fd9c819d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 shutdown_connections 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 >> 10.20.193.106:0/118621231 conn(0x7fd9c80915f0 msgr2=0x7fd9c805d090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 shutdown_connections 2026-02-17T05:42:56.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.031+0000 7fd9ccd0c640 1 -- 10.20.193.106:0/118621231 wait complete. 2026-02-17T05:42:56.042 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:42:56.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:42:56.042 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: get_monmap_and_config 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: monmap: 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:56.108521+0000 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:56.108521+0000 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.109 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:56.110 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 1 Processor -- start 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 1 -- start start 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: init 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-c con 0x7f158c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-b con 0x7f158c05dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-a con 0x7f158c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c08b060 con 0x7f158c182720 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c05dc90 con 0x7f158c05d1b0 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c08d6a0 con 0x7f158c05dee0 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1593e12640 10 monclient(hunting): authenticate will time out at 1504.736898s 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1591386640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f158c05dee0 0x7f158c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46784/0 (socket says 10.20.193.106:46784) 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.107+0000 7f1591386640 1 -- 10.20.193.106:0/2206984805 learned_addr learned my addr 10.20.193.106:0/2206984805 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035660702 0 0) 0x7f158c08d6a0 con 0x7f158c05dee0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): my global_id is 5216 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15740035e0 con 0x7f158c05dee0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106854181 0 0) 0x7f158c08b060 con 0x7f158c182720 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient(hunting): my global_id is 124191 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c08d6a0 con 0x7f158c182720 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 64005810 0 0) 0x7f15740035e0 con 0x7f158c05dee0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 >> v1:10.20.193.118:6789/0 conn(0x7f158c05d1b0 legacy=0x7f158c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 >> v1:10.20.193.106:6789/0 conn(0x7f158c182720 legacy=0x7f158c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 monclient: found mon.noname-b 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c057960 con 0x7f158c05dee0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1580002dd0 con 0x7f158c05dee0 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: dump: 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 5 monclient: authenticate success, global_id 5216 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1580003090 con 0x7f158c05dee0 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 1 -- 10.20.193.106:0/2206984805 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f15800034a0 con 0x7f158c05dee0 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1590b85640 10 monclient: dump: 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 4 set_mon_vals no callback set 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 10 monclient: shutdown 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 1 -- 10.20.193.106:0/2206984805 >> v1:10.20.193.106:6790/0 conn(0x7f158c05dee0 legacy=0x7f158c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 1 -- 10.20.193.106:0/2206984805 shutdown_connections 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 1 -- 10.20.193.106:0/2206984805 >> 10.20.193.106:0/2206984805 conn(0x7f158c0915f0 msgr2=0x7f158c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 1 -- 10.20.193.106:0/2206984805 shutdown_connections 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.108+0000 7f1593e12640 1 -- 10.20.193.106:0/2206984805 wait complete. 2026-02-17T05:42:56.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient: monmap: 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 1 Processor -- start 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 1 -- start start 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient: init 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-c con 0x7f158c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-a con 0x7f158c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient(hunting): picked mon.noname-b con 0x7f158c182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c13f5e0 con 0x7f158c05dee0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c12bd60 con 0x7f158c182720 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c129090 con 0x7f158c05d1b0 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1593e12640 10 monclient(hunting): authenticate will time out at 1504.738664s 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1591386640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f158c05dee0 0x7f158c128980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43420/0 (socket says 10.20.193.106:43420) 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1591b87640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f158c05d1b0 0x7f158c128270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46796/0 (socket says 10.20.193.106:46796) 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f1591386640 1 -- 10.20.193.106:0/799573282 learned_addr learned my addr 10.20.193.106:0/799573282 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360161045 0 0) 0x7f158c13f5e0 con 0x7f158c05dee0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): my global_id is 124194 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f155c0035e0 con 0x7f158c05dee0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995771686 0 0) 0x7f158c129090 con 0x7f158c05d1b0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 10 monclient(hunting): my global_id is 5219 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.109+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c13f5e0 con 0x7f158c05d1b0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3706745555 0 0) 0x7f155c0035e0 con 0x7f158c05dee0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f158c129090 con 0x7f158c05dee0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f15800033b0 con 0x7f158c05dee0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): dump: 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.120 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4290465573 0 0) 0x7f158c13f5e0 con 0x7f158c05d1b0 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f155c0035e0 con 0x7f158c05d1b0 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f157c003f70 con 0x7f158c05d1b0 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient(hunting): dump: 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.121 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2346667082 0 0) 0x7f158c129090 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6790/0 conn(0x7f158c05d1b0 legacy=0x7f158c128270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.118:6789/0 conn(0x7f158c182720 legacy=0x7f158c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 monclient: found mon.a 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c05e8e0 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 5 monclient: authenticate success, global_id 124194 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 10 monclient: _renew_subs 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f158c12b1d0 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 10 monclient: _renew_subs 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f158c12ba80 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15800028b0 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1580004e60 con 0x7f158c05dee0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 10 monclient: dump: 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157bfff640 4 set_mon_vals no callback set 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f158c057ca0 con 0x7f158c12aa70 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.110+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1580011e00 con 0x7f158c05dee0 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(774..774 src has 522..774) ==== 4007+0+0 (unknown 3158963191 0 0) 0x7f158004fef0 con 0x7f158c05dee0 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049657024 0 0) 0x7f158c057ca0 con 0x7f158c12aa70 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient(hunting): my global_id is 124197 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c129090 con 0x7f158c12aa70 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f1592388640 10 monclient: get_auth_request con 0x7f155c040bf0 auth_method 0 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1499434618 0 0) 0x7f158c129090 con 0x7f158c12aa70 2026-02-17T05:42:56.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f158c057ca0 con 0x7f158c12aa70 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f157c004540 con 0x7f158c12aa70 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient: dump: 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2213869500 0 0) 0x7f158c057ca0 con 0x7f158c12aa70 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f158c12c100 con 0x7f158c12aa70 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f157c0069b0 con 0x7f158c12aa70 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6789/0 conn(0x7f158c12aa70 legacy=0x7f158c058c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.111+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6789/0 conn(0x7f158c12aa70 legacy=0x7f158c058c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.114+0000 7f1593e12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f158c08e3d0 con 0x7f158c059360 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643837409 0 0) 0x7f158c08e3d0 con 0x7f158c059360 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient(hunting): my global_id is 124200 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c057ca0 con 0x7f158c059360 2026-02-17T05:42:56.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 353473097 0 0) 0x7f158c057ca0 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f158c08e3d0 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f157c002eb0 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient: dump: 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1271534813 0 0) 0x7f158c08e3d0 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f158c08e560 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4347 (unknown 0 0 2111148969) 0x7f157c006bd0 con 0x7f158c059360 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6789/0 conn(0x7f158c059360 legacy=0x7f158c1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f157a7fc640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6789/0 conn(0x7f158c059360 legacy=0x7f158c1973c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 107280, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.127 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.128 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.129 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:56.130 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.131 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:56.132 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.118:6812/703720803 conn(0x7f155c040bf0 legacy=0x7f155c0610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 10 monclient: shutdown 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 >> v1:10.20.193.106:6789/0 conn(0x7f158c05dee0 legacy=0x7f158c128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1592388640 1 -- 10.20.193.106:0/799573282 reap_dead start 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1592388640 1 -- 10.20.193.106:0/799573282 reap_dead start 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 shutdown_connections 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.115+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 >> 10.20.193.106:0/799573282 conn(0x7f158c0915f0 msgr2=0x7f158c0885f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.116+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 shutdown_connections 2026-02-17T05:42:56.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.116+0000 7f1593e12640 1 -- 10.20.193.106:0/799573282 wait complete. 2026-02-17T05:42:56.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:56.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:42:56.134 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 10 monclient: get_monmap_and_config 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 10 monclient: monmap: 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:56.196868+0000 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:56.196868+0000 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:56.197 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 1 Processor -- start 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 1 -- start start 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.195+0000 7fb15c6b8640 10 monclient: init 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-b con 0x7fb15405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-a con 0x7fb15405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-c con 0x7fb154182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15408b060 con 0x7fb15405dee0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15405dc90 con 0x7fb154182720 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15408d6a0 con 0x7fb15405d1b0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient(hunting): authenticate will time out at 1504.825221s 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15a42d640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb15405d1b0 0x7fb15405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46806/0 (socket says 10.20.193.106:46806) 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15a42d640 1 -- 10.20.193.106:0/350771869 learned_addr learned my addr 10.20.193.106:0/350771869 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371773616 0 0) 0x7fb15408b060 con 0x7fb15405dee0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): my global_id is 124203 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb13c0035e0 con 0x7fb15405dee0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755418394 0 0) 0x7fb15408d6a0 con 0x7fb15405d1b0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient(hunting): my global_id is 5222 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15408b060 con 0x7fb15405d1b0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 313970029 0 0) 0x7fb15408b060 con 0x7fb15405d1b0 2026-02-17T05:42:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 >> v1:10.20.193.118:6789/0 conn(0x7fb154182720 legacy=0x7fb1541a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 >> v1:10.20.193.106:6789/0 conn(0x7fb15405dee0 legacy=0x7fb154181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 monclient: found mon.noname-b 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb154057960 con 0x7fb15405d1b0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb144002d00 con 0x7fb15405d1b0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: dump: 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 5 monclient: authenticate success, global_id 5222 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb144002e90 con 0x7fb15405d1b0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 1 -- 10.20.193.106:0/350771869 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb1440032a0 con 0x7fb15405d1b0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15c6b8640 4 set_mon_vals no callback set 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.196+0000 7fb15942b640 10 monclient: dump: 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.200 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 10 monclient: shutdown 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- 10.20.193.106:0/350771869 >> v1:10.20.193.106:6790/0 conn(0x7fb15405d1b0 legacy=0x7fb15405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- 10.20.193.106:0/350771869 shutdown_connections 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- 10.20.193.106:0/350771869 >> 10.20.193.106:0/350771869 conn(0x7fb1540915f0 msgr2=0x7fb1540919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- 10.20.193.106:0/350771869 shutdown_connections 2026-02-17T05:42:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- 10.20.193.106:0/350771869 wait complete. 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 10 monclient: monmap: 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 Processor -- start 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 1 -- start start 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.197+0000 7fb15c6b8640 10 monclient: init 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-c con 0x7fb15405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-a con 0x7fb15405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient(hunting): picked mon.noname-b con 0x7fb154182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154128d00 con 0x7fb15405dee0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15405e950 con 0x7fb154182720 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15410cc00 con 0x7fb15405d1b0 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient(hunting): authenticate will time out at 1504.827184s 2026-02-17T05:42:56.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15a42d640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb15405d1b0 0x7fb15412b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46818/0 (socket says 10.20.193.106:46818) 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15a42d640 1 -- 10.20.193.106:0/1104288662 learned_addr learned my addr 10.20.193.106:0/1104288662 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431954758 0 0) 0x7fb154128d00 con 0x7fb15405dee0 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): my global_id is 124206 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1240035e0 con 0x7fb15405dee0 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3210854564 0 0) 0x7fb15410cc00 con 0x7fb15405d1b0 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): my global_id is 5225 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb154128d00 con 0x7fb15405d1b0 2026-02-17T05:42:56.204 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3544090371 0 0) 0x7fb1240035e0 con 0x7fb15405dee0 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb15410cc00 con 0x7fb15405dee0 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb148002870 con 0x7fb15405dee0 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): dump: 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.205 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 155095357 0 0) 0x7fb154128d00 con 0x7fb15405d1b0 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1240035e0 con 0x7fb15405d1b0 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb1440031b0 con 0x7fb15405d1b0 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient(hunting): dump: 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.206 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1728078706 0 0) 0x7fb15410cc00 con 0x7fb15405dee0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6790/0 conn(0x7fb15405d1b0 legacy=0x7fb15412b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.118:6789/0 conn(0x7fb154182720 legacy=0x7fb154181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 monclient: found mon.a 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15412c120 con 0x7fb15405dee0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 5 monclient: authenticate success, global_id 124206 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _renew_subs 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb15410a8a0 con 0x7fb15405dee0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _renew_subs 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb15410c360 con 0x7fb15405dee0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1480029d0 con 0x7fb15405dee0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb148003230 con 0x7fb15405dee0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb13affd640 10 monclient: dump: 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.208 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.198+0000 7fb158c2a640 4 set_mon_vals no callback set 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb15c6b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1540008d0 con 0x7fb154128240 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236975266 0 0) 0x7fb1540008d0 con 0x7fb154128240 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient(hunting): my global_id is 5228 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15410cc00 con 0x7fb154128240 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb148003410 con 0x7fb15405dee0 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(774..774 src has 522..774) ==== 4007+0+0 (unknown 3158963191 0 0) 0x7fb14804ebc0 con 0x7fb15405dee0 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 722336349 0 0) 0x7fb15410cc00 con 0x7fb154128240 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1540008d0 con 0x7fb154128240 2026-02-17T05:42:56.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb1440028f0 con 0x7fb154128240 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient: dump: 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1781748529 0 0) 0x7fb1540008d0 con 0x7fb154128240 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb154057ca0 con 0x7fb154128240 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb15ac2e640 10 monclient: get_auth_request con 0x7fb124040950 auth_method 0 2026-02-17T05:42:56.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb144004f20 con 0x7fb154128240 2026-02-17T05:42:56.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:56.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6790/0 conn(0x7fb154128240 legacy=0x7fb154059e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.199+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6790/0 conn(0x7fb154128240 legacy=0x7fb154059e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb15410b6f0 con 0x7fb154109dc0 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528542711 0 0) 0x7fb15410b6f0 con 0x7fb154109dc0 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.212 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient(hunting): my global_id is 5231 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1540008d0 con 0x7fb154109dc0 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3445923282 0 0) 0x7fb1540008d0 con 0x7fb154109dc0 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb15410b6f0 con 0x7fb154109dc0 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb1440056a0 con 0x7fb154109dc0 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient: dump: 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.213 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2202388642 0 0) 0x7fb15410b6f0 con 0x7fb154109dc0 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb154059b90 con 0x7fb154109dc0 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 3428782921) 0x7fb144006b40 con 0x7fb154109dc0 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6790/0 conn(0x7fb154109dc0 legacy=0x7fb154059480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb13affd640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6790/0 conn(0x7fb154109dc0 legacy=0x7fb154059480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:56.214 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 900965, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.215 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.216 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:56.217 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.218 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:56.219 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:56.220 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:56.221 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:56.222 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.223 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:56.224 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.118:6812/703720803 conn(0x7fb124040950 legacy=0x7fb124060e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 10 monclient: shutdown 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 >> v1:10.20.193.106:6789/0 conn(0x7fb15405dee0 legacy=0x7fb15412ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15ac2e640 1 -- 10.20.193.106:0/1104288662 reap_dead start 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 shutdown_connections 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 >> 10.20.193.106:0/1104288662 conn(0x7fb1540915f0 msgr2=0x7fb1541a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 shutdown_connections 2026-02-17T05:42:56.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.203+0000 7fb15c6b8640 1 -- 10.20.193.106:0/1104288662 wait complete. 2026-02-17T05:42:56.226 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:56.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:42:56.226 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.288+0000 7fcd9a0cc640 10 monclient: get_monmap_and_config 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.288+0000 7fcd9a0cc640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.288+0000 7fcd9a0cc640 10 monclient: monmap: 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:56.290180+0000 2026-02-17T05:42:56.291 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:56.290180+0000 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 1 Processor -- start 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 1 -- start start 2026-02-17T05:42:56.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient: init 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-c con 0x7fcd9405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-b con 0x7fcd9405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-a con 0x7fcd94182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9408b060 con 0x7fcd94182720 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9405dc90 con 0x7fcd9405d1b0 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9408d6a0 con 0x7fcd9405dee0 2026-02-17T05:42:56.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd9a0cc640 10 monclient(hunting): authenticate will time out at 1504.918528s 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd92ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fcd9405dee0 0x7fcd94181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46860/0 (socket says 10.20.193.106:46860) 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd92ffd640 1 -- 10.20.193.106:0/4279482513 learned_addr learned my addr 10.20.193.106:0/4279482513 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd93fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fcd94182720 0x7fcd941a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43470/0 (socket says 10.20.193.106:43470) 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893993353 0 0) 0x7fcd9408d6a0 con 0x7fcd9405dee0 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): my global_id is 5234 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd780035e0 con 0x7fcd9405dee0 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009267306 0 0) 0x7fcd9408b060 con 0x7fcd94182720 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient(hunting): my global_id is 124209 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd9408d6a0 con 0x7fcd94182720 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814716674 0 0) 0x7fcd780035e0 con 0x7fcd9405dee0 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 >> v1:10.20.193.118:6789/0 conn(0x7fcd9405d1b0 legacy=0x7fcd9405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 >> v1:10.20.193.106:6789/0 conn(0x7fcd94182720 legacy=0x7fcd941a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 monclient: found mon.noname-b 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd94057960 con 0x7fcd9405dee0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd84002dd0 con 0x7fcd9405dee0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.289+0000 7fcd927fc640 10 monclient: dump: 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.299 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 5 monclient: authenticate success, global_id 5234 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd84003010 con 0x7fcd9405dee0 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 4 set_mon_vals no callback set 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 1 -- 10.20.193.106:0/4279482513 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd84003420 con 0x7fcd9405dee0 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd927fc640 10 monclient: dump: 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.300 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 10 monclient: shutdown 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/4279482513 >> v1:10.20.193.106:6790/0 conn(0x7fcd9405dee0 legacy=0x7fcd94181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/4279482513 shutdown_connections 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/4279482513 >> 10.20.193.106:0/4279482513 conn(0x7fcd940915f0 msgr2=0x7fcd940919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/4279482513 shutdown_connections 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/4279482513 wait complete. 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 10 monclient: monmap: 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.301 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 Processor -- start 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 1 -- start start 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.290+0000 7fcd9a0cc640 10 monclient: init 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-a con 0x7fcd9405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-b con 0x7fcd9405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient(hunting): picked mon.noname-c con 0x7fcd94182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9410c710 con 0x7fcd9405d1b0 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9410ccd0 con 0x7fcd9405dee0 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9412c1f0 con 0x7fcd94182720 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient(hunting): authenticate will time out at 1504.920244s 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd937fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fcd9405d1b0 0x7fcd9412b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43472/0 (socket says 10.20.193.106:43472) 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd937fe640 1 -- 10.20.193.106:0/3809932816 learned_addr learned my addr 10.20.193.106:0/3809932816 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.302 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124461123 0 0) 0x7fcd9412c1f0 con 0x7fcd94182720 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): my global_id is 5237 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd640035e0 con 0x7fcd94182720 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482786289 0 0) 0x7fcd9410c710 con 0x7fcd9405d1b0 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): my global_id is 124212 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd9412c1f0 con 0x7fcd9405d1b0 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3326367525 0 0) 0x7fcd640035e0 con 0x7fcd94182720 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd9410c710 con 0x7fcd94182720 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd88004170 con 0x7fcd94182720 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): dump: 2026-02-17T05:42:56.303 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3732280596 0 0) 0x7fcd9412c1f0 con 0x7fcd9405d1b0 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd640035e0 con 0x7fcd9405d1b0 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd80003170 con 0x7fcd9405d1b0 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient(hunting): dump: 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.304 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3515856896 0 0) 0x7fcd640035e0 con 0x7fcd9405d1b0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.106:6790/0 conn(0x7fcd94182720 legacy=0x7fcd94181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6789/0 conn(0x7fcd9405dee0 legacy=0x7fcd9412bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 monclient: found mon.a 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9410be60 con 0x7fcd9405d1b0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 5 monclient: authenticate success, global_id 124212 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _renew_subs 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9410a9d0 con 0x7fcd9405d1b0 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _renew_subs 2026-02-17T05:42:56.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd9410b670 con 0x7fcd9405d1b0 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd80003450 con 0x7fcd9405d1b0 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd80003b30 con 0x7fcd9405d1b0 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd6ffff640 10 monclient: dump: 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.291+0000 7fcd91ffb640 4 set_mon_vals no callback set 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.292+0000 7fcd9a0cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.292+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd940008d0 con 0x7fcd94128310 2026-02-17T05:42:56.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.292+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fcd80003c90 con 0x7fcd9405d1b0 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.292+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(774..774 src has 522..774) ==== 4007+0+0 (unknown 3158963191 0 0) 0x7fcd8004fe30 con 0x7fcd9405d1b0 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.292+0000 7fcd93fff640 10 monclient: get_auth_request con 0x7fcd64040be0 auth_method 0 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329146598 0 0) 0x7fcd940008d0 con 0x7fcd94128310 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient(hunting): my global_id is 134110 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd640035e0 con 0x7fcd94128310 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3173945671 0 0) 0x7fcd640035e0 con 0x7fcd94128310 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd940008d0 con 0x7fcd94128310 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd84002850 con 0x7fcd94128310 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient: dump: 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.307 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3515635691 0 0) 0x7fcd940008d0 con 0x7fcd94128310 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd94057d00 con 0x7fcd94128310 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fcd84002ab0 con 0x7fcd94128310 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6789/0 conn(0x7fcd94128310 legacy=0x7fcd9405a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.308 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.293+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6789/0 conn(0x7fcd94128310 legacy=0x7fcd9405a010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd9a0cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd941286e0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777628168 0 0) 0x7fcd941286e0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient(hunting): my global_id is 134113 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd940008d0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3694774849 0 0) 0x7fcd940008d0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd941286e0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fcd84004bb0 con 0x7fcd94109f30 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 10 monclient: dump: 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.309 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2076566041 0 0) 0x7fcd941286e0 con 0x7fcd94109f30 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.297+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd9404d910 con 0x7fcd94109f30 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 212309395) 0x7fcd84004f70 con 0x7fcd94109f30 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd6ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd6ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6789/0 conn(0x7fcd94109f30 legacy=0x7fcd9404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd6ffff640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6789/0 conn(0x7fcd94109f30 legacy=0x7fcd9404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:42:56.310 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 440, 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.311 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:56.312 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.313 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:56.314 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:56.315 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:56.316 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.118:6812/703720803 conn(0x7fcd64040be0 legacy=0x7fcd64061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 10 monclient: shutdown 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 >> v1:10.20.193.106:6789/0 conn(0x7fcd9405d1b0 legacy=0x7fcd9412b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd93fff640 1 -- 10.20.193.106:0/3809932816 reap_dead start 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd93fff640 1 -- 10.20.193.106:0/3809932816 reap_dead start 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 shutdown_connections 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 >> 10.20.193.106:0/3809932816 conn(0x7fcd940915f0 msgr2=0x7fcd9408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 shutdown_connections 2026-02-17T05:42:56.317 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.298+0000 7fcd9a0cc640 1 -- 10.20.193.106:0/3809932816 wait complete. 2026-02-17T05:42:56.318 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:56.318 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:42:56.318 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:42:56.374 INFO:tasks.rados.rados.0.trial118.stdout:3489: done (1 left) 2026-02-17T05:42:56.374 INFO:tasks.rados.rados.0.trial118.stdout:3490: write oid 36 current snap is 383 2026-02-17T05:42:56.374 INFO:tasks.rados.rados.0.trial118.stdout:3490: seq_num 1212 ranges {770084=501915,2023470=346614} 2026-02-17T05:42:56.378 INFO:tasks.rados.rados.0.trial118.stdout:3490: writing trial11845692-36 from 770084 to 1271999 tid 1 2026-02-17T05:42:56.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.380+0000 7f344d1b9640 10 monclient: get_monmap_and_config 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.380+0000 7f344d1b9640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.380+0000 7f344d1b9640 10 monclient: monmap: 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:56.382101+0000 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:56.382101+0000 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:56.383 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3490: writing trial11845692-36 from 2023470 to 2370084 tid 2 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3491: rollback oid 48 current snap is 383 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 371 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3488: finishing copy_from racing read to trial11845692-40 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3488: finishing copy_from to trial11845692-40 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1709 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3490: finishing write tid 1 to trial11845692-36 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3488: done (2 left) 2026-02-17T05:42:56.385 INFO:tasks.rados.rados.0.trial118.stdout:3492: snap_create 2026-02-17T05:42:56.389 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 1 Processor -- start 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 1 -- start start 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient: init 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-b con 0x7f344813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-c con 0x7f344813f010 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-a con 0x7f34481811f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344808a7d0 con 0x7f34481811f0 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344808d5c0 con 0x7f344813f010 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344808d800 con 0x7f344813ec40 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f344d1b9640 10 monclient(hunting): authenticate will time out at 1505.010727s 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3446d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f344813ec40 0x7f344808ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46878/0 (socket says 10.20.193.106:46878) 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3446d76640 1 -- 10.20.193.106:0/1449760411 learned_addr learned my addr 10.20.193.106:0/1449760411 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124218469 0 0) 0x7f344808a7d0 con 0x7f34481811f0 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.390 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): my global_id is 124215 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3434005870 con 0x7f34481811f0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087696337 0 0) 0x7f344808d800 con 0x7f344813ec40 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.381+0000 7f3445d74640 10 monclient(hunting): my global_id is 5240 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f344808a7d0 con 0x7f344813ec40 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2791898691 0 0) 0x7f3434005870 con 0x7f34481811f0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 >> v1:10.20.193.106:6790/0 conn(0x7f344813ec40 legacy=0x7f344808ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 >> v1:10.20.193.118:6789/0 conn(0x7f344813f010 legacy=0x7f344813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 monclient: found mon.noname-a 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344808a180 con 0x7f34481811f0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.391 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3438003eb0 con 0x7f34481811f0 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 5 monclient: authenticate success, global_id 124215 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: dump: 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34380040f0 con 0x7f34481811f0 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 1 -- 10.20.193.106:0/1449760411 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3438004500 con 0x7f34481811f0 2026-02-17T05:42:56.392 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 4 set_mon_vals no callback set 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f3445d74640 10 monclient: dump: 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 10 monclient: shutdown 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 1 -- 10.20.193.106:0/1449760411 >> v1:10.20.193.106:6789/0 conn(0x7f34481811f0 legacy=0x7f34481a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 1 -- 10.20.193.106:0/1449760411 shutdown_connections 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 1 -- 10.20.193.106:0/1449760411 >> 10.20.193.106:0/1449760411 conn(0x7f34480915f0 msgr2=0x7f34480919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.393 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 1 -- 10.20.193.106:0/1449760411 shutdown_connections 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.382+0000 7f344d1b9640 1 -- 10.20.193.106:0/1449760411 wait complete. 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient: build_initial_monmap 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient: monmap: 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 1 Processor -- start 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 1 -- start start 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient: init 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-c con 0x7f344813ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:56.394 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-a con 0x7f344813f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient(hunting): picked mon.noname-b con 0x7f34481811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344812c810 con 0x7f344813f010 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344813d220 con 0x7f34481811f0 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34481294e0 con 0x7f344813ec40 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f344d1b9640 10 monclient(hunting): authenticate will time out at 1505.012723s 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f3446d76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f344813ec40 0x7f34481286c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46884/0 (socket says 10.20.193.106:46884) 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f3446d76640 1 -- 10.20.193.106:0/3177630089 learned_addr learned my addr 10.20.193.106:0/3177630089 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46312869 0 0) 0x7f344812c810 con 0x7f344813f010 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): my global_id is 124218 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34140035e0 con 0x7f344813f010 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123476596 0 0) 0x7f34481294e0 con 0x7f344813ec40 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _negotiate 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 10 monclient(hunting): my global_id is 5243 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.383+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f344812c810 con 0x7f344813ec40 2026-02-17T05:42:56.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3583106663 0 0) 0x7f34140035e0 con 0x7f344813f010 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34481294e0 con 0x7f344813f010 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3430003070 con 0x7f344813f010 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): dump: 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 771678169 0 0) 0x7f344812c810 con 0x7f344813ec40 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34140035e0 con 0x7f344813ec40 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f343c003090 con 0x7f344813ec40 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:56.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient(hunting): dump: 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3607028213 0 0) 0x7f34481294e0 con 0x7f344813f010 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 >> v1:10.20.193.106:6790/0 conn(0x7f344813ec40 legacy=0x7f34481286c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 >> v1:10.20.193.118:6789/0 conn(0x7f34481811f0 legacy=0x7f34481702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: _finish_hunting 0 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 monclient: found mon.a 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344812b580 con 0x7f344813f010 2026-02-17T05:42:56.397 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: _finish_auth 0 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: _check_auth_tickets 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 5 monclient: authenticate success, global_id 124218 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _renew_subs 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f344812a090 con 0x7f344813f010 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _renew_subs 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f344812c4a0 con 0x7f344813f010 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3430003240 con 0x7f344813f010 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3430003900 con 0x7f344813f010 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 10 monclient: dump: 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:56.398 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f3444d72640 4 set_mon_vals no callback set 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344813ce60 con 0x7f344813f010 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.384+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3430003a60 con 0x7f344813f010 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.385+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(775..775 src has 522..775) ==== 3959+0+0 (unknown 4142836072 0 0) 0x7f343004ec00 con 0x7f344813f010 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.385+0000 7f3446d76640 10 monclient: get_auth_request con 0x7f3414040c30 auth_method 0 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.387+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f3430016250 con 0x7f344813f010 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.387+0000 7f34277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:56.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.387+0000 7f34277fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: finishing write tid 2 to trial11845692-36 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: finishing write tid 3 to trial11845692-36 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: finishing write tid 4 to trial11845692-36 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: oid 36 updating version 0 to 1876 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: oid 36 updating version 1876 to 1877 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: oid 36 version 1877 is already newer than 1873 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1877 (ObjNum 1212 snap 383 seq_num 1212) dirty exists 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3490: left oid 36 (ObjNum 1212 snap 383 seq_num 1212) 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3491: finishing rollback tid 0 to trial11845692-48 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3491: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:3491: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:42:56.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1881 (ObjNum 1019 snap 309 seq_num 1019) dirty exists 2026-02-17T05:42:56.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.536+0000 7f344d1b9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:42:56.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.536+0000 7f344d1b9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:42:56.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.536+0000 7f344d1b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:56.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.536+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3448055570 con 0x7f344813f010 2026-02-17T05:42:56.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.537+0000 7f34277fe640 1 -- 10.20.193.106:0/3177630089 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f3430015a00 con 0x7f344813f010 2026-02-17T05:42:56.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.537+0000 7f34277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.537+0000 7f34277fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=22,config=2,health=13,kv=10,logm=53} crc {auth=2416150376,config=1618278320,health=138231836,kv=3912199512,logm=59423755}) 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=13,kv=11,logm=52} crc {auth=3856775949,config=1618278320,health=138231836,kv=675723720,logm=3354070975}) 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=22,config=2,health=13,kv=10,logm=53} crc {auth=2416150376,config=1618278320,health=138231836,kv=3912199512,logm=59423755}) 2026-02-17T05:42:56.539 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.537+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=22,config=2,health=11,kv=9,logm=56} crc {auth=3792099393,config=1618278320,health=2714443347,kv=989699136,logm=152774676}) 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 >> v1:10.20.193.118:6812/703720803 conn(0x7f3414040c30 legacy=0x7f34140610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 10 monclient: shutdown 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 >> v1:10.20.193.106:6789/0 conn(0x7f344813f010 legacy=0x7f3448128dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 shutdown_connections 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 >> 10.20.193.106:0/3177630089 conn(0x7f34480915f0 msgr2=0x7f3448054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:56.540 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 shutdown_connections 2026-02-17T05:42:56.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1537751200}) 2026-02-17T05:42:56.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2888333462}) 2026-02-17T05:42:56.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:56.538+0000 7f344d1b9640 1 -- 10.20.193.106:0/3177630089 wait complete. 2026-02-17T05:42:56.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1537751200}) 2026-02-17T05:42:56.541 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1805963394}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517491310}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3048240593}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517491310}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.538+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3840720315}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1121923897}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3640312963}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1121923897}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2499754923}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3592586021}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1292241211}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3592586021}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.539+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4052498974}) 2026-02-17T05:42:56.542 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=945734950}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2889136293}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=945734950}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4113803583}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=791375570}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3278095385}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=791375570}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.540+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=963082370}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=506411724}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957747371}) 2026-02-17T05:42:56.543 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=506411724}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3521739636}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1259515337}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227657608}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1259515337}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.541+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=65736059}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1909149343}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3348288021}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1909149343}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3945223964}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3792405943}) 2026-02-17T05:42:56.544 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939598790}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3792405943}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.542+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3003043455}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1029302624}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2226902693}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1029302624}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2756397667}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=329760762}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3821939382}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=329760762}) 2026-02-17T05:42:56.545 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.543+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=66136383}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357888567}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1284968811}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357888567}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=509776838}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4090451163}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668354998}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4090451163}) 2026-02-17T05:42:56.546 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1105230448}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4083870326}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812997186}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4083870326}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.544+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2490534595}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=34797554}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2969790952}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=34797554}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=419699215}) 2026-02-17T05:42:56.547 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.548 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3547751323}) 2026-02-17T05:42:56.548 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871030565}) 2026-02-17T05:42:56.548 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.548 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3547751323}) 2026-02-17T05:42:56.548 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.545+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2337286441}) 2026-02-17T05:42:56.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3111246461}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3745266830}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3111246461}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3749605750}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1210146548}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3077800041}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1210146548}) 2026-02-17T05:42:56.549 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.546+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3918517855}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1802150332}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235100281}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1802150332}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1359577169}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=972839693}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911219637}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=972839693}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.547+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3367443741}) 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.550 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4051719808}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2019425573}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4051719808}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3135819570}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3947743933}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2032467716}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3947743933}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.548+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=455690607}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=736933294}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241382505}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=736933294}) 2026-02-17T05:42:56.551 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1531788202}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2968712998}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1254082669}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2968712998}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.549+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2492334400}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1598006912}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3741909310}) 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.552 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1598006912}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.550+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=441990300}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2701079368}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=88727096}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2701079368}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3949379247}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1095126690}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=785628075}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1095126690}) 2026-02-17T05:42:56.553 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.551+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3500212912}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2444141397}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795151024}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2444141397}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2474156111}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=309902352}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387035167}) 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.554 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=309902352}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.552+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3514794114}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3554516411}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=207635438}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3554516411}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3370817348}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=23} crc {logm=2443834044,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=3657651285,mon_config_key=2145285359,monmap=1228700967,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4015664669,osd_snap=703839535}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=35,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=24} crc {logm=2264015180,mdsmap=568353036,mgr=3510968629,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=715516171,mon_config_key=3856452920,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4015664669,osd_snap=4124508540}) 2026-02-17T05:42:56.555 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=23} crc {logm=2443834044,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=3657651285,mon_config_key=2145285359,monmap=1228700967,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4015664669,osd_snap=703839535}) 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.553+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=38,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=19} crc {logm=1446068214,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857887,mgrstat=715516171,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=4015664669,osd_snap=3024014593}) 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=85,osdmap=15} crc {osd_snap=1712255898,osdmap=1374857343}) 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=82,osdmap=18} crc {osd_snap=2906045650,osdmap=1808861833}) 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=85,osdmap=15} crc {osd_snap=1712255898,osdmap=1374857343}) 2026-02-17T05:42:56.556 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=85,osdmap=15} crc {osd_snap=2947696453,osdmap=1431710031}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=748612219}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=669421422}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=748612219}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.554+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=235120737}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1794833646}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1415712784}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1794833646}) 2026-02-17T05:42:56.557 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2280183742}) 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.555+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2665492174}) 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.556+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=257152286}) 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.556+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.556+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2665492174}) 2026-02-17T05:42:56.558 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.556+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2125856758}) 2026-02-17T05:42:56.559 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.559 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=67} crc {osdmap=2153804163}) 2026-02-17T05:42:56.559 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=68} crc {osdmap=1338223662}) 2026-02-17T05:42:56.559 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:42:56.560 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=67} crc {osdmap=2153804163}) 2026-02-17T05:42:56.560 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:42:56.557+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=65} crc {osdmap=810616913}) 2026-02-17T05:42:57.381 INFO:tasks.rados.rados.0.trial118.stdout:3490: done (2 left) 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:3491: done (1 left) 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:3492: done (0 left) 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:3493: rollback oid 2 current snap is 384 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 2 to 377 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:3494: write (excl) oid 15 current snap is 384 2026-02-17T05:42:57.382 INFO:tasks.rados.rados.0.trial118.stdout:3494: seq_num 1213 ranges {786891=577164,2081952=304939} 2026-02-17T05:42:57.387 INFO:tasks.rados.rados.0.trial118.stdout:3494: writing trial11845692-15 from 786891 to 1364055 tid 1 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:3494: writing trial11845692-15 from 2081952 to 2386891 tid 2 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:3495: delete oid 30 current snap is 384 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:3493: finishing rollback tid 0 to trial11845692-2 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:3493: finishing rollback tid 1 to trial11845692-2 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:3493: finishing rollback tid 2 to trial11845692-2 2026-02-17T05:42:57.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2286 (ObjNum 1192 snap 375 seq_num 1192) dirty exists 2026-02-17T05:42:57.393 INFO:tasks.rados.rados.0.trial118.stdout:3493: done (2 left) 2026-02-17T05:42:57.394 INFO:tasks.rados.rados.0.trial118.stdout:3495: done (1 left) 2026-02-17T05:42:57.394 INFO:tasks.rados.rados.0.trial118.stdout:3496: rollback oid 1 current snap is 384 2026-02-17T05:42:57.394 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 1 to 378 2026-02-17T05:42:57.394 INFO:tasks.rados.rados.0.trial118.stdout:3497: snap_create 2026-02-17T05:42:57.394 INFO:tasks.rados.rados.0.trial118.stdout:3494: finishing write tid 1 to trial11845692-15 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: finishing write tid 2 to trial11845692-15 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: finishing write tid 3 to trial11845692-15 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: finishing write tid 4 to trial11845692-15 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: oid 15 updating version 0 to 1883 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: oid 15 updating version 1883 to 1884 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: oid 15 updating version 1884 to 1885 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1885 (ObjNum 1213 snap 384 seq_num 1213) dirty exists 2026-02-17T05:42:57.395 INFO:tasks.rados.rados.0.trial118.stdout:3494: left oid 15 (ObjNum 1213 snap 384 seq_num 1213) 2026-02-17T05:42:57.396 INFO:tasks.rados.rados.0.trial118.stdout:3496: finishing rollback tid 0 to trial11845692-1 2026-02-17T05:42:57.396 INFO:tasks.rados.rados.0.trial118.stdout:3496: finishing rollback tid 1 to trial11845692-1 2026-02-17T05:42:57.396 INFO:tasks.rados.rados.0.trial118.stdout:3496: finishing rollback tid 2 to trial11845692-1 2026-02-17T05:42:57.396 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 2205 (ObjNum 1191 snap 375 seq_num 1191) dirty exists 2026-02-17T05:42:57.549 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:42:57.550 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:42:57.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.611+0000 7f7cb848c640 10 monclient: get_monmap_and_config 2026-02-17T05:42:57.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.611+0000 7f7cb848c640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.611+0000 7f7cb848c640 10 monclient: monmap: 2026-02-17T05:42:57.621 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.621 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:57.613085+0000 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:57.613085+0000 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 1 Processor -- start 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 1 -- start start 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient: init 2026-02-17T05:42:57.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb008b060 con 0x7f7cb005dee0 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb005dc90 con 0x7f7cb005d1b0 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb008d6a0 con 0x7f7cb0182720 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb848c640 10 monclient(hunting): authenticate will time out at 1506.241530s 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb5a00640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f7cb005dee0 0x7f7cb0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43490/0 (socket says 10.20.193.106:43490) 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb5a00640 1 -- 10.20.193.106:0/1774236882 learned_addr learned my addr 10.20.193.106:0/1774236882 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb6a02640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7cb0182720 0x7f7cb01a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46892/0 (socket says 10.20.193.106:46892) 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648775212 0 0) 0x7f7cb008d6a0 con 0x7f7cb0182720 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): my global_id is 5246 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c980035e0 con 0x7f7cb0182720 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800976236 0 0) 0x7f7cb008b060 con 0x7f7cb005dee0 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 10 monclient(hunting): my global_id is 124221 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.612+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb008d6a0 con 0x7f7cb005dee0 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1873415758 0 0) 0x7f7c980035e0 con 0x7f7cb0182720 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 >> v1:10.20.193.118:6789/0 conn(0x7f7cb005d1b0 legacy=0x7f7cb005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 >> v1:10.20.193.106:6789/0 conn(0x7f7cb005dee0 legacy=0x7f7cb0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 monclient: found mon.noname-b 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0057960 con 0x7f7cb0182720 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cac003eb0 con 0x7f7cb0182720 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: dump: 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.626 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 5 monclient: authenticate success, global_id 5246 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cac004130 con 0x7f7cb0182720 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 1 -- 10.20.193.106:0/1774236882 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7cac004540 con 0x7f7cb0182720 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb51ff640 10 monclient: dump: 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.627 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 4 set_mon_vals no callback set 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 10 monclient: shutdown 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 1 -- 10.20.193.106:0/1774236882 >> v1:10.20.193.106:6790/0 conn(0x7f7cb0182720 legacy=0x7f7cb01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 1 -- 10.20.193.106:0/1774236882 shutdown_connections 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 1 -- 10.20.193.106:0/1774236882 >> 10.20.193.106:0/1774236882 conn(0x7f7cb00915f0 msgr2=0x7f7cb00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 1 -- 10.20.193.106:0/1774236882 shutdown_connections 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 1 -- 10.20.193.106:0/1774236882 wait complete. 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.613+0000 7f7cb848c640 10 monclient: monmap: 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.629 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 Processor -- start 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- start start 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: init 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb0182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb010e480 con 0x7f7cb005d1b0 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb012b370 con 0x7f7cb0182720 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb005e8e0 con 0x7f7cb005dee0 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient(hunting): authenticate will time out at 1506.243368s 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb5a00640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f7cb005dee0 0x7f7cb0180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46900/0 (socket says 10.20.193.106:46900) 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb5a00640 1 -- 10.20.193.106:0/634466838 learned_addr learned my addr 10.20.193.106:0/634466838 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb6201640 1 --1- 10.20.193.106:0/634466838 >> v1:10.20.193.106:6789/0 conn(0x7f7cb005d1b0 0x7f7cb013ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43492/0 (socket says 10.20.193.106:43492) 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260968922 0 0) 0x7f7cb005e8e0 con 0x7f7cb005dee0 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 5249 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c800035e0 con 0x7f7cb005dee0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602914968 0 0) 0x7f7cb010e480 con 0x7f7cb005d1b0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 124224 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb005e8e0 con 0x7f7cb005d1b0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2573758207 0 0) 0x7f7c800035e0 con 0x7f7cb005dee0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cb010e480 con 0x7f7cb005dee0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7ca4003170 con 0x7f7cb005dee0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.632 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): dump: 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.633 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3986429472 0 0) 0x7f7cb005e8e0 con 0x7f7cb005d1b0 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c800035e0 con 0x7f7cb005d1b0 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7ca0003020 con 0x7f7cb005d1b0 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient(hunting): dump: 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.634 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 223647627 0 0) 0x7f7cb010e480 con 0x7f7cb005dee0 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 >> v1:10.20.193.118:6789/0 conn(0x7f7cb0182720 legacy=0x7f7cb01198b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 >> v1:10.20.193.106:6789/0 conn(0x7f7cb005d1b0 legacy=0x7f7cb013ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 monclient: found mon.c 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb010cf90 con 0x7f7cb005dee0 2026-02-17T05:42:57.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7c96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 5 monclient: authenticate success, global_id 5249 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _renew_subs 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01824f0 con 0x7f7cb005dee0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _renew_subs 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.614+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cb013d520 con 0x7f7cb005dee0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ca4002da0 con 0x7f7cb005dee0 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f7ca4004a50 con 0x7f7cb005dee0 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 10 monclient: dump: 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.637 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb49fe640 4 set_mon_vals no callback set 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb848c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb848c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb848c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb013f5c0 con 0x7f7cb005dee0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f7ca4004bb0 con 0x7f7cb005dee0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f7ca404fdb0 con 0x7f7cb005dee0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.615+0000 7f7cb6201640 10 monclient: get_auth_request con 0x7f7c80040ac0 auth_method 0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.617+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f7ca4004e90 con 0x7f7cb005dee0 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.617+0000 7f7c96ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.617+0000 7f7c96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:57.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7cb848c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:42:57.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7cb848c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:42:57.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7cb848c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7cb013f8a0 con 0x7f7cb005dee0 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7c96ffd640 1 -- 10.20.193.106:0/634466838 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2992041359) 0x7f7ca4016bf0 con 0x7f7cb005dee0 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7c96ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.763+0000 7f7c96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 >> v1:10.20.193.118:6812/703720803 conn(0x7f7c80040ac0 legacy=0x7f7c80060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 10 monclient: shutdown 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 >> v1:10.20.193.106:6790/0 conn(0x7f7cb005dee0 legacy=0x7f7cb0180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 shutdown_connections 2026-02-17T05:42:57.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 >> 10.20.193.106:0/634466838 conn(0x7f7cb00915f0 msgr2=0x7f7cb0088680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 shutdown_connections 2026-02-17T05:42:57.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.764+0000 7f7cb848c640 1 -- 10.20.193.106:0/634466838 wait complete. 2026-02-17T05:42:57.774 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:42:57.774 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:42:57.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:42:57.774 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 10 monclient: get_monmap_and_config 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 10 monclient: monmap: 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.840 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:57.839778+0000 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:57.839778+0000 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:57.841 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 1 Processor -- start 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 1 -- start start 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.838+0000 7f10b610c640 10 monclient: init 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-b con 0x7f10b005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-c con 0x7f10b005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-a con 0x7f10b0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b008b060 con 0x7f10b0182720 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b005dc90 con 0x7f10b005dee0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b008d6a0 con 0x7f10b005d1b0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient(hunting): authenticate will time out at 1506.468157s 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10affff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f10b0182720 0x7f10b01a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43498/0 (socket says 10.20.193.106:43498) 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10affff640 1 -- 10.20.193.106:0/3637598615 learned_addr learned my addr 10.20.193.106:0/3637598615 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10af7fe640 1 --1- 10.20.193.106:0/3637598615 >> v1:10.20.193.106:6790/0 conn(0x7f10b005d1b0 0x7f10b005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46910/0 (socket says 10.20.193.106:46910) 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343455900 0 0) 0x7f10b008b060 con 0x7f10b0182720 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): my global_id is 124227 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10940035e0 con 0x7f10b0182720 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010307713 0 0) 0x7f10b008d6a0 con 0x7f10b005d1b0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): my global_id is 5252 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b008b060 con 0x7f10b005d1b0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2037843010 0 0) 0x7f10b005dc90 con 0x7f10b005dee0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient(hunting): my global_id is 134125 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b008d6a0 con 0x7f10b005dee0 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751051971 0 0) 0x7f10940035e0 con 0x7f10b0182720 2026-02-17T05:42:57.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 >> v1:10.20.193.106:6790/0 conn(0x7f10b005d1b0 legacy=0x7f10b005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 >> v1:10.20.193.118:6789/0 conn(0x7f10b005dee0 legacy=0x7f10b0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 monclient: found mon.noname-a 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b0057960 con 0x7f10b0182720 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 5 monclient: authenticate success, global_id 124227 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f10a4003eb0 con 0x7f10b0182720 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: dump: 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10a4004080 con 0x7f10b0182720 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 1 -- 10.20.193.106:0/3637598615 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f10a4004490 con 0x7f10b0182720 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10ae7fc640 10 monclient: dump: 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.846 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.839+0000 7f10b610c640 4 set_mon_vals no callback set 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: shutdown 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- 10.20.193.106:0/3637598615 >> v1:10.20.193.106:6789/0 conn(0x7f10b0182720 legacy=0x7f10b01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- 10.20.193.106:0/3637598615 shutdown_connections 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- 10.20.193.106:0/3637598615 >> 10.20.193.106:0/3637598615 conn(0x7f10b00915f0 msgr2=0x7f10b00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- 10.20.193.106:0/3637598615 shutdown_connections 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- 10.20.193.106:0/3637598615 wait complete. 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: monmap: 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 Processor -- start 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 1 -- start start 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: init 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-c con 0x7f10b005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-b con 0x7f10b005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.840+0000 7f10b610c640 10 monclient(hunting): picked mon.noname-a con 0x7f10b0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b010e0a0 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b012e3f0 con 0x7f10b005dee0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b012af90 con 0x7f10b005d1b0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient(hunting): authenticate will time out at 1506.470009s 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10affff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f10b0182720 0x7f10b0181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43510/0 (socket says 10.20.193.106:43510) 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10affff640 1 -- 10.20.193.106:0/2130456227 learned_addr learned my addr 10.20.193.106:0/2130456227 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207611342 0 0) 0x7f10b010e0a0 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): my global_id is 124230 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10800035e0 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647039253 0 0) 0x7f10b012af90 con 0x7f10b005d1b0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): my global_id is 5255 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b010e0a0 con 0x7f10b005d1b0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3902362614 0 0) 0x7f10800035e0 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10b012af90 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f10a40043a0 con 0x7f10b0182720 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): dump: 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1369236632 0 0) 0x7f10b010e0a0 con 0x7f10b005d1b0 2026-02-17T05:42:57.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10800035e0 con 0x7f10b005d1b0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f109c0028f0 con 0x7f10b005d1b0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient(hunting): dump: 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3100627668 0 0) 0x7f10b012af90 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6790/0 conn(0x7f10b005d1b0 legacy=0x7f10b012d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.118:6789/0 conn(0x7f10b005dee0 legacy=0x7f10b012dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 monclient: found mon.a 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b005e8e0 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 5 monclient: authenticate success, global_id 124230 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient: _renew_subs 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f10b008a000 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient: _renew_subs 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f10b010ef10 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10a40039f0 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f10a4005de0 con 0x7f10b0182720 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10adffb640 4 set_mon_vals no callback set 2026-02-17T05:42:57.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f108bfff640 10 monclient: dump: 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.841+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10b010eb70 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f10a4012d80 con 0x7f10b0182720 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f10a4050f30 con 0x7f10b0182720 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418702494 0 0) 0x7f10800035e0 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient(hunting): my global_id is 124233 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b012af90 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 235267102 0 0) 0x7f10b012af90 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10800035e0 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f109c002e30 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f10aeffd640 10 monclient: get_auth_request con 0x7f1080040bb0 auth_method 0 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient: dump: 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 845800566 0 0) 0x7f10800035e0 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10b0057ca0 con 0x7f10b010d710 2026-02-17T05:42:57.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f109c006a70 con 0x7f10b010d710 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6789/0 conn(0x7f10b010d710 legacy=0x7f10b0059f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.842+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6789/0 conn(0x7f10b010d710 legacy=0x7f10b0059f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.845+0000 7f10b610c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.845+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10b010dae0 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964178535 0 0) 0x7f10b010dae0 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient(hunting): my global_id is 124236 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10800035e0 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2796575964 0 0) 0x7f10800035e0 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10b010dae0 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f109c005120 con 0x7f10b012a550 2026-02-17T05:42:57.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient: dump: 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3027083676 0 0) 0x7f10b010dae0 con 0x7f10b012a550 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10b012a920 con 0x7f10b012a550 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4347 (unknown 0 0 2345926578) 0x7f109c006600 con 0x7f10b012a550 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6789/0 conn(0x7f10b012a550 legacy=0x7f10b004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f108bfff640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6789/0 conn(0x7f10b012a550 legacy=0x7f10b004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 109011, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 1, 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:57.852 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:57.853 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:57.854 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.855 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "num": 3 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:57.856 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.118:6812/703720803 conn(0x7f1080040bb0 legacy=0x7f1080061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 10 monclient: shutdown 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 >> v1:10.20.193.106:6789/0 conn(0x7f10b0182720 legacy=0x7f10b0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10affff640 1 -- 10.20.193.106:0/2130456227 reap_dead start 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10affff640 1 -- 10.20.193.106:0/2130456227 reap_dead start 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 shutdown_connections 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 >> 10.20.193.106:0/2130456227 conn(0x7f10b00915f0 msgr2=0x7f10b008b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 shutdown_connections 2026-02-17T05:42:57.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.846+0000 7f10b610c640 1 -- 10.20.193.106:0/2130456227 wait complete. 2026-02-17T05:42:57.857 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:57.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:42:57.857 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: get_monmap_and_config 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: monmap: 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:57.922527+0000 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:57.922527+0000 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:57.923 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 1 Processor -- start 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 1 -- start start 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: init 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-b con 0x7f05c405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-c con 0x7f05c405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.925 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-a con 0x7f05c4182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c408b060 con 0x7f05c4182720 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c405dc90 con 0x7f05c405dee0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c408d6a0 con 0x7f05c405d1b0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05cb9f6640 10 monclient(hunting): authenticate will time out at 1506.550914s 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05c976b640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f05c405d1b0 0x7f05c405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46934/0 (socket says 10.20.193.106:46934) 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.921+0000 7f05c976b640 1 -- 10.20.193.106:0/2773972885 learned_addr learned my addr 10.20.193.106:0/2773972885 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223850307 0 0) 0x7f05c408d6a0 con 0x7f05c405d1b0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): my global_id is 5258 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05ac0035e0 con 0x7f05c405d1b0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940760960 0 0) 0x7f05c408b060 con 0x7f05c4182720 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): my global_id is 124239 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c408d6a0 con 0x7f05c4182720 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304780463 0 0) 0x7f05c405dc90 con 0x7f05c405dee0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient(hunting): my global_id is 134131 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c408b060 con 0x7f05c405dee0 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 250807763 0 0) 0x7f05c408d6a0 con 0x7f05c4182720 2026-02-17T05:42:57.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 >> v1:10.20.193.106:6790/0 conn(0x7f05c405d1b0 legacy=0x7f05c405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 >> v1:10.20.193.118:6789/0 conn(0x7f05c405dee0 legacy=0x7f05c4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 monclient: found mon.noname-a 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c4057960 con 0x7f05c4182720 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05c0003eb0 con 0x7f05c4182720 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 5 monclient: authenticate success, global_id 124239 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: dump: 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05c0004080 con 0x7f05c4182720 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 1 -- 10.20.193.106:0/2773972885 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05c0004490 con 0x7f05c4182720 2026-02-17T05:42:57.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 4 set_mon_vals no callback set 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05b3fff640 10 monclient: dump: 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 10 monclient: shutdown 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 1 -- 10.20.193.106:0/2773972885 >> v1:10.20.193.106:6789/0 conn(0x7f05c4182720 legacy=0x7f05c41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 1 -- 10.20.193.106:0/2773972885 shutdown_connections 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.922+0000 7f05cb9f6640 1 -- 10.20.193.106:0/2773972885 >> 10.20.193.106:0/2773972885 conn(0x7f05c40915f0 msgr2=0x7f05c40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 1 -- 10.20.193.106:0/2773972885 shutdown_connections 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 1 -- 10.20.193.106:0/2773972885 wait complete. 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient: build_initial_monmap 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient: monmap: 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:57.928 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 1 Processor -- start 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 1 -- start start 2026-02-17T05:42:57.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient: init 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.923+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-c con 0x7f05c405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-a con 0x7f05c405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient(hunting): picked mon.noname-b con 0x7f05c4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c410ee90 con 0x7f05c405dee0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c412adc0 con 0x7f05c4182720 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c410d810 con 0x7f05c405d1b0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient(hunting): authenticate will time out at 1506.553036s 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05c976b640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f05c405d1b0 0x7f05c4129fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46948/0 (socket says 10.20.193.106:46948) 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05c976b640 1 -- 10.20.193.106:0/422261915 learned_addr learned my addr 10.20.193.106:0/422261915 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949868694 0 0) 0x7f05c410ee90 con 0x7f05c405dee0 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 124242 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05940035e0 con 0x7f05c405dee0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134635547 0 0) 0x7f05c410d810 con 0x7f05c405d1b0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 5261 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c410ee90 con 0x7f05c405d1b0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662870065 0 0) 0x7f05c412adc0 con 0x7f05c4182720 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 134134 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c410d810 con 0x7f05c4182720 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1210810907 0 0) 0x7f05940035e0 con 0x7f05c405dee0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c412adc0 con 0x7f05c405dee0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05b8003110 con 0x7f05c405dee0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): dump: 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.932 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2208975957 0 0) 0x7f05c410ee90 con 0x7f05c405d1b0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05940035e0 con 0x7f05c405d1b0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05b40031f0 con 0x7f05c405d1b0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): dump: 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1951243918 0 0) 0x7f05c410d810 con 0x7f05c4182720 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c410ee90 con 0x7f05c4182720 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05c00043a0 con 0x7f05c4182720 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient(hunting): dump: 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.933 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1021513264 0 0) 0x7f05c412adc0 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6790/0 conn(0x7f05c405d1b0 legacy=0x7f05c4129fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.118:6789/0 conn(0x7f05c4182720 legacy=0x7f05c4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 monclient: found mon.a 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c413f500 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: _finish_auth 0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 5 monclient: authenticate success, global_id 124242 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient: _renew_subs 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05c405e8e0 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient: _renew_subs 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05c410ebb0 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b8003520 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05b80038b0 con 0x7f05c405dee0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b1ffb640 10 monclient: dump: 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.934 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.924+0000 7f05b37fe640 4 set_mon_vals no callback set 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05cb9f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f05c410da40 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f05b8003a10 con 0x7f05c405dee0 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f05b804ea20 con 0x7f05c405dee0 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261375821 0 0) 0x7f05c410da40 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 5264 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c412adc0 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05c9f6c640 10 monclient: get_auth_request con 0x7f0594041010 auth_method 0 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 996920835 0 0) 0x7f05c412adc0 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c410da40 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05b4004a50 con 0x7f05c4089830 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 10 monclient: dump: 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.935 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2631444425 0 0) 0x7f05c410da40 con 0x7f05c4089830 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.925+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05c4057ca0 con 0x7f05c4089830 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.926+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f05b4007a20 con 0x7f05c4089830 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.926+0000 7f05b1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.926+0000 7f05b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.926+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6790/0 conn(0x7f05c4089830 legacy=0x7f05c4059df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.926+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6790/0 conn(0x7f05c4089830 legacy=0x7f05c4059df0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05cb9f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f05c412d910 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493070541 0 0) 0x7f05c412d910 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 5267 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c410da40 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3824514495 0 0) 0x7f05c410da40 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c412d910 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f05b4005490 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.929+0000 7f05b1ffb640 10 monclient: dump: 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2753374971 0 0) 0x7f05c412d910 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f05c4055570 con 0x7f05c412d540 2026-02-17T05:42:57.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 1728700234) 0x7f05b40055f0 con 0x7f05c412d540 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6790/0 conn(0x7f05c412d540 legacy=0x7f05c4059430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05b1ffb640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6790/0 conn(0x7f05c412d540 legacy=0x7f05c4059430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 902692, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.938 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:57.939 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:57.940 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.941 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:57.942 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:57.943 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.118:6812/703720803 conn(0x7f0594041010 legacy=0x7f05940614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 10 monclient: shutdown 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 >> v1:10.20.193.106:6789/0 conn(0x7f05c405dee0 legacy=0x7f05c412a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05c9f6c640 1 -- 10.20.193.106:0/422261915 reap_dead start 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 shutdown_connections 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 >> 10.20.193.106:0/422261915 conn(0x7f05c40915f0 msgr2=0x7f05c41a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 shutdown_connections 2026-02-17T05:42:57.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:57.930+0000 7f05cb9f6640 1 -- 10.20.193.106:0/422261915 wait complete. 2026-02-17T05:42:57.945 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:57.945 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:42:57.945 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:42:58.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.007+0000 7f378bf0c640 10 monclient: get_monmap_and_config 2026-02-17T05:42:58.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.007+0000 7f378bf0c640 10 monclient: build_initial_monmap 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.007+0000 7f378bf0c640 10 monclient: monmap: 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:42:58.009176+0000 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:42:58.009176+0000 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:42:58.010 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 1 Processor -- start 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 1 -- start start 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient: init 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f378405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f378405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f3784182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378408b060 con 0x7f378405dee0 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378405dc90 con 0x7f3784182720 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378408d6a0 con 0x7f378405d1b0 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:58.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 10 monclient(hunting): authenticate will time out at 1506.637531s 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3789480640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f378405dee0 0x7f3784181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:43552/0 (socket says 10.20.193.106:43552) 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3789480640 1 -- 10.20.193.106:0/371510377 learned_addr learned my addr 10.20.193.106:0/371510377 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3789c81640 1 --1- 10.20.193.106:0/371510377 >> v1:10.20.193.106:6790/0 conn(0x7f378405d1b0 0x7f378405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46972/0 (socket says 10.20.193.106:46972) 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181520148 0 0) 0x7f378408b060 con 0x7f378405dee0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): my global_id is 124245 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f376c0035e0 con 0x7f378405dee0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053903310 0 0) 0x7f378408d6a0 con 0x7f378405d1b0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient(hunting): my global_id is 5270 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f378408b060 con 0x7f378405d1b0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2287158474 0 0) 0x7f376c0035e0 con 0x7f378405dee0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 >> v1:10.20.193.106:6790/0 conn(0x7f378405d1b0 legacy=0x7f378405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 >> v1:10.20.193.118:6789/0 conn(0x7f3784182720 legacy=0x7f37841a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: _finish_hunting 0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 monclient: found mon.noname-a 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784057960 con 0x7f378405dee0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: _finish_auth 0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: _check_auth_tickets 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 5 monclient: authenticate success, global_id 124245 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3778002dd0 con 0x7f378405dee0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f3788c7f640 10 monclient: dump: 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.012 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.008+0000 7f378bf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3778003010 con 0x7f378405dee0 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 1 -- 10.20.193.106:0/371510377 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3778003420 con 0x7f378405dee0 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 4 set_mon_vals no callback set 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f3788c7f640 10 monclient: dump: 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 10 monclient: shutdown 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- 10.20.193.106:0/371510377 >> v1:10.20.193.106:6789/0 conn(0x7f378405dee0 legacy=0x7f3784181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- 10.20.193.106:0/371510377 shutdown_connections 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- 10.20.193.106:0/371510377 >> 10.20.193.106:0/371510377 conn(0x7f37840915f0 msgr2=0x7f37840919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- 10.20.193.106:0/371510377 shutdown_connections 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- 10.20.193.106:0/371510377 wait complete. 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 10 monclient: build_initial_monmap 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 10 monclient: monmap: 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:42:58.013 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:42:58.014 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 Processor -- start 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 1 -- start start 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.009+0000 7f378bf0c640 10 monclient: init 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f378405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f378405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3784182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378412ab90 con 0x7f378405dee0 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378405ce60 con 0x7f3784182720 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378405e8e0 con 0x7f378405d1b0 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient(hunting): authenticate will time out at 1506.639116s 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f3789c81640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f378405d1b0 0x7f37841a33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46980/0 (socket says 10.20.193.106:46980) 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f3789c81640 1 -- 10.20.193.106:0/620653006 learned_addr learned my addr 10.20.193.106:0/620653006 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:42:58.015 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949036775 0 0) 0x7f3784057960 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): my global_id is 124248 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37540035e0 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939256112 0 0) 0x7f378405e8e0 con 0x7f378405d1b0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): my global_id is 5273 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3784057960 con 0x7f378405d1b0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 836162836 0 0) 0x7f37540035e0 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f378405e8e0 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3778002ce0 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): dump: 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847660173 0 0) 0x7f378405ce60 con 0x7f3784182720 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient(hunting): my global_id is 134140 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37540035e0 con 0x7f3784182720 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3323856407 0 0) 0x7f378405e8e0 con 0x7f378405dee0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.106:6790/0 conn(0x7f378405d1b0 legacy=0x7f37841a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6789/0 conn(0x7f3784182720 legacy=0x7f3784181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: _finish_hunting 0 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 monclient: found mon.a 2026-02-17T05:42:58.016 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784129f20 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: _finish_auth 0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: _check_auth_tickets 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 5 monclient: authenticate success, global_id 124248 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _renew_subs 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37841824f0 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _renew_subs 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f378412c330 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3778004b50 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3778002eb0 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f3773fff640 4 set_mon_vals no callback set 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.010+0000 7f37727fc640 10 monclient: dump: 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f378bf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f378413d920 con 0x7f3784129500 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3778011cb0 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f377804fcc0 con 0x7f378405dee0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f378a482640 10 monclient: get_auth_request con 0x7f3754040a80 auth_method 0 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387551813 0 0) 0x7f3784057960 con 0x7f3784129500 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 10 monclient(hunting): my global_id is 134143 2026-02-17T05:42:58.017 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.011+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f378405e8e0 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3891348972 0 0) 0x7f378405e8e0 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3784057960 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3774003100 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 10 monclient: dump: 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3706456678 0 0) 0x7f3784057960 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3784057cd0 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f37740058d0 con 0x7f3784129500 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6789/0 conn(0x7f3784129500 legacy=0x7f3784089600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.018 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.012+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6789/0 conn(0x7f3784129500 legacy=0x7f3784089600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.015+0000 7f378bf0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.015+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f37841298d0 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615765351 0 0) 0x7f37841298d0 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient(hunting): _negotiate 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient(hunting): my global_id is 134146 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3784057960 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2592453576 0 0) 0x7f3784057960 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f37841298d0 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3774004cf0 con 0x7f3784089d10 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:42:58.019 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient: dump: 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 690777725 0 0) 0x7f37841298d0 con 0x7f3784089d10 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3784055570 con 0x7f3784089d10 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4512 (unknown 0 0 3140637017) 0x7f3774005a40 con 0x7f3784089d10 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6789/0 conn(0x7f3784089d10 legacy=0x7f37841307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.016+0000 7f37727fc640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6789/0 conn(0x7f3784089d10 legacy=0x7f37841307e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:58.020 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 50, 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 2159, 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:58.021 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:42:58.022 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:42:58.023 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.024 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:58.025 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.118:6812/703720803 conn(0x7f3754040a80 legacy=0x7f3754060f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 10 monclient: shutdown 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 >> v1:10.20.193.106:6789/0 conn(0x7f378405dee0 legacy=0x7f37841a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378a482640 1 -- 10.20.193.106:0/620653006 reap_dead start 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378a482640 1 -- 10.20.193.106:0/620653006 reap_dead start 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 shutdown_connections 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 >> 10.20.193.106:0/620653006 conn(0x7f37840915f0 msgr2=0x7f378405c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 shutdown_connections 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:42:58.017+0000 7f378bf0c640 1 -- 10.20.193.106:0/620653006 wait complete. 2026-02-17T05:42:58.027 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:42:58.027 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:42:58.027 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-17T05:42:58.027 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:42:58.027 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:42:58.027 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:42:58.027 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:42:58.035 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:42:58.035 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-17T05:42:58.035 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T05:42:58.035 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T05:42:58.035 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T05:43:13.036 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-17T05:43:13.036 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T05:43:13.037 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T05:43:13.037 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:43:13.037 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:43:13.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 10 monclient: get_monmap_and_config 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 10 monclient: build_initial_monmap 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 10 monclient: monmap: 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:43:13.102766+0000 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:43:13.102766+0000 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 1 Processor -- start 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 1 -- start start 2026-02-17T05:43:13.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.102+0000 7f94a0a5b640 10 monclient: init 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f949c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f949c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f949c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:13.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08b060 con 0x7f949c05d1b0 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c05dc90 con 0x7f949c05dee0 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08d6a0 con 0x7f949c182720 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f949a575640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f94a0a5b640 10 monclient(hunting): authenticate will time out at 1521.731178s 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f949ad76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f949c182720 0x7f949c1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:49384/0 (socket says 10.20.193.106:49384) 2026-02-17T05:43:13.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.103+0000 7f949ad76640 1 -- 10.20.193.106:0/2903019508 learned_addr learned my addr 10.20.193.106:0/2903019508 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:13.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.304+0000 7f949a575640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:13.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:13.706+0000 7f949a575640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:14.509 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:14.507+0000 7f949a575640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c05d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): tick 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 monclient(hunting): continuing hunt 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6790/0 conn(0x7f949c182720 legacy=0x7f949c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.118:6789/0 conn(0x7f949c05dee0 legacy=0x7f949c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c05d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:43:16.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): picked mon.noname-c con 0x7f9478003780 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): picked mon.noname-a con 0x7f949c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): picked mon.noname-b con 0x7f949c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c057960 con 0x7f949c05d1b0 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9499d74640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f9478045450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08b060 con 0x7f9478003780 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 1 -- 10.20.193.106:0/2903019508 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f947806a470 con 0x7f949c182720 2026-02-17T05:43:16.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.103+0000 7f9483fff640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:16.306 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.304+0000 7f9499d74640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f9478045450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:16.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:16.705+0000 7f9499d74640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f9478045450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:17.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:17.506+0000 7f9499d74640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f9478045450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910874728 0 0) 0x7f949c08b060 con 0x7f9478003780 2026-02-17T05:43:18.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 10 monclient(hunting): my global_id is 134149 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.045+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94880035e0 con 0x7f9478003780 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3406245556 0 0) 0x7f94880035e0 con 0x7f9478003780 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6790/0 conn(0x7f949c182720 legacy=0x7f9478066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.106:6789/0 conn(0x7f949c05d1b0 legacy=0x7f9478045450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 monclient: found mon.noname-c 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947806b6d0 con 0x7f9478003780 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9490004270 con 0x7f9478003780 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f94a0a5b640 5 monclient: authenticate success, global_id 134149 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f94a0a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: dump: 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.048 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f94a0a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9490004470 con 0x7f9478003780 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 1 -- 10.20.193.106:0/2903019508 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9490004850 con 0x7f9478003780 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f9499573640 10 monclient: dump: 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.049 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.050 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f94a0a5b640 10 monclient: get_monmap_and_config success 2026-02-17T05:43:18.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.046+0000 7f94a0a5b640 4 set_mon_vals no callback set 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 10 monclient: shutdown 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2903019508 >> v1:10.20.193.118:6789/0 conn(0x7f9478003780 legacy=0x7f9478023ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2903019508 shutdown_connections 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2903019508 >> 10.20.193.106:0/2903019508 conn(0x7f949c0915f0 msgr2=0x7f949c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2903019508 shutdown_connections 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2903019508 wait complete. 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 10 monclient: build_initial_monmap 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.047+0000 7f94a0a5b640 10 monclient: monmap: 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:43:18.053 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 1 Processor -- start 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 1 -- start start 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient: init 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f9478003780 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f949c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f949c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c05ce50 con 0x7f9478003780 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c05e8e0 con 0x7f949c05d1b0 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c12c1f0 con 0x7f949c182720 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f94a0a5b640 10 monclient(hunting): authenticate will time out at 1526.676459s 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f949a575640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f9478003780 legacy=0x7f949c13cb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f949ad76640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f949c182720 0x7f949c1728c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36724/0 (socket says 10.20.193.106:36724) 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f949ad76640 1 -- 10.20.193.106:0/2940223585 learned_addr learned my addr 10.20.193.106:0/2940223585 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278678910 0 0) 0x7f949c12c1f0 con 0x7f949c182720 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): my global_id is 5279 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94680035e0 con 0x7f949c182720 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938673909 0 0) 0x7f949c05e8e0 con 0x7f949c05d1b0 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): my global_id is 134152 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c12c1f0 con 0x7f949c05d1b0 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1040657339 0 0) 0x7f94680035e0 con 0x7f949c182720 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f949c05e8e0 con 0x7f949c182720 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f948c003f70 con 0x7f949c182720 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): dump: 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.055 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.048+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1837089207 0 0) 0x7f949c12c1f0 con 0x7f949c05d1b0 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94680035e0 con 0x7f949c05d1b0 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f9484002f90 con 0x7f949c05d1b0 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient(hunting): dump: 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2708226558 0 0) 0x7f949c05e8e0 con 0x7f949c182720 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 >> v1:10.20.193.118:6789/0 conn(0x7f949c05d1b0 legacy=0x7f949c1711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 >> v1:10.20.193.106:6789/0 conn(0x7f9478003780 legacy=0x7f949c13cb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 monclient: found mon.c 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c12e550 con 0x7f949c182720 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 5 monclient: authenticate success, global_id 5279 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _renew_subs 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f949c12dcb0 con 0x7f949c182720 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _renew_subs 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f949c13d260 con 0x7f949c182720 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f948c0045b0 con 0x7f949c182720 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f948c005b30 con 0x7f949c182720 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9498d72640 4 set_mon_vals no callback set 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 10 monclient: dump: 2026-02-17T05:43:18.057 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f949c0008d0 con 0x7f949c182720 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.049+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f948c005c90 con 0x7f949c182720 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.050+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f948c050da0 con 0x7f949c182720 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.050+0000 7f949a575640 10 monclient: get_auth_request con 0x7f9468040b60 auth_method 0 2026-02-17T05:43:18.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.052+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f948c005f70 con 0x7f949c182720 2026-02-17T05:43:18.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.052+0000 7f9482ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.052+0000 7f9482ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:43:18.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.204+0000 7f94a0a5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:43:18.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.204+0000 7f94a0a5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:43:18.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.204+0000 7f94a0a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.204+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f949c13d510 con 0x7f949c182720 2026-02-17T05:43:18.206 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.204+0000 7f9482ffd640 1 -- 10.20.193.106:0/2940223585 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1763596878) 0x7f948c017bc0 con 0x7f949c182720 2026-02-17T05:43:18.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.205+0000 7f9482ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:43:18.207 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.205+0000 7f9482ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:43:18.207 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":52,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:43:18.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 >> v1:10.20.193.118:6812/703720803 conn(0x7f9468040b60 legacy=0x7f9468061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 10 monclient: shutdown 2026-02-17T05:43:18.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 >> v1:10.20.193.106:6790/0 conn(0x7f949c182720 legacy=0x7f949c1728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 shutdown_connections 2026-02-17T05:43:18.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 >> 10.20.193.106:0/2940223585 conn(0x7f949c0915f0 msgr2=0x7f949c08c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 shutdown_connections 2026-02-17T05:43:18.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.206+0000 7f94a0a5b640 1 -- 10.20.193.106:0/2940223585 wait complete. 2026-02-17T05:43:18.215 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:43:18.215 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:43:18.215 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: get_monmap_and_config 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: build_initial_monmap 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: monmap: 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:43:18.279459+0000 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:43:18.279459+0000 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:43:18.280 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 1 Processor -- start 2026-02-17T05:43:18.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 1 -- start start 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: init 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-c con 0x7f128805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-a con 0x7f128805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-b con 0x7f1288182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128808b060 con 0x7f128805dee0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128805dc90 con 0x7f128805d1b0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128808d6a0 con 0x7f1288182720 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f128d50c640 10 monclient(hunting): authenticate will time out at 1526.907857s 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f12867fc640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f128805dee0 legacy=0x7f1288181000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f12877fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1288182720 0x7f12881a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36734/0 (socket says 10.20.193.106:36734) 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.279+0000 7f12877fe640 1 -- 10.20.193.106:0/1388569351 learned_addr learned my addr 10.20.193.106:0/1388569351 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134058283 0 0) 0x7f128808d6a0 con 0x7f1288182720 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): my global_id is 5282 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12740035e0 con 0x7f1288182720 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537401431 0 0) 0x7f128805dc90 con 0x7f128805d1b0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient(hunting): my global_id is 134155 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128808d6a0 con 0x7f128805d1b0 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1688880068 0 0) 0x7f12740035e0 con 0x7f1288182720 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 >> v1:10.20.193.118:6789/0 conn(0x7f128805d1b0 legacy=0x7f128805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 >> v1:10.20.193.106:6789/0 conn(0x7f128805dee0 legacy=0x7f1288181000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 monclient: found mon.noname-b 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1288057960 con 0x7f1288182720 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1278003eb0 con 0x7f1288182720 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 5 monclient: authenticate success, global_id 5282 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: dump: 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1278004170 con 0x7f1288182720 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 1 -- 10.20.193.106:0/1388569351 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1278004580 con 0x7f1288182720 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 10 monclient: get_monmap_and_config success 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 4 set_mon_vals no callback set 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f1285ffb640 10 monclient: dump: 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.283 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 10 monclient: shutdown 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 1 -- 10.20.193.106:0/1388569351 >> v1:10.20.193.106:6790/0 conn(0x7f1288182720 legacy=0x7f12881a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 1 -- 10.20.193.106:0/1388569351 shutdown_connections 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 1 -- 10.20.193.106:0/1388569351 >> 10.20.193.106:0/1388569351 conn(0x7f12880915f0 msgr2=0x7f12880919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 1 -- 10.20.193.106:0/1388569351 shutdown_connections 2026-02-17T05:43:18.284 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.280+0000 7f128d50c640 1 -- 10.20.193.106:0/1388569351 wait complete. 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient: build_initial_monmap 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient: monmap: 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 1 Processor -- start 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 1 -- start start 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient: init 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-b con 0x7f128805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-a con 0x7f128805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient(hunting): picked mon.noname-c con 0x7f1288182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128810e5f0 con 0x7f128805dee0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128805e8e0 con 0x7f128805d1b0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128812ae30 con 0x7f1288182720 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f128d50c640 10 monclient(hunting): authenticate will time out at 1526.909644s 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12867fc640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f128805dee0 legacy=0x7f128812a720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12877fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1288182720 0x7f1288181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36746/0 (socket says 10.20.193.106:36746) 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12877fe640 1 -- 10.20.193.106:0/732920153 learned_addr learned my addr 10.20.193.106:0/732920153 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105700220 0 0) 0x7f128812ae30 con 0x7f1288182720 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 10 monclient(hunting): my global_id is 5285 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12540035e0 con 0x7f1288182720 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2345602707 0 0) 0x7f12540035e0 con 0x7f1288182720 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f128812ae30 con 0x7f1288182720 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.281+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1278004490 con 0x7f1288182720 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): dump: 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693272960 0 0) 0x7f128805e8e0 con 0x7f128805d1b0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): my global_id is 134158 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12540035e0 con 0x7f128805d1b0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 431087163 0 0) 0x7f128812ae30 con 0x7f1288182720 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.118:6789/0 conn(0x7f128805d1b0 legacy=0x7f128812a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6789/0 conn(0x7f128805dee0 legacy=0x7f128812a720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 monclient: found mon.c 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128813f6c0 con 0x7f1288182720 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 5 monclient: authenticate success, global_id 5285 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 10 monclient: _renew_subs 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f128808a040 con 0x7f1288182720 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 10 monclient: _renew_subs 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f128810d370 con 0x7f1288182720 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1278003950 con 0x7f1288182720 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1278005f40 con 0x7f1288182720 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12857fa640 4 set_mon_vals no callback set 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient: dump: 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f128810eb10 con 0x7f128812dfd0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522565431 0 0) 0x7f128810eb10 con 0x7f128812dfd0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 10 monclient(hunting): my global_id is 5288 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128812ae30 con 0x7f128812dfd0 2026-02-17T05:43:18.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1278012ee0 con 0x7f1288182720 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f1278050e90 con 0x7f1288182720 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 591909643 0 0) 0x7f128812ae30 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f128810eb10 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.282+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f127c002f00 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 10 monclient: dump: 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 509298710 0 0) 0x7f128810eb10 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1288057cd0 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12867fc640 10 monclient: get_auth_request con 0x7f12540408b0 auth_method 0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f127c0044b0 con 0x7f128812dfd0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6790/0 conn(0x7f128812dfd0 legacy=0x7f1288059e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.283+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6790/0 conn(0x7f128812dfd0 legacy=0x7f1288059e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.286+0000 7f128d50c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.286+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f128812e3a0 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.286+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286838931 0 0) 0x7f128812e3a0 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient(hunting): my global_id is 5291 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128810eb10 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3864413862 0 0) 0x7f128810eb10 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f128812e3a0 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f127c003670 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient: dump: 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2745792563 0 0) 0x7f128812e3a0 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1288055570 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 583396170) 0x7f127c003ab0 con 0x7f128804d200 2026-02-17T05:43:18.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6790/0 conn(0x7f128804d200 legacy=0x7f128811b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12677fe640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6790/0 conn(0x7f128804d200 legacy=0x7f128811b450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 52, 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 923048, 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:43:18.291 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.292 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:43:18.293 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.294 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.118:6812/703720803 conn(0x7f12540408b0 legacy=0x7f1254060d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 10 monclient: shutdown 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 >> v1:10.20.193.106:6790/0 conn(0x7f1288182720 legacy=0x7f1288181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12877fe640 1 -- 10.20.193.106:0/732920153 reap_dead start 2026-02-17T05:43:18.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f12877fe640 1 -- 10.20.193.106:0/732920153 reap_dead start 2026-02-17T05:43:18.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 shutdown_connections 2026-02-17T05:43:18.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 >> 10.20.193.106:0/732920153 conn(0x7f12880915f0 msgr2=0x7f12881a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 shutdown_connections 2026-02-17T05:43:18.296 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.287+0000 7f128d50c640 1 -- 10.20.193.106:0/732920153 wait complete. 2026-02-17T05:43:18.296 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:43:18.296 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:43:18.296 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:43:18.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 10 monclient: get_monmap_and_config 2026-02-17T05:43:18.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 10 monclient: build_initial_monmap 2026-02-17T05:43:18.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 10 monclient: monmap: 2026-02-17T05:43:18.361 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:18.361 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:43:18.360805+0000 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:43:18.360805+0000 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:43:18.362 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 1 Processor -- start 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 1 -- start start 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.360+0000 7f8f4be1b640 10 monclient: init 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-c con 0x7f8f4405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-b con 0x7f8f4405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-a con 0x7f8f44182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4408b060 con 0x7f8f44182720 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4405dc90 con 0x7f8f4405d1b0 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4408d6a0 con 0x7f8f4405dee0 2026-02-17T05:43:18.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient(hunting): authenticate will time out at 1526.989246s 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4a391640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f8f44182720 legacy=0x7f8f441a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4938f640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8f4405dee0 0x7f8f44181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36790/0 (socket says 10.20.193.106:36790) 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4938f640 1 -- 10.20.193.106:0/2977869203 learned_addr learned my addr 10.20.193.106:0/2977869203 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386681369 0 0) 0x7f8f4408d6a0 con 0x7f8f4405dee0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient(hunting): my global_id is 5294 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f2c0035e0 con 0x7f8f4405dee0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1583063267 0 0) 0x7f8f2c0035e0 con 0x7f8f4405dee0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 >> v1:10.20.193.118:6789/0 conn(0x7f8f4405d1b0 legacy=0x7f8f4405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 >> v1:10.20.193.106:6789/0 conn(0x7f8f44182720 legacy=0x7f8f441a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 monclient: found mon.noname-b 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44057960 con 0x7f8f4405dee0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f38002dd0 con 0x7f8f4405dee0 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 5 monclient: authenticate success, global_id 5294 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: dump: 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f38003090 con 0x7f8f4405dee0 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 1 -- 10.20.193.106:0/2977869203 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f380034a0 con 0x7f8f4405dee0 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f48b8e640 10 monclient: dump: 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 10 monclient: get_monmap_and_config success 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.361+0000 7f8f4be1b640 4 set_mon_vals no callback set 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 10 monclient: shutdown 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2977869203 >> v1:10.20.193.106:6790/0 conn(0x7f8f4405dee0 legacy=0x7f8f44181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2977869203 shutdown_connections 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2977869203 >> 10.20.193.106:0/2977869203 conn(0x7f8f440915f0 msgr2=0x7f8f440919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2977869203 shutdown_connections 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2977869203 wait complete. 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 10 monclient: build_initial_monmap 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 10 monclient: monmap: 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 Processor -- start 2026-02-17T05:43:18.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 1 -- start start 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.362+0000 7f8f4be1b640 10 monclient: init 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-b con 0x7f8f4405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-a con 0x7f8f4405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient(hunting): picked mon.noname-c con 0x7f8f44182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4410c750 con 0x7f8f4405dee0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4413d910 con 0x7f8f4405d1b0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4405e8e0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient(hunting): authenticate will time out at 1526.991218s 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4938f640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f8f4405dee0 legacy=0x7f8f4413d200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4a391640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f8f44182720 0x7f8f44181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36798/0 (socket says 10.20.193.106:36798) 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4a391640 1 -- 10.20.193.106:0/2166826678 learned_addr learned my addr 10.20.193.106:0/2166826678 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075281083 0 0) 0x7f8f4405e8e0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): my global_id is 5297 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f140035e0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3481131001 0 0) 0x7f8f140035e0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f4405e8e0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f400051c0 con 0x7f8f44182720 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:43:18.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): dump: 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3740875314 0 0) 0x7f8f4405e8e0 con 0x7f8f44182720 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6789/0 conn(0x7f8f4405d1b0 legacy=0x7f8f4413caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.106:6789/0 conn(0x7f8f4405dee0 legacy=0x7f8f4413d200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: _finish_hunting 0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 monclient: found mon.c 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4410e160 con 0x7f8f44182720 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: _finish_auth 0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: _check_auth_tickets 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 5 monclient: authenticate success, global_id 5297 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _renew_subs 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4410cc70 con 0x7f8f44182720 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _renew_subs 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:43:18.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f4410efd0 con 0x7f8f44182720 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f40005400 con 0x7f8f44182720 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f400057e0 con 0x7f8f44182720 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f33fff640 4 set_mon_vals no callback set 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.363+0000 7f8f327fc640 10 monclient: dump: 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f4be1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8f4412aa30 con 0x7f8f4412a660 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f8f40005940 con 0x7f8f44182720 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(776..776 src has 522..776) ==== 3931+0+0 (unknown 4165991535 0 0) 0x7f8f40050d20 con 0x7f8f44182720 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240867566 0 0) 0x7f8f4412aa30 con 0x7f8f4412a660 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient(hunting): my global_id is 134167 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f4405e8e0 con 0x7f8f4412a660 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f4938f640 10 monclient: get_auth_request con 0x7f8f140405a0 auth_method 0 2026-02-17T05:43:18.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3107096044 0 0) 0x7f8f4405e8e0 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f4412aa30 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f34002e90 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.364+0000 7f8f327fc640 10 monclient: dump: 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3128711191 0 0) 0x7f8f4412aa30 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f44057cd0 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8f34003410 con 0x7f8f4412a660 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6789/0 conn(0x7f8f4412a660 legacy=0x7f8f441076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.365+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6789/0 conn(0x7f8f4412a660 legacy=0x7f8f441076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.368+0000 7f8f4be1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.368+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8f4410dba0 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492791508 0 0) 0x7f8f4410dba0 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient(hunting): _negotiate 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient(hunting): my global_id is 134170 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f4412aa30 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2751103683 0 0) 0x7f8f4412aa30 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f4410dba0 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8f34003b20 con 0x7f8f4410d7d0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 10 monclient: dump: 2026-02-17T05:43:18.374 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2891523881 0 0) 0x7f8f4410dba0 con 0x7f8f4410d7d0 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.369+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8f44055570 con 0x7f8f4410d7d0 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4502 (unknown 0 0 2543571405) 0x7f8f34003e90 con 0x7f8f4410d7d0 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6789/0 conn(0x7f8f4410d7d0 legacy=0x7f8f44107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f327fc640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6789/0 conn(0x7f8f4410d7d0 legacy=0x7f8f44107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 52, 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 22511, 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:43:18.375 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.376 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:43:18.377 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.378 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.379 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:43:18.380 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.118:6812/703720803 conn(0x7f8f140405a0 legacy=0x7f8f14060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 10 monclient: shutdown 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 >> v1:10.20.193.106:6790/0 conn(0x7f8f44182720 legacy=0x7f8f44181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4a391640 1 -- 10.20.193.106:0/2166826678 reap_dead start 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4a391640 1 -- 10.20.193.106:0/2166826678 reap_dead start 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 shutdown_connections 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 >> 10.20.193.106:0/2166826678 conn(0x7f8f440915f0 msgr2=0x7f8f440886f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 shutdown_connections 2026-02-17T05:43:18.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:43:18.370+0000 7f8f4be1b640 1 -- 10.20.193.106:0/2166826678 wait complete. 2026-02-17T05:43:18.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:43:18.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:43:19.047 INFO:tasks.rados.rados.0.trial118.stdout:3494: done (2 left) 2026-02-17T05:43:19.048 INFO:tasks.rados.rados.0.trial118.stdout:3496: done (1 left) 2026-02-17T05:43:19.048 INFO:tasks.rados.rados.0.trial118.stdout:3497: done (0 left) 2026-02-17T05:43:19.048 INFO:tasks.rados.rados.0.trial118.stdout:3498: rollback oid 9 current snap is 385 2026-02-17T05:43:19.048 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 9 to 381 2026-02-17T05:43:19.048 INFO:tasks.rados.rados.0.trial118.stdout:3499: delete oid 30 current snap is 385 2026-02-17T05:43:19.051 INFO:tasks.rados.rados.0.trial118.stdout:3499: done (1 left) 2026-02-17T05:43:19.051 INFO:tasks.rados.rados.0.trial118.stdout:3500: copy_from oid 1 from oid 34 current snap is 385 2026-02-17T05:43:19.051 INFO:tasks.rados.rados.0.trial118.stdout:3501: write (excl) oid 30 current snap is 385 2026-02-17T05:43:19.051 INFO:tasks.rados.rados.0.trial118.stdout:3501: seq_num 1216 ranges {437312=402911,1341045=696749} 2026-02-17T05:43:19.054 INFO:tasks.rados.rados.0.trial118.stdout:3501: writing trial11845692-30 from 437312 to 840223 tid 1 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3501: writing trial11845692-30 from 1341045 to 2037794 tid 2 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3498: finishing rollback tid 0 to trial11845692-9 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3498: finishing rollback tid 1 to trial11845692-9 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3498: finishing rollback tid 2 to trial11845692-9 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2150 (ObjNum 1186 snap 374 seq_num 1186) dirty exists 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3500: finishing copy_from to trial11845692-1 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3500: got expected ENOENT (src dne) 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3500: finishing copy_from racing read to trial11845692-1 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3501: finishing write tid 1 to trial11845692-30 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3502: read oid 20 snap -1 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3502: expect (ObjNum 1163 snap 363 seq_num 1163) 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3498: done (3 left) 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3500: done (2 left) 2026-02-17T05:43:19.059 INFO:tasks.rados.rados.0.trial118.stdout:3503: delete oid 13 current snap is 385 2026-02-17T05:43:19.060 INFO:tasks.rados.rados.0.trial118.stdout:3502: expect (ObjNum 1163 snap 363 seq_num 1163) 2026-02-17T05:43:19.065 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 844799 2026-02-17T05:43:19.114 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3407787 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: finishing write tid 2 to trial11845692-30 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: finishing write tid 3 to trial11845692-30 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: finishing write tid 4 to trial11845692-30 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: oid 30 updating version 0 to 2207 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: oid 30 updating version 2207 to 2208 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:3501: oid 30 updating version 2208 to 2209 2026-02-17T05:43:19.139 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2209 (ObjNum 1216 snap 385 seq_num 1216) dirty exists 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3501: left oid 30 (ObjNum 1216 snap 385 seq_num 1216) 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3501: done (2 left) 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3502: done (1 left) 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3503: done (0 left) 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3504: read oid 15 snap 348 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3504: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:43:19.140 INFO:tasks.rados.rados.0.trial118.stdout:3505: delete oid 33 current snap is 385 2026-02-17T05:43:19.141 INFO:tasks.rados.rados.0.trial118.stdout:3505: done (1 left) 2026-02-17T05:43:19.141 INFO:tasks.rados.rados.0.trial118.stdout:3506: delete oid 14 current snap is 385 2026-02-17T05:43:19.141 INFO:tasks.rados.rados.0.trial118.stdout:3506: done (1 left) 2026-02-17T05:43:19.141 INFO:tasks.rados.rados.0.trial118.stdout:3507: write (excl) oid 36 current snap is 385 2026-02-17T05:43:19.141 INFO:tasks.rados.rados.0.trial118.stdout:3507: seq_num 1220 ranges {504540=420260,1574973=704087} 2026-02-17T05:43:19.144 INFO:tasks.rados.rados.0.trial118.stdout:3507: writing trial11845692-36 from 504540 to 924800 tid 1 2026-02-17T05:43:19.149 INFO:tasks.rados.rados.0.trial118.stdout:3507: writing trial11845692-36 from 1574973 to 2279060 tid 2 2026-02-17T05:43:19.149 INFO:tasks.rados.rados.0.trial118.stdout:3508: write oid 16 current snap is 385 2026-02-17T05:43:19.149 INFO:tasks.rados.rados.0.trial118.stdout:3508: seq_num 1221 ranges {521347=495509,1633455=564098} 2026-02-17T05:43:19.153 INFO:tasks.rados.rados.0.trial118.stdout:3508: writing trial11845692-16 from 521347 to 1016856 tid 1 2026-02-17T05:43:19.157 INFO:tasks.rados.rados.0.trial118.stdout:3508: writing trial11845692-16 from 1633455 to 2197553 tid 2 2026-02-17T05:43:19.158 INFO:tasks.rados.rados.0.trial118.stdout:3509: snap_create 2026-02-17T05:43:19.158 INFO:tasks.rados.rados.0.trial118.stdout:3504: expect (ObjNum 939 snap 281 seq_num 939) 2026-02-17T05:43:19.185 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: finishing write tid 1 to trial11845692-36 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: finishing write tid 2 to trial11845692-36 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: finishing write tid 3 to trial11845692-36 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: finishing write tid 4 to trial11845692-36 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: oid 36 updating version 0 to 1889 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: oid 36 version 1889 is already newer than 1887 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:3507: oid 36 version 1889 is already newer than 1888 2026-02-17T05:43:19.233 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1889 (ObjNum 1220 snap 385 seq_num 1220) dirty exists 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3507: left oid 36 (ObjNum 1220 snap 385 seq_num 1220) 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: finishing write tid 1 to trial11845692-16 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: finishing write tid 2 to trial11845692-16 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: finishing write tid 3 to trial11845692-16 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: finishing write tid 4 to trial11845692-16 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: oid 16 updating version 0 to 2152 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: oid 16 updating version 2152 to 2154 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: oid 16 version 2154 is already newer than 2153 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 2154 (ObjNum 1221 snap 385 seq_num 1221) dirty exists 2026-02-17T05:43:19.234 INFO:tasks.rados.rados.0.trial118.stdout:3508: left oid 16 (ObjNum 1221 snap 385 seq_num 1221) 2026-02-17T05:43:20.053 INFO:tasks.rados.rados.0.trial118.stdout:3504: done (3 left) 2026-02-17T05:43:20.053 INFO:tasks.rados.rados.0.trial118.stdout:3507: done (2 left) 2026-02-17T05:43:20.053 INFO:tasks.rados.rados.0.trial118.stdout:3508: done (1 left) 2026-02-17T05:43:20.053 INFO:tasks.rados.rados.0.trial118.stdout:3509: done (0 left) 2026-02-17T05:43:20.053 INFO:tasks.rados.rados.0.trial118.stdout:3510: snap_remove snap 382 2026-02-17T05:43:20.361 INFO:tasks.rados.rados.0.trial118.stdout:3510: done (0 left) 2026-02-17T05:43:20.362 INFO:tasks.rados.rados.0.trial118.stdout:3511: delete oid 6 current snap is 386 2026-02-17T05:43:20.366 INFO:tasks.rados.rados.0.trial118.stdout:3511: done (0 left) 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3512: read oid 33 snap -1 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3512: expect deleted 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3513: read oid 29 snap -1 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3513: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3514: rollback oid 13 current snap is 386 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 372 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3515: write (excl) oid 30 current snap is 386 2026-02-17T05:43:20.367 INFO:tasks.rados.rados.0.trial118.stdout:3515: seq_num 1223 ranges {554961=646007,1750419=451414} 2026-02-17T05:43:20.371 INFO:tasks.rados.rados.0.trial118.stdout:3515: writing trial11845692-30 from 554961 to 1200968 tid 1 2026-02-17T05:43:20.375 INFO:tasks.rados.rados.0.trial118.stdout:3515: writing trial11845692-30 from 1750419 to 2201833 tid 2 2026-02-17T05:43:20.375 INFO:tasks.rados.rados.0.trial118.stdout:3516: read oid 4 snap -1 2026-02-17T05:43:20.375 INFO:tasks.rados.rados.0.trial118.stdout:3516: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:20.375 INFO:tasks.rados.rados.0.trial118.stdout:3517: snap_remove snap 371 2026-02-17T05:43:21.365 INFO:tasks.rados.rados.0.trial118.stdout:3517: done (5 left) 2026-02-17T05:43:21.365 INFO:tasks.rados.rados.0.trial118.stdout:3518: snap_create 2026-02-17T05:43:21.365 INFO:tasks.rados.rados.0.trial118.stdout:3513: expect (ObjNum 1128 snap 343 seq_num 1128) 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:3514: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:3514: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 1841 (ObjNum 1178 snap 369 seq_num 1178) dirty exists 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:3515: finishing write tid 1 to trial11845692-30 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:3515: finishing write tid 2 to trial11845692-30 2026-02-17T05:43:21.423 INFO:tasks.rados.rados.0.trial118.stdout:3515: finishing write tid 3 to trial11845692-30 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3515: finishing write tid 4 to trial11845692-30 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3515: oid 30 updating version 0 to 2218 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3515: oid 30 updating version 2218 to 2219 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3515: oid 30 updating version 2219 to 2220 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2220 (ObjNum 1223 snap 386 seq_num 1223) dirty exists 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3515: left oid 30 (ObjNum 1223 snap 386 seq_num 1223) 2026-02-17T05:43:21.424 INFO:tasks.rados.rados.0.trial118.stdout:3516: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:21.425 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 558022 2026-02-17T05:43:21.443 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 798774 2026-02-17T05:43:21.463 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2357462 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3512: done (5 left) 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3513: done (4 left) 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3514: done (3 left) 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3515: done (2 left) 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3516: done (1 left) 2026-02-17T05:43:22.368 INFO:tasks.rados.rados.0.trial118.stdout:3518: done (0 left) 2026-02-17T05:43:22.369 INFO:tasks.rados.rados.0.trial118.stdout:3519: delete oid 19 current snap is 387 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3519: done (0 left) 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3520: read oid 6 snap 368 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3520: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3521: read oid 30 snap -1 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3521: expect (ObjNum 1223 snap 386 seq_num 1223) 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3522: read oid 32 snap -1 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3522: expect (ObjNum 1138 snap 353 seq_num 1138) 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3523: copy_from oid 25 from oid 11 current snap is 387 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3524: rollback oid 42 current snap is 387 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 386 2026-02-17T05:43:22.371 INFO:tasks.rados.rados.0.trial118.stdout:3525: copy_from oid 19 from oid 41 current snap is 387 2026-02-17T05:43:22.372 INFO:tasks.rados.rados.0.trial118.stdout:3526: write oid 37 current snap is 387 2026-02-17T05:43:22.372 INFO:tasks.rados.rados.0.trial118.stdout:3526: seq_num 1225 ranges {588575=512858,1867383=455083} 2026-02-17T05:43:22.374 INFO:tasks.rados.rados.0.trial118.stdout:3526: writing trial11845692-37 from 588575 to 1101433 tid 1 2026-02-17T05:43:22.381 INFO:tasks.rados.rados.0.trial118.stdout:3526: writing trial11845692-37 from 1867383 to 2322466 tid 2 2026-02-17T05:43:22.381 INFO:tasks.rados.rados.0.trial118.stdout:3527: delete oid 35 current snap is 387 2026-02-17T05:43:22.381 INFO:tasks.rados.rados.0.trial118.stdout:3521: expect (ObjNum 1223 snap 386 seq_num 1223) 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3523: finishing copy_from to trial11845692-25 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3523: got expected ENOENT (src dne) 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3523: finishing copy_from racing read to trial11845692-25 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3524: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3524: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3524: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 1839 (ObjNum 1178 snap 369 seq_num 1178) dirty exists 2026-02-17T05:43:22.448 INFO:tasks.rados.rados.0.trial118.stdout:3520: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:43:22.450 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 803587 2026-02-17T05:43:22.478 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 816634 2026-02-17T05:43:22.487 INFO:tasks.rados.rados.0.trial118.stdout:3522: expect (ObjNum 1138 snap 353 seq_num 1138) 2026-02-17T05:43:22.487 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:22.538 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2249799 2026-02-17T05:43:22.545 INFO:tasks.rados.rados.0.trial118.stdout:3526: finishing write tid 1 to trial11845692-37 2026-02-17T05:43:22.545 INFO:tasks.rados.rados.0.trial118.stdout:3525: finishing copy_from racing read to trial11845692-19 2026-02-17T05:43:22.545 INFO:tasks.rados.rados.0.trial118.stdout:3525: finishing copy_from to trial11845692-19 2026-02-17T05:43:22.545 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2136 (ObjNum 1208 snap 381 seq_num 1208) dirty exists 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: finishing write tid 2 to trial11845692-37 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: finishing write tid 3 to trial11845692-37 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: finishing write tid 4 to trial11845692-37 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: oid 37 updating version 0 to 1569 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: oid 37 version 1569 is already newer than 1568 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: oid 37 version 1569 is already newer than 1567 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1569 (ObjNum 1225 snap 387 seq_num 1225) dirty exists 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3526: left oid 37 (ObjNum 1225 snap 387 seq_num 1225) 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3520: done (7 left) 2026-02-17T05:43:22.546 INFO:tasks.rados.rados.0.trial118.stdout:3521: done (6 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3522: done (5 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3523: done (4 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3524: done (3 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3525: done (2 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3526: done (1 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3527: done (0 left) 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3528: rollback oid 32 current snap is 387 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 363 2026-02-17T05:43:22.547 INFO:tasks.rados.rados.0.trial118.stdout:3529: delete oid 8 current snap is 387 2026-02-17T05:43:22.548 INFO:tasks.rados.rados.0.trial118.stdout:3528: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3529: done (1 left) 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3530: delete oid 39 current snap is 387 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3528: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3528: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1734 (ObjNum 1138 snap 353 seq_num 1138) dirty exists 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3528: done (1 left) 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3530: done (0 left) 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3531: read oid 45 snap -1 2026-02-17T05:43:22.549 INFO:tasks.rados.rados.0.trial118.stdout:3531: expect deleted 2026-02-17T05:43:22.550 INFO:tasks.rados.rados.0.trial118.stdout:3532: snap_create 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:3531: done (1 left) 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:3532: done (0 left) 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:3533: rollback oid 47 current snap is 388 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 385 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:3534: write (excl) oid 30 current snap is 388 2026-02-17T05:43:23.369 INFO:tasks.rados.rados.0.trial118.stdout:3534: seq_num 1229 ranges {655803=413854,1584958=462421} 2026-02-17T05:43:23.374 INFO:tasks.rados.rados.0.trial118.stdout:3534: writing trial11845692-30 from 655803 to 1069657 tid 1 2026-02-17T05:43:23.377 INFO:tasks.rados.rados.0.trial118.stdout:3534: writing trial11845692-30 from 1584958 to 2047379 tid 2 2026-02-17T05:43:23.377 INFO:tasks.rados.rados.0.trial118.stdout:3535: delete oid 39 current snap is 388 2026-02-17T05:43:23.378 INFO:tasks.rados.rados.0.trial118.stdout:3533: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:43:23.378 INFO:tasks.rados.rados.0.trial118.stdout:3533: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:43:23.378 INFO:tasks.rados.rados.0.trial118.stdout:3533: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:43:23.378 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 1842 (ObjNum 1204 snap 380 seq_num 1204) dirty exists 2026-02-17T05:43:23.378 INFO:tasks.rados.rados.0.trial118.stdout:3534: finishing write tid 1 to trial11845692-30 2026-02-17T05:43:23.379 INFO:tasks.rados.rados.0.trial118.stdout:3533: done (2 left) 2026-02-17T05:43:23.379 INFO:tasks.rados.rados.0.trial118.stdout:3535: done (1 left) 2026-02-17T05:43:23.379 INFO:tasks.rados.rados.0.trial118.stdout:3536: write (excl) oid 20 current snap is 388 2026-02-17T05:43:23.379 INFO:tasks.rados.rados.0.trial118.stdout:3536: seq_num 1231 ranges {689417=564352,1701922=466090} 2026-02-17T05:43:23.383 INFO:tasks.rados.rados.0.trial118.stdout:3536: writing trial11845692-20 from 689417 to 1253769 tid 1 2026-02-17T05:43:23.387 INFO:tasks.rados.rados.0.trial118.stdout:3536: writing trial11845692-20 from 1701922 to 2168012 tid 2 2026-02-17T05:43:23.387 INFO:tasks.rados.rados.0.trial118.stdout:3537: snap_remove snap 383 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3537: done (2 left) 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3538: rollback oid 14 current snap is 388 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 384 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: finishing write tid 2 to trial11845692-30 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: finishing write tid 3 to trial11845692-30 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: finishing write tid 4 to trial11845692-30 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: oid 30 updating version 0 to 2230 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: oid 30 version 2230 is already newer than 2229 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: oid 30 version 2230 is already newer than 2228 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2230 (ObjNum 1229 snap 388 seq_num 1229) dirty exists 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: left oid 30 (ObjNum 1229 snap 388 seq_num 1229) 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3536: finishing write tid 1 to trial11845692-20 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3536: finishing write tid 2 to trial11845692-20 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3534: done (2 left) 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3539: read oid 30 snap -1 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3539: expect (ObjNum 1229 snap 388 seq_num 1229) 2026-02-17T05:43:24.375 INFO:tasks.rados.rados.0.trial118.stdout:3540: snap_remove snap 374 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3540: done (3 left) 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3541: copy_from oid 36 from oid 17 current snap is 388 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: finishing write tid 3 to trial11845692-20 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: finishing write tid 4 to trial11845692-20 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: oid 20 updating version 0 to 2294 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: oid 20 updating version 2294 to 2296 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: oid 20 version 2296 is already newer than 2295 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2296 (ObjNum 1231 snap 388 seq_num 1231) dirty exists 2026-02-17T05:43:25.376 INFO:tasks.rados.rados.0.trial118.stdout:3536: left oid 20 (ObjNum 1231 snap 388 seq_num 1231) 2026-02-17T05:43:25.377 INFO:tasks.rados.rados.0.trial118.stdout:3538: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:43:25.377 INFO:tasks.rados.rados.0.trial118.stdout:3538: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:43:25.377 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1809 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:43:25.377 INFO:tasks.rados.rados.0.trial118.stdout:3539: expect (ObjNum 1229 snap 388 seq_num 1229) 2026-02-17T05:43:25.377 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:25.448 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:25.485 INFO:tasks.rados.rados.0.trial118.stdout:3541: finishing copy_from racing read to trial11845692-36 2026-02-17T05:43:25.485 INFO:tasks.rados.rados.0.trial118.stdout:3541: finishing copy_from to trial11845692-36 2026-02-17T05:43:25.485 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1509 (ObjNum 1203 snap 380 seq_num 1203) dirty exists 2026-02-17T05:43:25.485 INFO:tasks.rados.rados.0.trial118.stdout:3536: done (3 left) 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3538: done (2 left) 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3539: done (1 left) 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3541: done (0 left) 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3542: rollback oid 36 current snap is 388 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 366 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3543: copy_from oid 33 from oid 39 current snap is 388 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3544: delete oid 11 current snap is 388 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3543: finishing copy_from to trial11845692-33 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3543: got expected ENOENT (src dne) 2026-02-17T05:43:25.486 INFO:tasks.rados.rados.0.trial118.stdout:3543: finishing copy_from racing read to trial11845692-33 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3542: finishing rollback tid 0 to trial11845692-36 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3543: done (2 left) 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3544: done (1 left) 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3545: copy_from oid 47 from oid 9 current snap is 388 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3546: copy_from oid 48 from oid 24 current snap is 388 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3542: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 1923 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3542: done (2 left) 2026-02-17T05:43:25.488 INFO:tasks.rados.rados.0.trial118.stdout:3547: copy_from oid 42 from oid 11 current snap is 388 2026-02-17T05:43:25.489 INFO:tasks.rados.rados.0.trial118.stdout:3548: read oid 39 snap -1 2026-02-17T05:43:25.489 INFO:tasks.rados.rados.0.trial118.stdout:3548: expect deleted 2026-02-17T05:43:25.489 INFO:tasks.rados.rados.0.trial118.stdout:3549: write (excl) oid 33 current snap is 388 2026-02-17T05:43:25.489 INFO:tasks.rados.rados.0.trial118.stdout:3549: seq_num 1233 ranges {723031=431203,1818886=469759} 2026-02-17T05:43:25.490 INFO:tasks.rados.rados.0.trial118.stdout:3549: writing trial11845692-33 from 723031 to 1154234 tid 1 2026-02-17T05:43:25.495 INFO:tasks.rados.rados.0.trial118.stdout:3549: writing trial11845692-33 from 1818886 to 2288645 tid 2 2026-02-17T05:43:25.495 INFO:tasks.rados.rados.0.trial118.stdout:3550: read oid 37 snap 387 2026-02-17T05:43:25.495 INFO:tasks.rados.rados.0.trial118.stdout:3550: expect (ObjNum 1225 snap 387 seq_num 1225) 2026-02-17T05:43:25.495 INFO:tasks.rados.rados.0.trial118.stdout:3551: write oid 41 current snap is 388 2026-02-17T05:43:25.495 INFO:tasks.rados.rados.0.trial118.stdout:3551: seq_num 1234 ranges {739838=506452,1877368=613417} 2026-02-17T05:43:25.500 INFO:tasks.rados.rados.0.trial118.stdout:3551: writing trial11845692-41 from 739838 to 1246290 tid 1 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:3551: writing trial11845692-41 from 1877368 to 2490785 tid 2 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:3552: rollback oid 35 current snap is 388 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 381 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:3547: finishing copy_from to trial11845692-42 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:3547: got expected ENOENT (src dne) 2026-02-17T05:43:25.505 INFO:tasks.rados.rados.0.trial118.stdout:3547: finishing copy_from racing read to trial11845692-42 2026-02-17T05:43:25.506 INFO:tasks.rados.rados.0.trial118.stdout:3546: finishing copy_from racing read to trial11845692-48 2026-02-17T05:43:25.506 INFO:tasks.rados.rados.0.trial118.stdout:3549: finishing write tid 1 to trial11845692-33 2026-02-17T05:43:25.506 INFO:tasks.rados.rados.0.trial118.stdout:3546: finishing copy_from to trial11845692-48 2026-02-17T05:43:25.506 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1716 (ObjNum 1161 snap 363 seq_num 1161) dirty exists 2026-02-17T05:43:25.506 INFO:tasks.rados.rados.0.trial118.stdout:3550: expect (ObjNum 1225 snap 387 seq_num 1225) 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3545: finishing copy_from racing read to trial11845692-47 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: finishing write tid 2 to trial11845692-33 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: finishing write tid 3 to trial11845692-33 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3545: finishing copy_from to trial11845692-47 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 2150 (ObjNum 1186 snap 374 seq_num 1186) dirty exists 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: finishing write tid 4 to trial11845692-33 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: oid 33 updating version 0 to 2241 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: oid 33 updating version 2241 to 2243 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: oid 33 version 2243 is already newer than 2242 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 2243 (ObjNum 1233 snap 388 seq_num 1233) dirty exists 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3549: left oid 33 (ObjNum 1233 snap 388 seq_num 1233) 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3551: finishing write tid 1 to trial11845692-41 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3545: done (7 left) 2026-02-17T05:43:25.654 INFO:tasks.rados.rados.0.trial118.stdout:3546: done (6 left) 2026-02-17T05:43:25.655 INFO:tasks.rados.rados.0.trial118.stdout:3547: done (5 left) 2026-02-17T05:43:25.655 INFO:tasks.rados.rados.0.trial118.stdout:3548: done (4 left) 2026-02-17T05:43:25.655 INFO:tasks.rados.rados.0.trial118.stdout:3549: done (3 left) 2026-02-17T05:43:25.655 INFO:tasks.rados.rados.0.trial118.stdout:3550: done (2 left) 2026-02-17T05:43:25.655 INFO:tasks.rados.rados.0.trial118.stdout:3553: snap_remove snap 377 2026-02-17T05:43:26.381 INFO:tasks.rados.rados.0.trial118.stdout:3553: done (2 left) 2026-02-17T05:43:26.381 INFO:tasks.rados.rados.0.trial118.stdout:3554: write oid 45 current snap is 388 2026-02-17T05:43:26.381 INFO:tasks.rados.rados.0.trial118.stdout:3554: seq_num 1235 ranges {756645=581701,1935850=473428} 2026-02-17T05:43:26.386 INFO:tasks.rados.rados.0.trial118.stdout:3554: writing trial11845692-45 from 756645 to 1338346 tid 1 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3554: writing trial11845692-45 from 1935850 to 2409278 tid 2 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3555: copy_from oid 15 from oid 39 current snap is 388 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3552: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1726 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3551: finishing write tid 2 to trial11845692-41 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3551: finishing write tid 3 to trial11845692-41 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3551: finishing write tid 4 to trial11845692-41 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3551: oid 41 updating version 0 to 2174 2026-02-17T05:43:26.391 INFO:tasks.rados.rados.0.trial118.stdout:3551: oid 41 updating version 2174 to 2176 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3551: oid 41 version 2176 is already newer than 2175 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2176 (ObjNum 1234 snap 388 seq_num 1234) dirty exists 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3551: left oid 41 (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3554: finishing write tid 1 to trial11845692-45 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3551: done (3 left) 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3552: done (2 left) 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3556: read oid 46 snap 381 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3556: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3557: read oid 48 snap -1 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3557: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3558: rollback oid 26 current snap is 388 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 350 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3559: rollback oid 38 current snap is 388 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 38 to 372 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3560: copy_from oid 18 from oid 25 current snap is 388 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3561: read oid 27 snap -1 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3561: expect deleted 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3562: write oid 50 current snap is 388 2026-02-17T05:43:26.392 INFO:tasks.rados.rados.0.trial118.stdout:3562: seq_num 1236 ranges {773452=656950,1877979=617086} 2026-02-17T05:43:26.395 INFO:tasks.rados.rados.0.trial118.stdout:3562: writing trial11845692-50 from 773452 to 1430402 tid 1 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3562: writing trial11845692-50 from 1877979 to 2495065 tid 2 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3563: read oid 1 snap -1 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3563: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3564: read oid 49 snap 370 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3564: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3565: delete oid 8 current snap is 388 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3558: finishing rollback tid 0 to trial11845692-26 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3558: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1475 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3559: finishing rollback tid 0 to trial11845692-38 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3559: finishing rollback tid 1 to trial11845692-38 2026-02-17T05:43:26.400 INFO:tasks.rados.rados.0.trial118.stdout:3559: finishing rollback tid 2 to trial11845692-38 2026-02-17T05:43:26.401 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 2153 (ObjNum 1031 snap 312 seq_num 1031) dirty exists 2026-02-17T05:43:26.401 INFO:tasks.rados.rados.0.trial118.stdout:3556: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:43:26.431 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1011154 2026-02-17T05:43:26.450 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 36767 2026-02-17T05:43:26.477 INFO:tasks.rados.rados.0.trial118.stdout:3555: finishing copy_from to trial11845692-15 2026-02-17T05:43:26.477 INFO:tasks.rados.rados.0.trial118.stdout:3555: got expected ENOENT (src dne) 2026-02-17T05:43:26.477 INFO:tasks.rados.rados.0.trial118.stdout:3555: finishing copy_from racing read to trial11845692-15 2026-02-17T05:43:26.477 INFO:tasks.rados.rados.0.trial118.stdout:3554: finishing write tid 2 to trial11845692-45 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: finishing write tid 3 to trial11845692-45 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: finishing write tid 4 to trial11845692-45 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: oid 45 updating version 0 to 1936 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: oid 45 version 1936 is already newer than 1926 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: oid 45 version 1936 is already newer than 1935 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 1936 (ObjNum 1235 snap 388 seq_num 1235) dirty exists 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3554: left oid 45 (ObjNum 1235 snap 388 seq_num 1235) 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3560: finishing copy_from racing read to trial11845692-18 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:3557: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:26.478 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:26.505 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2129583 2026-02-17T05:43:26.519 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3560: finishing copy_from to trial11845692-18 2026-02-17T05:43:26.546 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2126 (ObjNum 1190 snap 374 seq_num 1190) dirty exists 2026-02-17T05:43:26.546 INFO:tasks.rados.rados.0.trial118.stdout:3562: finishing write tid 1 to trial11845692-50 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3554: done (11 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3555: done (10 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3556: done (9 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3557: done (8 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3558: done (7 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3559: done (6 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3560: done (5 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3561: done (4 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3565: done (3 left) 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3566: write oid 27 current snap is 388 2026-02-17T05:43:26.547 INFO:tasks.rados.rados.0.trial118.stdout:3564: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:26.661 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1372586 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: finishing write tid 2 to trial11845692-50 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: finishing write tid 3 to trial11845692-50 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: finishing write tid 4 to trial11845692-50 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: oid 50 updating version 0 to 2142 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: oid 50 version 2142 is already newer than 2141 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: oid 50 version 2142 is already newer than 2140 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2142 (ObjNum 1236 snap 388 seq_num 1236) dirty exists 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3562: left oid 50 (ObjNum 1236 snap 388 seq_num 1236) 2026-02-17T05:43:26.699 INFO:tasks.rados.rados.0.trial118.stdout:3563: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:26.710 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:26.728 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:26.745 INFO:tasks.rados.rados.0.trial118.stdout:3566: seq_num 1238 ranges {407066=407448,1594943=620755} 2026-02-17T05:43:26.748 INFO:tasks.rados.rados.0.trial118.stdout:3566: writing trial11845692-27 from 407066 to 814514 tid 1 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3566: writing trial11845692-27 from 1594943 to 2215698 tid 2 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3562: done (3 left) 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3563: done (2 left) 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3564: done (1 left) 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3567: snap_create 2026-02-17T05:43:26.754 INFO:tasks.rados.rados.0.trial118.stdout:3566: finishing write tid 1 to trial11845692-27 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: finishing write tid 2 to trial11845692-27 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: finishing write tid 3 to trial11845692-27 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: finishing write tid 4 to trial11845692-27 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: oid 27 updating version 0 to 2321 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: oid 27 updating version 2321 to 2322 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: oid 27 updating version 2322 to 2323 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 27 v 2323 (ObjNum 1238 snap 388 seq_num 1238) dirty exists 2026-02-17T05:43:26.756 INFO:tasks.rados.rados.0.trial118.stdout:3566: left oid 27 (ObjNum 1238 snap 388 seq_num 1238) 2026-02-17T05:43:27.385 INFO:tasks.rados.rados.0.trial118.stdout:3566: done (1 left) 2026-02-17T05:43:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3567: done (0 left) 2026-02-17T05:43:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3568: delete oid 48 current snap is 389 2026-02-17T05:43:27.390 INFO:tasks.rados.rados.0.trial118.stdout:3568: done (0 left) 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3569: read oid 5 snap -1 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3569: expect (ObjNum 1141 snap 355 seq_num 1141) 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3570: copy_from oid 20 from oid 49 current snap is 389 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3571: read oid 46 snap -1 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3571: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3572: write (excl) oid 29 current snap is 389 2026-02-17T05:43:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3572: seq_num 1240 ranges {440680=674299,1711907=624424} 2026-02-17T05:43:27.394 INFO:tasks.rados.rados.0.trial118.stdout:3572: writing trial11845692-29 from 440680 to 1114979 tid 1 2026-02-17T05:43:27.399 INFO:tasks.rados.rados.0.trial118.stdout:3572: writing trial11845692-29 from 1711907 to 2336331 tid 2 2026-02-17T05:43:27.399 INFO:tasks.rados.rados.0.trial118.stdout:3573: delete oid 27 current snap is 389 2026-02-17T05:43:27.399 INFO:tasks.rados.rados.0.trial118.stdout:3571: expect (ObjNum 1059 snap 318 seq_num 1059) 2026-02-17T05:43:27.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3337052 2026-02-17T05:43:27.456 INFO:tasks.rados.rados.0.trial118.stdout:3569: expect (ObjNum 1141 snap 355 seq_num 1141) 2026-02-17T05:43:27.474 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3570: finishing copy_from racing read to trial11845692-20 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3570: finishing copy_from to trial11845692-20 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: finishing write tid 1 to trial11845692-29 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: finishing write tid 2 to trial11845692-29 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: finishing write tid 3 to trial11845692-29 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: finishing write tid 4 to trial11845692-29 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: oid 29 updating version 0 to 2184 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: oid 29 updating version 2184 to 2186 2026-02-17T05:43:27.516 INFO:tasks.rados.rados.0.trial118.stdout:3572: oid 29 version 2186 is already newer than 2185 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 2186 (ObjNum 1240 snap 389 seq_num 1240) dirty exists 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3572: left oid 29 (ObjNum 1240 snap 389 seq_num 1240) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3569: done (4 left) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3570: done (3 left) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3571: done (2 left) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3572: done (1 left) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3573: done (0 left) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3574: read oid 7 snap -1 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3574: expect (ObjNum 1089 snap 324 seq_num 1089) 2026-02-17T05:43:27.517 INFO:tasks.rados.rados.0.trial118.stdout:3575: delete oid 22 current snap is 389 2026-02-17T05:43:27.518 INFO:tasks.rados.rados.0.trial118.stdout:3575: done (1 left) 2026-02-17T05:43:27.518 INFO:tasks.rados.rados.0.trial118.stdout:3576: copy_from oid 2 from oid 17 current snap is 389 2026-02-17T05:43:27.518 INFO:tasks.rados.rados.0.trial118.stdout:3577: snap_create 2026-02-17T05:43:27.518 INFO:tasks.rados.rados.0.trial118.stdout:3574: expect (ObjNum 1089 snap 324 seq_num 1089) 2026-02-17T05:43:27.578 INFO:tasks.rados.rados.0.trial118.stdout:3576: finishing copy_from racing read to trial11845692-2 2026-02-17T05:43:27.579 INFO:tasks.rados.rados.0.trial118.stdout:3576: finishing copy_from to trial11845692-2 2026-02-17T05:43:27.579 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1509 (ObjNum 1203 snap 380 seq_num 1203) dirty exists 2026-02-17T05:43:28.388 INFO:tasks.rados.rados.0.trial118.stdout:3574: done (2 left) 2026-02-17T05:43:28.389 INFO:tasks.rados.rados.0.trial118.stdout:3576: done (1 left) 2026-02-17T05:43:28.389 INFO:tasks.rados.rados.0.trial118.stdout:3577: done (0 left) 2026-02-17T05:43:28.389 INFO:tasks.rados.rados.0.trial118.stdout:3578: write oid 42 current snap is 390 2026-02-17T05:43:28.389 INFO:tasks.rados.rados.0.trial118.stdout:3578: seq_num 1243 ranges {491101=500046,1487353=488104,2401133=489968} 2026-02-17T05:43:28.392 INFO:tasks.rados.rados.0.trial118.stdout:3578: writing trial11845692-42 from 491101 to 991147 tid 1 2026-02-17T05:43:28.396 INFO:tasks.rados.rados.0.trial118.stdout:3578: writing trial11845692-42 from 1487353 to 1975457 tid 2 2026-02-17T05:43:28.399 INFO:tasks.rados.rados.0.trial118.stdout:3578: writing trial11845692-42 from 2401133 to 2891101 tid 3 2026-02-17T05:43:28.399 INFO:tasks.rados.rados.0.trial118.stdout:3579: snap_create 2026-02-17T05:43:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3578: finishing write tid 1 to trial11845692-42 2026-02-17T05:43:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3578: finishing write tid 2 to trial11845692-42 2026-02-17T05:43:28.401 INFO:tasks.rados.rados.0.trial118.stdout:3578: finishing write tid 3 to trial11845692-42 2026-02-17T05:43:28.401 INFO:tasks.rados.rados.0.trial118.stdout:3578: finishing write tid 4 to trial11845692-42 2026-02-17T05:43:28.401 INFO:tasks.rados.rados.0.trial118.stdout:3578: finishing write tid 5 to trial11845692-42 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3578: oid 42 updating version 0 to 2154 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3578: oid 42 updating version 2154 to 2157 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3578: oid 42 version 2157 is already newer than 2155 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3578: oid 42 version 2157 is already newer than 2156 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 2157 (ObjNum 1243 snap 390 seq_num 1243) dirty exists 2026-02-17T05:43:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3578: left oid 42 (ObjNum 1243 snap 390 seq_num 1243) 2026-02-17T05:43:29.390 INFO:tasks.rados.rados.0.trial118.stdout:3578: done (1 left) 2026-02-17T05:43:29.390 INFO:tasks.rados.rados.0.trial118.stdout:3579: done (0 left) 2026-02-17T05:43:29.390 INFO:tasks.rados.rados.0.trial118.stdout:3580: read oid 43 snap -1 2026-02-17T05:43:29.390 INFO:tasks.rados.rados.0.trial118.stdout:3580: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:43:29.390 INFO:tasks.rados.rados.0.trial118.stdout:3581: snap_remove snap 357 2026-02-17T05:43:30.364 INFO:tasks.rados.rados.0.trial118.stdout:3581: done (1 left) 2026-02-17T05:43:30.364 INFO:tasks.rados.rados.0.trial118.stdout:3582: snap_remove snap 389 2026-02-17T05:43:31.367 INFO:tasks.rados.rados.0.trial118.stdout:3582: done (1 left) 2026-02-17T05:43:31.367 INFO:tasks.rados.rados.0.trial118.stdout:3583: write (excl) oid 32 current snap is 391 2026-02-17T05:43:31.367 INFO:tasks.rados.rados.0.trial118.stdout:3583: seq_num 1244 ranges {507908=575295,1829482=631762} 2026-02-17T05:43:31.371 INFO:tasks.rados.rados.0.trial118.stdout:3583: writing trial11845692-32 from 507908 to 1083203 tid 1 2026-02-17T05:43:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3583: writing trial11845692-32 from 1829482 to 2461244 tid 2 2026-02-17T05:43:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3584: delete oid 41 current snap is 391 2026-02-17T05:43:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3580: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:43:31.489 INFO:tasks.rados.rados.0.trial118.stdout:3583: finishing write tid 1 to trial11845692-32 2026-02-17T05:43:31.489 INFO:tasks.rados.rados.0.trial118.stdout:3583: finishing write tid 2 to trial11845692-32 2026-02-17T05:43:31.489 INFO:tasks.rados.rados.0.trial118.stdout:3583: finishing write tid 3 to trial11845692-32 2026-02-17T05:43:31.489 INFO:tasks.rados.rados.0.trial118.stdout:3580: done (2 left) 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3584: done (1 left) 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3585: rollback oid 31 current snap is 391 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 381 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3583: finishing write tid 4 to trial11845692-32 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3583: oid 32 updating version 0 to 1735 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3583: oid 32 updating version 1735 to 1737 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:3583: oid 32 version 1737 is already newer than 1736 2026-02-17T05:43:31.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1737 (ObjNum 1244 snap 391 seq_num 1244) dirty exists 2026-02-17T05:43:31.491 INFO:tasks.rados.rados.0.trial118.stdout:3583: left oid 32 (ObjNum 1244 snap 391 seq_num 1244) 2026-02-17T05:43:31.491 INFO:tasks.rados.rados.0.trial118.stdout:3583: done (1 left) 2026-02-17T05:43:31.491 INFO:tasks.rados.rados.0.trial118.stdout:3586: write oid 37 current snap is 391 2026-02-17T05:43:31.491 INFO:tasks.rados.rados.0.trial118.stdout:3586: seq_num 1246 ranges {541522=725793,1946446=635431} 2026-02-17T05:43:31.493 INFO:tasks.rados.rados.0.trial118.stdout:3586: writing trial11845692-37 from 541522 to 1267315 tid 1 2026-02-17T05:43:31.498 INFO:tasks.rados.rados.0.trial118.stdout:3586: writing trial11845692-37 from 1946446 to 2581877 tid 2 2026-02-17T05:43:31.498 INFO:tasks.rados.rados.0.trial118.stdout:3587: read oid 4 snap -1 2026-02-17T05:43:31.498 INFO:tasks.rados.rados.0.trial118.stdout:3587: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:31.498 INFO:tasks.rados.rados.0.trial118.stdout:3588: snap_create 2026-02-17T05:43:31.499 INFO:tasks.rados.rados.0.trial118.stdout:3585: finishing rollback tid 0 to trial11845692-31 2026-02-17T05:43:31.499 INFO:tasks.rados.rados.0.trial118.stdout:3585: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:43:31.499 INFO:tasks.rados.rados.0.trial118.stdout:3585: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:43:31.499 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 2339 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:43:31.499 INFO:tasks.rados.rados.0.trial118.stdout:3586: finishing write tid 1 to trial11845692-37 2026-02-17T05:43:31.500 INFO:tasks.rados.rados.0.trial118.stdout:3586: finishing write tid 2 to trial11845692-37 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: finishing write tid 3 to trial11845692-37 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: finishing write tid 4 to trial11845692-37 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: oid 37 updating version 0 to 1570 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: oid 37 updating version 1570 to 1572 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: oid 37 version 1572 is already newer than 1571 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 1572 (ObjNum 1246 snap 391 seq_num 1246) dirty exists 2026-02-17T05:43:31.501 INFO:tasks.rados.rados.0.trial118.stdout:3586: left oid 37 (ObjNum 1246 snap 391 seq_num 1246) 2026-02-17T05:43:31.502 INFO:tasks.rados.rados.0.trial118.stdout:3587: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:31.502 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1065177 2026-02-17T05:43:31.519 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1359188 2026-02-17T05:43:32.397 INFO:tasks.rados.rados.0.trial118.stdout:3585: done (3 left) 2026-02-17T05:43:32.398 INFO:tasks.rados.rados.0.trial118.stdout:3586: done (2 left) 2026-02-17T05:43:32.398 INFO:tasks.rados.rados.0.trial118.stdout:3587: done (1 left) 2026-02-17T05:43:32.398 INFO:tasks.rados.rados.0.trial118.stdout:3588: done (0 left) 2026-02-17T05:43:32.398 INFO:tasks.rados.rados.0.trial118.stdout:3589: write (excl) oid 28 current snap is 392 2026-02-17T05:43:32.398 INFO:tasks.rados.rados.0.trial118.stdout:3589: seq_num 1247 ranges {558329=517395,1721281=779089} 2026-02-17T05:43:32.402 INFO:tasks.rados.rados.0.trial118.stdout:3589: writing trial11845692-28 from 558329 to 1075724 tid 1 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3589: writing trial11845692-28 from 1721281 to 2500370 tid 2 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3590: read oid 19 snap -1 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3590: expect (ObjNum 1208 snap 381 seq_num 1208) 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3591: read oid 35 snap -1 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3591: expect deleted 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3592: snap_remove snap 386 2026-02-17T05:43:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3589: finishing write tid 1 to trial11845692-28 2026-02-17T05:43:33.401 INFO:tasks.rados.rados.0.trial118.stdout:3592: done (3 left) 2026-02-17T05:43:33.401 INFO:tasks.rados.rados.0.trial118.stdout:3593: delete oid 17 current snap is 392 2026-02-17T05:43:33.401 INFO:tasks.rados.rados.0.trial118.stdout:3589: finishing write tid 2 to trial11845692-28 2026-02-17T05:43:33.401 INFO:tasks.rados.rados.0.trial118.stdout:3589: finishing write tid 3 to trial11845692-28 2026-02-17T05:43:33.401 INFO:tasks.rados.rados.0.trial118.stdout:3589: finishing write tid 4 to trial11845692-28 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:3589: oid 28 updating version 0 to 2127 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:3589: oid 28 updating version 2127 to 2128 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:3589: oid 28 updating version 2128 to 2129 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2129 (ObjNum 1247 snap 392 seq_num 1247) dirty exists 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:3589: left oid 28 (ObjNum 1247 snap 392 seq_num 1247) 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:3590: expect (ObjNum 1208 snap 381 seq_num 1208) 2026-02-17T05:43:33.402 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:33.479 INFO:tasks.rados.rados.0.trial118.stdout:3589: done (3 left) 2026-02-17T05:43:33.479 INFO:tasks.rados.rados.0.trial118.stdout:3590: done (2 left) 2026-02-17T05:43:33.479 INFO:tasks.rados.rados.0.trial118.stdout:3591: done (1 left) 2026-02-17T05:43:33.479 INFO:tasks.rados.rados.0.trial118.stdout:3593: done (0 left) 2026-02-17T05:43:33.479 INFO:tasks.rados.rados.0.trial118.stdout:3594: read oid 33 snap -1 2026-02-17T05:43:33.480 INFO:tasks.rados.rados.0.trial118.stdout:3594: expect (ObjNum 1233 snap 388 seq_num 1233) 2026-02-17T05:43:33.480 INFO:tasks.rados.rados.0.trial118.stdout:3595: rollback oid 28 current snap is 392 2026-02-17T05:43:33.480 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 391 2026-02-17T05:43:33.480 INFO:tasks.rados.rados.0.trial118.stdout:3596: write oid 9 current snap is 392 2026-02-17T05:43:33.480 INFO:tasks.rados.rados.0.trial118.stdout:3596: seq_num 1249 ranges {591943=667893,1721892=782758} 2026-02-17T05:43:33.484 INFO:tasks.rados.rados.0.trial118.stdout:3596: writing trial11845692-9 from 591943 to 1259836 tid 1 2026-02-17T05:43:33.489 INFO:tasks.rados.rados.0.trial118.stdout:3596: writing trial11845692-9 from 1721892 to 2504650 tid 2 2026-02-17T05:43:33.489 INFO:tasks.rados.rados.0.trial118.stdout:3597: write (excl) oid 19 current snap is 392 2026-02-17T05:43:33.489 INFO:tasks.rados.rados.0.trial118.stdout:3597: seq_num 1250 ranges {608750=743142,1780374=642769} 2026-02-17T05:43:33.493 INFO:tasks.rados.rados.0.trial118.stdout:3597: writing trial11845692-19 from 608750 to 1351892 tid 1 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3597: writing trial11845692-19 from 1780374 to 2423143 tid 2 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3598: read oid 26 snap -1 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3598: expect deleted 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3599: rollback oid 47 current snap is 392 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 47 to 370 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3595: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3595: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:43:33.498 INFO:tasks.rados.rados.0.trial118.stdout:3595: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:43:33.499 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2132 (ObjNum 1207 snap 380 seq_num 1207) dirty exists 2026-02-17T05:43:33.499 INFO:tasks.rados.rados.0.trial118.stdout:3594: expect (ObjNum 1233 snap 388 seq_num 1233) 2026-02-17T05:43:33.499 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:33.518 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:33.545 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1846415 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: finishing write tid 1 to trial11845692-9 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: finishing write tid 2 to trial11845692-9 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: finishing write tid 3 to trial11845692-9 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: finishing write tid 4 to trial11845692-9 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: oid 9 updating version 0 to 2201 2026-02-17T05:43:33.552 INFO:tasks.rados.rados.0.trial118.stdout:3596: oid 9 updating version 2201 to 2202 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3596: oid 9 version 2202 is already newer than 2200 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2202 (ObjNum 1249 snap 392 seq_num 1249) dirty exists 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3596: left oid 9 (ObjNum 1249 snap 392 seq_num 1249) 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: finishing write tid 1 to trial11845692-19 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: finishing write tid 2 to trial11845692-19 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: finishing write tid 3 to trial11845692-19 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: finishing write tid 4 to trial11845692-19 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: oid 19 updating version 0 to 2137 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: oid 19 updating version 2137 to 2139 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: oid 19 version 2139 is already newer than 2138 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2139 (ObjNum 1250 snap 392 seq_num 1250) dirty exists 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3597: left oid 19 (ObjNum 1250 snap 392 seq_num 1250) 2026-02-17T05:43:33.553 INFO:tasks.rados.rados.0.trial118.stdout:3599: finishing rollback tid 0 to trial11845692-47 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3594: done (5 left) 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3595: done (4 left) 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3596: done (3 left) 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3597: done (2 left) 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3598: done (1 left) 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3600: write oid 38 current snap is 392 2026-02-17T05:43:33.554 INFO:tasks.rados.rados.0.trial118.stdout:3600: seq_num 1251 ranges {625557=418391,1838856=786427} 2026-02-17T05:43:33.555 INFO:tasks.rados.rados.0.trial118.stdout:3600: writing trial11845692-38 from 625557 to 1043948 tid 1 2026-02-17T05:43:33.561 INFO:tasks.rados.rados.0.trial118.stdout:3600: writing trial11845692-38 from 1838856 to 2625283 tid 2 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:3601: write (excl) oid 24 current snap is 392 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:3599: finishing rollback tid 1 to trial11845692-47 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:3599: finishing rollback tid 2 to trial11845692-47 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 2160 (ObjNum 1160 snap 362 seq_num 1160) dirty exists 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:3600: finishing write tid 1 to trial11845692-38 2026-02-17T05:43:33.562 INFO:tasks.rados.rados.0.trial118.stdout:3601: seq_num 1252 ranges {642364=493640,1897338=646438} 2026-02-17T05:43:33.565 INFO:tasks.rados.rados.0.trial118.stdout:3601: writing trial11845692-24 from 642364 to 1136004 tid 1 2026-02-17T05:43:33.571 INFO:tasks.rados.rados.0.trial118.stdout:3601: writing trial11845692-24 from 1897338 to 2543776 tid 2 2026-02-17T05:43:33.571 INFO:tasks.rados.rados.0.trial118.stdout:3599: done (2 left) 2026-02-17T05:43:33.571 INFO:tasks.rados.rados.0.trial118.stdout:3602: snap_remove snap 381 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3602: done (2 left) 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3603: copy_from oid 10 from oid 15 current snap is 392 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3600: finishing write tid 2 to trial11845692-38 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3600: finishing write tid 3 to trial11845692-38 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3600: finishing write tid 4 to trial11845692-38 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3600: oid 38 updating version 0 to 2162 2026-02-17T05:43:34.406 INFO:tasks.rados.rados.0.trial118.stdout:3600: oid 38 updating version 2162 to 2163 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3600: oid 38 version 2163 is already newer than 2161 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 2163 (ObjNum 1251 snap 392 seq_num 1251) dirty exists 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3600: left oid 38 (ObjNum 1251 snap 392 seq_num 1251) 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: finishing write tid 1 to trial11845692-24 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: finishing write tid 2 to trial11845692-24 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: finishing write tid 3 to trial11845692-24 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: finishing write tid 4 to trial11845692-24 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: oid 24 updating version 0 to 1727 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: oid 24 updating version 1727 to 1729 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: oid 24 version 1729 is already newer than 1728 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1729 (ObjNum 1252 snap 392 seq_num 1252) dirty exists 2026-02-17T05:43:34.407 INFO:tasks.rados.rados.0.trial118.stdout:3601: left oid 24 (ObjNum 1252 snap 392 seq_num 1252) 2026-02-17T05:43:34.408 INFO:tasks.rados.rados.0.trial118.stdout:3600: done (2 left) 2026-02-17T05:43:34.408 INFO:tasks.rados.rados.0.trial118.stdout:3601: done (1 left) 2026-02-17T05:43:34.408 INFO:tasks.rados.rados.0.trial118.stdout:3604: write (excl) oid 17 current snap is 392 2026-02-17T05:43:34.408 INFO:tasks.rados.rados.0.trial118.stdout:3604: seq_num 1253 ranges {659171=568889,1839467=790096} 2026-02-17T05:43:34.409 INFO:tasks.rados.rados.0.trial118.stdout:3604: writing trial11845692-17 from 659171 to 1228060 tid 1 2026-02-17T05:43:34.415 INFO:tasks.rados.rados.0.trial118.stdout:3604: writing trial11845692-17 from 1839467 to 2629563 tid 2 2026-02-17T05:43:34.415 INFO:tasks.rados.rados.0.trial118.stdout:3605: write (excl) oid 2 current snap is 392 2026-02-17T05:43:34.416 INFO:tasks.rados.rados.0.trial118.stdout:3603: finishing copy_from racing read to trial11845692-10 2026-02-17T05:43:34.416 INFO:tasks.rados.rados.0.trial118.stdout:3604: finishing write tid 1 to trial11845692-17 2026-02-17T05:43:34.416 INFO:tasks.rados.rados.0.trial118.stdout:3603: finishing copy_from to trial11845692-10 2026-02-17T05:43:34.416 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1885 (ObjNum 1213 snap 384 seq_num 1213) dirty exists 2026-02-17T05:43:34.416 INFO:tasks.rados.rados.0.trial118.stdout:3605: seq_num 1254 ranges {675978=644138,1897949=650107} 2026-02-17T05:43:34.420 INFO:tasks.rados.rados.0.trial118.stdout:3605: writing trial11845692-2 from 675978 to 1320116 tid 1 2026-02-17T05:43:34.424 INFO:tasks.rados.rados.0.trial118.stdout:3605: writing trial11845692-2 from 1897949 to 2548056 tid 2 2026-02-17T05:43:34.425 INFO:tasks.rados.rados.0.trial118.stdout:3603: done (2 left) 2026-02-17T05:43:34.425 INFO:tasks.rados.rados.0.trial118.stdout:3606: snap_remove snap 385 2026-02-17T05:43:35.367 INFO:tasks.rados.rados.0.trial118.stdout:3606: done (2 left) 2026-02-17T05:43:35.367 INFO:tasks.rados.rados.0.trial118.stdout:3607: write (excl) oid 7 current snap is 392 2026-02-17T05:43:35.367 INFO:tasks.rados.rados.0.trial118.stdout:3607: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2026-02-17T05:43:35.371 INFO:tasks.rados.rados.0.trial118.stdout:3607: writing trial11845692-7 from 692785 to 1128525 tid 1 2026-02-17T05:43:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3607: writing trial11845692-7 from 1672784 to 2466549 tid 2 2026-02-17T05:43:35.379 INFO:tasks.rados.rados.0.trial118.stdout:3607: writing trial11845692-7 from 2897503 to 3092785 tid 3 2026-02-17T05:43:35.379 INFO:tasks.rados.rados.0.trial118.stdout:3608: write (excl) oid 9 current snap is 392 2026-02-17T05:43:35.379 INFO:tasks.rados.rados.0.trial118.stdout:3608: seq_num 1256 ranges {709592=510989,1731266=653776,3041279=68313} 2026-02-17T05:43:35.383 INFO:tasks.rados.rados.0.trial118.stdout:3608: writing trial11845692-9 from 709592 to 1220581 tid 1 2026-02-17T05:43:35.387 INFO:tasks.rados.rados.0.trial118.stdout:3608: writing trial11845692-9 from 1731266 to 2385042 tid 2 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3608: writing trial11845692-9 from 3041279 to 3109592 tid 3 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3609: copy_from oid 50 from oid 5 current snap is 392 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: finishing write tid 2 to trial11845692-17 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: finishing write tid 3 to trial11845692-17 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: finishing write tid 4 to trial11845692-17 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: oid 17 updating version 0 to 1511 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: oid 17 updating version 1511 to 1513 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:3604: oid 17 version 1513 is already newer than 1512 2026-02-17T05:43:35.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1513 (ObjNum 1253 snap 392 seq_num 1253) dirty exists 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3604: left oid 17 (ObjNum 1253 snap 392 seq_num 1253) 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: finishing write tid 1 to trial11845692-2 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: finishing write tid 2 to trial11845692-2 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: finishing write tid 3 to trial11845692-2 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: finishing write tid 4 to trial11845692-2 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: oid 2 updating version 0 to 2359 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: oid 2 version 2359 is already newer than 2358 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: oid 2 version 2359 is already newer than 2357 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2359 (ObjNum 1254 snap 392 seq_num 1254) dirty exists 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3605: left oid 2 (ObjNum 1254 snap 392 seq_num 1254) 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3607: finishing write tid 1 to trial11845692-7 2026-02-17T05:43:35.393 INFO:tasks.rados.rados.0.trial118.stdout:3607: finishing write tid 2 to trial11845692-7 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: finishing write tid 3 to trial11845692-7 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: finishing write tid 4 to trial11845692-7 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: finishing write tid 5 to trial11845692-7 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: oid 7 updating version 0 to 2221 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: oid 7 version 2221 is already newer than 2220 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: oid 7 version 2221 is already newer than 2212 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: oid 7 version 2221 is already newer than 2219 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2221 (ObjNum 1255 snap 392 seq_num 1255) dirty exists 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3607: left oid 7 (ObjNum 1255 snap 392 seq_num 1255) 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3608: finishing write tid 1 to trial11845692-9 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3608: finishing write tid 2 to trial11845692-9 2026-02-17T05:43:35.394 INFO:tasks.rados.rados.0.trial118.stdout:3604: done (4 left) 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3605: done (3 left) 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3607: done (2 left) 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3610: snap_create 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: finishing write tid 3 to trial11845692-9 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: finishing write tid 4 to trial11845692-9 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: finishing write tid 5 to trial11845692-9 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: oid 9 updating version 0 to 2224 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: oid 9 updating version 2224 to 2225 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: oid 9 version 2225 is already newer than 2222 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: oid 9 version 2225 is already newer than 2223 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2225 (ObjNum 1256 snap 392 seq_num 1256) dirty exists 2026-02-17T05:43:35.395 INFO:tasks.rados.rados.0.trial118.stdout:3608: left oid 9 (ObjNum 1256 snap 392 seq_num 1256) 2026-02-17T05:43:35.396 INFO:tasks.rados.rados.0.trial118.stdout:3609: finishing copy_from racing read to trial11845692-50 2026-02-17T05:43:35.397 INFO:tasks.rados.rados.0.trial118.stdout:3609: finishing copy_from to trial11845692-50 2026-02-17T05:43:35.397 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1470 (ObjNum 1141 snap 355 seq_num 1141) dirty exists 2026-02-17T05:43:36.369 INFO:tasks.rados.rados.0.trial118.stdout:3608: done (2 left) 2026-02-17T05:43:36.370 INFO:tasks.rados.rados.0.trial118.stdout:3609: done (1 left) 2026-02-17T05:43:36.370 INFO:tasks.rados.rados.0.trial118.stdout:3610: done (0 left) 2026-02-17T05:43:36.370 INFO:tasks.rados.rados.0.trial118.stdout:3611: snap_create 2026-02-17T05:43:37.371 INFO:tasks.rados.rados.0.trial118.stdout:3611: done (0 left) 2026-02-17T05:43:37.371 INFO:tasks.rados.rados.0.trial118.stdout:3612: rollback oid 48 current snap is 394 2026-02-17T05:43:37.371 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 48 to 388 2026-02-17T05:43:37.371 INFO:tasks.rados.rados.0.trial118.stdout:3613: write (excl) oid 35 current snap is 394 2026-02-17T05:43:37.372 INFO:tasks.rados.rados.0.trial118.stdout:3613: seq_num 1257 ranges {726399=586238,2073395=797434} 2026-02-17T05:43:37.375 INFO:tasks.rados.rados.0.trial118.stdout:3613: writing trial11845692-35 from 726399 to 1312637 tid 1 2026-02-17T05:43:37.381 INFO:tasks.rados.rados.0.trial118.stdout:3613: writing trial11845692-35 from 2073395 to 2870829 tid 2 2026-02-17T05:43:37.381 INFO:tasks.rados.rados.0.trial118.stdout:3614: write (excl) oid 6 current snap is 394 2026-02-17T05:43:37.381 INFO:tasks.rados.rados.0.trial118.stdout:3614: seq_num 1258 ranges {743206=661487,2131877=541092} 2026-02-17T05:43:37.386 INFO:tasks.rados.rados.0.trial118.stdout:3614: writing trial11845692-6 from 743206 to 1404693 tid 1 2026-02-17T05:43:37.391 INFO:tasks.rados.rados.0.trial118.stdout:3614: writing trial11845692-6 from 2131877 to 2672969 tid 2 2026-02-17T05:43:37.392 INFO:tasks.rados.rados.0.trial118.stdout:3615: read oid 45 snap -1 2026-02-17T05:43:37.392 INFO:tasks.rados.rados.0.trial118.stdout:3615: expect (ObjNum 1235 snap 388 seq_num 1235) 2026-02-17T05:43:37.392 INFO:tasks.rados.rados.0.trial118.stdout:3616: snap_remove snap 364 2026-02-17T05:43:38.374 INFO:tasks.rados.rados.0.trial118.stdout:3616: done (4 left) 2026-02-17T05:43:38.374 INFO:tasks.rados.rados.0.trial118.stdout:3617: write (excl) oid 18 current snap is 394 2026-02-17T05:43:38.374 INFO:tasks.rados.rados.0.trial118.stdout:3617: seq_num 1259 ranges {760013=736736,2190359=401103} 2026-02-17T05:43:38.380 INFO:tasks.rados.rados.0.trial118.stdout:3617: writing trial11845692-18 from 760013 to 1496749 tid 1 2026-02-17T05:43:38.385 INFO:tasks.rados.rados.0.trial118.stdout:3617: writing trial11845692-18 from 2190359 to 2591462 tid 2 2026-02-17T05:43:38.385 INFO:tasks.rados.rados.0.trial118.stdout:3618: rollback oid 34 current snap is 394 2026-02-17T05:43:38.385 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 367 2026-02-17T05:43:38.385 INFO:tasks.rados.rados.0.trial118.stdout:3612: finishing rollback tid 1 to trial11845692-48 2026-02-17T05:43:38.385 INFO:tasks.rados.rados.0.trial118.stdout:3619: delete oid 40 current snap is 394 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3612: finishing rollback tid 2 to trial11845692-48 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 1968 (ObjNum 1161 snap 363 seq_num 1161) dirty exists 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: finishing write tid 1 to trial11845692-35 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: finishing write tid 2 to trial11845692-35 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: finishing write tid 3 to trial11845692-35 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: finishing write tid 4 to trial11845692-35 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: oid 35 updating version 0 to 1731 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: oid 35 updating version 1731 to 1732 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: oid 35 version 1732 is already newer than 1730 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1732 (ObjNum 1257 snap 394 seq_num 1257) dirty exists 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3613: left oid 35 (ObjNum 1257 snap 394 seq_num 1257) 2026-02-17T05:43:38.386 INFO:tasks.rados.rados.0.trial118.stdout:3614: finishing write tid 1 to trial11845692-6 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: finishing write tid 2 to trial11845692-6 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: finishing write tid 3 to trial11845692-6 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: finishing write tid 4 to trial11845692-6 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: oid 6 updating version 0 to 1730 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: oid 6 version 1730 is already newer than 1728 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: oid 6 version 1730 is already newer than 1729 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1730 (ObjNum 1258 snap 394 seq_num 1258) dirty exists 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3614: left oid 6 (ObjNum 1258 snap 394 seq_num 1258) 2026-02-17T05:43:38.387 INFO:tasks.rados.rados.0.trial118.stdout:3615: expect (ObjNum 1235 snap 388 seq_num 1235) 2026-02-17T05:43:38.427 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2436508 2026-02-17T05:43:38.432 INFO:tasks.rados.rados.0.trial118.stdout:3617: finishing write tid 1 to trial11845692-18 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3612: done (6 left) 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3613: done (5 left) 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3614: done (4 left) 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3615: done (3 left) 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3619: done (2 left) 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3620: write oid 44 current snap is 394 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3617: finishing write tid 2 to trial11845692-18 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3617: finishing write tid 3 to trial11845692-18 2026-02-17T05:43:38.433 INFO:tasks.rados.rados.0.trial118.stdout:3617: finishing write tid 4 to trial11845692-18 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3617: oid 18 updating version 0 to 2135 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3617: oid 18 version 2135 is already newer than 2133 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3617: oid 18 version 2135 is already newer than 2134 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2135 (ObjNum 1259 snap 394 seq_num 1259) dirty exists 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3617: left oid 18 (ObjNum 1259 snap 394 seq_num 1259) 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3618: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 1584 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:38.434 INFO:tasks.rados.rados.0.trial118.stdout:3620: seq_num 1261 ranges {793627=487234,1790970=404772,2829335=364292} 2026-02-17T05:43:38.437 INFO:tasks.rados.rados.0.trial118.stdout:3620: writing trial11845692-44 from 793627 to 1280861 tid 1 2026-02-17T05:43:38.441 INFO:tasks.rados.rados.0.trial118.stdout:3620: writing trial11845692-44 from 1790970 to 2195742 tid 2 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3620: writing trial11845692-44 from 2829335 to 3193627 tid 3 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3617: done (2 left) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3618: done (1 left) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3621: read oid 2 snap -1 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3621: expect (ObjNum 1254 snap 392 seq_num 1254) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3622: read oid 20 snap 390 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3622: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3623: read oid 23 snap -1 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3623: expect deleted 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3624: read oid 4 snap -1 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3624: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3625: copy_from oid 15 from oid 49 current snap is 394 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3620: finishing write tid 1 to trial11845692-44 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3620: finishing write tid 2 to trial11845692-44 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3626: read oid 1 snap -1 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3626: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:38.445 INFO:tasks.rados.rados.0.trial118.stdout:3627: delete oid 35 current snap is 394 2026-02-17T05:43:38.446 INFO:tasks.rados.rados.0.trial118.stdout:3620: finishing write tid 3 to trial11845692-44 2026-02-17T05:43:38.446 INFO:tasks.rados.rados.0.trial118.stdout:3620: finishing write tid 4 to trial11845692-44 2026-02-17T05:43:38.446 INFO:tasks.rados.rados.0.trial118.stdout:3626: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:38.446 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:38.474 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1471499 2026-02-17T05:43:38.482 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1360231 2026-02-17T05:43:38.490 INFO:tasks.rados.rados.0.trial118.stdout:3620: finishing write tid 5 to trial11845692-44 2026-02-17T05:43:38.490 INFO:tasks.rados.rados.0.trial118.stdout:3620: oid 44 updating version 0 to 1735 2026-02-17T05:43:38.490 INFO:tasks.rados.rados.0.trial118.stdout:3620: oid 44 version 1735 is already newer than 1733 2026-02-17T05:43:38.490 INFO:tasks.rados.rados.0.trial118.stdout:3620: oid 44 version 1735 is already newer than 1734 2026-02-17T05:43:38.490 INFO:tasks.rados.rados.0.trial118.stdout:3620: oid 44 updating version 1735 to 1736 2026-02-17T05:43:38.491 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1736 (ObjNum 1261 snap 394 seq_num 1261) dirty exists 2026-02-17T05:43:38.491 INFO:tasks.rados.rados.0.trial118.stdout:3620: left oid 44 (ObjNum 1261 snap 394 seq_num 1261) 2026-02-17T05:43:38.491 INFO:tasks.rados.rados.0.trial118.stdout:3624: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:38.523 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:38.543 INFO:tasks.rados.rados.0.trial118.stdout:3621: expect (ObjNum 1254 snap 392 seq_num 1254) 2026-02-17T05:43:38.593 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:38.675 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1945818 2026-02-17T05:43:38.686 INFO:tasks.rados.rados.0.trial118.stdout:3625: finishing copy_from racing read to trial11845692-15 2026-02-17T05:43:38.686 INFO:tasks.rados.rados.0.trial118.stdout:3622: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:38.845 INFO:tasks.rados.rados.0.trial118.stdout:3625: finishing copy_from to trial11845692-15 2026-02-17T05:43:38.845 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:43:38.845 INFO:tasks.rados.rados.0.trial118.stdout:3620: done (7 left) 2026-02-17T05:43:38.845 INFO:tasks.rados.rados.0.trial118.stdout:3621: done (6 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3622: done (5 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3623: done (4 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3624: done (3 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3625: done (2 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3626: done (1 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3627: done (0 left) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3628: read oid 48 snap -1 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3628: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3629: write oid 32 current snap is 394 2026-02-17T05:43:38.846 INFO:tasks.rados.rados.0.trial118.stdout:3629: seq_num 1263 ranges {427241=754085,1624287=408441,2600534=549964} 2026-02-17T05:43:38.849 INFO:tasks.rados.rados.0.trial118.stdout:3629: writing trial11845692-32 from 427241 to 1181326 tid 1 2026-02-17T05:43:38.853 INFO:tasks.rados.rados.0.trial118.stdout:3629: writing trial11845692-32 from 1624287 to 2032728 tid 2 2026-02-17T05:43:38.857 INFO:tasks.rados.rados.0.trial118.stdout:3629: writing trial11845692-32 from 2600534 to 3150498 tid 3 2026-02-17T05:43:38.857 INFO:tasks.rados.rados.0.trial118.stdout:3630: delete oid 28 current snap is 394 2026-02-17T05:43:38.858 INFO:tasks.rados.rados.0.trial118.stdout:3628: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:38.888 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2280133 2026-02-17T05:43:38.914 INFO:tasks.rados.rados.0.trial118.stdout:3629: finishing write tid 1 to trial11845692-32 2026-02-17T05:43:38.914 INFO:tasks.rados.rados.0.trial118.stdout:3628: done (2 left) 2026-02-17T05:43:38.914 INFO:tasks.rados.rados.0.trial118.stdout:3630: done (1 left) 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3631: rollback oid 21 current snap is 394 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 348 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: finishing write tid 2 to trial11845692-32 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: finishing write tid 3 to trial11845692-32 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: finishing write tid 4 to trial11845692-32 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: finishing write tid 5 to trial11845692-32 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: oid 32 updating version 0 to 1888 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: oid 32 version 1888 is already newer than 1886 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: oid 32 updating version 1888 to 1889 2026-02-17T05:43:38.915 INFO:tasks.rados.rados.0.trial118.stdout:3629: oid 32 version 1889 is already newer than 1887 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1889 (ObjNum 1263 snap 394 seq_num 1263) dirty exists 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3629: left oid 32 (ObjNum 1263 snap 394 seq_num 1263) 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3629: done (1 left) 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3632: read oid 24 snap 391 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3632: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3633: rollback oid 40 current snap is 394 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 372 2026-02-17T05:43:38.916 INFO:tasks.rados.rados.0.trial118.stdout:3634: snap_create 2026-02-17T05:43:38.917 INFO:tasks.rados.rados.0.trial118.stdout:3631: finishing rollback tid 0 to trial11845692-21 2026-02-17T05:43:38.918 INFO:tasks.rados.rados.0.trial118.stdout:3631: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:43:38.918 INFO:tasks.rados.rados.0.trial118.stdout:3631: finishing rollback tid 2 to trial11845692-21 2026-02-17T05:43:38.919 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2283 (ObjNum 1012 snap 301 seq_num 1012) dirty exists 2026-02-17T05:43:38.919 INFO:tasks.rados.rados.0.trial118.stdout:3632: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:43:38.944 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:38.994 INFO:tasks.rados.rados.0.trial118.stdout:3633: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:43:38.994 INFO:tasks.rados.rados.0.trial118.stdout:3633: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:43:38.995 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2285 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3631: done (3 left) 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3632: done (2 left) 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3633: done (1 left) 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3634: done (0 left) 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3635: rollback oid 50 current snap is 395 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 384 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3636: write (excl) oid 28 current snap is 395 2026-02-17T05:43:39.378 INFO:tasks.rados.rados.0.trial118.stdout:3636: seq_num 1265 ranges {460855=504583,1624898=412110,2539027=572508} 2026-02-17T05:43:39.381 INFO:tasks.rados.rados.0.trial118.stdout:3636: writing trial11845692-28 from 460855 to 965438 tid 1 2026-02-17T05:43:39.385 INFO:tasks.rados.rados.0.trial118.stdout:3636: writing trial11845692-28 from 1624898 to 2037008 tid 2 2026-02-17T05:43:39.390 INFO:tasks.rados.rados.0.trial118.stdout:3636: writing trial11845692-28 from 2539027 to 3111535 tid 3 2026-02-17T05:43:39.390 INFO:tasks.rados.rados.0.trial118.stdout:3637: write oid 38 current snap is 395 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:3635: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:3635: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:3635: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2145 (ObjNum 1210 snap 381 seq_num 1210) dirty exists 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:3636: finishing write tid 1 to trial11845692-28 2026-02-17T05:43:39.391 INFO:tasks.rados.rados.0.trial118.stdout:3637: seq_num 1266 ranges {477662=579832,1683380=555768,2966450=311212} 2026-02-17T05:43:39.394 INFO:tasks.rados.rados.0.trial118.stdout:3637: writing trial11845692-38 from 477662 to 1057494 tid 1 2026-02-17T05:43:39.399 INFO:tasks.rados.rados.0.trial118.stdout:3637: writing trial11845692-38 from 1683380 to 2239148 tid 2 2026-02-17T05:43:39.403 INFO:tasks.rados.rados.0.trial118.stdout:3637: writing trial11845692-38 from 2966450 to 3277662 tid 3 2026-02-17T05:43:39.403 INFO:tasks.rados.rados.0.trial118.stdout:3635: done (2 left) 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3638: delete oid 46 current snap is 395 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: finishing write tid 2 to trial11845692-28 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: finishing write tid 3 to trial11845692-28 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: finishing write tid 4 to trial11845692-28 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: finishing write tid 5 to trial11845692-28 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: oid 28 updating version 0 to 2140 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: oid 28 version 2140 is already newer than 2137 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: oid 28 version 2140 is already newer than 2139 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: oid 28 version 2140 is already newer than 2138 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2140 (ObjNum 1265 snap 395 seq_num 1265) dirty exists 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3636: left oid 28 (ObjNum 1265 snap 395 seq_num 1265) 2026-02-17T05:43:39.404 INFO:tasks.rados.rados.0.trial118.stdout:3637: finishing write tid 1 to trial11845692-38 2026-02-17T05:43:39.405 INFO:tasks.rados.rados.0.trial118.stdout:3637: finishing write tid 2 to trial11845692-38 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: finishing write tid 3 to trial11845692-38 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: finishing write tid 4 to trial11845692-38 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: finishing write tid 5 to trial11845692-38 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: oid 38 updating version 0 to 2164 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: oid 38 updating version 2164 to 2167 2026-02-17T05:43:39.406 INFO:tasks.rados.rados.0.trial118.stdout:3637: oid 38 version 2167 is already newer than 2165 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3637: oid 38 version 2167 is already newer than 2166 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 2167 (ObjNum 1266 snap 395 seq_num 1266) dirty exists 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3637: left oid 38 (ObjNum 1266 snap 395 seq_num 1266) 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3636: done (2 left) 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3637: done (1 left) 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3638: done (0 left) 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3639: copy_from oid 21 from oid 26 current snap is 395 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3640: snap_create 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3639: finishing copy_from to trial11845692-21 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3639: got expected ENOENT (src dne) 2026-02-17T05:43:39.407 INFO:tasks.rados.rados.0.trial118.stdout:3639: finishing copy_from racing read to trial11845692-21 2026-02-17T05:43:40.366 INFO:tasks.rados.rados.0.trial118.stdout:3639: done (1 left) 2026-02-17T05:43:40.366 INFO:tasks.rados.rados.0.trial118.stdout:3640: done (0 left) 2026-02-17T05:43:40.366 INFO:tasks.rados.rados.0.trial118.stdout:3641: snap_create 2026-02-17T05:43:41.369 INFO:tasks.rados.rados.0.trial118.stdout:3641: done (0 left) 2026-02-17T05:43:41.369 INFO:tasks.rados.rados.0.trial118.stdout:3642: write (excl) oid 2 current snap is 397 2026-02-17T05:43:41.369 INFO:tasks.rados.rados.0.trial118.stdout:3642: seq_num 1268 ranges {511276=730330,1800344=559437,3021296=289980} 2026-02-17T05:43:41.373 INFO:tasks.rados.rados.0.trial118.stdout:3642: writing trial11845692-2 from 511276 to 1241606 tid 1 2026-02-17T05:43:41.378 INFO:tasks.rados.rados.0.trial118.stdout:3642: writing trial11845692-2 from 1800344 to 2359781 tid 2 2026-02-17T05:43:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3642: writing trial11845692-2 from 3021296 to 3311276 tid 3 2026-02-17T05:43:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3643: write oid 38 current snap is 397 2026-02-17T05:43:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3642: finishing write tid 1 to trial11845692-2 2026-02-17T05:43:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3642: finishing write tid 2 to trial11845692-2 2026-02-17T05:43:41.382 INFO:tasks.rados.rados.0.trial118.stdout:3643: seq_num 1269 ranges {528083=405579,1342473=419448,2248719=733949} 2026-02-17T05:43:41.385 INFO:tasks.rados.rados.0.trial118.stdout:3643: writing trial11845692-38 from 528083 to 933662 tid 1 2026-02-17T05:43:41.388 INFO:tasks.rados.rados.0.trial118.stdout:3643: writing trial11845692-38 from 1342473 to 1761921 tid 2 2026-02-17T05:43:41.393 INFO:tasks.rados.rados.0.trial118.stdout:3643: writing trial11845692-38 from 2248719 to 2982668 tid 3 2026-02-17T05:43:41.393 INFO:tasks.rados.rados.0.trial118.stdout:3644: write oid 40 current snap is 397 2026-02-17T05:43:41.393 INFO:tasks.rados.rados.0.trial118.stdout:3644: seq_num 1270 ranges {544890=597181,1917308=563106,3076142=268748} 2026-02-17T05:43:41.397 INFO:tasks.rados.rados.0.trial118.stdout:3644: writing trial11845692-40 from 544890 to 1142071 tid 1 2026-02-17T05:43:41.402 INFO:tasks.rados.rados.0.trial118.stdout:3644: writing trial11845692-40 from 1917308 to 2480414 tid 2 2026-02-17T05:43:41.406 INFO:tasks.rados.rados.0.trial118.stdout:3644: writing trial11845692-40 from 3076142 to 3344890 tid 3 2026-02-17T05:43:41.407 INFO:tasks.rados.rados.0.trial118.stdout:3645: read oid 20 snap -1 2026-02-17T05:43:41.407 INFO:tasks.rados.rados.0.trial118.stdout:3645: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:41.407 INFO:tasks.rados.rados.0.trial118.stdout:3646: write oid 7 current snap is 397 2026-02-17T05:43:41.407 INFO:tasks.rados.rados.0.trial118.stdout:3646: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2026-02-17T05:43:41.411 INFO:tasks.rados.rados.0.trial118.stdout:3646: writing trial11845692-7 from 561697 to 1234127 tid 1 2026-02-17T05:43:41.416 INFO:tasks.rados.rados.0.trial118.stdout:3646: writing trial11845692-7 from 1975790 to 2682554 tid 2 2026-02-17T05:43:41.420 INFO:tasks.rados.rados.0.trial118.stdout:3646: writing trial11845692-7 from 3103565 to 3361697 tid 3 2026-02-17T05:43:41.420 INFO:tasks.rados.rados.0.trial118.stdout:3647: read oid 28 snap -1 2026-02-17T05:43:41.420 INFO:tasks.rados.rados.0.trial118.stdout:3647: expect (ObjNum 1265 snap 395 seq_num 1265) 2026-02-17T05:43:41.420 INFO:tasks.rados.rados.0.trial118.stdout:3648: rollback oid 24 current snap is 397 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 366 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: finishing write tid 3 to trial11845692-2 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: finishing write tid 4 to trial11845692-2 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: finishing write tid 5 to trial11845692-2 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: oid 2 updating version 0 to 2378 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: oid 2 version 2378 is already newer than 2377 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: oid 2 updating version 2378 to 2380 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: oid 2 version 2380 is already newer than 2379 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2380 (ObjNum 1268 snap 397 seq_num 1268) dirty exists 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3642: left oid 2 (ObjNum 1268 snap 397 seq_num 1268) 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3643: finishing write tid 1 to trial11845692-38 2026-02-17T05:43:41.421 INFO:tasks.rados.rados.0.trial118.stdout:3643: finishing write tid 2 to trial11845692-38 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3643: finishing write tid 3 to trial11845692-38 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3643: finishing write tid 4 to trial11845692-38 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3642: done (6 left) 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3649: read oid 8 snap -1 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3649: expect deleted 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3650: read oid 39 snap -1 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3650: expect deleted 2026-02-17T05:43:41.422 INFO:tasks.rados.rados.0.trial118.stdout:3651: snap_remove snap 370 2026-02-17T05:43:42.385 INFO:tasks.rados.rados.0.trial118.stdout:3651: done (8 left) 2026-02-17T05:43:42.386 INFO:tasks.rados.rados.0.trial118.stdout:3652: read oid 15 snap -1 2026-02-17T05:43:42.386 INFO:tasks.rados.rados.0.trial118.stdout:3652: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:42.386 INFO:tasks.rados.rados.0.trial118.stdout:3653: snap_create 2026-02-17T05:43:42.386 INFO:tasks.rados.rados.0.trial118.stdout:3643: finishing write tid 5 to trial11845692-38 2026-02-17T05:43:42.387 INFO:tasks.rados.rados.0.trial118.stdout:3643: oid 38 updating version 0 to 2170 2026-02-17T05:43:42.387 INFO:tasks.rados.rados.0.trial118.stdout:3643: oid 38 version 2170 is already newer than 2169 2026-02-17T05:43:42.387 INFO:tasks.rados.rados.0.trial118.stdout:3643: oid 38 version 2170 is already newer than 2168 2026-02-17T05:43:42.387 INFO:tasks.rados.rados.0.trial118.stdout:3643: oid 38 updating version 2170 to 2171 2026-02-17T05:43:42.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 38 v 2171 (ObjNum 1269 snap 397 seq_num 1269) dirty exists 2026-02-17T05:43:42.388 INFO:tasks.rados.rados.0.trial118.stdout:3643: left oid 38 (ObjNum 1269 snap 397 seq_num 1269) 2026-02-17T05:43:42.388 INFO:tasks.rados.rados.0.trial118.stdout:3644: finishing write tid 1 to trial11845692-40 2026-02-17T05:43:42.388 INFO:tasks.rados.rados.0.trial118.stdout:3644: finishing write tid 2 to trial11845692-40 2026-02-17T05:43:42.389 INFO:tasks.rados.rados.0.trial118.stdout:3645: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:42.393 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1148448 2026-02-17T05:43:42.542 INFO:tasks.rados.rados.0.trial118.stdout:3644: finishing write tid 3 to trial11845692-40 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: finishing write tid 4 to trial11845692-40 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: finishing write tid 5 to trial11845692-40 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: oid 40 updating version 0 to 2288 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: oid 40 updating version 2288 to 2289 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: oid 40 updating version 2289 to 2290 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: oid 40 version 2290 is already newer than 2287 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2290 (ObjNum 1270 snap 397 seq_num 1270) dirty exists 2026-02-17T05:43:42.543 INFO:tasks.rados.rados.0.trial118.stdout:3644: left oid 40 (ObjNum 1270 snap 397 seq_num 1270) 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: finishing write tid 1 to trial11845692-7 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: finishing write tid 2 to trial11845692-7 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: finishing write tid 3 to trial11845692-7 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: finishing write tid 4 to trial11845692-7 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: finishing write tid 5 to trial11845692-7 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: oid 7 updating version 0 to 2237 2026-02-17T05:43:42.544 INFO:tasks.rados.rados.0.trial118.stdout:3646: oid 7 updating version 2237 to 2238 2026-02-17T05:43:42.545 INFO:tasks.rados.rados.0.trial118.stdout:3646: oid 7 version 2238 is already newer than 2235 2026-02-17T05:43:42.545 INFO:tasks.rados.rados.0.trial118.stdout:3646: oid 7 version 2238 is already newer than 2236 2026-02-17T05:43:42.545 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2238 (ObjNum 1271 snap 397 seq_num 1271) dirty exists 2026-02-17T05:43:42.545 INFO:tasks.rados.rados.0.trial118.stdout:3646: left oid 7 (ObjNum 1271 snap 397 seq_num 1271) 2026-02-17T05:43:42.545 INFO:tasks.rados.rados.0.trial118.stdout:3648: finishing rollback tid 0 to trial11845692-24 2026-02-17T05:43:42.546 INFO:tasks.rados.rados.0.trial118.stdout:3648: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:43:42.546 INFO:tasks.rados.rados.0.trial118.stdout:3648: finishing rollback tid 2 to trial11845692-24 2026-02-17T05:43:42.546 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1740 (ObjNum 1161 snap 363 seq_num 1161) dirty exists 2026-02-17T05:43:42.546 INFO:tasks.rados.rados.0.trial118.stdout:3647: expect (ObjNum 1265 snap 395 seq_num 1265) 2026-02-17T05:43:42.580 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:42.604 INFO:tasks.rados.rados.0.trial118.stdout:3652: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:42.625 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2281596 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3643: done (9 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3644: done (8 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3645: done (7 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3646: done (6 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3647: done (5 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3648: done (4 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3649: done (3 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3650: done (2 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3652: done (1 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3653: done (0 left) 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3654: write (excl) oid 39 current snap is 398 2026-02-17T05:43:43.385 INFO:tasks.rados.rados.0.trial118.stdout:3654: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2026-02-17T05:43:43.390 INFO:tasks.rados.rados.0.trial118.stdout:3654: writing trial11845692-39 from 578504 to 1326183 tid 1 2026-02-17T05:43:43.395 INFO:tasks.rados.rados.0.trial118.stdout:3654: writing trial11845692-39 from 2034272 to 2601047 tid 2 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3654: writing trial11845692-39 from 3130988 to 3378504 tid 3 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3655: read oid 14 snap -1 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3655: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3656: copy_from oid 42 from oid 2 current snap is 398 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3654: finishing write tid 1 to trial11845692-39 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3654: finishing write tid 2 to trial11845692-39 2026-02-17T05:43:43.398 INFO:tasks.rados.rados.0.trial118.stdout:3657: snap_create 2026-02-17T05:43:43.399 INFO:tasks.rados.rados.0.trial118.stdout:3654: finishing write tid 3 to trial11845692-39 2026-02-17T05:43:43.399 INFO:tasks.rados.rados.0.trial118.stdout:3654: finishing write tid 4 to trial11845692-39 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: finishing write tid 5 to trial11845692-39 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: oid 39 updating version 0 to 2173 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: oid 39 updating version 2173 to 2175 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: oid 39 version 2175 is already newer than 2172 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: oid 39 version 2175 is already newer than 2174 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 2175 (ObjNum 1272 snap 398 seq_num 1272) dirty exists 2026-02-17T05:43:43.400 INFO:tasks.rados.rados.0.trial118.stdout:3654: left oid 39 (ObjNum 1272 snap 398 seq_num 1272) 2026-02-17T05:43:43.403 INFO:tasks.rados.rados.0.trial118.stdout:3655: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:43:43.469 INFO:tasks.rados.rados.0.trial118.stdout:3656: finishing copy_from racing read to trial11845692-42 2026-02-17T05:43:43.470 INFO:tasks.rados.rados.0.trial118.stdout:3656: finishing copy_from to trial11845692-42 2026-02-17T05:43:43.470 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 2380 (ObjNum 1268 snap 397 seq_num 1268) dirty exists 2026-02-17T05:43:44.389 INFO:tasks.rados.rados.0.trial118.stdout:3654: done (3 left) 2026-02-17T05:43:44.390 INFO:tasks.rados.rados.0.trial118.stdout:3655: done (2 left) 2026-02-17T05:43:44.390 INFO:tasks.rados.rados.0.trial118.stdout:3656: done (1 left) 2026-02-17T05:43:44.390 INFO:tasks.rados.rados.0.trial118.stdout:3657: done (0 left) 2026-02-17T05:43:44.390 INFO:tasks.rados.rados.0.trial118.stdout:3658: copy_from oid 31 from oid 7 current snap is 399 2026-02-17T05:43:44.390 INFO:tasks.rados.rados.0.trial118.stdout:3659: delete oid 11 current snap is 399 2026-02-17T05:43:44.391 INFO:tasks.rados.rados.0.trial118.stdout:3659: done (1 left) 2026-02-17T05:43:44.392 INFO:tasks.rados.rados.0.trial118.stdout:3660: delete oid 48 current snap is 399 2026-02-17T05:43:44.394 INFO:tasks.rados.rados.0.trial118.stdout:3660: done (1 left) 2026-02-17T05:43:44.394 INFO:tasks.rados.rados.0.trial118.stdout:3661: delete oid 18 current snap is 399 2026-02-17T05:43:44.396 INFO:tasks.rados.rados.0.trial118.stdout:3661: done (1 left) 2026-02-17T05:43:44.396 INFO:tasks.rados.rados.0.trial118.stdout:3662: rollback oid 43 current snap is 399 2026-02-17T05:43:44.396 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 43 to 398 2026-02-17T05:43:44.396 INFO:tasks.rados.rados.0.trial118.stdout:3663: copy_from oid 50 from oid 20 current snap is 399 2026-02-17T05:43:44.396 INFO:tasks.rados.rados.0.trial118.stdout:3664: snap_create 2026-02-17T05:43:44.397 INFO:tasks.rados.rados.0.trial118.stdout:3658: finishing copy_from racing read to trial11845692-31 2026-02-17T05:43:44.398 INFO:tasks.rados.rados.0.trial118.stdout:3658: finishing copy_from to trial11845692-31 2026-02-17T05:43:44.398 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 2238 (ObjNum 1271 snap 397 seq_num 1271) dirty exists 2026-02-17T05:43:44.400 INFO:tasks.rados.rados.0.trial118.stdout:3662: finishing rollback tid 0 to trial11845692-43 2026-02-17T05:43:44.400 INFO:tasks.rados.rados.0.trial118.stdout:3662: finishing rollback tid 1 to trial11845692-43 2026-02-17T05:43:44.400 INFO:tasks.rados.rados.0.trial118.stdout:3662: finishing rollback tid 2 to trial11845692-43 2026-02-17T05:43:44.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 43 v 2148 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-17T05:43:44.405 INFO:tasks.rados.rados.0.trial118.stdout:3663: finishing copy_from racing read to trial11845692-50 2026-02-17T05:43:44.407 INFO:tasks.rados.rados.0.trial118.stdout:3663: finishing copy_from to trial11845692-50 2026-02-17T05:43:44.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:43:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3658: done (3 left) 2026-02-17T05:43:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3662: done (2 left) 2026-02-17T05:43:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3663: done (1 left) 2026-02-17T05:43:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3664: done (0 left) 2026-02-17T05:43:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3665: snap_create 2026-02-17T05:43:46.394 INFO:tasks.rados.rados.0.trial118.stdout:3665: done (0 left) 2026-02-17T05:43:46.394 INFO:tasks.rados.rados.0.trial118.stdout:3666: read oid 47 snap -1 2026-02-17T05:43:46.394 INFO:tasks.rados.rados.0.trial118.stdout:3666: expect (ObjNum 1160 snap 362 seq_num 1160) 2026-02-17T05:43:46.394 INFO:tasks.rados.rados.0.trial118.stdout:3667: snap_create 2026-02-17T05:43:46.401 INFO:tasks.rados.rados.0.trial118.stdout:3666: expect (ObjNum 1160 snap 362 seq_num 1160) 2026-02-17T05:43:46.487 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3666: done (1 left) 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3667: done (0 left) 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3668: read oid 19 snap -1 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3668: expect (ObjNum 1250 snap 392 seq_num 1250) 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3669: rollback oid 49 current snap is 402 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 49 to 392 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:3670: rollback oid 18 current snap is 402 2026-02-17T05:43:47.396 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 399 2026-02-17T05:43:47.397 INFO:tasks.rados.rados.0.trial118.stdout:3671: read oid 4 snap -1 2026-02-17T05:43:47.397 INFO:tasks.rados.rados.0.trial118.stdout:3671: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:47.397 INFO:tasks.rados.rados.0.trial118.stdout:3672: write (excl) oid 14 current snap is 402 2026-02-17T05:43:47.397 INFO:tasks.rados.rados.0.trial118.stdout:3672: seq_num 1276 ranges {645732=648675,1751847=574113,3124327=321405} 2026-02-17T05:43:47.400 INFO:tasks.rados.rados.0.trial118.stdout:3672: writing trial11845692-14 from 645732 to 1294407 tid 1 2026-02-17T05:43:47.404 INFO:tasks.rados.rados.0.trial118.stdout:3672: writing trial11845692-14 from 1751847 to 2325960 tid 2 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3672: writing trial11845692-14 from 3124327 to 3445732 tid 3 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3673: read oid 7 snap -1 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3673: expect (ObjNum 1271 snap 397 seq_num 1271) 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3674: copy_from oid 21 from oid 34 current snap is 402 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3670: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2141 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:47.409 INFO:tasks.rados.rados.0.trial118.stdout:3671: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:43:47.423 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1102400 2026-02-17T05:43:47.455 INFO:tasks.rados.rados.0.trial118.stdout:3669: finishing rollback tid 0 to trial11845692-49 2026-02-17T05:43:47.455 INFO:tasks.rados.rados.0.trial118.stdout:3669: finishing rollback tid 1 to trial11845692-49 2026-02-17T05:43:47.456 INFO:tasks.rados.rados.0.trial118.stdout:3669: finishing rollback tid 2 to trial11845692-49 2026-02-17T05:43:47.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1892 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:43:47.456 INFO:tasks.rados.rados.0.trial118.stdout:3668: expect (ObjNum 1250 snap 392 seq_num 1250) 2026-02-17T05:43:47.462 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1398233 2026-02-17T05:43:47.524 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: finishing write tid 1 to trial11845692-14 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: finishing write tid 2 to trial11845692-14 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: finishing write tid 3 to trial11845692-14 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: finishing write tid 4 to trial11845692-14 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: finishing write tid 5 to trial11845692-14 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: oid 14 updating version 0 to 1810 2026-02-17T05:43:47.564 INFO:tasks.rados.rados.0.trial118.stdout:3672: oid 14 updating version 1810 to 1811 2026-02-17T05:43:47.565 INFO:tasks.rados.rados.0.trial118.stdout:3672: oid 14 updating version 1811 to 1812 2026-02-17T05:43:47.565 INFO:tasks.rados.rados.0.trial118.stdout:3672: oid 14 updating version 1812 to 1813 2026-02-17T05:43:47.565 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1813 (ObjNum 1276 snap 402 seq_num 1276) dirty exists 2026-02-17T05:43:47.565 INFO:tasks.rados.rados.0.trial118.stdout:3672: left oid 14 (ObjNum 1276 snap 402 seq_num 1276) 2026-02-17T05:43:47.565 INFO:tasks.rados.rados.0.trial118.stdout:3673: expect (ObjNum 1271 snap 397 seq_num 1271) 2026-02-17T05:43:47.567 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1080560 2026-02-17T05:43:47.645 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:47.688 INFO:tasks.rados.rados.0.trial118.stdout:3674: finishing copy_from to trial11845692-21 2026-02-17T05:43:47.688 INFO:tasks.rados.rados.0.trial118.stdout:3674: got expected ENOENT (src dne) 2026-02-17T05:43:47.688 INFO:tasks.rados.rados.0.trial118.stdout:3674: finishing copy_from racing read to trial11845692-21 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3668: done (6 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3669: done (5 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3670: done (4 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3671: done (3 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3672: done (2 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3673: done (1 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3674: done (0 left) 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3675: copy_from oid 35 from oid 20 current snap is 402 2026-02-17T05:43:47.689 INFO:tasks.rados.rados.0.trial118.stdout:3676: delete oid 39 current snap is 402 2026-02-17T05:43:47.690 INFO:tasks.rados.rados.0.trial118.stdout:3676: done (1 left) 2026-02-17T05:43:47.690 INFO:tasks.rados.rados.0.trial118.stdout:3677: read oid 25 snap -1 2026-02-17T05:43:47.690 INFO:tasks.rados.rados.0.trial118.stdout:3677: expect (ObjNum 1190 snap 374 seq_num 1190) 2026-02-17T05:43:47.690 INFO:tasks.rados.rados.0.trial118.stdout:3678: read oid 22 snap -1 2026-02-17T05:43:47.691 INFO:tasks.rados.rados.0.trial118.stdout:3678: expect deleted 2026-02-17T05:43:47.691 INFO:tasks.rados.rados.0.trial118.stdout:3679: copy_from oid 6 from oid 46 current snap is 402 2026-02-17T05:43:47.691 INFO:tasks.rados.rados.0.trial118.stdout:3680: write (excl) oid 29 current snap is 402 2026-02-17T05:43:47.691 INFO:tasks.rados.rados.0.trial118.stdout:3680: seq_num 1278 ranges {679346=515526,1868811=577782,3179173=300173} 2026-02-17T05:43:47.694 INFO:tasks.rados.rados.0.trial118.stdout:3680: writing trial11845692-29 from 679346 to 1194872 tid 1 2026-02-17T05:43:47.699 INFO:tasks.rados.rados.0.trial118.stdout:3680: writing trial11845692-29 from 1868811 to 2446593 tid 2 2026-02-17T05:43:47.703 INFO:tasks.rados.rados.0.trial118.stdout:3680: writing trial11845692-29 from 3179173 to 3479346 tid 3 2026-02-17T05:43:47.703 INFO:tasks.rados.rados.0.trial118.stdout:3681: snap_create 2026-02-17T05:43:47.703 INFO:tasks.rados.rados.0.trial118.stdout:3677: expect (ObjNum 1190 snap 374 seq_num 1190) 2026-02-17T05:43:47.739 INFO:tasks.rados.rados.0.trial118.stdout:3679: finishing copy_from to trial11845692-6 2026-02-17T05:43:47.739 INFO:tasks.rados.rados.0.trial118.stdout:3679: got expected ENOENT (src dne) 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3679: finishing copy_from racing read to trial11845692-6 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3675: finishing copy_from racing read to trial11845692-35 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3675: finishing copy_from to trial11845692-35 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: finishing write tid 1 to trial11845692-29 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: finishing write tid 2 to trial11845692-29 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: finishing write tid 3 to trial11845692-29 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: finishing write tid 4 to trial11845692-29 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: finishing write tid 5 to trial11845692-29 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: oid 29 updating version 0 to 2250 2026-02-17T05:43:47.740 INFO:tasks.rados.rados.0.trial118.stdout:3680: oid 29 version 2250 is already newer than 2248 2026-02-17T05:43:47.741 INFO:tasks.rados.rados.0.trial118.stdout:3680: oid 29 version 2250 is already newer than 2249 2026-02-17T05:43:47.741 INFO:tasks.rados.rados.0.trial118.stdout:3680: oid 29 updating version 2250 to 2251 2026-02-17T05:43:47.741 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 2251 (ObjNum 1278 snap 402 seq_num 1278) dirty exists 2026-02-17T05:43:47.741 INFO:tasks.rados.rados.0.trial118.stdout:3680: left oid 29 (ObjNum 1278 snap 402 seq_num 1278) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3675: done (5 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3677: done (4 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3678: done (3 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3679: done (2 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3680: done (1 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3681: done (0 left) 2026-02-17T05:43:48.402 INFO:tasks.rados.rados.0.trial118.stdout:3682: rollback oid 24 current snap is 403 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 24 to 378 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:3683: rollback oid 26 current snap is 403 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 388 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:3684: copy_from oid 28 from oid 9 current snap is 403 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:3685: write (excl) oid 5 current snap is 403 2026-02-17T05:43:48.403 INFO:tasks.rados.rados.0.trial118.stdout:3685: seq_num 1279 ranges {696153=590775,1927293=721440,3206596=289557} 2026-02-17T05:43:48.405 INFO:tasks.rados.rados.0.trial118.stdout:3685: writing trial11845692-5 from 696153 to 1286928 tid 1 2026-02-17T05:43:48.411 INFO:tasks.rados.rados.0.trial118.stdout:3685: writing trial11845692-5 from 1927293 to 2648733 tid 2 2026-02-17T05:43:48.414 INFO:tasks.rados.rados.0.trial118.stdout:3685: writing trial11845692-5 from 3206596 to 3496153 tid 3 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3686: delete oid 7 current snap is 403 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3683: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1475 (ObjNum 257 snap 0 seq_num 11499056) dirty dne 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3682: finishing rollback tid 0 to trial11845692-24 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3682: finishing rollback tid 1 to trial11845692-24 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3682: finishing rollback tid 2 to trial11845692-24 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1743 (ObjNum 1161 snap 363 seq_num 1161) dirty exists 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3685: finishing write tid 1 to trial11845692-5 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3684: finishing copy_from racing read to trial11845692-28 2026-02-17T05:43:48.415 INFO:tasks.rados.rados.0.trial118.stdout:3685: finishing write tid 2 to trial11845692-5 2026-02-17T05:43:48.416 INFO:tasks.rados.rados.0.trial118.stdout:3684: finishing copy_from to trial11845692-28 2026-02-17T05:43:48.416 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2225 (ObjNum 1256 snap 392 seq_num 1256) dirty exists 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: finishing write tid 3 to trial11845692-5 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: finishing write tid 4 to trial11845692-5 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: finishing write tid 5 to trial11845692-5 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: oid 5 updating version 0 to 1815 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: oid 5 version 1815 is already newer than 1814 2026-02-17T05:43:48.417 INFO:tasks.rados.rados.0.trial118.stdout:3685: oid 5 updating version 1815 to 1816 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3685: oid 5 updating version 1816 to 1817 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 5 v 1817 (ObjNum 1279 snap 403 seq_num 1279) dirty exists 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3685: left oid 5 (ObjNum 1279 snap 403 seq_num 1279) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3682: done (4 left) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3683: done (3 left) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3684: done (2 left) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3685: done (1 left) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3686: done (0 left) 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3687: write (excl) oid 20 current snap is 403 2026-02-17T05:43:48.418 INFO:tasks.rados.rados.0.trial118.stdout:3687: seq_num 1281 ranges {729767=741273,1927904=725109,3145089=384678} 2026-02-17T05:43:48.421 INFO:tasks.rados.rados.0.trial118.stdout:3687: writing trial11845692-20 from 729767 to 1471040 tid 1 2026-02-17T05:43:48.426 INFO:tasks.rados.rados.0.trial118.stdout:3687: writing trial11845692-20 from 1927904 to 2653013 tid 2 2026-02-17T05:43:48.429 INFO:tasks.rados.rados.0.trial118.stdout:3687: writing trial11845692-20 from 3145089 to 3529767 tid 3 2026-02-17T05:43:48.429 INFO:tasks.rados.rados.0.trial118.stdout:3688: write oid 14 current snap is 403 2026-02-17T05:43:48.430 INFO:tasks.rados.rados.0.trial118.stdout:3688: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2026-02-17T05:43:48.433 INFO:tasks.rados.rados.0.trial118.stdout:3688: writing trial11845692-14 from 746574 to 1163096 tid 1 2026-02-17T05:43:48.437 INFO:tasks.rados.rados.0.trial118.stdout:3688: writing trial11845692-14 from 1586386 to 2055153 tid 2 2026-02-17T05:43:48.442 INFO:tasks.rados.rados.0.trial118.stdout:3688: writing trial11845692-14 from 2772512 to 3402056 tid 3 2026-02-17T05:43:48.442 INFO:tasks.rados.rados.0.trial118.stdout:3689: copy_from oid 17 from oid 11 current snap is 403 2026-02-17T05:43:48.442 INFO:tasks.rados.rados.0.trial118.stdout:3687: finishing write tid 1 to trial11845692-20 2026-02-17T05:43:48.443 INFO:tasks.rados.rados.0.trial118.stdout:3687: finishing write tid 2 to trial11845692-20 2026-02-17T05:43:48.443 INFO:tasks.rados.rados.0.trial118.stdout:3690: write oid 39 current snap is 403 2026-02-17T05:43:48.443 INFO:tasks.rados.rados.0.trial118.stdout:3690: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2026-02-17T05:43:48.446 INFO:tasks.rados.rados.0.trial118.stdout:3690: writing trial11845692-39 from 763381 to 1255152 tid 1 2026-02-17T05:43:48.452 INFO:tasks.rados.rados.0.trial118.stdout:3690: writing trial11845692-39 from 2044868 to 2773646 tid 2 2026-02-17T05:43:48.456 INFO:tasks.rados.rados.0.trial118.stdout:3690: writing trial11845692-39 from 3199935 to 3563381 tid 3 2026-02-17T05:43:48.456 INFO:tasks.rados.rados.0.trial118.stdout:3691: delete oid 28 current snap is 403 2026-02-17T05:43:48.456 INFO:tasks.rados.rados.0.trial118.stdout:3687: finishing write tid 3 to trial11845692-20 2026-02-17T05:43:48.456 INFO:tasks.rados.rados.0.trial118.stdout:3687: finishing write tid 4 to trial11845692-20 2026-02-17T05:43:48.456 INFO:tasks.rados.rados.0.trial118.stdout:3687: finishing write tid 5 to trial11845692-20 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3687: oid 20 updating version 0 to 2393 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3687: oid 20 updating version 2393 to 2396 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3687: oid 20 version 2396 is already newer than 2395 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3687: oid 20 version 2396 is already newer than 2394 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2396 (ObjNum 1281 snap 403 seq_num 1281) dirty exists 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3687: left oid 20 (ObjNum 1281 snap 403 seq_num 1281) 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3688: finishing write tid 1 to trial11845692-14 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3688: finishing write tid 2 to trial11845692-14 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3689: finishing copy_from to trial11845692-17 2026-02-17T05:43:48.457 INFO:tasks.rados.rados.0.trial118.stdout:3689: got expected ENOENT (src dne) 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3689: finishing copy_from racing read to trial11845692-17 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: finishing write tid 3 to trial11845692-14 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: finishing write tid 4 to trial11845692-14 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: finishing write tid 5 to trial11845692-14 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: oid 14 updating version 0 to 1818 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: oid 14 updating version 1818 to 1821 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: oid 14 version 1821 is already newer than 1819 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: oid 14 version 1821 is already newer than 1820 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1821 (ObjNum 1282 snap 403 seq_num 1282) dirty exists 2026-02-17T05:43:48.458 INFO:tasks.rados.rados.0.trial118.stdout:3688: left oid 14 (ObjNum 1282 snap 403 seq_num 1282) 2026-02-17T05:43:48.459 INFO:tasks.rados.rados.0.trial118.stdout:3690: finishing write tid 1 to trial11845692-39 2026-02-17T05:43:48.459 INFO:tasks.rados.rados.0.trial118.stdout:3690: finishing write tid 2 to trial11845692-39 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3687: done (4 left) 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3688: done (3 left) 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3689: done (2 left) 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3691: done (1 left) 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3692: read oid 13 snap -1 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3692: expect (ObjNum 1178 snap 369 seq_num 1178) 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3693: write (excl) oid 14 current snap is 403 2026-02-17T05:43:48.460 INFO:tasks.rados.rados.0.trial118.stdout:3693: seq_num 1285 ranges {796995=758622,2161832=732447} 2026-02-17T05:43:48.462 INFO:tasks.rados.rados.0.trial118.stdout:3693: writing trial11845692-14 from 796995 to 1555617 tid 1 2026-02-17T05:43:48.467 INFO:tasks.rados.rados.0.trial118.stdout:3693: writing trial11845692-14 from 2161832 to 2894279 tid 2 2026-02-17T05:43:48.467 INFO:tasks.rados.rados.0.trial118.stdout:3694: write oid 22 current snap is 403 2026-02-17T05:43:48.468 INFO:tasks.rados.rados.0.trial118.stdout:3690: finishing write tid 3 to trial11845692-39 2026-02-17T05:43:48.468 INFO:tasks.rados.rados.0.trial118.stdout:3694: seq_num 1286 ranges {413802=433871,1420314=476105,2482204=790985} 2026-02-17T05:43:48.470 INFO:tasks.rados.rados.0.trial118.stdout:3694: writing trial11845692-22 from 413802 to 847673 tid 1 2026-02-17T05:43:48.474 INFO:tasks.rados.rados.0.trial118.stdout:3694: writing trial11845692-22 from 1420314 to 1896419 tid 2 2026-02-17T05:43:48.480 INFO:tasks.rados.rados.0.trial118.stdout:3694: writing trial11845692-22 from 2482204 to 3273189 tid 3 2026-02-17T05:43:48.480 INFO:tasks.rados.rados.0.trial118.stdout:3695: read oid 33 snap -1 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3695: expect (ObjNum 1233 snap 388 seq_num 1233) 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3696: rollback oid 40 current snap is 403 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 378 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: finishing write tid 4 to trial11845692-39 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: finishing write tid 5 to trial11845692-39 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: oid 39 updating version 0 to 2382 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: oid 39 updating version 2382 to 2383 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: oid 39 updating version 2383 to 2385 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:3690: oid 39 version 2385 is already newer than 2384 2026-02-17T05:43:48.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 2385 (ObjNum 1283 snap 403 seq_num 1283) dirty exists 2026-02-17T05:43:48.482 INFO:tasks.rados.rados.0.trial118.stdout:3690: left oid 39 (ObjNum 1283 snap 403 seq_num 1283) 2026-02-17T05:43:48.482 INFO:tasks.rados.rados.0.trial118.stdout:3692: expect (ObjNum 1178 snap 369 seq_num 1178) 2026-02-17T05:43:48.482 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:48.699 INFO:tasks.rados.rados.0.trial118.stdout:3693: finishing write tid 1 to trial11845692-14 2026-02-17T05:43:48.699 INFO:tasks.rados.rados.0.trial118.stdout:3690: done (5 left) 2026-02-17T05:43:48.699 INFO:tasks.rados.rados.0.trial118.stdout:3692: done (4 left) 2026-02-17T05:43:48.699 INFO:tasks.rados.rados.0.trial118.stdout:3697: write (excl) oid 7 current snap is 403 2026-02-17T05:43:48.699 INFO:tasks.rados.rados.0.trial118.stdout:3697: seq_num 1287 ranges {430609=509120,1478796=736116,2909627=602257} 2026-02-17T05:43:48.702 INFO:tasks.rados.rados.0.trial118.stdout:3697: writing trial11845692-7 from 430609 to 939729 tid 1 2026-02-17T05:43:48.706 INFO:tasks.rados.rados.0.trial118.stdout:3697: writing trial11845692-7 from 1478796 to 2214912 tid 2 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3697: writing trial11845692-7 from 2909627 to 3511884 tid 3 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3698: snap_create 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: finishing write tid 2 to trial11845692-14 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: finishing write tid 3 to trial11845692-14 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: finishing write tid 4 to trial11845692-14 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: oid 14 updating version 0 to 1824 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: oid 14 version 1824 is already newer than 1822 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:3693: oid 14 version 1824 is already newer than 1823 2026-02-17T05:43:48.712 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1824 (ObjNum 1285 snap 403 seq_num 1285) dirty exists 2026-02-17T05:43:48.713 INFO:tasks.rados.rados.0.trial118.stdout:3693: left oid 14 (ObjNum 1285 snap 403 seq_num 1285) 2026-02-17T05:43:48.713 INFO:tasks.rados.rados.0.trial118.stdout:3694: finishing write tid 1 to trial11845692-22 2026-02-17T05:43:48.713 INFO:tasks.rados.rados.0.trial118.stdout:3694: finishing write tid 2 to trial11845692-22 2026-02-17T05:43:48.713 INFO:tasks.rados.rados.0.trial118.stdout:3695: expect (ObjNum 1233 snap 388 seq_num 1233) 2026-02-17T05:43:48.732 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: finishing write tid 3 to trial11845692-22 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: finishing write tid 4 to trial11845692-22 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: finishing write tid 5 to trial11845692-22 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: oid 22 updating version 0 to 1991 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: oid 22 version 1991 is already newer than 1989 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: oid 22 updating version 1991 to 1992 2026-02-17T05:43:48.765 INFO:tasks.rados.rados.0.trial118.stdout:3694: oid 22 version 1992 is already newer than 1990 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 22 v 1992 (ObjNum 1286 snap 403 seq_num 1286) dirty exists 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3694: left oid 22 (ObjNum 1286 snap 403 seq_num 1286) 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3696: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3696: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3696: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2300 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: finishing write tid 1 to trial11845692-7 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: finishing write tid 2 to trial11845692-7 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: finishing write tid 3 to trial11845692-7 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: finishing write tid 4 to trial11845692-7 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: finishing write tid 5 to trial11845692-7 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: oid 7 updating version 0 to 2255 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: oid 7 updating version 2255 to 2257 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: oid 7 version 2257 is already newer than 2256 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:3697: oid 7 version 2257 is already newer than 2254 2026-02-17T05:43:48.766 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2257 (ObjNum 1287 snap 403 seq_num 1287) dirty exists 2026-02-17T05:43:48.767 INFO:tasks.rados.rados.0.trial118.stdout:3697: left oid 7 (ObjNum 1287 snap 403 seq_num 1287) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3693: done (5 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3694: done (4 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3695: done (3 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3696: done (2 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3697: done (1 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3698: done (0 left) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3699: rollback oid 42 current snap is 404 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 42 to 396 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3700: read oid 2 snap -1 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3700: expect (ObjNum 1268 snap 397 seq_num 1268) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3701: read oid 49 snap 393 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3701: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:49.404 INFO:tasks.rados.rados.0.trial118.stdout:3702: snap_remove snap 366 2026-02-17T05:43:50.367 INFO:tasks.rados.rados.0.trial118.stdout:3702: done (3 left) 2026-02-17T05:43:50.368 INFO:tasks.rados.rados.0.trial118.stdout:3703: delete oid 13 current snap is 404 2026-02-17T05:43:50.368 INFO:tasks.rados.rados.0.trial118.stdout:3700: expect (ObjNum 1268 snap 397 seq_num 1268) 2026-02-17T05:43:50.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3225915 2026-02-17T05:43:50.423 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 958574 2026-02-17T05:43:50.471 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:50.529 INFO:tasks.rados.rados.0.trial118.stdout:3699: finishing rollback tid 0 to trial11845692-42 2026-02-17T05:43:50.529 INFO:tasks.rados.rados.0.trial118.stdout:3699: finishing rollback tid 1 to trial11845692-42 2026-02-17T05:43:50.529 INFO:tasks.rados.rados.0.trial118.stdout:3699: finishing rollback tid 2 to trial11845692-42 2026-02-17T05:43:50.529 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 2388 (ObjNum 1243 snap 390 seq_num 1243) dirty exists 2026-02-17T05:43:50.530 INFO:tasks.rados.rados.0.trial118.stdout:3701: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:50.530 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 134894 2026-02-17T05:43:50.582 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:50.690 INFO:tasks.rados.rados.0.trial118.stdout:3699: done (3 left) 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3700: done (2 left) 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3701: done (1 left) 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3703: done (0 left) 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3704: read oid 18 snap -1 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3704: expect deleted 2026-02-17T05:43:50.691 INFO:tasks.rados.rados.0.trial118.stdout:3705: snap_create 2026-02-17T05:43:51.407 INFO:tasks.rados.rados.0.trial118.stdout:3704: done (1 left) 2026-02-17T05:43:51.407 INFO:tasks.rados.rados.0.trial118.stdout:3705: done (0 left) 2026-02-17T05:43:51.407 INFO:tasks.rados.rados.0.trial118.stdout:3706: snap_remove snap 398 2026-02-17T05:43:52.410 INFO:tasks.rados.rados.0.trial118.stdout:3706: done (0 left) 2026-02-17T05:43:52.411 INFO:tasks.rados.rados.0.trial118.stdout:3707: delete oid 39 current snap is 405 2026-02-17T05:43:52.415 INFO:tasks.rados.rados.0.trial118.stdout:3707: done (0 left) 2026-02-17T05:43:52.415 INFO:tasks.rados.rados.0.trial118.stdout:3708: write oid 24 current snap is 405 2026-02-17T05:43:52.415 INFO:tasks.rados.rados.0.trial118.stdout:3708: seq_num 1290 ranges {481030=734867,1937889=483443,2875543=552426} 2026-02-17T05:43:52.419 INFO:tasks.rados.rados.0.trial118.stdout:3708: writing trial11845692-24 from 481030 to 1215897 tid 1 2026-02-17T05:43:52.424 INFO:tasks.rados.rados.0.trial118.stdout:3708: writing trial11845692-24 from 1937889 to 2421332 tid 2 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:3708: writing trial11845692-24 from 2875543 to 3427969 tid 3 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:3709: rollback oid 14 current snap is 405 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 348 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:3708: finishing write tid 1 to trial11845692-24 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:3708: finishing write tid 2 to trial11845692-24 2026-02-17T05:43:52.428 INFO:tasks.rados.rados.0.trial118.stdout:3710: delete oid 8 current snap is 405 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:3710: done (2 left) 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:3711: rollback oid 39 current snap is 405 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 401 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:3712: read oid 35 snap 404 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:3712: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:52.429 INFO:tasks.rados.rados.0.trial118.stdout:3713: delete oid 9 current snap is 405 2026-02-17T05:43:52.430 INFO:tasks.rados.rados.0.trial118.stdout:3713: done (4 left) 2026-02-17T05:43:52.430 INFO:tasks.rados.rados.0.trial118.stdout:3714: write (excl) oid 20 current snap is 405 2026-02-17T05:43:52.430 INFO:tasks.rados.rados.0.trial118.stdout:3714: seq_num 1293 ranges {531451=676967,1713335=747123,2957812=502595} 2026-02-17T05:43:52.435 INFO:tasks.rados.rados.0.trial118.stdout:3714: writing trial11845692-20 from 531451 to 1208418 tid 1 2026-02-17T05:43:52.440 INFO:tasks.rados.rados.0.trial118.stdout:3714: writing trial11845692-20 from 1713335 to 2460458 tid 2 2026-02-17T05:43:52.444 INFO:tasks.rados.rados.0.trial118.stdout:3714: writing trial11845692-20 from 2957812 to 3460407 tid 3 2026-02-17T05:43:52.444 INFO:tasks.rados.rados.0.trial118.stdout:3715: write oid 40 current snap is 405 2026-02-17T05:43:52.444 INFO:tasks.rados.rados.0.trial118.stdout:3711: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:43:52.444 INFO:tasks.rados.rados.0.trial118.stdout:3709: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:43:52.445 INFO:tasks.rados.rados.0.trial118.stdout:3709: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:43:52.445 INFO:tasks.rados.rados.0.trial118.stdout:3715: seq_num 1294 ranges {548258=752216,1771817=490781,2985235=713867} 2026-02-17T05:43:52.448 INFO:tasks.rados.rados.0.trial118.stdout:3715: writing trial11845692-40 from 548258 to 1300474 tid 1 2026-02-17T05:43:52.452 INFO:tasks.rados.rados.0.trial118.stdout:3715: writing trial11845692-40 from 1771817 to 2262598 tid 2 2026-02-17T05:43:52.457 INFO:tasks.rados.rados.0.trial118.stdout:3715: writing trial11845692-40 from 2985235 to 3699102 tid 3 2026-02-17T05:43:52.457 INFO:tasks.rados.rados.0.trial118.stdout:3716: write (excl) oid 12 current snap is 405 2026-02-17T05:43:52.457 INFO:tasks.rados.rados.0.trial118.stdout:3711: finishing rollback tid 2 to trial11845692-39 2026-02-17T05:43:52.458 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 2391 (ObjNum 1272 snap 398 seq_num 1272) dirty exists 2026-02-17T05:43:52.458 INFO:tasks.rados.rados.0.trial118.stdout:3709: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:43:52.458 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1827 (ObjNum 1103 snap 331 seq_num 1103) dirty exists 2026-02-17T05:43:52.458 INFO:tasks.rados.rados.0.trial118.stdout:3716: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2026-02-17T05:43:52.461 INFO:tasks.rados.rados.0.trial118.stdout:3716: writing trial11845692-12 from 565065 to 992530 tid 1 2026-02-17T05:43:52.465 INFO:tasks.rados.rados.0.trial118.stdout:3716: writing trial11845692-12 from 1430299 to 2064738 tid 2 2026-02-17T05:43:52.468 INFO:tasks.rados.rados.0.trial118.stdout:3716: writing trial11845692-12 from 2496305 to 3021444 tid 3 2026-02-17T05:43:52.471 INFO:tasks.rados.rados.0.trial118.stdout:3716: writing trial11845692-12 from 3472104 to 3765065 tid 4 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3709: done (6 left) 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3711: done (5 left) 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3717: rollback oid 14 current snap is 405 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 14 to 372 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: finishing write tid 3 to trial11845692-24 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: finishing write tid 4 to trial11845692-24 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: finishing write tid 5 to trial11845692-24 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: oid 24 updating version 0 to 1746 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: oid 24 version 1746 is already newer than 1745 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: oid 24 version 1746 is already newer than 1744 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: oid 24 updating version 1746 to 1747 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 24 v 1747 (ObjNum 1290 snap 405 seq_num 1290) dirty exists 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3708: left oid 24 (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:3712: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:43:52.472 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:52.526 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:52.624 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3556454 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: finishing write tid 1 to trial11845692-20 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: finishing write tid 2 to trial11845692-20 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: finishing write tid 3 to trial11845692-20 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: finishing write tid 4 to trial11845692-20 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: finishing write tid 5 to trial11845692-20 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: oid 20 updating version 0 to 2413 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: oid 20 version 2413 is already newer than 2412 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: oid 20 version 2413 is already newer than 2411 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: oid 20 updating version 2413 to 2414 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2414 (ObjNum 1293 snap 405 seq_num 1293) dirty exists 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3714: left oid 20 (ObjNum 1293 snap 405 seq_num 1293) 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3715: finishing write tid 1 to trial11845692-40 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3715: finishing write tid 2 to trial11845692-40 2026-02-17T05:43:52.628 INFO:tasks.rados.rados.0.trial118.stdout:3715: finishing write tid 3 to trial11845692-40 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: finishing write tid 4 to trial11845692-40 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: finishing write tid 5 to trial11845692-40 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: oid 40 updating version 0 to 2310 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: oid 40 updating version 2310 to 2311 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: oid 40 updating version 2311 to 2312 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: oid 40 updating version 2312 to 2313 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2313 (ObjNum 1294 snap 405 seq_num 1294) dirty exists 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3715: left oid 40 (ObjNum 1294 snap 405 seq_num 1294) 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 1 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 2 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 3 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 4 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3717: finishing rollback tid 0 to trial11845692-14 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 5 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: finishing write tid 6 to trial11845692-12 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: oid 12 updating version 0 to 2150 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: oid 12 updating version 2150 to 2151 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: oid 12 updating version 2151 to 2152 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: oid 12 updating version 2152 to 2153 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:3716: oid 12 version 2153 is already newer than 2149 2026-02-17T05:43:52.629 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 2153 (ObjNum 1295 snap 405 seq_num 1295) dirty exists 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3716: left oid 12 (ObjNum 1295 snap 405 seq_num 1295) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3717: finishing rollback tid 1 to trial11845692-14 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3717: finishing rollback tid 2 to trial11845692-14 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1830 (ObjNum 1084 snap 323 seq_num 1084) dirty exists 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3708: done (5 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3712: done (4 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3714: done (3 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3715: done (2 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3716: done (1 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3717: done (0 left) 2026-02-17T05:43:52.630 INFO:tasks.rados.rados.0.trial118.stdout:3718: snap_remove snap 372 2026-02-17T05:43:53.414 INFO:tasks.rados.rados.0.trial118.stdout:3718: done (0 left) 2026-02-17T05:43:53.414 INFO:tasks.rados.rados.0.trial118.stdout:3719: read oid 14 snap -1 2026-02-17T05:43:53.414 INFO:tasks.rados.rados.0.trial118.stdout:3719: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:43:53.415 INFO:tasks.rados.rados.0.trial118.stdout:3720: write oid 49 current snap is 405 2026-02-17T05:43:53.415 INFO:tasks.rados.rados.0.trial118.stdout:3720: seq_num 1296 ranges {581872=502714,1488781=494450,2640081=736411} 2026-02-17T05:43:53.418 INFO:tasks.rados.rados.0.trial118.stdout:3720: writing trial11845692-49 from 581872 to 1084586 tid 1 2026-02-17T05:43:53.421 INFO:tasks.rados.rados.0.trial118.stdout:3720: writing trial11845692-49 from 1488781 to 1983231 tid 2 2026-02-17T05:43:53.426 INFO:tasks.rados.rados.0.trial118.stdout:3720: writing trial11845692-49 from 2640081 to 3376492 tid 3 2026-02-17T05:43:53.427 INFO:tasks.rados.rados.0.trial118.stdout:3721: snap_remove snap 399 2026-02-17T05:43:54.419 INFO:tasks.rados.rados.0.trial118.stdout:3721: done (2 left) 2026-02-17T05:43:54.419 INFO:tasks.rados.rados.0.trial118.stdout:3722: read oid 11 snap -1 2026-02-17T05:43:54.419 INFO:tasks.rados.rados.0.trial118.stdout:3722: expect deleted 2026-02-17T05:43:54.419 INFO:tasks.rados.rados.0.trial118.stdout:3723: write oid 44 current snap is 405 2026-02-17T05:43:54.420 INFO:tasks.rados.rados.0.trial118.stdout:3723: seq_num 1297 ranges {598679=577963,1947263=638108,3351151=447528} 2026-02-17T05:43:54.422 INFO:tasks.rados.rados.0.trial118.stdout:3723: writing trial11845692-44 from 598679 to 1176642 tid 1 2026-02-17T05:43:54.428 INFO:tasks.rados.rados.0.trial118.stdout:3723: writing trial11845692-44 from 1947263 to 2585371 tid 2 2026-02-17T05:43:54.433 INFO:tasks.rados.rados.0.trial118.stdout:3723: writing trial11845692-44 from 3351151 to 3798679 tid 3 2026-02-17T05:43:54.433 INFO:tasks.rados.rados.0.trial118.stdout:3724: read oid 30 snap -1 2026-02-17T05:43:54.433 INFO:tasks.rados.rados.0.trial118.stdout:3724: expect (ObjNum 1229 snap 388 seq_num 1229) 2026-02-17T05:43:54.434 INFO:tasks.rados.rados.0.trial118.stdout:3725: write (excl) oid 34 current snap is 405 2026-02-17T05:43:54.434 INFO:tasks.rados.rados.0.trial118.stdout:3725: seq_num 1298 ranges {615486=653212,1889392=498119,2978574=475308} 2026-02-17T05:43:54.437 INFO:tasks.rados.rados.0.trial118.stdout:3725: writing trial11845692-34 from 615486 to 1268698 tid 1 2026-02-17T05:43:54.441 INFO:tasks.rados.rados.0.trial118.stdout:3725: writing trial11845692-34 from 1889392 to 2387511 tid 2 2026-02-17T05:43:54.446 INFO:tasks.rados.rados.0.trial118.stdout:3725: writing trial11845692-34 from 2978574 to 3453882 tid 3 2026-02-17T05:43:54.446 INFO:tasks.rados.rados.0.trial118.stdout:3726: snap_create 2026-02-17T05:43:54.446 INFO:tasks.rados.rados.0.trial118.stdout:3720: finishing write tid 1 to trial11845692-49 2026-02-17T05:43:54.446 INFO:tasks.rados.rados.0.trial118.stdout:3719: expect (ObjNum 1084 snap 323 seq_num 1084) 2026-02-17T05:43:54.446 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:54.468 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:54.491 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:54.513 INFO:tasks.rados.rados.0.trial118.stdout:3720: finishing write tid 2 to trial11845692-49 2026-02-17T05:43:54.513 INFO:tasks.rados.rados.0.trial118.stdout:3720: finishing write tid 3 to trial11845692-49 2026-02-17T05:43:54.513 INFO:tasks.rados.rados.0.trial118.stdout:3720: finishing write tid 4 to trial11845692-49 2026-02-17T05:43:54.513 INFO:tasks.rados.rados.0.trial118.stdout:3720: finishing write tid 5 to trial11845692-49 2026-02-17T05:43:54.513 INFO:tasks.rados.rados.0.trial118.stdout:3720: oid 49 updating version 0 to 1895 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3720: oid 49 version 1895 is already newer than 1894 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3720: oid 49 updating version 1895 to 1896 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3720: oid 49 version 1896 is already newer than 1893 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1896 (ObjNum 1296 snap 405 seq_num 1296) dirty exists 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3720: left oid 49 (ObjNum 1296 snap 405 seq_num 1296) 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: finishing write tid 1 to trial11845692-44 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: finishing write tid 2 to trial11845692-44 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: finishing write tid 3 to trial11845692-44 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: finishing write tid 4 to trial11845692-44 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: finishing write tid 5 to trial11845692-44 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: oid 44 updating version 0 to 1751 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: oid 44 version 1751 is already newer than 1749 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: oid 44 version 1751 is already newer than 1748 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: oid 44 version 1751 is already newer than 1750 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1751 (ObjNum 1297 snap 405 seq_num 1297) dirty exists 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3723: left oid 44 (ObjNum 1297 snap 405 seq_num 1297) 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:3724: expect (ObjNum 1229 snap 388 seq_num 1229) 2026-02-17T05:43:54.514 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:54.549 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:54.592 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 972886 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: finishing write tid 1 to trial11845692-34 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: finishing write tid 2 to trial11845692-34 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: finishing write tid 3 to trial11845692-34 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: finishing write tid 4 to trial11845692-34 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: finishing write tid 5 to trial11845692-34 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: oid 34 updating version 0 to 2228 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: oid 34 version 2228 is already newer than 2227 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: oid 34 updating version 2228 to 2230 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: oid 34 version 2230 is already newer than 2229 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 2230 (ObjNum 1298 snap 405 seq_num 1298) dirty exists 2026-02-17T05:43:54.618 INFO:tasks.rados.rados.0.trial118.stdout:3725: left oid 34 (ObjNum 1298 snap 405 seq_num 1298) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3719: done (6 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3720: done (5 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3722: done (4 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3723: done (3 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3724: done (2 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3725: done (1 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3726: done (0 left) 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3727: copy_from oid 41 from oid 39 current snap is 406 2026-02-17T05:43:55.420 INFO:tasks.rados.rados.0.trial118.stdout:3728: write oid 20 current snap is 406 2026-02-17T05:43:55.421 INFO:tasks.rados.rados.0.trial118.stdout:3728: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2026-02-17T05:43:55.424 INFO:tasks.rados.rados.0.trial118.stdout:3728: writing trial11845692-20 from 632293 to 1360754 tid 1 2026-02-17T05:43:55.429 INFO:tasks.rados.rados.0.trial118.stdout:3728: writing trial11845692-20 from 1947874 to 2589651 tid 2 2026-02-17T05:43:55.433 INFO:tasks.rados.rados.0.trial118.stdout:3728: writing trial11845692-20 from 3005997 to 3692577 tid 3 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:3729: snap_create 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:3728: finishing write tid 1 to trial11845692-20 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:3727: finishing copy_from racing read to trial11845692-41 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:3727: finishing copy_from to trial11845692-41 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2391 (ObjNum 1272 snap 398 seq_num 1272) dirty exists 2026-02-17T05:43:55.434 INFO:tasks.rados.rados.0.trial118.stdout:3728: finishing write tid 2 to trial11845692-20 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: finishing write tid 3 to trial11845692-20 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: finishing write tid 4 to trial11845692-20 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: finishing write tid 5 to trial11845692-20 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: oid 20 updating version 0 to 2428 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: oid 20 version 2428 is already newer than 2427 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: oid 20 updating version 2428 to 2429 2026-02-17T05:43:55.436 INFO:tasks.rados.rados.0.trial118.stdout:3728: oid 20 version 2429 is already newer than 2426 2026-02-17T05:43:55.437 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 2429 (ObjNum 1299 snap 406 seq_num 1299) dirty exists 2026-02-17T05:43:55.437 INFO:tasks.rados.rados.0.trial118.stdout:3728: left oid 20 (ObjNum 1299 snap 406 seq_num 1299) 2026-02-17T05:43:56.422 INFO:tasks.rados.rados.0.trial118.stdout:3727: done (2 left) 2026-02-17T05:43:56.423 INFO:tasks.rados.rados.0.trial118.stdout:3728: done (1 left) 2026-02-17T05:43:56.423 INFO:tasks.rados.rados.0.trial118.stdout:3729: done (0 left) 2026-02-17T05:43:56.423 INFO:tasks.rados.rados.0.trial118.stdout:3730: copy_from oid 14 from oid 44 current snap is 407 2026-02-17T05:43:56.423 INFO:tasks.rados.rados.0.trial118.stdout:3731: write oid 4 current snap is 407 2026-02-17T05:43:56.423 INFO:tasks.rados.rados.0.trial118.stdout:3731: seq_num 1300 ranges {649100=403710,1606356=501788,2633420=497852,3636005=213095} 2026-02-17T05:43:56.426 INFO:tasks.rados.rados.0.trial118.stdout:3731: writing trial11845692-4 from 649100 to 1052810 tid 1 2026-02-17T05:43:56.430 INFO:tasks.rados.rados.0.trial118.stdout:3731: writing trial11845692-4 from 1606356 to 2108144 tid 2 2026-02-17T05:43:56.434 INFO:tasks.rados.rados.0.trial118.stdout:3731: writing trial11845692-4 from 2633420 to 3131272 tid 3 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3731: writing trial11845692-4 from 3636005 to 3849100 tid 4 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3732: copy_from oid 28 from oid 10 current snap is 407 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 1 to trial11845692-4 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3730: finishing copy_from racing read to trial11845692-14 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 2 to trial11845692-4 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3730: finishing copy_from to trial11845692-14 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 14 v 1751 (ObjNum 1297 snap 405 seq_num 1297) dirty exists 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 3 to trial11845692-4 2026-02-17T05:43:56.438 INFO:tasks.rados.rados.0.trial118.stdout:3730: done (2 left) 2026-02-17T05:43:56.439 INFO:tasks.rados.rados.0.trial118.stdout:3733: copy_from oid 37 from oid 16 current snap is 407 2026-02-17T05:43:56.439 INFO:tasks.rados.rados.0.trial118.stdout:3734: snap_remove snap 387 2026-02-17T05:43:57.426 INFO:tasks.rados.rados.0.trial118.stdout:3734: done (3 left) 2026-02-17T05:43:57.426 INFO:tasks.rados.rados.0.trial118.stdout:3735: write (excl) oid 49 current snap is 407 2026-02-17T05:43:57.426 INFO:tasks.rados.rados.0.trial118.stdout:3735: seq_num 1301 ranges {665907=595312,1781191=645446,3177196=688711} 2026-02-17T05:43:57.430 INFO:tasks.rados.rados.0.trial118.stdout:3735: writing trial11845692-49 from 665907 to 1261219 tid 1 2026-02-17T05:43:57.435 INFO:tasks.rados.rados.0.trial118.stdout:3735: writing trial11845692-49 from 1781191 to 2426637 tid 2 2026-02-17T05:43:57.440 INFO:tasks.rados.rados.0.trial118.stdout:3735: writing trial11845692-49 from 3177196 to 3865907 tid 3 2026-02-17T05:43:57.440 INFO:tasks.rados.rados.0.trial118.stdout:3736: write oid 40 current snap is 407 2026-02-17T05:43:57.441 INFO:tasks.rados.rados.0.trial118.stdout:3736: seq_num 1302 ranges {682714=670561,2123320=505457,3088266=636749} 2026-02-17T05:43:57.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: writing trial11845692-40 from 682714 to 1353275 tid 1 2026-02-17T05:43:57.450 INFO:tasks.rados.rados.0.trial118.stdout:3736: writing trial11845692-40 from 2123320 to 2628777 tid 2 2026-02-17T05:43:57.455 INFO:tasks.rados.rados.0.trial118.stdout:3736: writing trial11845692-40 from 3088266 to 3725015 tid 3 2026-02-17T05:43:57.455 INFO:tasks.rados.rados.0.trial118.stdout:3737: delete oid 45 current snap is 407 2026-02-17T05:43:57.455 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 4 to trial11845692-4 2026-02-17T05:43:57.455 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 5 to trial11845692-4 2026-02-17T05:43:57.455 INFO:tasks.rados.rados.0.trial118.stdout:3731: finishing write tid 6 to trial11845692-4 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: oid 4 updating version 0 to 2394 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: oid 4 version 2394 is already newer than 2392 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: oid 4 updating version 2394 to 2396 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: oid 4 version 2396 is already newer than 2393 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: oid 4 version 2396 is already newer than 2395 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 2396 (ObjNum 1300 snap 407 seq_num 1300) dirty exists 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3731: left oid 4 (ObjNum 1300 snap 407 seq_num 1300) 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3732: finishing copy_from racing read to trial11845692-28 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3732: finishing copy_from to trial11845692-28 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 1885 (ObjNum 1213 snap 384 seq_num 1213) dirty exists 2026-02-17T05:43:57.456 INFO:tasks.rados.rados.0.trial118.stdout:3733: finishing copy_from racing read to trial11845692-37 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3733: finishing copy_from to trial11845692-37 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 2154 (ObjNum 1221 snap 385 seq_num 1221) dirty exists 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: finishing write tid 1 to trial11845692-49 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: finishing write tid 2 to trial11845692-49 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: finishing write tid 3 to trial11845692-49 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: finishing write tid 4 to trial11845692-49 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: finishing write tid 5 to trial11845692-49 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: oid 49 updating version 0 to 1899 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: oid 49 version 1899 is already newer than 1898 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: oid 49 version 1899 is already newer than 1897 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: oid 49 updating version 1899 to 1900 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 49 v 1900 (ObjNum 1301 snap 407 seq_num 1301) dirty exists 2026-02-17T05:43:57.457 INFO:tasks.rados.rados.0.trial118.stdout:3735: left oid 49 (ObjNum 1301 snap 407 seq_num 1301) 2026-02-17T05:43:57.458 INFO:tasks.rados.rados.0.trial118.stdout:3736: finishing write tid 1 to trial11845692-40 2026-02-17T05:43:57.458 INFO:tasks.rados.rados.0.trial118.stdout:3736: finishing write tid 2 to trial11845692-40 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3731: done (5 left) 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3732: done (4 left) 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3733: done (3 left) 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3735: done (2 left) 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3737: done (1 left) 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3738: copy_from oid 42 from oid 1 current snap is 407 2026-02-17T05:43:57.459 INFO:tasks.rados.rados.0.trial118.stdout:3739: snap_remove snap 402 2026-02-17T05:43:58.430 INFO:tasks.rados.rados.0.trial118.stdout:3739: done (2 left) 2026-02-17T05:43:58.430 INFO:tasks.rados.rados.0.trial118.stdout:3740: write (excl) oid 19 current snap is 407 2026-02-17T05:43:58.430 INFO:tasks.rados.rados.0.trial118.stdout:3740: seq_num 1304 ranges {716328=421059,1840284=509126,3143112=659293} 2026-02-17T05:43:58.434 INFO:tasks.rados.rados.0.trial118.stdout:3740: writing trial11845692-19 from 716328 to 1137387 tid 1 2026-02-17T05:43:58.438 INFO:tasks.rados.rados.0.trial118.stdout:3740: writing trial11845692-19 from 1840284 to 2349410 tid 2 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3740: writing trial11845692-19 from 3143112 to 3802405 tid 3 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3741: rollback oid 26 current snap is 407 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 26 to 397 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: finishing write tid 3 to trial11845692-40 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: finishing write tid 4 to trial11845692-40 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: finishing write tid 5 to trial11845692-40 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: oid 40 updating version 0 to 2330 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: oid 40 updating version 2330 to 2331 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: oid 40 version 2331 is already newer than 2329 2026-02-17T05:43:58.445 INFO:tasks.rados.rados.0.trial118.stdout:3736: oid 40 updating version 2331 to 2332 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2332 (ObjNum 1302 snap 407 seq_num 1302) dirty exists 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3736: left oid 40 (ObjNum 1302 snap 407 seq_num 1302) 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3738: finishing copy_from racing read to trial11845692-42 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3738: finishing copy_from to trial11845692-42 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 42 v 2205 (ObjNum 1191 snap 375 seq_num 1191) dirty exists 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3740: finishing write tid 1 to trial11845692-19 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3740: finishing write tid 2 to trial11845692-19 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3736: done (3 left) 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3738: done (2 left) 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3742: write oid 34 current snap is 407 2026-02-17T05:43:58.446 INFO:tasks.rados.rados.0.trial118.stdout:3742: seq_num 1305 ranges {733135=496308,1898766=652784,3170535=470565} 2026-02-17T05:43:58.449 INFO:tasks.rados.rados.0.trial118.stdout:3742: writing trial11845692-34 from 733135 to 1229443 tid 1 2026-02-17T05:43:58.454 INFO:tasks.rados.rados.0.trial118.stdout:3742: writing trial11845692-34 from 1898766 to 2551550 tid 2 2026-02-17T05:43:58.458 INFO:tasks.rados.rados.0.trial118.stdout:3742: writing trial11845692-34 from 3170535 to 3641100 tid 3 2026-02-17T05:43:58.458 INFO:tasks.rados.rados.0.trial118.stdout:3743: read oid 42 snap -1 2026-02-17T05:43:58.458 INFO:tasks.rados.rados.0.trial118.stdout:3743: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:58.458 INFO:tasks.rados.rados.0.trial118.stdout:3744: snap_remove snap 404 2026-02-17T05:43:59.434 INFO:tasks.rados.rados.0.trial118.stdout:3744: done (4 left) 2026-02-17T05:43:59.434 INFO:tasks.rados.rados.0.trial118.stdout:3745: read oid 48 snap -1 2026-02-17T05:43:59.434 INFO:tasks.rados.rados.0.trial118.stdout:3745: expect deleted 2026-02-17T05:43:59.434 INFO:tasks.rados.rados.0.trial118.stdout:3746: write (excl) oid 44 current snap is 407 2026-02-17T05:43:59.434 INFO:tasks.rados.rados.0.trial118.stdout:3746: seq_num 1306 ranges {749942=571557,1840895=796442,3365252=584690} 2026-02-17T05:43:59.438 INFO:tasks.rados.rados.0.trial118.stdout:3746: writing trial11845692-44 from 749942 to 1321499 tid 1 2026-02-17T05:43:59.443 INFO:tasks.rados.rados.0.trial118.stdout:3746: writing trial11845692-44 from 1840895 to 2637337 tid 2 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3746: writing trial11845692-44 from 3365252 to 3949942 tid 3 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3747: delete oid 28 current snap is 407 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3741: finishing rollback tid 1 to trial11845692-26 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 1475 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3740: finishing write tid 3 to trial11845692-19 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3740: finishing write tid 4 to trial11845692-19 2026-02-17T05:43:59.449 INFO:tasks.rados.rados.0.trial118.stdout:3740: finishing write tid 5 to trial11845692-19 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3740: oid 19 updating version 0 to 2144 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3740: oid 19 version 2144 is already newer than 2141 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3740: oid 19 version 2144 is already newer than 2143 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3740: oid 19 version 2144 is already newer than 2142 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2144 (ObjNum 1304 snap 407 seq_num 1304) dirty exists 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3740: left oid 19 (ObjNum 1304 snap 407 seq_num 1304) 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3742: finishing write tid 1 to trial11845692-34 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3742: finishing write tid 2 to trial11845692-34 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3742: finishing write tid 3 to trial11845692-34 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3742: finishing write tid 4 to trial11845692-34 2026-02-17T05:43:59.450 INFO:tasks.rados.rados.0.trial118.stdout:3742: finishing write tid 5 to trial11845692-34 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3742: oid 34 updating version 0 to 2231 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3742: oid 34 updating version 2231 to 2234 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3742: oid 34 version 2234 is already newer than 2233 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3742: oid 34 version 2234 is already newer than 2232 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 2234 (ObjNum 1305 snap 407 seq_num 1305) dirty exists 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3742: left oid 34 (ObjNum 1305 snap 407 seq_num 1305) 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:3743: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:43:59.451 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:43:59.471 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1077280 2026-02-17T05:43:59.492 INFO:tasks.rados.rados.0.trial118.stdout:3740: done (6 left) 2026-02-17T05:43:59.492 INFO:tasks.rados.rados.0.trial118.stdout:3741: done (5 left) 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3742: done (4 left) 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3743: done (3 left) 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3745: done (2 left) 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3747: done (1 left) 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3748: write (excl) oid 37 current snap is 407 2026-02-17T05:43:59.493 INFO:tasks.rados.rados.0.trial118.stdout:3748: seq_num 1308 ranges {783556=438408,1674212=400111,2736451=420734,3882270=101286} 2026-02-17T05:43:59.496 INFO:tasks.rados.rados.0.trial118.stdout:3748: writing trial11845692-37 from 783556 to 1221964 tid 1 2026-02-17T05:43:59.499 INFO:tasks.rados.rados.0.trial118.stdout:3748: writing trial11845692-37 from 1674212 to 2074323 tid 2 2026-02-17T05:43:59.503 INFO:tasks.rados.rados.0.trial118.stdout:3748: writing trial11845692-37 from 2736451 to 3157185 tid 3 2026-02-17T05:43:59.508 INFO:tasks.rados.rados.0.trial118.stdout:3748: writing trial11845692-37 from 3882270 to 3983556 tid 4 2026-02-17T05:43:59.508 INFO:tasks.rados.rados.0.trial118.stdout:3749: rollback oid 29 current snap is 407 2026-02-17T05:43:59.508 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 29 to 392 2026-02-17T05:43:59.508 INFO:tasks.rados.rados.0.trial118.stdout:3746: finishing write tid 1 to trial11845692-44 2026-02-17T05:43:59.508 INFO:tasks.rados.rados.0.trial118.stdout:3746: finishing write tid 2 to trial11845692-44 2026-02-17T05:43:59.509 INFO:tasks.rados.rados.0.trial118.stdout:3746: finishing write tid 3 to trial11845692-44 2026-02-17T05:43:59.509 INFO:tasks.rados.rados.0.trial118.stdout:3746: finishing write tid 4 to trial11845692-44 2026-02-17T05:43:59.509 INFO:tasks.rados.rados.0.trial118.stdout:3746: finishing write tid 5 to trial11845692-44 2026-02-17T05:43:59.509 INFO:tasks.rados.rados.0.trial118.stdout:3746: oid 44 updating version 0 to 1755 2026-02-17T05:43:59.509 INFO:tasks.rados.rados.0.trial118.stdout:3746: oid 44 version 1755 is already newer than 1753 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:3746: oid 44 version 1755 is already newer than 1754 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:3746: oid 44 version 1755 is already newer than 1752 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1755 (ObjNum 1306 snap 407 seq_num 1306) dirty exists 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:3746: left oid 44 (ObjNum 1306 snap 407 seq_num 1306) 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 1 to trial11845692-37 2026-02-17T05:43:59.510 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 2 to trial11845692-37 2026-02-17T05:43:59.511 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 3 to trial11845692-37 2026-02-17T05:43:59.511 INFO:tasks.rados.rados.0.trial118.stdout:3746: done (2 left) 2026-02-17T05:43:59.511 INFO:tasks.rados.rados.0.trial118.stdout:3750: snap_remove snap 403 2026-02-17T05:44:00.370 INFO:tasks.rados.rados.0.trial118.stdout:3750: done (2 left) 2026-02-17T05:44:00.371 INFO:tasks.rados.rados.0.trial118.stdout:3751: snap_remove snap 391 2026-02-17T05:44:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3751: done (2 left) 2026-02-17T05:44:01.376 INFO:tasks.rados.rados.0.trial118.stdout:3752: read oid 38 snap 396 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3752: expect (ObjNum 1266 snap 395 seq_num 1266) 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3753: copy_from oid 30 from oid 8 current snap is 407 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 4 to trial11845692-37 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 5 to trial11845692-37 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3748: finishing write tid 6 to trial11845692-37 2026-02-17T05:44:01.377 INFO:tasks.rados.rados.0.trial118.stdout:3748: oid 37 updating version 0 to 2157 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:3748: oid 37 version 2157 is already newer than 2155 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:3748: oid 37 version 2157 is already newer than 2156 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:3748: oid 37 updating version 2157 to 2158 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:3748: oid 37 updating version 2158 to 2159 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 2159 (ObjNum 1308 snap 407 seq_num 1308) dirty exists 2026-02-17T05:44:01.378 INFO:tasks.rados.rados.0.trial118.stdout:3748: left oid 37 (ObjNum 1308 snap 407 seq_num 1308) 2026-02-17T05:44:01.379 INFO:tasks.rados.rados.0.trial118.stdout:3749: finishing rollback tid 0 to trial11845692-29 2026-02-17T05:44:01.379 INFO:tasks.rados.rados.0.trial118.stdout:3749: finishing rollback tid 1 to trial11845692-29 2026-02-17T05:44:01.379 INFO:tasks.rados.rados.0.trial118.stdout:3749: finishing rollback tid 2 to trial11845692-29 2026-02-17T05:44:01.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 2399 (ObjNum 1240 snap 389 seq_num 1240) dirty exists 2026-02-17T05:44:01.379 INFO:tasks.rados.rados.0.trial118.stdout:3748: done (3 left) 2026-02-17T05:44:01.380 INFO:tasks.rados.rados.0.trial118.stdout:3749: done (2 left) 2026-02-17T05:44:01.380 INFO:tasks.rados.rados.0.trial118.stdout:3754: snap_create 2026-02-17T05:44:01.381 INFO:tasks.rados.rados.0.trial118.stdout:3753: finishing copy_from to trial11845692-30 2026-02-17T05:44:01.381 INFO:tasks.rados.rados.0.trial118.stdout:3753: got expected ENOENT (src dne) 2026-02-17T05:44:01.381 INFO:tasks.rados.rados.0.trial118.stdout:3753: finishing copy_from racing read to trial11845692-30 2026-02-17T05:44:01.382 INFO:tasks.rados.rados.0.trial118.stdout:3752: expect (ObjNum 1266 snap 395 seq_num 1266) 2026-02-17T05:44:01.424 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1502010 2026-02-17T05:44:02.374 INFO:tasks.rados.rados.0.trial118.stdout:3752: done (2 left) 2026-02-17T05:44:02.375 INFO:tasks.rados.rados.0.trial118.stdout:3753: done (1 left) 2026-02-17T05:44:02.375 INFO:tasks.rados.rados.0.trial118.stdout:3754: done (0 left) 2026-02-17T05:44:02.375 INFO:tasks.rados.rados.0.trial118.stdout:3755: snap_remove snap 395 2026-02-17T05:44:03.375 INFO:tasks.rados.rados.0.trial118.stdout:3755: done (0 left) 2026-02-17T05:44:03.375 INFO:tasks.rados.rados.0.trial118.stdout:3756: write (excl) oid 2 current snap is 408 2026-02-17T05:44:03.375 INFO:tasks.rados.rados.0.trial118.stdout:3756: seq_num 1309 ranges {400363=513657,1332694=660122} 2026-02-17T05:44:03.379 INFO:tasks.rados.rados.0.trial118.stdout:3756: writing trial11845692-2 from 400363 to 914020 tid 1 2026-02-17T05:44:03.384 INFO:tasks.rados.rados.0.trial118.stdout:3756: writing trial11845692-2 from 1332694 to 1992816 tid 2 2026-02-17T05:44:03.384 INFO:tasks.rados.rados.0.trial118.stdout:3757: delete oid 31 current snap is 408 2026-02-17T05:44:03.384 INFO:tasks.rados.rados.0.trial118.stdout:3756: finishing write tid 1 to trial11845692-2 2026-02-17T05:44:03.387 INFO:tasks.rados.rados.0.trial118.stdout:3756: finishing write tid 2 to trial11845692-2 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: finishing write tid 3 to trial11845692-2 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: finishing write tid 4 to trial11845692-2 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: oid 2 updating version 0 to 2455 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: oid 2 version 2455 is already newer than 2449 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: oid 2 version 2455 is already newer than 2454 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2455 (ObjNum 1309 snap 408 seq_num 1309) dirty exists 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: left oid 2 (ObjNum 1309 snap 408 seq_num 1309) 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3756: done (1 left) 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3757: done (0 left) 2026-02-17T05:44:03.388 INFO:tasks.rados.rados.0.trial118.stdout:3758: snap_create 2026-02-17T05:44:03.389 INFO:tasks.ceph.osd.5.trial118.stderr:2026-02-17T05:44:03.386+0000 7fa343dfd640 -1 snap_mapper [pg_id:e, match:14, mask_bits:4, last_key_checked:, pool:3, shard:-1, shard_prefix: , prefixes: {"0000000000000003.E"}] get_next_objects_to_trim New Clone-Objects were added to Snap 194 after trimming was started 2026-02-17T05:44:04.379 INFO:tasks.rados.rados.0.trial118.stdout:3758: done (0 left) 2026-02-17T05:44:04.379 INFO:tasks.rados.rados.0.trial118.stdout:3759: delete oid 45 current snap is 409 2026-02-17T05:44:04.380 INFO:tasks.rados.rados.0.trial118.stdout:3759: done (0 left) 2026-02-17T05:44:04.380 INFO:tasks.rados.rados.0.trial118.stdout:3760: snap_remove snap 348 2026-02-17T05:44:05.370 INFO:tasks.rados.rados.0.trial118.stdout:3760: done (0 left) 2026-02-17T05:44:05.370 INFO:tasks.rados.rados.0.trial118.stdout:3761: write oid 18 current snap is 409 2026-02-17T05:44:05.371 INFO:tasks.rados.rados.0.trial118.stdout:3761: seq_num 1312 ranges {450784=739404,1791787=258997} 2026-02-17T05:44:05.375 INFO:tasks.rados.rados.0.trial118.stdout:3761: writing trial11845692-18 from 450784 to 1190188 tid 1 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3761: writing trial11845692-18 from 1791787 to 2050784 tid 2 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3762: copy_from oid 33 from oid 19 current snap is 409 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3761: finishing write tid 1 to trial11845692-18 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3763: read oid 5 snap -1 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3763: expect (ObjNum 1279 snap 403 seq_num 1279) 2026-02-17T05:44:05.379 INFO:tasks.rados.rados.0.trial118.stdout:3764: delete oid 17 current snap is 409 2026-02-17T05:44:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3761: finishing write tid 2 to trial11845692-18 2026-02-17T05:44:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3761: finishing write tid 3 to trial11845692-18 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3761: finishing write tid 4 to trial11845692-18 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3761: oid 18 updating version 0 to 2237 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3761: oid 18 version 2237 is already newer than 2236 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3761: oid 18 updating version 2237 to 2238 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2238 (ObjNum 1312 snap 409 seq_num 1312) dirty exists 2026-02-17T05:44:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3761: left oid 18 (ObjNum 1312 snap 409 seq_num 1312) 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3761: done (3 left) 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3764: done (2 left) 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3765: copy_from oid 20 from oid 50 current snap is 409 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3766: copy_from oid 2 from oid 10 current snap is 409 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3767: read oid 29 snap -1 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3767: expect (ObjNum 1240 snap 389 seq_num 1240) 2026-02-17T05:44:05.382 INFO:tasks.rados.rados.0.trial118.stdout:3768: delete oid 22 current snap is 409 2026-02-17T05:44:05.383 INFO:tasks.rados.rados.0.trial118.stdout:3768: done (5 left) 2026-02-17T05:44:05.383 INFO:tasks.rados.rados.0.trial118.stdout:3769: snap_remove snap 388 2026-02-17T05:44:06.385 INFO:tasks.rados.rados.0.trial118.stdout:3769: done (5 left) 2026-02-17T05:44:06.385 INFO:tasks.rados.rados.0.trial118.stdout:3770: write (excl) oid 1 current snap is 409 2026-02-17T05:44:06.386 INFO:tasks.rados.rados.0.trial118.stdout:3770: seq_num 1315 ranges {501205=565151,1850880=250325} 2026-02-17T05:44:06.389 INFO:tasks.rados.rados.0.trial118.stdout:3770: writing trial11845692-1 from 501205 to 1066356 tid 1 2026-02-17T05:44:06.393 INFO:tasks.rados.rados.0.trial118.stdout:3770: writing trial11845692-1 from 1850880 to 2101205 tid 2 2026-02-17T05:44:06.393 INFO:tasks.rados.rados.0.trial118.stdout:3771: write oid 36 current snap is 409 2026-02-17T05:44:06.393 INFO:tasks.rados.rados.0.trial118.stdout:3771: seq_num 1316 ranges {518012=756753,2025715=92297} 2026-02-17T05:44:06.398 INFO:tasks.rados.rados.0.trial118.stdout:3771: writing trial11845692-36 from 518012 to 1274765 tid 1 2026-02-17T05:44:06.401 INFO:tasks.rados.rados.0.trial118.stdout:3771: writing trial11845692-36 from 2025715 to 2118012 tid 2 2026-02-17T05:44:06.401 INFO:tasks.rados.rados.0.trial118.stdout:3772: copy_from oid 7 from oid 44 current snap is 409 2026-02-17T05:44:06.401 INFO:tasks.rados.rados.0.trial118.stdout:3763: expect (ObjNum 1279 snap 403 seq_num 1279) 2026-02-17T05:44:06.431 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:06.490 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 3294343 2026-02-17T05:44:06.491 INFO:tasks.rados.rados.0.trial118.stdout:3767: expect (ObjNum 1240 snap 389 seq_num 1240) 2026-02-17T05:44:06.534 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2194100 2026-02-17T05:44:06.575 INFO:tasks.rados.rados.0.trial118.stdout:3762: finishing copy_from racing read to trial11845692-33 2026-02-17T05:44:06.575 INFO:tasks.rados.rados.0.trial118.stdout:3763: done (7 left) 2026-02-17T05:44:06.575 INFO:tasks.rados.rados.0.trial118.stdout:3767: done (6 left) 2026-02-17T05:44:06.575 INFO:tasks.rados.rados.0.trial118.stdout:3773: snap_create 2026-02-17T05:44:06.575 INFO:tasks.rados.rados.0.trial118.stdout:3762: finishing copy_from to trial11845692-33 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 2144 (ObjNum 1304 snap 407 seq_num 1304) dirty exists 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3765: finishing copy_from racing read to trial11845692-20 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3766: finishing copy_from to trial11845692-2 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 1885 (ObjNum 1213 snap 384 seq_num 1213) dirty exists 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3766: finishing copy_from racing read to trial11845692-2 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3765: finishing copy_from to trial11845692-20 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 20 v 1722 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3770: finishing write tid 1 to trial11845692-1 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3770: finishing write tid 2 to trial11845692-1 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3770: finishing write tid 3 to trial11845692-1 2026-02-17T05:44:06.576 INFO:tasks.rados.rados.0.trial118.stdout:3770: finishing write tid 4 to trial11845692-1 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3770: oid 1 updating version 0 to 2366 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3770: oid 1 updating version 2366 to 2368 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3770: oid 1 version 2368 is already newer than 2367 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 2368 (ObjNum 1315 snap 409 seq_num 1315) dirty exists 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3770: left oid 1 (ObjNum 1315 snap 409 seq_num 1315) 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: finishing write tid 1 to trial11845692-36 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: finishing write tid 2 to trial11845692-36 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: finishing write tid 3 to trial11845692-36 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: finishing write tid 4 to trial11845692-36 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: oid 36 updating version 0 to 2056 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: oid 36 version 2056 is already newer than 2055 2026-02-17T05:44:06.577 INFO:tasks.rados.rados.0.trial118.stdout:3771: oid 36 version 2056 is already newer than 2054 2026-02-17T05:44:06.578 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 2056 (ObjNum 1316 snap 409 seq_num 1316) dirty exists 2026-02-17T05:44:06.578 INFO:tasks.rados.rados.0.trial118.stdout:3771: left oid 36 (ObjNum 1316 snap 409 seq_num 1316) 2026-02-17T05:44:06.578 INFO:tasks.rados.rados.0.trial118.stdout:3772: finishing copy_from racing read to trial11845692-7 2026-02-17T05:44:06.578 INFO:tasks.rados.rados.0.trial118.stdout:3772: finishing copy_from to trial11845692-7 2026-02-17T05:44:06.578 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 1755 (ObjNum 1306 snap 407 seq_num 1306) dirty exists 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3762: done (6 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3765: done (5 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3766: done (4 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3770: done (3 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3771: done (2 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3772: done (1 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3773: done (0 left) 2026-02-17T05:44:07.388 INFO:tasks.rados.rados.0.trial118.stdout:3774: delete oid 19 current snap is 410 2026-02-17T05:44:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3774: done (0 left) 2026-02-17T05:44:07.391 INFO:tasks.rados.rados.0.trial118.stdout:3775: snap_create 2026-02-17T05:44:08.390 INFO:tasks.rados.rados.0.trial118.stdout:3775: done (0 left) 2026-02-17T05:44:08.390 INFO:tasks.rados.rados.0.trial118.stdout:3776: snap_create 2026-02-17T05:44:09.391 INFO:tasks.rados.rados.0.trial118.stdout:3776: done (0 left) 2026-02-17T05:44:09.391 INFO:tasks.rados.rados.0.trial118.stdout:3777: read oid 39 snap -1 2026-02-17T05:44:09.391 INFO:tasks.rados.rados.0.trial118.stdout:3777: expect (ObjNum 1272 snap 398 seq_num 1272) 2026-02-17T05:44:09.391 INFO:tasks.rados.rados.0.trial118.stdout:3778: copy_from oid 1 from oid 14 current snap is 412 2026-02-17T05:44:09.391 INFO:tasks.rados.rados.0.trial118.stdout:3779: snap_create 2026-02-17T05:44:09.398 INFO:tasks.rados.rados.0.trial118.stdout:3777: expect (ObjNum 1272 snap 398 seq_num 1272) 2026-02-17T05:44:09.398 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:09.444 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1302636 2026-02-17T05:44:09.459 INFO:tasks.rados.rados.0.trial118.stdout:3778: finishing copy_from racing read to trial11845692-1 2026-02-17T05:44:09.459 INFO:tasks.rados.rados.0.trial118.stdout:3778: finishing copy_from to trial11845692-1 2026-02-17T05:44:09.459 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 1 v 1751 (ObjNum 1297 snap 405 seq_num 1297) dirty exists 2026-02-17T05:44:10.373 INFO:tasks.rados.rados.0.trial118.stdout:3777: done (2 left) 2026-02-17T05:44:10.373 INFO:tasks.rados.rados.0.trial118.stdout:3778: done (1 left) 2026-02-17T05:44:10.374 INFO:tasks.rados.rados.0.trial118.stdout:3779: done (0 left) 2026-02-17T05:44:10.374 INFO:tasks.rados.rados.0.trial118.stdout:3780: write oid 15 current snap is 413 2026-02-17T05:44:10.374 INFO:tasks.rados.rados.0.trial118.stdout:3780: seq_num 1318 ranges {551626=507251,1626326=418456} 2026-02-17T05:44:10.377 INFO:tasks.rados.rados.0.trial118.stdout:3780: writing trial11845692-15 from 551626 to 1058877 tid 1 2026-02-17T05:44:10.381 INFO:tasks.rados.rados.0.trial118.stdout:3780: writing trial11845692-15 from 1626326 to 2044782 tid 2 2026-02-17T05:44:10.381 INFO:tasks.rados.rados.0.trial118.stdout:3781: snap_create 2026-02-17T05:44:10.384 INFO:tasks.rados.rados.0.trial118.stdout:3780: finishing write tid 1 to trial11845692-15 2026-02-17T05:44:10.384 INFO:tasks.rados.rados.0.trial118.stdout:3780: finishing write tid 2 to trial11845692-15 2026-02-17T05:44:10.384 INFO:tasks.rados.rados.0.trial118.stdout:3780: finishing write tid 3 to trial11845692-15 2026-02-17T05:44:10.384 INFO:tasks.rados.rados.0.trial118.stdout:3780: finishing write tid 4 to trial11845692-15 2026-02-17T05:44:10.385 INFO:tasks.rados.rados.0.trial118.stdout:3780: oid 15 updating version 0 to 2060 2026-02-17T05:44:10.385 INFO:tasks.rados.rados.0.trial118.stdout:3780: oid 15 version 2060 is already newer than 2058 2026-02-17T05:44:10.385 INFO:tasks.rados.rados.0.trial118.stdout:3780: oid 15 version 2060 is already newer than 2059 2026-02-17T05:44:10.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 2060 (ObjNum 1318 snap 413 seq_num 1318) dirty exists 2026-02-17T05:44:10.385 INFO:tasks.rados.rados.0.trial118.stdout:3780: left oid 15 (ObjNum 1318 snap 413 seq_num 1318) 2026-02-17T05:44:11.375 INFO:tasks.rados.rados.0.trial118.stdout:3780: done (1 left) 2026-02-17T05:44:11.376 INFO:tasks.rados.rados.0.trial118.stdout:3781: done (0 left) 2026-02-17T05:44:11.376 INFO:tasks.rados.rados.0.trial118.stdout:3782: write (excl) oid 25 current snap is 414 2026-02-17T05:44:11.376 INFO:tasks.rados.rados.0.trial118.stdout:3782: seq_num 1319 ranges {568433=582500,1684808=483625} 2026-02-17T05:44:11.379 INFO:tasks.rados.rados.0.trial118.stdout:3782: writing trial11845692-25 from 568433 to 1150933 tid 1 2026-02-17T05:44:11.383 INFO:tasks.rados.rados.0.trial118.stdout:3782: writing trial11845692-25 from 1684808 to 2168433 tid 2 2026-02-17T05:44:11.384 INFO:tasks.rados.rados.0.trial118.stdout:3783: write (excl) oid 19 current snap is 414 2026-02-17T05:44:11.384 INFO:tasks.rados.rados.0.trial118.stdout:3783: seq_num 1320 ranges {585240=657749,1743290=422125} 2026-02-17T05:44:11.388 INFO:tasks.rados.rados.0.trial118.stdout:3783: writing trial11845692-19 from 585240 to 1242989 tid 1 2026-02-17T05:44:11.392 INFO:tasks.rados.rados.0.trial118.stdout:3783: writing trial11845692-19 from 1743290 to 2165415 tid 2 2026-02-17T05:44:11.392 INFO:tasks.rados.rados.0.trial118.stdout:3784: write (excl) oid 17 current snap is 414 2026-02-17T05:44:11.392 INFO:tasks.rados.rados.0.trial118.stdout:3784: seq_num 1321 ranges {602047=732998,1801772=400275} 2026-02-17T05:44:11.397 INFO:tasks.rados.rados.0.trial118.stdout:3784: writing trial11845692-17 from 602047 to 1335045 tid 1 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3784: writing trial11845692-17 from 1801772 to 2202047 tid 2 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3785: delete oid 33 current snap is 414 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: finishing write tid 1 to trial11845692-25 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: finishing write tid 2 to trial11845692-25 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: finishing write tid 3 to trial11845692-25 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: finishing write tid 4 to trial11845692-25 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: oid 25 updating version 0 to 2372 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: oid 25 updating version 2372 to 2373 2026-02-17T05:44:11.401 INFO:tasks.rados.rados.0.trial118.stdout:3782: oid 25 updating version 2373 to 2374 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 25 v 2374 (ObjNum 1319 snap 414 seq_num 1319) dirty exists 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3782: left oid 25 (ObjNum 1319 snap 414 seq_num 1319) 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: finishing write tid 1 to trial11845692-19 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: finishing write tid 2 to trial11845692-19 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: finishing write tid 3 to trial11845692-19 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: finishing write tid 4 to trial11845692-19 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: oid 19 updating version 0 to 2148 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: oid 19 version 2148 is already newer than 2147 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: oid 19 version 2148 is already newer than 2146 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2148 (ObjNum 1320 snap 414 seq_num 1320) dirty exists 2026-02-17T05:44:11.402 INFO:tasks.rados.rados.0.trial118.stdout:3783: left oid 19 (ObjNum 1320 snap 414 seq_num 1320) 2026-02-17T05:44:11.403 INFO:tasks.rados.rados.0.trial118.stdout:3784: finishing write tid 1 to trial11845692-17 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: finishing write tid 2 to trial11845692-17 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: finishing write tid 3 to trial11845692-17 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: finishing write tid 4 to trial11845692-17 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: oid 17 updating version 0 to 1518 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: oid 17 version 1518 is already newer than 1516 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: oid 17 version 1518 is already newer than 1517 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1518 (ObjNum 1321 snap 414 seq_num 1321) dirty exists 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3784: left oid 17 (ObjNum 1321 snap 414 seq_num 1321) 2026-02-17T05:44:11.404 INFO:tasks.rados.rados.0.trial118.stdout:3782: done (3 left) 2026-02-17T05:44:11.405 INFO:tasks.rados.rados.0.trial118.stdout:3783: done (2 left) 2026-02-17T05:44:11.405 INFO:tasks.rados.rados.0.trial118.stdout:3784: done (1 left) 2026-02-17T05:44:11.405 INFO:tasks.rados.rados.0.trial118.stdout:3785: done (0 left) 2026-02-17T05:44:11.405 INFO:tasks.rados.rados.0.trial118.stdout:3786: write (excl) oid 30 current snap is 414 2026-02-17T05:44:11.405 INFO:tasks.rados.rados.0.trial118.stdout:3786: seq_num 1323 ranges {635661=599849,1918736=316925} 2026-02-17T05:44:11.408 INFO:tasks.rados.rados.0.trial118.stdout:3786: writing trial11845692-30 from 635661 to 1235510 tid 1 2026-02-17T05:44:11.412 INFO:tasks.rados.rados.0.trial118.stdout:3786: writing trial11845692-30 from 1918736 to 2235661 tid 2 2026-02-17T05:44:11.412 INFO:tasks.rados.rados.0.trial118.stdout:3787: read oid 12 snap -1 2026-02-17T05:44:11.412 INFO:tasks.rados.rados.0.trial118.stdout:3787: expect (ObjNum 1295 snap 405 seq_num 1295) 2026-02-17T05:44:11.412 INFO:tasks.rados.rados.0.trial118.stdout:3788: snap_remove snap 397 2026-02-17T05:44:12.399 INFO:tasks.rados.rados.0.trial118.stdout:3788: done (2 left) 2026-02-17T05:44:12.399 INFO:tasks.rados.rados.0.trial118.stdout:3789: delete oid 37 current snap is 414 2026-02-17T05:44:12.399 INFO:tasks.rados.rados.0.trial118.stdout:3786: finishing write tid 1 to trial11845692-30 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: finishing write tid 2 to trial11845692-30 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: finishing write tid 3 to trial11845692-30 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: finishing write tid 4 to trial11845692-30 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: oid 30 updating version 0 to 2379 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: oid 30 updating version 2379 to 2380 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: oid 30 version 2380 is already newer than 2378 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2380 (ObjNum 1323 snap 414 seq_num 1323) dirty exists 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3786: left oid 30 (ObjNum 1323 snap 414 seq_num 1323) 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:3787: expect (ObjNum 1295 snap 405 seq_num 1295) 2026-02-17T05:44:12.400 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:12.455 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 739194 2026-02-17T05:44:12.499 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:12.550 INFO:tasks.rados.rados.0.trial118.stdout:3786: done (2 left) 2026-02-17T05:44:12.550 INFO:tasks.rados.rados.0.trial118.stdout:3787: done (1 left) 2026-02-17T05:44:12.550 INFO:tasks.rados.rados.0.trial118.stdout:3789: done (0 left) 2026-02-17T05:44:12.550 INFO:tasks.rados.rados.0.trial118.stdout:3790: delete oid 21 current snap is 414 2026-02-17T05:44:12.551 INFO:tasks.rados.rados.0.trial118.stdout:3790: done (0 left) 2026-02-17T05:44:12.552 INFO:tasks.rados.rados.0.trial118.stdout:3791: rollback oid 8 current snap is 414 2026-02-17T05:44:12.552 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 411 2026-02-17T05:44:12.552 INFO:tasks.rados.rados.0.trial118.stdout:3792: snap_remove snap 393 2026-02-17T05:44:13.400 INFO:tasks.rados.rados.0.trial118.stdout:3792: done (1 left) 2026-02-17T05:44:13.401 INFO:tasks.rados.rados.0.trial118.stdout:3793: read oid 18 snap 378 2026-02-17T05:44:13.401 INFO:tasks.rados.rados.0.trial118.stdout:3793: expect (ObjNum 1155 snap 361 seq_num 1155) 2026-02-17T05:44:13.401 INFO:tasks.rados.rados.0.trial118.stdout:3794: snap_create 2026-02-17T05:44:13.401 INFO:tasks.rados.rados.0.trial118.stdout:3791: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:44:13.401 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2292 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:44:13.408 INFO:tasks.rados.rados.0.trial118.stdout:3793: expect (ObjNum 1155 snap 361 seq_num 1155) 2026-02-17T05:44:14.406 INFO:tasks.rados.rados.0.trial118.stdout:3791: done (2 left) 2026-02-17T05:44:14.406 INFO:tasks.rados.rados.0.trial118.stdout:3793: done (1 left) 2026-02-17T05:44:14.406 INFO:tasks.rados.rados.0.trial118.stdout:3794: done (0 left) 2026-02-17T05:44:14.406 INFO:tasks.rados.rados.0.trial118.stdout:3795: write oid 7 current snap is 415 2026-02-17T05:44:14.407 INFO:tasks.rados.rados.0.trial118.stdout:3795: seq_num 1326 ranges {686082=425596,1577829=433132} 2026-02-17T05:44:14.410 INFO:tasks.rados.rados.0.trial118.stdout:3795: writing trial11845692-7 from 686082 to 1111678 tid 1 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3795: writing trial11845692-7 from 1577829 to 2010961 tid 2 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3796: read oid 45 snap 406 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3796: expect (ObjNum 1235 snap 388 seq_num 1235) 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3797: read oid 44 snap -1 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3797: expect (ObjNum 1306 snap 407 seq_num 1306) 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3798: write (excl) oid 40 current snap is 415 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3795: finishing write tid 1 to trial11845692-7 2026-02-17T05:44:14.415 INFO:tasks.rados.rados.0.trial118.stdout:3798: seq_num 1327 ranges {702889=500845,1636311=576790} 2026-02-17T05:44:14.419 INFO:tasks.rados.rados.0.trial118.stdout:3798: writing trial11845692-40 from 702889 to 1203734 tid 1 2026-02-17T05:44:14.423 INFO:tasks.rados.rados.0.trial118.stdout:3798: writing trial11845692-40 from 1636311 to 2213101 tid 2 2026-02-17T05:44:14.423 INFO:tasks.rados.rados.0.trial118.stdout:3799: write oid 36 current snap is 415 2026-02-17T05:44:14.423 INFO:tasks.rados.rados.0.trial118.stdout:3799: seq_num 1328 ranges {719696=576094,2094793=224903} 2026-02-17T05:44:14.427 INFO:tasks.rados.rados.0.trial118.stdout:3799: writing trial11845692-36 from 719696 to 1295790 tid 1 2026-02-17T05:44:14.431 INFO:tasks.rados.rados.0.trial118.stdout:3799: writing trial11845692-36 from 2094793 to 2319696 tid 2 2026-02-17T05:44:14.432 INFO:tasks.rados.rados.0.trial118.stdout:3800: delete oid 21 current snap is 415 2026-02-17T05:44:14.432 INFO:tasks.rados.rados.0.trial118.stdout:3795: finishing write tid 2 to trial11845692-7 2026-02-17T05:44:14.432 INFO:tasks.rados.rados.0.trial118.stdout:3796: expect (ObjNum 1235 snap 388 seq_num 1235) 2026-02-17T05:44:14.432 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:14.472 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 590946 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: finishing write tid 3 to trial11845692-7 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: finishing write tid 4 to trial11845692-7 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: oid 7 updating version 0 to 2402 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: oid 7 version 2402 is already newer than 2401 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: oid 7 version 2402 is already newer than 2400 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2402 (ObjNum 1326 snap 415 seq_num 1326) dirty exists 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3795: left oid 7 (ObjNum 1326 snap 415 seq_num 1326) 2026-02-17T05:44:14.490 INFO:tasks.rados.rados.0.trial118.stdout:3797: expect (ObjNum 1306 snap 407 seq_num 1306) 2026-02-17T05:44:14.556 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:14.622 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:14.689 INFO:tasks.rados.rados.0.trial118.stdout:3798: finishing write tid 1 to trial11845692-40 2026-02-17T05:44:14.689 INFO:tasks.rados.rados.0.trial118.stdout:3798: finishing write tid 2 to trial11845692-40 2026-02-17T05:44:14.689 INFO:tasks.rados.rados.0.trial118.stdout:3798: finishing write tid 3 to trial11845692-40 2026-02-17T05:44:14.689 INFO:tasks.rados.rados.0.trial118.stdout:3798: finishing write tid 4 to trial11845692-40 2026-02-17T05:44:14.689 INFO:tasks.rados.rados.0.trial118.stdout:3798: oid 40 updating version 0 to 2407 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3798: oid 40 version 2407 is already newer than 2406 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3798: oid 40 updating version 2407 to 2408 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2408 (ObjNum 1327 snap 415 seq_num 1327) dirty exists 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3798: left oid 40 (ObjNum 1327 snap 415 seq_num 1327) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3799: finishing write tid 1 to trial11845692-36 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3795: done (5 left) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3796: done (4 left) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3797: done (3 left) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3798: done (2 left) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3800: done (1 left) 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3801: delete oid 5 current snap is 415 2026-02-17T05:44:14.690 INFO:tasks.rados.rados.0.trial118.stdout:3799: finishing write tid 2 to trial11845692-36 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: finishing write tid 3 to trial11845692-36 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: finishing write tid 4 to trial11845692-36 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: oid 36 updating version 0 to 2073 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: oid 36 version 2073 is already newer than 2072 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: oid 36 updating version 2073 to 2074 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 2074 (ObjNum 1328 snap 415 seq_num 1328) dirty exists 2026-02-17T05:44:14.691 INFO:tasks.rados.rados.0.trial118.stdout:3799: left oid 36 (ObjNum 1328 snap 415 seq_num 1328) 2026-02-17T05:44:14.692 INFO:tasks.rados.rados.0.trial118.stdout:3799: done (1 left) 2026-02-17T05:44:14.692 INFO:tasks.rados.rados.0.trial118.stdout:3801: done (0 left) 2026-02-17T05:44:14.692 INFO:tasks.rados.rados.0.trial118.stdout:3802: write oid 15 current snap is 415 2026-02-17T05:44:14.692 INFO:tasks.rados.rados.0.trial118.stdout:3802: seq_num 1331 ranges {770117=518194,1870239=499878} 2026-02-17T05:44:14.696 INFO:tasks.rados.rados.0.trial118.stdout:3802: writing trial11845692-15 from 770117 to 1288311 tid 1 2026-02-17T05:44:14.700 INFO:tasks.rados.rados.0.trial118.stdout:3802: writing trial11845692-15 from 1870239 to 2370117 tid 2 2026-02-17T05:44:14.700 INFO:tasks.rados.rados.0.trial118.stdout:3803: snap_create 2026-02-17T05:44:14.701 INFO:tasks.rados.rados.0.trial118.stdout:3802: finishing write tid 1 to trial11845692-15 2026-02-17T05:44:14.702 INFO:tasks.rados.rados.0.trial118.stdout:3802: finishing write tid 2 to trial11845692-15 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: finishing write tid 3 to trial11845692-15 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: finishing write tid 4 to trial11845692-15 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: oid 15 updating version 0 to 2077 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: oid 15 version 2077 is already newer than 2076 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: oid 15 updating version 2077 to 2078 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 15 v 2078 (ObjNum 1331 snap 415 seq_num 1331) dirty exists 2026-02-17T05:44:14.703 INFO:tasks.rados.rados.0.trial118.stdout:3802: left oid 15 (ObjNum 1331 snap 415 seq_num 1331) 2026-02-17T05:44:15.374 INFO:tasks.rados.rados.0.trial118.stdout:3802: done (1 left) 2026-02-17T05:44:15.374 INFO:tasks.rados.rados.0.trial118.stdout:3803: done (0 left) 2026-02-17T05:44:15.374 INFO:tasks.rados.rados.0.trial118.stdout:3804: snap_create 2026-02-17T05:44:16.376 INFO:tasks.rados.rados.0.trial118.stdout:3804: done (0 left) 2026-02-17T05:44:16.376 INFO:tasks.rados.rados.0.trial118.stdout:3805: snap_create 2026-02-17T05:44:17.377 INFO:tasks.rados.rados.0.trial118.stdout:3805: done (0 left) 2026-02-17T05:44:17.377 INFO:tasks.rados.rados.0.trial118.stdout:3806: write (excl) oid 2 current snap is 418 2026-02-17T05:44:17.377 INFO:tasks.rados.rados.0.trial118.stdout:3806: seq_num 1332 ranges {786924=593443,1928721=458203} 2026-02-17T05:44:17.382 INFO:tasks.rados.rados.0.trial118.stdout:3806: writing trial11845692-2 from 786924 to 1380367 tid 1 2026-02-17T05:44:17.386 INFO:tasks.rados.rados.0.trial118.stdout:3806: writing trial11845692-2 from 1928721 to 2386924 tid 2 2026-02-17T05:44:17.386 INFO:tasks.rados.rados.0.trial118.stdout:3807: write oid 39 current snap is 418 2026-02-17T05:44:17.386 INFO:tasks.rados.rados.0.trial118.stdout:3807: seq_num 1333 ranges {403731=668692,1587203=587797} 2026-02-17T05:44:17.390 INFO:tasks.rados.rados.0.trial118.stdout:3807: writing trial11845692-39 from 403731 to 1072423 tid 1 2026-02-17T05:44:17.395 INFO:tasks.rados.rados.0.trial118.stdout:3807: writing trial11845692-39 from 1587203 to 2175000 tid 2 2026-02-17T05:44:17.395 INFO:tasks.rados.rados.0.trial118.stdout:3808: write oid 18 current snap is 418 2026-02-17T05:44:17.395 INFO:tasks.rados.rados.0.trial118.stdout:3808: seq_num 1334 ranges {420538=743941,1929332=491206} 2026-02-17T05:44:17.399 INFO:tasks.rados.rados.0.trial118.stdout:3808: writing trial11845692-18 from 420538 to 1164479 tid 1 2026-02-17T05:44:17.404 INFO:tasks.rados.rados.0.trial118.stdout:3808: writing trial11845692-18 from 1929332 to 2420538 tid 2 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3809: copy_from oid 48 from oid 22 current snap is 418 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3806: finishing write tid 1 to trial11845692-2 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3806: finishing write tid 2 to trial11845692-2 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3806: finishing write tid 3 to trial11845692-2 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3806: finishing write tid 4 to trial11845692-2 2026-02-17T05:44:17.405 INFO:tasks.rados.rados.0.trial118.stdout:3806: oid 2 updating version 0 to 2495 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3806: oid 2 version 2495 is already newer than 2494 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3806: oid 2 updating version 2495 to 2496 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2496 (ObjNum 1332 snap 418 seq_num 1332) dirty exists 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3806: left oid 2 (ObjNum 1332 snap 418 seq_num 1332) 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3807: finishing write tid 1 to trial11845692-39 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3807: finishing write tid 2 to trial11845692-39 2026-02-17T05:44:17.406 INFO:tasks.rados.rados.0.trial118.stdout:3806: done (3 left) 2026-02-17T05:44:17.407 INFO:tasks.rados.rados.0.trial118.stdout:3810: snap_remove snap 350 2026-02-17T05:44:18.382 INFO:tasks.rados.rados.0.trial118.stdout:3810: done (3 left) 2026-02-17T05:44:18.382 INFO:tasks.rados.rados.0.trial118.stdout:3811: rollback oid 19 current snap is 418 2026-02-17T05:44:18.382 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 19 to 405 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: finishing write tid 3 to trial11845692-39 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: finishing write tid 4 to trial11845692-39 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: oid 39 updating version 0 to 2394 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: oid 39 version 2394 is already newer than 2393 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: oid 39 version 2394 is already newer than 2392 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 2394 (ObjNum 1333 snap 418 seq_num 1333) dirty exists 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3807: left oid 39 (ObjNum 1333 snap 418 seq_num 1333) 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3808: finishing write tid 1 to trial11845692-18 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3809: finishing copy_from to trial11845692-48 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3809: got expected ENOENT (src dne) 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3809: finishing copy_from racing read to trial11845692-48 2026-02-17T05:44:18.383 INFO:tasks.rados.rados.0.trial118.stdout:3808: finishing write tid 2 to trial11845692-18 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: finishing write tid 3 to trial11845692-18 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: finishing write tid 4 to trial11845692-18 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: oid 18 updating version 0 to 2239 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: oid 18 updating version 2239 to 2240 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: oid 18 updating version 2240 to 2241 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2241 (ObjNum 1334 snap 418 seq_num 1334) dirty exists 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: left oid 18 (ObjNum 1334 snap 418 seq_num 1334) 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3807: done (3 left) 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3808: done (2 left) 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3809: done (1 left) 2026-02-17T05:44:18.384 INFO:tasks.rados.rados.0.trial118.stdout:3812: snap_create 2026-02-17T05:44:18.385 INFO:tasks.rados.rados.0.trial118.stdout:3811: finishing rollback tid 0 to trial11845692-19 2026-02-17T05:44:18.386 INFO:tasks.rados.rados.0.trial118.stdout:3811: finishing rollback tid 1 to trial11845692-19 2026-02-17T05:44:18.386 INFO:tasks.rados.rados.0.trial118.stdout:3811: finishing rollback tid 2 to trial11845692-19 2026-02-17T05:44:18.386 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2151 (ObjNum 1250 snap 392 seq_num 1250) dirty exists 2026-02-17T05:44:19.385 INFO:tasks.rados.rados.0.trial118.stdout:3811: done (1 left) 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3812: done (0 left) 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3813: read oid 48 snap -1 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3813: expect deleted 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3814: read oid 13 snap -1 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3814: expect deleted 2026-02-17T05:44:19.386 INFO:tasks.rados.rados.0.trial118.stdout:3815: delete oid 25 current snap is 419 2026-02-17T05:44:19.388 INFO:tasks.rados.rados.0.trial118.stdout:3813: done (2 left) 2026-02-17T05:44:19.388 INFO:tasks.rados.rados.0.trial118.stdout:3814: done (1 left) 2026-02-17T05:44:19.388 INFO:tasks.rados.rados.0.trial118.stdout:3815: done (0 left) 2026-02-17T05:44:19.388 INFO:tasks.rados.rados.0.trial118.stdout:3816: snap_create 2026-02-17T05:44:20.373 INFO:tasks.rados.rados.0.trial118.stdout:3816: done (0 left) 2026-02-17T05:44:20.374 INFO:tasks.rados.rados.0.trial118.stdout:3817: delete oid 35 current snap is 420 2026-02-17T05:44:20.378 INFO:tasks.rados.rados.0.trial118.stdout:3817: done (0 left) 2026-02-17T05:44:20.378 INFO:tasks.rados.rados.0.trial118.stdout:3818: copy_from oid 15 from oid 31 current snap is 420 2026-02-17T05:44:20.378 INFO:tasks.rados.rados.0.trial118.stdout:3819: copy_from oid 40 from oid 24 current snap is 420 2026-02-17T05:44:20.378 INFO:tasks.rados.rados.0.trial118.stdout:3820: delete oid 20 current snap is 420 2026-02-17T05:44:20.379 INFO:tasks.rados.rados.0.trial118.stdout:3818: finishing copy_from to trial11845692-15 2026-02-17T05:44:20.379 INFO:tasks.rados.rados.0.trial118.stdout:3818: got expected ENOENT (src dne) 2026-02-17T05:44:20.379 INFO:tasks.rados.rados.0.trial118.stdout:3818: finishing copy_from racing read to trial11845692-15 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3818: done (2 left) 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3820: done (1 left) 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3821: copy_from oid 47 from oid 16 current snap is 420 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3822: rollback oid 4 current snap is 420 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 4 to 401 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3823: write (excl) oid 9 current snap is 420 2026-02-17T05:44:20.382 INFO:tasks.rados.rados.0.trial118.stdout:3823: seq_num 1338 ranges {487766=644937,1646907=738793} 2026-02-17T05:44:20.386 INFO:tasks.rados.rados.0.trial118.stdout:3823: writing trial11845692-9 from 487766 to 1132703 tid 1 2026-02-17T05:44:20.391 INFO:tasks.rados.rados.0.trial118.stdout:3823: writing trial11845692-9 from 1646907 to 2385700 tid 2 2026-02-17T05:44:20.391 INFO:tasks.rados.rados.0.trial118.stdout:3824: snap_create 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3822: finishing rollback tid 0 to trial11845692-4 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3822: finishing rollback tid 1 to trial11845692-4 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3822: finishing rollback tid 2 to trial11845692-4 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 4 v 2405 (ObjNum 1120 snap 343 seq_num 1120) dirty exists 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3819: finishing copy_from racing read to trial11845692-40 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3819: finishing copy_from to trial11845692-40 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 1747 (ObjNum 1290 snap 405 seq_num 1290) dirty exists 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3823: finishing write tid 1 to trial11845692-9 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3821: finishing copy_from racing read to trial11845692-47 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:3821: finishing copy_from to trial11845692-47 2026-02-17T05:44:20.392 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 2154 (ObjNum 1221 snap 385 seq_num 1221) dirty exists 2026-02-17T05:44:20.393 INFO:tasks.rados.rados.0.trial118.stdout:3823: finishing write tid 2 to trial11845692-9 2026-02-17T05:44:20.393 INFO:tasks.rados.rados.0.trial118.stdout:3823: finishing write tid 3 to trial11845692-9 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:3823: finishing write tid 4 to trial11845692-9 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:3823: oid 9 updating version 0 to 2407 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:3823: oid 9 updating version 2407 to 2408 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:3823: oid 9 version 2408 is already newer than 2406 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2408 (ObjNum 1338 snap 420 seq_num 1338) dirty exists 2026-02-17T05:44:20.394 INFO:tasks.rados.rados.0.trial118.stdout:3823: left oid 9 (ObjNum 1338 snap 420 seq_num 1338) 2026-02-17T05:44:21.388 INFO:tasks.rados.rados.0.trial118.stdout:3819: done (4 left) 2026-02-17T05:44:21.388 INFO:tasks.rados.rados.0.trial118.stdout:3821: done (3 left) 2026-02-17T05:44:21.388 INFO:tasks.rados.rados.0.trial118.stdout:3822: done (2 left) 2026-02-17T05:44:21.389 INFO:tasks.rados.rados.0.trial118.stdout:3823: done (1 left) 2026-02-17T05:44:21.389 INFO:tasks.rados.rados.0.trial118.stdout:3824: done (0 left) 2026-02-17T05:44:21.389 INFO:tasks.rados.rados.0.trial118.stdout:3825: snap_create 2026-02-17T05:44:22.392 INFO:tasks.rados.rados.0.trial118.stdout:3825: done (0 left) 2026-02-17T05:44:22.392 INFO:tasks.rados.rados.0.trial118.stdout:3826: read oid 6 snap -1 2026-02-17T05:44:22.393 INFO:tasks.rados.rados.0.trial118.stdout:3826: expect (ObjNum 1258 snap 394 seq_num 1258) 2026-02-17T05:44:22.393 INFO:tasks.rados.rados.0.trial118.stdout:3827: snap_create 2026-02-17T05:44:22.397 INFO:tasks.rados.rados.0.trial118.stdout:3826: expect (ObjNum 1258 snap 394 seq_num 1258) 2026-02-17T05:44:22.416 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1003412 2026-02-17T05:44:23.393 INFO:tasks.rados.rados.0.trial118.stdout:3826: done (1 left) 2026-02-17T05:44:23.394 INFO:tasks.rados.rados.0.trial118.stdout:3827: done (0 left) 2026-02-17T05:44:23.394 INFO:tasks.rados.rados.0.trial118.stdout:3828: copy_from oid 2 from oid 7 current snap is 423 2026-02-17T05:44:23.394 INFO:tasks.rados.rados.0.trial118.stdout:3829: write oid 6 current snap is 423 2026-02-17T05:44:23.394 INFO:tasks.rados.rados.0.trial118.stdout:3829: seq_num 1339 ranges {504573=436539,1421742=598804,2437505=67068} 2026-02-17T05:44:23.397 INFO:tasks.rados.rados.0.trial118.stdout:3829: writing trial11845692-6 from 504573 to 941112 tid 1 2026-02-17T05:44:23.401 INFO:tasks.rados.rados.0.trial118.stdout:3829: writing trial11845692-6 from 1421742 to 2020546 tid 2 2026-02-17T05:44:23.404 INFO:tasks.rados.rados.0.trial118.stdout:3829: writing trial11845692-6 from 2437505 to 2504573 tid 3 2026-02-17T05:44:23.404 INFO:tasks.rados.rados.0.trial118.stdout:3830: copy_from oid 37 from oid 5 current snap is 423 2026-02-17T05:44:23.404 INFO:tasks.rados.rados.0.trial118.stdout:3829: finishing write tid 1 to trial11845692-6 2026-02-17T05:44:23.404 INFO:tasks.rados.rados.0.trial118.stdout:3831: rollback oid 13 current snap is 423 2026-02-17T05:44:23.405 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 415 2026-02-17T05:44:23.405 INFO:tasks.rados.rados.0.trial118.stdout:3832: snap_create 2026-02-17T05:44:23.405 INFO:tasks.rados.rados.0.trial118.stdout:3829: finishing write tid 2 to trial11845692-6 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3830: finishing copy_from to trial11845692-37 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3830: got expected ENOENT (src dne) 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3829: finishing write tid 3 to trial11845692-6 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3828: finishing copy_from racing read to trial11845692-2 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3830: finishing copy_from racing read to trial11845692-37 2026-02-17T05:44:23.406 INFO:tasks.rados.rados.0.trial118.stdout:3829: finishing write tid 4 to trial11845692-6 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: finishing write tid 5 to trial11845692-6 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: oid 6 updating version 0 to 1732 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: oid 6 updating version 1732 to 1734 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: oid 6 version 1734 is already newer than 1733 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: oid 6 version 1734 is already newer than 1731 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1734 (ObjNum 1339 snap 423 seq_num 1339) dirty exists 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3829: left oid 6 (ObjNum 1339 snap 423 seq_num 1339) 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3828: finishing copy_from to trial11845692-2 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 2 v 2402 (ObjNum 1326 snap 415 seq_num 1326) dirty exists 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:3831: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:44:23.407 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 2140 (ObjNum 2145 snap 0 seq_num 2491396608) dirty dne 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3828: done (4 left) 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3829: done (3 left) 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3830: done (2 left) 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3831: done (1 left) 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3832: done (0 left) 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3833: read oid 46 snap -1 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3833: expect deleted 2026-02-17T05:44:24.399 INFO:tasks.rados.rados.0.trial118.stdout:3834: snap_remove snap 413 2026-02-17T05:44:25.374 INFO:tasks.rados.rados.0.trial118.stdout:3834: done (1 left) 2026-02-17T05:44:25.374 INFO:tasks.rados.rados.0.trial118.stdout:3835: rollback oid 11 current snap is 424 2026-02-17T05:44:25.374 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 11 to 418 2026-02-17T05:44:25.374 INFO:tasks.rados.rados.0.trial118.stdout:3833: done (1 left) 2026-02-17T05:44:25.374 INFO:tasks.rados.rados.0.trial118.stdout:3836: snap_create 2026-02-17T05:44:25.380 INFO:tasks.rados.rados.0.trial118.stdout:3835: finishing rollback tid 1 to trial11845692-11 2026-02-17T05:44:25.380 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2261 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3835: done (1 left) 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3836: done (0 left) 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3837: read oid 24 snap -1 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3837: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3838: read oid 11 snap -1 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3838: expect deleted 2026-02-17T05:44:26.378 INFO:tasks.rados.rados.0.trial118.stdout:3839: snap_remove snap 378 2026-02-17T05:44:27.379 INFO:tasks.rados.rados.0.trial118.stdout:3839: done (2 left) 2026-02-17T05:44:27.380 INFO:tasks.rados.rados.0.trial118.stdout:3840: rollback oid 41 current snap is 425 2026-02-17T05:44:27.380 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 390 2026-02-17T05:44:27.380 INFO:tasks.rados.rados.0.trial118.stdout:3837: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:3840: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:3840: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:3840: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2411 (ObjNum 1234 snap 388 seq_num 1234) dirty exists 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:3837: done (2 left) 2026-02-17T05:44:27.481 INFO:tasks.rados.rados.0.trial118.stdout:3838: done (1 left) 2026-02-17T05:44:27.482 INFO:tasks.rados.rados.0.trial118.stdout:3840: done (0 left) 2026-02-17T05:44:27.482 INFO:tasks.rados.rados.0.trial118.stdout:3841: read oid 41 snap -1 2026-02-17T05:44:27.482 INFO:tasks.rados.rados.0.trial118.stdout:3841: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:27.482 INFO:tasks.rados.rados.0.trial118.stdout:3842: delete oid 3 current snap is 425 2026-02-17T05:44:27.483 INFO:tasks.rados.rados.0.trial118.stdout:3842: done (1 left) 2026-02-17T05:44:27.483 INFO:tasks.rados.rados.0.trial118.stdout:3843: read oid 43 snap -1 2026-02-17T05:44:27.483 INFO:tasks.rados.rados.0.trial118.stdout:3843: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:44:27.483 INFO:tasks.rados.rados.0.trial118.stdout:3844: read oid 10 snap -1 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3844: expect (ObjNum 1213 snap 384 seq_num 1213) 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3845: read oid 49 snap 418 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3845: expect (ObjNum 1301 snap 407 seq_num 1301) 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3846: copy_from oid 4 from oid 25 current snap is 425 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3847: delete oid 5 current snap is 425 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3847: done (5 left) 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3848: copy_from oid 12 from oid 17 current snap is 425 2026-02-17T05:44:27.484 INFO:tasks.rados.rados.0.trial118.stdout:3849: snap_remove snap 419 2026-02-17T05:44:28.382 INFO:tasks.rados.rados.0.trial118.stdout:3849: done (6 left) 2026-02-17T05:44:28.382 INFO:tasks.rados.rados.0.trial118.stdout:3850: snap_remove snap 406 2026-02-17T05:44:29.385 INFO:tasks.rados.rados.0.trial118.stdout:3850: done (6 left) 2026-02-17T05:44:29.385 INFO:tasks.rados.rados.0.trial118.stdout:3851: rollback oid 6 current snap is 425 2026-02-17T05:44:29.386 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 424 2026-02-17T05:44:29.386 INFO:tasks.rados.rados.0.trial118.stdout:3844: expect (ObjNum 1213 snap 384 seq_num 1213) 2026-02-17T05:44:29.386 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:29.453 INFO:tasks.rados.rados.0.trial118.stdout:3841: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:29.477 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1799518 2026-02-17T05:44:29.569 INFO:tasks.rados.rados.0.trial118.stdout:3846: finishing copy_from to trial11845692-4 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3846: got expected ENOENT (src dne) 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3846: finishing copy_from racing read to trial11845692-4 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3841: done (6 left) 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3844: done (5 left) 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3846: done (4 left) 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3852: read oid 8 snap -1 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3852: expect deleted 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3853: snap_create 2026-02-17T05:44:29.570 INFO:tasks.rados.rados.0.trial118.stdout:3843: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-17T05:44:29.670 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2367062 2026-02-17T05:44:29.676 INFO:tasks.rados.rados.0.trial118.stdout:3845: expect (ObjNum 1301 snap 407 seq_num 1301) 2026-02-17T05:44:29.782 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1428725 2026-02-17T05:44:29.815 INFO:tasks.rados.rados.0.trial118.stdout:3848: finishing copy_from racing read to trial11845692-12 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:3848: finishing copy_from to trial11845692-12 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 12 v 1518 (ObjNum 1321 snap 414 seq_num 1321) dirty exists 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:3851: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:3851: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:3851: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:44:29.816 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1737 (ObjNum 1339 snap 423 seq_num 1339) dirty exists 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3843: done (5 left) 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3845: done (4 left) 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3848: done (3 left) 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3851: done (2 left) 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3852: done (1 left) 2026-02-17T05:44:30.376 INFO:tasks.rados.rados.0.trial118.stdout:3853: done (0 left) 2026-02-17T05:44:30.377 INFO:tasks.rados.rados.0.trial118.stdout:3854: read oid 34 snap -1 2026-02-17T05:44:30.377 INFO:tasks.rados.rados.0.trial118.stdout:3854: expect (ObjNum 1305 snap 407 seq_num 1305) 2026-02-17T05:44:30.377 INFO:tasks.rados.rados.0.trial118.stdout:3855: read oid 26 snap -1 2026-02-17T05:44:30.377 INFO:tasks.rados.rados.0.trial118.stdout:3855: expect deleted 2026-02-17T05:44:30.377 INFO:tasks.rados.rados.0.trial118.stdout:3856: snap_create 2026-02-17T05:44:30.382 INFO:tasks.rados.rados.0.trial118.stdout:3854: expect (ObjNum 1305 snap 407 seq_num 1305) 2026-02-17T05:44:30.430 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 940768 2026-02-17T05:44:31.375 INFO:tasks.rados.rados.0.trial118.stdout:3854: done (2 left) 2026-02-17T05:44:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3855: done (1 left) 2026-02-17T05:44:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3856: done (0 left) 2026-02-17T05:44:31.376 INFO:tasks.rados.rados.0.trial118.stdout:3857: snap_remove snap 416 2026-02-17T05:44:32.376 INFO:tasks.rados.rados.0.trial118.stdout:3857: done (0 left) 2026-02-17T05:44:32.376 INFO:tasks.rados.rados.0.trial118.stdout:3858: snap_remove snap 414 2026-02-17T05:44:33.379 INFO:tasks.rados.rados.0.trial118.stdout:3858: done (0 left) 2026-02-17T05:44:33.379 INFO:tasks.rados.rados.0.trial118.stdout:3859: rollback oid 39 current snap is 427 2026-02-17T05:44:33.380 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 39 to 396 2026-02-17T05:44:33.380 INFO:tasks.rados.rados.0.trial118.stdout:3860: read oid 4 snap -1 2026-02-17T05:44:33.380 INFO:tasks.rados.rados.0.trial118.stdout:3860: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:44:33.380 INFO:tasks.rados.rados.0.trial118.stdout:3861: write (excl) oid 10 current snap is 427 2026-02-17T05:44:33.380 INFO:tasks.rados.rados.0.trial118.stdout:3861: seq_num 1342 ranges {554994=662286,1997188=557806} 2026-02-17T05:44:33.383 INFO:tasks.rados.rados.0.trial118.stdout:3861: writing trial11845692-10 from 554994 to 1217280 tid 1 2026-02-17T05:44:33.388 INFO:tasks.rados.rados.0.trial118.stdout:3861: writing trial11845692-10 from 1997188 to 2554994 tid 2 2026-02-17T05:44:33.389 INFO:tasks.rados.rados.0.trial118.stdout:3862: snap_remove snap 418 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:3862: done (3 left) 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:3863: snap_create 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:3859: finishing rollback tid 0 to trial11845692-39 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:3859: finishing rollback tid 1 to trial11845692-39 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 39 v 2396 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:3860: expect (ObjNum 1120 snap 343 seq_num 1120) 2026-02-17T05:44:34.383 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 247348 2026-02-17T05:44:34.401 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:34.441 INFO:tasks.rados.rados.0.trial118.stdout:3861: finishing write tid 1 to trial11845692-10 2026-02-17T05:44:34.441 INFO:tasks.rados.rados.0.trial118.stdout:3861: finishing write tid 2 to trial11845692-10 2026-02-17T05:44:34.441 INFO:tasks.rados.rados.0.trial118.stdout:3861: finishing write tid 3 to trial11845692-10 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:3861: finishing write tid 4 to trial11845692-10 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:3861: oid 10 updating version 0 to 1903 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:3861: oid 10 version 1903 is already newer than 1902 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:3861: oid 10 version 1903 is already newer than 1901 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1903 (ObjNum 1342 snap 427 seq_num 1342) dirty exists 2026-02-17T05:44:34.442 INFO:tasks.rados.rados.0.trial118.stdout:3861: left oid 10 (ObjNum 1342 snap 427 seq_num 1342) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3859: done (3 left) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3860: done (2 left) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3861: done (1 left) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3863: done (0 left) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3864: read oid 19 snap -1 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3864: expect (ObjNum 1250 snap 392 seq_num 1250) 2026-02-17T05:44:35.376 INFO:tasks.rados.rados.0.trial118.stdout:3865: delete oid 28 current snap is 428 2026-02-17T05:44:35.378 INFO:tasks.rados.rados.0.trial118.stdout:3865: done (1 left) 2026-02-17T05:44:35.378 INFO:tasks.rados.rados.0.trial118.stdout:3866: write oid 30 current snap is 428 2026-02-17T05:44:35.379 INFO:tasks.rados.rados.0.trial118.stdout:3866: seq_num 1344 ranges {588608=412784,1597799=749800} 2026-02-17T05:44:35.382 INFO:tasks.rados.rados.0.trial118.stdout:3866: writing trial11845692-30 from 588608 to 1001392 tid 1 2026-02-17T05:44:35.387 INFO:tasks.rados.rados.0.trial118.stdout:3866: writing trial11845692-30 from 1597799 to 2347599 tid 2 2026-02-17T05:44:35.387 INFO:tasks.rados.rados.0.trial118.stdout:3867: snap_remove snap 390 2026-02-17T05:44:36.386 INFO:tasks.rados.rados.0.trial118.stdout:3867: done (2 left) 2026-02-17T05:44:36.386 INFO:tasks.rados.rados.0.trial118.stdout:3868: snap_create 2026-02-17T05:44:36.386 INFO:tasks.rados.rados.0.trial118.stdout:3864: expect (ObjNum 1250 snap 392 seq_num 1250) 2026-02-17T05:44:36.492 INFO:tasks.rados.rados.0.trial118.stdout:3866: finishing write tid 1 to trial11845692-30 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: finishing write tid 2 to trial11845692-30 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: finishing write tid 3 to trial11845692-30 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: finishing write tid 4 to trial11845692-30 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: oid 30 updating version 0 to 2471 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: oid 30 updating version 2471 to 2473 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: oid 30 version 2473 is already newer than 2472 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2473 (ObjNum 1344 snap 428 seq_num 1344) dirty exists 2026-02-17T05:44:36.493 INFO:tasks.rados.rados.0.trial118.stdout:3866: left oid 30 (ObjNum 1344 snap 428 seq_num 1344) 2026-02-17T05:44:37.389 INFO:tasks.rados.rados.0.trial118.stdout:3864: done (2 left) 2026-02-17T05:44:37.389 INFO:tasks.rados.rados.0.trial118.stdout:3866: done (1 left) 2026-02-17T05:44:37.389 INFO:tasks.rados.rados.0.trial118.stdout:3868: done (0 left) 2026-02-17T05:44:37.390 INFO:tasks.rados.rados.0.trial118.stdout:3869: rollback oid 41 current snap is 429 2026-02-17T05:44:37.390 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 411 2026-02-17T05:44:37.390 INFO:tasks.rados.rados.0.trial118.stdout:3870: write (excl) oid 48 current snap is 429 2026-02-17T05:44:37.390 INFO:tasks.rados.rados.0.trial118.stdout:3870: seq_num 1345 ranges {605415=488033,1656281=493458} 2026-02-17T05:44:37.393 INFO:tasks.rados.rados.0.trial118.stdout:3870: writing trial11845692-48 from 605415 to 1093448 tid 1 2026-02-17T05:44:37.397 INFO:tasks.rados.rados.0.trial118.stdout:3870: writing trial11845692-48 from 1656281 to 2149739 tid 2 2026-02-17T05:44:37.397 INFO:tasks.rados.rados.0.trial118.stdout:3871: write (excl) oid 8 current snap is 429 2026-02-17T05:44:37.398 INFO:tasks.rados.rados.0.trial118.stdout:3871: seq_num 1346 ranges {622222=679635,1831116=753469} 2026-02-17T05:44:37.402 INFO:tasks.rados.rados.0.trial118.stdout:3871: writing trial11845692-8 from 622222 to 1301857 tid 1 2026-02-17T05:44:37.407 INFO:tasks.rados.rados.0.trial118.stdout:3871: writing trial11845692-8 from 1831116 to 2584585 tid 2 2026-02-17T05:44:37.407 INFO:tasks.rados.rados.0.trial118.stdout:3872: read oid 23 snap -1 2026-02-17T05:44:37.407 INFO:tasks.rados.rados.0.trial118.stdout:3872: expect deleted 2026-02-17T05:44:37.407 INFO:tasks.rados.rados.0.trial118.stdout:3873: rollback oid 3 current snap is 429 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 3 to 367 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3869: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3869: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3869: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2453 (ObjNum 1272 snap 398 seq_num 1272) dirty exists 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: finishing write tid 1 to trial11845692-48 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: finishing write tid 2 to trial11845692-48 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3869: done (4 left) 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3874: rollback oid 41 current snap is 429 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 41 to 427 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: finishing write tid 3 to trial11845692-48 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: finishing write tid 4 to trial11845692-48 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: oid 48 updating version 0 to 2116 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: oid 48 updating version 2116 to 2117 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: oid 48 version 2117 is already newer than 2115 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 48 v 2117 (ObjNum 1345 snap 429 seq_num 1345) dirty exists 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: left oid 48 (ObjNum 1345 snap 429 seq_num 1345) 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3871: finishing write tid 1 to trial11845692-8 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3870: done (4 left) 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3875: write (excl) oid 13 current snap is 429 2026-02-17T05:44:37.408 INFO:tasks.rados.rados.0.trial118.stdout:3875: seq_num 1347 ranges {639029=754884,2173245=465784} 2026-02-17T05:44:37.412 INFO:tasks.rados.rados.0.trial118.stdout:3875: writing trial11845692-13 from 639029 to 1393913 tid 1 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3875: writing trial11845692-13 from 2173245 to 2639029 tid 2 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3876: read oid 17 snap -1 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3876: expect (ObjNum 1321 snap 414 seq_num 1321) 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3877: rollback oid 37 current snap is 429 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3873: finishing rollback tid 1 to trial11845692-3 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3873: finishing rollback tid 2 to trial11845692-3 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 3 v 2154 (ObjNum 1077 snap 320 seq_num 1077) dirty exists 2026-02-17T05:44:37.417 INFO:tasks.rados.rados.0.trial118.stdout:3871: finishing write tid 2 to trial11845692-8 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 37 to 420 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3874: finishing rollback tid 0 to trial11845692-41 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: finishing write tid 3 to trial11845692-8 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3874: finishing rollback tid 1 to trial11845692-41 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: finishing write tid 4 to trial11845692-8 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: oid 8 updating version 0 to 2554 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: oid 8 version 2554 is already newer than 2552 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: oid 8 version 2554 is already newer than 2553 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2554 (ObjNum 1346 snap 429 seq_num 1346) dirty exists 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: left oid 8 (ObjNum 1346 snap 429 seq_num 1346) 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3874: finishing rollback tid 2 to trial11845692-41 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 41 v 2456 (ObjNum 1234 snap 388 seq_num 1234) dirty exists 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3875: finishing write tid 1 to trial11845692-13 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3871: done (6 left) 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3872: done (5 left) 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3873: done (4 left) 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3874: done (3 left) 2026-02-17T05:44:37.418 INFO:tasks.rados.rados.0.trial118.stdout:3878: snap_create 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3877: finishing rollback tid 1 to trial11845692-37 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 2160 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: finishing write tid 2 to trial11845692-13 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: finishing write tid 3 to trial11845692-13 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: finishing write tid 4 to trial11845692-13 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: oid 13 updating version 0 to 2156 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: oid 13 version 2156 is already newer than 2155 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: oid 13 updating version 2156 to 2157 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 2157 (ObjNum 1347 snap 429 seq_num 1347) dirty exists 2026-02-17T05:44:37.419 INFO:tasks.rados.rados.0.trial118.stdout:3875: left oid 13 (ObjNum 1347 snap 429 seq_num 1347) 2026-02-17T05:44:37.420 INFO:tasks.rados.rados.0.trial118.stdout:3876: expect (ObjNum 1321 snap 414 seq_num 1321) 2026-02-17T05:44:37.421 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:37.436 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:37.455 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 998303 2026-02-17T05:44:38.392 INFO:tasks.rados.rados.0.trial118.stdout:3875: done (3 left) 2026-02-17T05:44:38.392 INFO:tasks.rados.rados.0.trial118.stdout:3876: done (2 left) 2026-02-17T05:44:38.392 INFO:tasks.rados.rados.0.trial118.stdout:3877: done (1 left) 2026-02-17T05:44:38.392 INFO:tasks.rados.rados.0.trial118.stdout:3878: done (0 left) 2026-02-17T05:44:38.393 INFO:tasks.rados.rados.0.trial118.stdout:3879: snap_create 2026-02-17T05:44:39.393 INFO:tasks.rados.rados.0.trial118.stdout:3879: done (0 left) 2026-02-17T05:44:39.393 INFO:tasks.rados.rados.0.trial118.stdout:3880: copy_from oid 9 from oid 42 current snap is 431 2026-02-17T05:44:39.393 INFO:tasks.rados.rados.0.trial118.stdout:3881: snap_create 2026-02-17T05:44:39.402 INFO:tasks.rados.rados.0.trial118.stdout:3880: finishing copy_from racing read to trial11845692-9 2026-02-17T05:44:39.403 INFO:tasks.rados.rados.0.trial118.stdout:3880: finishing copy_from to trial11845692-9 2026-02-17T05:44:39.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2205 (ObjNum 1191 snap 375 seq_num 1191) dirty exists 2026-02-17T05:44:40.376 INFO:tasks.rados.rados.0.trial118.stdout:3880: done (1 left) 2026-02-17T05:44:40.377 INFO:tasks.rados.rados.0.trial118.stdout:3881: done (0 left) 2026-02-17T05:44:40.377 INFO:tasks.rados.rados.0.trial118.stdout:3882: rollback oid 40 current snap is 432 2026-02-17T05:44:40.377 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 394 2026-02-17T05:44:40.377 INFO:tasks.rados.rados.0.trial118.stdout:3883: snap_create 2026-02-17T05:44:40.382 INFO:tasks.rados.rados.0.trial118.stdout:3882: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:44:40.382 INFO:tasks.rados.rados.0.trial118.stdout:3882: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:44:40.382 INFO:tasks.rados.rados.0.trial118.stdout:3882: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:44:40.383 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2489 (ObjNum 883 snap 266 seq_num 883) dirty exists 2026-02-17T05:44:41.377 INFO:tasks.rados.rados.0.trial118.stdout:3882: done (1 left) 2026-02-17T05:44:41.378 INFO:tasks.rados.rados.0.trial118.stdout:3883: done (0 left) 2026-02-17T05:44:41.378 INFO:tasks.rados.rados.0.trial118.stdout:3884: snap_remove snap 426 2026-02-17T05:44:42.378 INFO:tasks.rados.rados.0.trial118.stdout:3884: done (0 left) 2026-02-17T05:44:42.378 INFO:tasks.rados.rados.0.trial118.stdout:3885: rollback oid 40 current snap is 433 2026-02-17T05:44:42.378 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 40 to 409 2026-02-17T05:44:42.378 INFO:tasks.rados.rados.0.trial118.stdout:3886: snap_remove snap 400 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3886: done (1 left) 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3887: read oid 41 snap -1 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3887: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3888: read oid 39 snap -1 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3888: expect deleted 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3889: rollback oid 28 current snap is 433 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 429 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3885: finishing rollback tid 0 to trial11845692-40 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3890: copy_from oid 26 from oid 15 current snap is 433 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3885: finishing rollback tid 1 to trial11845692-40 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3885: finishing rollback tid 2 to trial11845692-40 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2493 (ObjNum 1302 snap 407 seq_num 1302) dirty exists 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3885: done (4 left) 2026-02-17T05:44:43.379 INFO:tasks.rados.rados.0.trial118.stdout:3891: snap_remove snap 420 2026-02-17T05:44:44.384 INFO:tasks.rados.rados.0.trial118.stdout:3891: done (4 left) 2026-02-17T05:44:44.384 INFO:tasks.rados.rados.0.trial118.stdout:3892: snap_create 2026-02-17T05:44:44.384 INFO:tasks.rados.rados.0.trial118.stdout:3889: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:44:44.384 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2235 (ObjNum 305 snap 0 seq_num 0) dirty dne 2026-02-17T05:44:44.384 INFO:tasks.rados.rados.0.trial118.stdout:3887: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:44.451 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1828070 2026-02-17T05:44:44.505 INFO:tasks.rados.rados.0.trial118.stdout:3890: finishing copy_from racing read to trial11845692-26 2026-02-17T05:44:44.505 INFO:tasks.rados.rados.0.trial118.stdout:3890: finishing copy_from to trial11845692-26 2026-02-17T05:44:44.505 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 26 v 2078 (ObjNum 1331 snap 415 seq_num 1331) dirty exists 2026-02-17T05:44:45.377 INFO:tasks.rados.rados.0.trial118.stdout:3887: done (4 left) 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3888: done (3 left) 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3889: done (2 left) 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3890: done (1 left) 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3892: done (0 left) 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3893: write (excl) oid 16 current snap is 434 2026-02-17T05:44:45.378 INFO:tasks.rados.rados.0.trial118.stdout:3893: seq_num 1348 ranges {655836=430133,1831727=757138} 2026-02-17T05:44:45.382 INFO:tasks.rados.rados.0.trial118.stdout:3893: writing trial11845692-16 from 655836 to 1085969 tid 1 2026-02-17T05:44:45.388 INFO:tasks.rados.rados.0.trial118.stdout:3893: writing trial11845692-16 from 1831727 to 2588865 tid 2 2026-02-17T05:44:45.388 INFO:tasks.rados.rados.0.trial118.stdout:3894: delete oid 13 current snap is 434 2026-02-17T05:44:45.388 INFO:tasks.rados.rados.0.trial118.stdout:3893: finishing write tid 1 to trial11845692-16 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: finishing write tid 2 to trial11845692-16 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: finishing write tid 3 to trial11845692-16 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: finishing write tid 4 to trial11845692-16 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: oid 16 updating version 0 to 2477 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: oid 16 updating version 2477 to 2478 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: oid 16 version 2478 is already newer than 2476 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 16 v 2478 (ObjNum 1348 snap 434 seq_num 1348) dirty exists 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: left oid 16 (ObjNum 1348 snap 434 seq_num 1348) 2026-02-17T05:44:45.390 INFO:tasks.rados.rados.0.trial118.stdout:3893: done (1 left) 2026-02-17T05:44:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3894: done (0 left) 2026-02-17T05:44:45.391 INFO:tasks.rados.rados.0.trial118.stdout:3895: snap_create 2026-02-17T05:44:46.387 INFO:tasks.rados.rados.0.trial118.stdout:3895: done (0 left) 2026-02-17T05:44:46.387 INFO:tasks.rados.rados.0.trial118.stdout:3896: write oid 44 current snap is 435 2026-02-17T05:44:46.387 INFO:tasks.rados.rados.0.trial118.stdout:3896: seq_num 1350 ranges {689450=580631,1948691=740759} 2026-02-17T05:44:46.392 INFO:tasks.rados.rados.0.trial118.stdout:3896: writing trial11845692-44 from 689450 to 1270081 tid 1 2026-02-17T05:44:46.397 INFO:tasks.rados.rados.0.trial118.stdout:3896: writing trial11845692-44 from 1948691 to 2689450 tid 2 2026-02-17T05:44:46.398 INFO:tasks.rados.rados.0.trial118.stdout:3897: snap_create 2026-02-17T05:44:46.400 INFO:tasks.rados.rados.0.trial118.stdout:3896: finishing write tid 1 to trial11845692-44 2026-02-17T05:44:46.400 INFO:tasks.rados.rados.0.trial118.stdout:3896: finishing write tid 2 to trial11845692-44 2026-02-17T05:44:46.400 INFO:tasks.rados.rados.0.trial118.stdout:3896: finishing write tid 3 to trial11845692-44 2026-02-17T05:44:46.400 INFO:tasks.rados.rados.0.trial118.stdout:3896: finishing write tid 4 to trial11845692-44 2026-02-17T05:44:46.400 INFO:tasks.rados.rados.0.trial118.stdout:3896: oid 44 updating version 0 to 1758 2026-02-17T05:44:46.401 INFO:tasks.rados.rados.0.trial118.stdout:3896: oid 44 version 1758 is already newer than 1757 2026-02-17T05:44:46.401 INFO:tasks.rados.rados.0.trial118.stdout:3896: oid 44 updating version 1758 to 1759 2026-02-17T05:44:46.401 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 44 v 1759 (ObjNum 1350 snap 435 seq_num 1350) dirty exists 2026-02-17T05:44:46.401 INFO:tasks.rados.rados.0.trial118.stdout:3896: left oid 44 (ObjNum 1350 snap 435 seq_num 1350) 2026-02-17T05:44:47.388 INFO:tasks.rados.rados.0.trial118.stdout:3896: done (1 left) 2026-02-17T05:44:47.388 INFO:tasks.rados.rados.0.trial118.stdout:3897: done (0 left) 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3898: read oid 47 snap -1 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3898: expect (ObjNum 1221 snap 385 seq_num 1221) 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3899: read oid 42 snap -1 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3899: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3900: rollback oid 50 current snap is 436 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 430 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3901: read oid 9 snap -1 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3901: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:44:47.389 INFO:tasks.rados.rados.0.trial118.stdout:3902: snap_remove snap 410 2026-02-17T05:44:48.382 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:44:48.382 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:44:48.382 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:44:48.383 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:44:48.394 INFO:tasks.rados.rados.0.trial118.stdout:3902: done (4 left) 2026-02-17T05:44:48.394 INFO:tasks.rados.rados.0.trial118.stdout:3903: rollback oid 28 current snap is 436 2026-02-17T05:44:48.394 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 405 2026-02-17T05:44:48.394 INFO:tasks.rados.rados.0.trial118.stdout:3901: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:44:48.394 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.401 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:44:48.401 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-17T05:44:48.401 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-17T05:44:48.402 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-17T05:44:48.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T05:44:48.411 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.429 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.446 INFO:tasks.rados.rados.0.trial118.stdout:3900: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:44:48.446 INFO:tasks.rados.rados.0.trial118.stdout:3900: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:44:48.446 INFO:tasks.rados.rados.0.trial118.stdout:3900: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:44:48.446 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2156 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:44:48.446 INFO:tasks.rados.rados.0.trial118.stdout:3898: expect (ObjNum 1221 snap 385 seq_num 1221) 2026-02-17T05:44:48.447 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.470 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 266344 2026-02-17T05:44:48.494 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.519 INFO:tasks.rados.rados.0.trial118.stdout:3899: expect (ObjNum 1191 snap 375 seq_num 1191) 2026-02-17T05:44:48.522 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 834032 2026-02-17T05:44:48.562 INFO:tasks.rados.rados.0.trial118.stdout:3903: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:44:48.562 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2235 (ObjNum 129 snap 0 seq_num 11526448) dirty dne 2026-02-17T05:44:48.562 INFO:tasks.rados.rados.0.trial118.stdout:3898: done (4 left) 2026-02-17T05:44:48.562 INFO:tasks.rados.rados.0.trial118.stdout:3899: done (3 left) 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3900: done (2 left) 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3901: done (1 left) 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3903: done (0 left) 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3904: read oid 1 snap -1 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3904: expect (ObjNum 1297 snap 405 seq_num 1297) 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3905: write oid 7 current snap is 436 2026-02-17T05:44:48.563 INFO:tasks.rados.rados.0.trial118.stdout:3905: seq_num 1351 ranges {706257=655880,1890820=504465} 2026-02-17T05:44:48.567 INFO:tasks.rados.rados.0.trial118.stdout:3905: writing trial11845692-7 from 706257 to 1362137 tid 1 2026-02-17T05:44:48.571 INFO:tasks.rados.rados.0.trial118.stdout:3905: writing trial11845692-7 from 1890820 to 2395285 tid 2 2026-02-17T05:44:48.572 INFO:tasks.rados.rados.0.trial118.stdout:3906: read oid 41 snap -1 2026-02-17T05:44:48.572 INFO:tasks.rados.rados.0.trial118.stdout:3906: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:48.572 INFO:tasks.rados.rados.0.trial118.stdout:3907: delete oid 9 current snap is 436 2026-02-17T05:44:48.572 INFO:tasks.rados.rados.0.trial118.stdout:3904: expect (ObjNum 1297 snap 405 seq_num 1297) 2026-02-17T05:44:48.617 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.670 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:44:48.722 INFO:tasks.rados.rados.0.trial118.stdout:3905: finishing write tid 1 to trial11845692-7 2026-02-17T05:44:48.722 INFO:tasks.rados.rados.0.trial118.stdout:3906: expect (ObjNum 1234 snap 388 seq_num 1234) 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: finishing write tid 2 to trial11845692-7 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: finishing write tid 3 to trial11845692-7 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: finishing write tid 4 to trial11845692-7 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: oid 7 updating version 0 to 2490 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: oid 7 version 2490 is already newer than 2489 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: oid 7 version 2490 is already newer than 2488 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 7 v 2490 (ObjNum 1351 snap 436 seq_num 1351) dirty exists 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: left oid 7 (ObjNum 1351 snap 436 seq_num 1351) 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3904: done (3 left) 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3905: done (2 left) 2026-02-17T05:44:48.842 INFO:tasks.rados.rados.0.trial118.stdout:3906: done (1 left) 2026-02-17T05:44:48.843 INFO:tasks.rados.rados.0.trial118.stdout:3907: done (0 left) 2026-02-17T05:44:48.843 INFO:tasks.rados.rados.0.trial118.stdout:3908: delete oid 50 current snap is 436 2026-02-17T05:44:48.844 INFO:tasks.rados.rados.0.trial118.stdout:3908: done (0 left) 2026-02-17T05:44:48.844 INFO:tasks.rados.rados.0.trial118.stdout:3909: rollback oid 33 current snap is 436 2026-02-17T05:44:48.844 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 429 2026-02-17T05:44:48.844 INFO:tasks.rados.rados.0.trial118.stdout:3910: snap_create 2026-02-17T05:44:48.847 INFO:tasks.rados.rados.0.trial118.stdout:3909: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:44:48.847 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 2376 (ObjNum 129 snap 0 seq_num 11478432) dirty dne 2026-02-17T05:45:03.403 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-17T05:45:03.403 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-17T05:45:03.403 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-17T05:45:03.403 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:45:03.403 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:45:03.465 INFO:tasks.rados.rados.0.trial118.stdout:3909: done (1 left) 2026-02-17T05:45:03.466 INFO:tasks.rados.rados.0.trial118.stdout:3910: done (0 left) 2026-02-17T05:45:03.466 INFO:tasks.rados.rados.0.trial118.stdout:3911: write (excl) oid 8 current snap is 437 2026-02-17T05:45:03.466 INFO:tasks.rados.rados.0.trial118.stdout:3911: seq_num 1354 ranges {756678=597980,1782619=768145} 2026-02-17T05:45:03.470 INFO:tasks.rados.rados.0.trial118.stdout:3911: writing trial11845692-8 from 756678 to 1354658 tid 1 2026-02-17T05:45:03.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:03.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: monmap: 2026-02-17T05:45:03.471 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.471 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:03.470637+0000 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:03.470637+0000 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:03.472 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.478 INFO:tasks.rados.rados.0.trial118.stdout:3911: writing trial11845692-8 from 1782619 to 2550764 tid 2 2026-02-17T05:45:03.478 INFO:tasks.rados.rados.0.trial118.stdout:3912: write oid 29 current snap is 437 2026-02-17T05:45:03.479 INFO:tasks.rados.rados.0.trial118.stdout:3912: seq_num 1355 ranges {773485=673229,2124748=511803} 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 1 Processor -- start 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 1 -- start start 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: init 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:45:03.481 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-a con 0x7fe51c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-c con 0x7fe51c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-b con 0x7fe51c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c08b060 con 0x7fe51c05d1b0 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.469+0000 7fe52150c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c05dc90 con 0x7fe51c05dee0 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c08d6a0 con 0x7fe51c182720 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 10 monclient(hunting): authenticate will time out at 1632.099012s 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe51affd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe51c05d1b0 0x7fe51c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40364/0 (socket says 10.20.193.106:40364) 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe51affd640 1 -- 10.20.193.106:0/1363896431 learned_addr learned my addr 10.20.193.106:0/1363896431 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853085265 0 0) 0x7fe51c08d6a0 con 0x7fe51c182720 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): my global_id is 5300 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5080035e0 con 0x7fe51c182720 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107796726 0 0) 0x7fe51c08b060 con 0x7fe51c05d1b0 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient(hunting): my global_id is 154098 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe51c08d6a0 con 0x7fe51c05d1b0 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450923334 0 0) 0x7fe5080035e0 con 0x7fe51c182720 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 >> v1:10.20.193.118:6789/0 conn(0x7fe51c05dee0 legacy=0x7fe51c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 >> v1:10.20.193.106:6789/0 conn(0x7fe51c05d1b0 legacy=0x7fe51c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 monclient: found mon.noname-b 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c057960 con 0x7fe51c182720 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe50c003eb0 con 0x7fe51c182720 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 5 monclient: authenticate success, global_id 5300 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: dump: 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.485 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe50c0040b0 con 0x7fe51c182720 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 4 set_mon_vals no callback set 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 1 -- 10.20.193.106:0/1363896431 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe50c004480 con 0x7fe51c182720 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe519ffb640 10 monclient: dump: 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.486 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 10 monclient: shutdown 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- 10.20.193.106:0/1363896431 >> v1:10.20.193.106:6790/0 conn(0x7fe51c182720 legacy=0x7fe51c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- 10.20.193.106:0/1363896431 shutdown_connections 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- 10.20.193.106:0/1363896431 >> 10.20.193.106:0/1363896431 conn(0x7fe51c0915f0 msgr2=0x7fe51c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- 10.20.193.106:0/1363896431 shutdown_connections 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.470+0000 7fe52150c640 1 -- 10.20.193.106:0/1363896431 wait complete. 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient: monmap: 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.488 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 1 Processor -- start 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 1 -- start start 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient: init 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-b con 0x7fe51c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-a con 0x7fe51c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient(hunting): picked mon.noname-c con 0x7fe51c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c10e960 con 0x7fe51c05dee0 2026-02-17T05:45:03.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c10ef20 con 0x7fe51c05d1b0 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c12aee0 con 0x7fe51c182720 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe52150c640 10 monclient(hunting): authenticate will time out at 1632.100704s 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe51b7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fe51c182720 0x7fe51c181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:50358/0 (socket says 10.20.193.106:50358) 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe51a7fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe51c05dee0 0x7fe51c12a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40378/0 (socket says 10.20.193.106:40378) 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe51b7fe640 1 -- 10.20.193.106:0/4287131332 learned_addr learned my addr 10.20.193.106:0/4287131332 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820970036 0 0) 0x7fe51c10e960 con 0x7fe51c05dee0 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): my global_id is 154101 2026-02-17T05:45:03.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4e80035e0 con 0x7fe51c05dee0 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812598488 0 0) 0x7fe51c12aee0 con 0x7fe51c182720 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 10 monclient(hunting): my global_id is 5303 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.471+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe51c10e960 con 0x7fe51c182720 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4055770775 0 0) 0x7fe4e80035e0 con 0x7fe51c05dee0 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe51c12aee0 con 0x7fe51c05dee0 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe504003050 con 0x7fe51c05dee0 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:03.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): dump: 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4071495450 0 0) 0x7fe51c10e960 con 0x7fe51c182720 2026-02-17T05:45:03.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4e80035e0 con 0x7fe51c182720 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe50c003dc0 con 0x7fe51c182720 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient(hunting): dump: 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.493 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 720026642 0 0) 0x7fe51c12aee0 con 0x7fe51c05dee0 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 >> v1:10.20.193.106:6790/0 conn(0x7fe51c182720 legacy=0x7fe51c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 >> v1:10.20.193.118:6789/0 conn(0x7fe51c05d1b0 legacy=0x7fe51c12a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 monclient: found mon.a 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c08a0e0 con 0x7fe51c05dee0 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 5 monclient: authenticate success, global_id 154101 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _renew_subs 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe51c12e0c0 con 0x7fe51c05dee0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _renew_subs 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe51c10e680 con 0x7fe51c05dee0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe504003440 con 0x7fe51c05dee0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe504003b30 con 0x7fe51c05dee0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 10 monclient: dump: 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe5197fa640 4 set_mon_vals no callback set 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe504003d00 con 0x7fe51c05dee0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51c10eb10 con 0x7fe51c05dee0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.472+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(870..870 src has 597..870) ==== 3899+0+0 (unknown 3073483933 0 0) 0x7fe50404fd80 con 0x7fe51c05dee0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.473+0000 7fe51affd640 10 monclient: get_auth_request con 0x7fe4e8040c10 auth_method 0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.475+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fe51c10eb10 con 0x7fe51c05dee0 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.475+0000 7fe4fb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.475+0000 7fe4fb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3912: writing trial11845692-29 from 773485 to 1446714 tid 1 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3912: writing trial11845692-29 from 2124748 to 2636551 tid 2 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3913: snap_create 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3911: finishing write tid 1 to trial11845692-8 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3911: finishing write tid 2 to trial11845692-8 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3911: finishing write tid 3 to trial11845692-8 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3911: finishing write tid 4 to trial11845692-8 2026-02-17T05:45:03.499 INFO:tasks.rados.rados.0.trial118.stdout:3911: oid 8 updating version 0 to 2570 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3911: oid 8 version 2570 is already newer than 2569 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3911: oid 8 version 2570 is already newer than 2568 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2570 (ObjNum 1354 snap 437 seq_num 1354) dirty exists 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3911: left oid 8 (ObjNum 1354 snap 437 seq_num 1354) 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: finishing write tid 1 to trial11845692-29 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: finishing write tid 2 to trial11845692-29 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: finishing write tid 3 to trial11845692-29 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: finishing write tid 4 to trial11845692-29 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: oid 29 updating version 0 to 2496 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: oid 29 version 2496 is already newer than 2495 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:3912: oid 29 version 2496 is already newer than 2494 2026-02-17T05:45:03.500 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 29 v 2496 (ObjNum 1355 snap 437 seq_num 1355) dirty exists 2026-02-17T05:45:03.501 INFO:tasks.rados.rados.0.trial118.stdout:3912: left oid 29 (ObjNum 1355 snap 437 seq_num 1355) 2026-02-17T05:45:03.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe52150c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:45:03.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe52150c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:03.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe52150c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe51c10eaf0 con 0x7fe51c05dee0 2026-02-17T05:45:03.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe4fb7fe640 1 -- 10.20.193.106:0/4287131332 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 812724761) 0x7fe504017410 con 0x7fe51c05dee0 2026-02-17T05:45:03.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe4fb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:03.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.623+0000 7fe4fb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:03.627 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:45:03.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 >> v1:10.20.193.118:6812/703720803 conn(0x7fe4e8040c10 legacy=0x7fe4e80610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 10 monclient: shutdown 2026-02-17T05:45:03.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 >> v1:10.20.193.106:6789/0 conn(0x7fe51c05dee0 legacy=0x7fe51c12a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 shutdown_connections 2026-02-17T05:45:03.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 >> 10.20.193.106:0/4287131332 conn(0x7fe51c0915f0 msgr2=0x7fe51c05bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 shutdown_connections 2026-02-17T05:45:03.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.625+0000 7fe52150c640 1 -- 10.20.193.106:0/4287131332 wait complete. 2026-02-17T05:45:03.636 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:45:03.636 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:45:03.636 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:45:03.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 10 monclient: get_monmap_and_config 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 10 monclient: monmap: 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:03.710833+0000 2026-02-17T05:45:03.717 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:03.710833+0000 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 1 Processor -- start 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 1 -- start start 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.709+0000 7f6ac265b640 10 monclient: init 2026-02-17T05:45:03.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-b con 0x7f6abc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-c con 0x7f6abc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-a con 0x7f6abc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc08b060 con 0x7f6abc182720 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc05dc90 con 0x7f6abc05dee0 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc08d6a0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac265b640 10 monclient(hunting): authenticate will time out at 1632.339241s 2026-02-17T05:45:03.719 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abbfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f6abc05d1b0 0x7f6abc05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:50370/0 (socket says 10.20.193.106:50370) 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abbfff640 1 -- 10.20.193.106:0/927049491 learned_addr learned my addr 10.20.193.106:0/927049491 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587475333 0 0) 0x7f6abc08b060 con 0x7f6abc182720 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): my global_id is 154104 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa00035e0 con 0x7f6abc182720 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493662056 0 0) 0x7f6abc08d6a0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.720 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): my global_id is 5306 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc08b060 con 0x7f6abc05d1b0 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3807620556 0 0) 0x7f6aa00035e0 con 0x7f6abc182720 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac0bd1640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6abc182720 legacy=0x7f6abc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac0bd1640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6abc182720 legacy=0x7f6abc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac0bd1640 1 --1- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6abc182720 0x7f6abc1a2b00 :-1 s=OPENED pgs=302 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6ac0bd1640 1 --1- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6abc182720 0x7f6abc1a2b00 :-1 s=OPENED pgs=302 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6790/0 conn(0x7f6abc05d1b0 legacy=0x7f6abc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.118:6789/0 conn(0x7f6abc05dee0 legacy=0x7f6abc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 monclient: found mon.noname-a 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc057960 con 0x7f6abc182720 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: ms_handle_reset current mon v1:10.20.193.106:6789/0 2026-02-17T05:45:03.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6abc182720 legacy=0x7f6abc1a2b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): picked mon.noname-a con 0x7f6aa0004bf0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): picked mon.noname-b con 0x7f6abc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): picked mon.noname-c con 0x7f6abc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa00035e0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc057960 con 0x7f6abc05dee0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc08d6a0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.710+0000 7f6abaffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.106:6789/0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357670189 0 0) 0x7f6aa00035e0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6aa006ad00 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918059842 0 0) 0x7f6abc08d6a0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6aa00035e0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 4164282170 0 0) 0x7f6aa006ad00 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6790/0 conn(0x7f6abc05d1b0 legacy=0x7f6aa0045a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.118:6789/0 conn(0x7f6abc05dee0 legacy=0x7f6aa0067360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 monclient: found mon.noname-a 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa006bdd0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 5 monclient: authenticate success, global_id 154104 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aa8002f80 con 0x7f6aa0004bf0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: dump: 2026-02-17T05:45:03.723 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6aa80030e0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 1 -- 10.20.193.106:0/927049491 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aa80034b0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6abaffd640 10 monclient: dump: 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.725 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.726 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 4 set_mon_vals no callback set 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 10 monclient: shutdown 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 1 -- 10.20.193.106:0/927049491 >> v1:10.20.193.106:6789/0 conn(0x7f6aa0004bf0 legacy=0x7f6aa0004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 1 -- 10.20.193.106:0/927049491 shutdown_connections 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 1 -- 10.20.193.106:0/927049491 >> 10.20.193.106:0/927049491 conn(0x7f6abc0915f0 msgr2=0x7f6abc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 1 -- 10.20.193.106:0/927049491 shutdown_connections 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 1 -- 10.20.193.106:0/927049491 wait complete. 2026-02-17T05:45:03.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.711+0000 7f6ac265b640 10 monclient: monmap: 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:03.736 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 Processor -- start 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 -- start start 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient: init 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:03.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-b con 0x7f6aa0004bf0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-c con 0x7f6abc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient(hunting): picked mon.noname-a con 0x7f6abc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc12f3d0 con 0x7f6abc05dee0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc05e8e0 con 0x7f6aa0004bf0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc12e3b0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient(hunting): authenticate will time out at 1632.341513s 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6abb7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f6abc05d1b0 0x7f6abc21a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:50384/0 (socket says 10.20.193.106:50384) 2026-02-17T05:45:03.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6abb7fe640 1 -- 10.20.193.106:0/1775079730 learned_addr learned my addr 10.20.193.106:0/1775079730 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955821390 0 0) 0x7f6abc12e3b0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): my global_id is 5309 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a8c0035e0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270214687 0 0) 0x7f6abc12f3d0 con 0x7f6abc05dee0 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): my global_id is 154107 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc12e3b0 con 0x7f6abc05dee0 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1575493344 0 0) 0x7f6a8c0035e0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6abc12f3d0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aac003080 con 0x7f6abc05d1b0 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.741 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 746476092 0 0) 0x7f6abc12e3b0 con 0x7f6abc05dee0 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a8c0035e0 con 0x7f6abc05dee0 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6ab00042b0 con 0x7f6abc05dee0 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.742 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1668971075 0 0) 0x7f6abc12f3d0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.118:6789/0 conn(0x7f6aa0004bf0 legacy=0x7f6abc13cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6789/0 conn(0x7f6abc05dee0 legacy=0x7f6abc23b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 monclient: found mon.c 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc130710 con 0x7f6abc05d1b0 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ab8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 5 monclient: authenticate success, global_id 5309 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient: _renew_subs 2026-02-17T05:45:03.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.712+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc12ef10 con 0x7f6abc05d1b0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ac265b640 10 monclient: _renew_subs 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ac265b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6abc13d7b0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6aac0032d0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aac004b90 con 0x7f6abc05d1b0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: dump: 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.745 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6aba7fc640 4 set_mon_vals no callback set 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ac265b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6abc12dd60 con 0x7f6abc12d990 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938221083 0 0) 0x7f6abc12dd60 con 0x7f6abc12d990 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient(hunting): my global_id is 154110 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc12f3d0 con 0x7f6abc12d990 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f6aac011b30 con 0x7f6abc05d1b0 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(870..870 src has 597..870) ==== 3899+0+0 (unknown 3073483933 0 0) 0x7f6aac04fce0 con 0x7f6abc05d1b0 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2362967358 0 0) 0x7f6abc12f3d0 con 0x7f6abc12d990 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6abc12dd60 con 0x7f6abc12d990 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aa8002a90 con 0x7f6abc12d990 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.713+0000 7f6ab8ff9640 10 monclient: dump: 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.747 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ac0bd1640 10 monclient: get_auth_request con 0x7f6a8c040d30 auth_method 0 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3767257169 0 0) 0x7f6abc12dd60 con 0x7f6abc12d990 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6abc08e3d0 con 0x7f6abc12d990 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6aa8002e50 con 0x7f6abc12d990 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6789/0 conn(0x7f6abc12d990 legacy=0x7f6abc058ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.714+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6789/0 conn(0x7f6abc12d990 legacy=0x7f6abc058ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ac265b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6abc055570 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996326541 0 0) 0x7f6abc055570 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient(hunting): my global_id is 154113 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc12dd60 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3337751690 0 0) 0x7f6abc12dd60 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6abc055570 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f6aa8004c40 con 0x7f6abc0595e0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.717+0000 7f6ab8ff9640 10 monclient: dump: 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1803270961 0 0) 0x7f6abc055570 con 0x7f6abc0595e0 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6abc1401d0 con 0x7f6abc0595e0 2026-02-17T05:45:03.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 3210499236) 0x7f6aa8004f80 con 0x7f6abc0595e0 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6789/0 conn(0x7f6abc0595e0 legacy=0x7f6abc25deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ab8ff9640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6789/0 conn(0x7f6abc0595e0 legacy=0x7f6abc25deb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:03.751 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 15262, 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.752 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.753 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:03.754 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.755 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:03.756 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.757 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.758 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:03.760 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:03.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.118:6812/703720803 conn(0x7f6a8c040d30 legacy=0x7f6a8c0611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 10 monclient: shutdown 2026-02-17T05:45:03.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 >> v1:10.20.193.106:6790/0 conn(0x7f6abc05d1b0 legacy=0x7f6abc21a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac0bd1640 1 -- 10.20.193.106:0/1775079730 reap_dead start 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac0bd1640 1 -- 10.20.193.106:0/1775079730 reap_dead start 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 shutdown_connections 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 >> 10.20.193.106:0/1775079730 conn(0x7f6abc0915f0 msgr2=0x7f6abc08c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 shutdown_connections 2026-02-17T05:45:03.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.718+0000 7f6ac265b640 1 -- 10.20.193.106:0/1775079730 wait complete. 2026-02-17T05:45:03.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:03.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:45:03.762 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 10 monclient: monmap: 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:03.841429+0000 2026-02-17T05:45:03.842 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:03.841429+0000 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:03.843 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 1 Processor -- start 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 1 -- start start 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.840+0000 7fd54630c640 10 monclient: init 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-c con 0x7fd54013ec40 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-a con 0x7fd54013f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-b con 0x7fd5401811f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54008a7d0 con 0x7fd54013f010 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54008d5c0 con 0x7fd54013ec40 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54008d800 con 0x7fd5401811f0 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient(hunting): authenticate will time out at 1632.470109s 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53f7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd54013f010 0x7fd54013f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40442/0 (socket says 10.20.193.106:40442) 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53f7fe640 1 -- 10.20.193.106:0/2827210526 learned_addr learned my addr 10.20.193.106:0/2827210526 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd544882640 1 --1- 10.20.193.106:0/2827210526 >> v1:10.20.193.106:6790/0 conn(0x7fd5401811f0 0x7fd5401a15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:50396/0 (socket says 10.20.193.106:50396) 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200878215 0 0) 0x7fd54008a7d0 con 0x7fd54013f010 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): my global_id is 154116 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5240035e0 con 0x7fd54013f010 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029812065 0 0) 0x7fd54008d800 con 0x7fd5401811f0 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient(hunting): my global_id is 5312 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54008a7d0 con 0x7fd5401811f0 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2984228265 0 0) 0x7fd5240035e0 con 0x7fd54013f010 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 >> v1:10.20.193.106:6790/0 conn(0x7fd5401811f0 legacy=0x7fd5401a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 >> v1:10.20.193.118:6789/0 conn(0x7fd54013ec40 legacy=0x7fd54008ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 monclient: found mon.noname-a 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54008a180 con 0x7fd54013f010 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd530002dd0 con 0x7fd54013f010 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 5 monclient: authenticate success, global_id 154116 2026-02-17T05:45:03.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: dump: 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd530002fd0 con 0x7fd54013f010 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 1 -- 10.20.193.106:0/2827210526 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd5300033e0 con 0x7fd54013f010 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd54630c640 4 set_mon_vals no callback set 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.841+0000 7fd53effd640 10 monclient: dump: 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.856 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: shutdown 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- 10.20.193.106:0/2827210526 >> v1:10.20.193.106:6789/0 conn(0x7fd54013f010 legacy=0x7fd54013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- 10.20.193.106:0/2827210526 shutdown_connections 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- 10.20.193.106:0/2827210526 >> 10.20.193.106:0/2827210526 conn(0x7fd5400915f0 msgr2=0x7fd5400919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- 10.20.193.106:0/2827210526 shutdown_connections 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- 10.20.193.106:0/2827210526 wait complete. 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: monmap: 2026-02-17T05:45:03.857 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 Processor -- start 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 1 -- start start 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: init 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:45:03.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.842+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-c con 0x7fd54013ec40 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-a con 0x7fd54013f010 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient(hunting): picked mon.noname-b con 0x7fd5401811f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54010ca40 con 0x7fd54013f010 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54010aca0 con 0x7fd5401811f0 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54005e8e0 con 0x7fd54013ec40 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient(hunting): authenticate will time out at 1632.472024s 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53f7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd54013f010 0x7fd540109230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40456/0 (socket says 10.20.193.106:40456) 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53f7fe640 1 -- 10.20.193.106:0/166085386 learned_addr learned my addr 10.20.193.106:0/166085386 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234792119 0 0) 0x7fd54010ca40 con 0x7fd54013f010 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): my global_id is 154119 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5100035e0 con 0x7fd54013f010 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980548118 0 0) 0x7fd54005e8e0 con 0x7fd54013ec40 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): my global_id is 5315 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54010ca40 con 0x7fd54013ec40 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 308932561 0 0) 0x7fd5100035e0 con 0x7fd54013f010 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd54005e8e0 con 0x7fd54013f010 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd5300032f0 con 0x7fd54013f010 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): dump: 2026-02-17T05:45:03.860 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785094905 0 0) 0x7fd54010aca0 con 0x7fd5401811f0 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): my global_id is 134188 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5100035e0 con 0x7fd5401811f0 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 135958027 0 0) 0x7fd54010ca40 con 0x7fd54013ec40 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd54010aca0 con 0x7fd54013ec40 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd52c002ff0 con 0x7fd54013ec40 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient(hunting): dump: 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.862 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2872873838 0 0) 0x7fd54005e8e0 con 0x7fd54013f010 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6790/0 conn(0x7fd54013ec40 legacy=0x7fd54011ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.118:6789/0 conn(0x7fd5401811f0 legacy=0x7fd540109940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 monclient: found mon.a 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54010c760 con 0x7fd54013f010 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.863 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 5 monclient: authenticate success, global_id 154119 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient: _renew_subs 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd54011c5c0 con 0x7fd54013f010 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient: _renew_subs 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5401306b0 con 0x7fd54013f010 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd530004b50 con 0x7fd54013f010 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd530004ef0 con 0x7fd54013f010 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53cff9640 10 monclient: dump: 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.864 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd53e7fc640 4 set_mon_vals no callback set 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.843+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5400008d0 con 0x7fd54010a050 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd530005050 con 0x7fd54013f010 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918728512 0 0) 0x7fd5400008d0 con 0x7fd54010a050 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.865 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient(hunting): my global_id is 5318 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54005e8e0 con 0x7fd54010a050 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(870..870 src has 597..870) ==== 3899+0+0 (unknown 3073483933 0 0) 0x7fd53004fe20 con 0x7fd54013f010 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2450896025 0 0) 0x7fd54005e8e0 con 0x7fd54010a050 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5400008d0 con 0x7fd54010a050 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd52c0036d0 con 0x7fd54010a050 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient: dump: 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.866 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd544882640 10 monclient: get_auth_request con 0x7fd510040d80 auth_method 0 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3328886034 0 0) 0x7fd5400008d0 con 0x7fd54010a050 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd54008a520 con 0x7fd54010a050 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd52c004700 con 0x7fd54010a050 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6790/0 conn(0x7fd54010a050 legacy=0x7fd54011cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.844+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6790/0 conn(0x7fd54010a050 legacy=0x7fd54011cb70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.847+0000 7fd54630c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:03.867 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.847+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd54008ba10 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4247318696 0 0) 0x7fd54008ba10 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient(hunting): my global_id is 5321 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5400008d0 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2635859870 0 0) 0x7fd5400008d0 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd54008ba10 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd52c003fd0 con 0x7fd54011d280 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient: dump: 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2046817764 0 0) 0x7fd54008ba10 con 0x7fd54011d280 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd54008bba0 con 0x7fd54011d280 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4517 (unknown 0 0 695197177) 0x7fd52c004410 con 0x7fd54011d280 2026-02-17T05:45:03.869 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6790/0 conn(0x7fd54011d280 legacy=0x7fd54012d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd53cff9640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6790/0 conn(0x7fd54011d280 legacy=0x7fd54012d510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:03.870 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 1028609, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.871 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.872 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:03.873 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.874 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.875 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.876 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.877 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.878 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.879 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.880 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.880 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:03.880 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.118:6812/703720803 conn(0x7fd510040d80 legacy=0x7fd510061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 10 monclient: shutdown 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 >> v1:10.20.193.106:6789/0 conn(0x7fd54013f010 legacy=0x7fd540109230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd544882640 1 -- 10.20.193.106:0/166085386 reap_dead start 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 shutdown_connections 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 >> 10.20.193.106:0/166085386 conn(0x7fd5400915f0 msgr2=0x7fd54011f180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 shutdown_connections 2026-02-17T05:45:03.881 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.848+0000 7fd54630c640 1 -- 10.20.193.106:0/166085386 wait complete. 2026-02-17T05:45:03.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:03.882 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:45:03.882 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:45:03.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 10 monclient: get_monmap_and_config 2026-02-17T05:45:03.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 10 monclient: monmap: 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:03.952541+0000 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:03.952541+0000 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:03.954 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 1 Processor -- start 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 1 -- start start 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.951+0000 7f472c847640 10 monclient: init 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient(hunting): picked mon.noname-b con 0x7f47240585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient(hunting): picked mon.noname-a con 0x7f472413f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient(hunting): picked mon.noname-c con 0x7f472408c0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4724056bb0 con 0x7f472413f6c0 2026-02-17T05:45:03.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47240575d0 con 0x7f472408c0d0 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47240578b0 con 0x7f47240585c0 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient(hunting): authenticate will time out at 1632.581102s 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f4729dbb640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f472413f6c0 0x7f4724183200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40462/0 (socket says 10.20.193.106:40462) 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f4729dbb640 1 -- 10.20.193.106:0/1995113085 learned_addr learned my addr 10.20.193.106:0/1995113085 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631830187 0 0) 0x7f4724056bb0 con 0x7f472413f6c0 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): my global_id is 154122 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47140035e0 con 0x7f472413f6c0 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971144465 0 0) 0x7f47240578b0 con 0x7f47240585c0 2026-02-17T05:45:03.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): my global_id is 5324 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4724056bb0 con 0x7f47240585c0 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177604336 0 0) 0x7f47240575d0 con 0x7f472408c0d0 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient(hunting): my global_id is 134191 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47240578b0 con 0x7f472408c0d0 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3145790448 0 0) 0x7f47140035e0 con 0x7f472413f6c0 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 >> v1:10.20.193.106:6790/0 conn(0x7f47240585c0 legacy=0x7f472413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 >> v1:10.20.193.118:6789/0 conn(0x7f472408c0d0 legacy=0x7f47241a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 monclient: found mon.noname-a 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4724057b90 con 0x7f472413f6c0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4710002dd0 con 0x7f472413f6c0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 5 monclient: authenticate success, global_id 154122 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:03.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: dump: 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4710002fa0 con 0x7f472413f6c0 2026-02-17T05:45:03.968 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 1 -- 10.20.193.106:0/1995113085 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4710003370 con 0x7f472413f6c0 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f47295ba640 10 monclient: dump: 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.969 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 4 set_mon_vals no callback set 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 10 monclient: shutdown 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- 10.20.193.106:0/1995113085 >> v1:10.20.193.106:6789/0 conn(0x7f472413f6c0 legacy=0x7f4724183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- 10.20.193.106:0/1995113085 shutdown_connections 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- 10.20.193.106:0/1995113085 >> 10.20.193.106:0/1995113085 conn(0x7f472405e410 msgr2=0x7f4724095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.952+0000 7f472c847640 1 -- 10.20.193.106:0/1995113085 shutdown_connections 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 -- 10.20.193.106:0/1995113085 wait complete. 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient: build_initial_monmap 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient: monmap: 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:03.970 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 Processor -- start 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 -- start start 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient: init 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:03.971 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient(hunting): picked mon.noname-b con 0x7f47240585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient(hunting): picked mon.noname-a con 0x7f472408c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient(hunting): picked mon.noname-c con 0x7f472413f6c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472413e530 con 0x7f472408c0d0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472412e750 con 0x7f47240585c0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472412c7c0 con 0x7f472413f6c0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f472c847640 10 monclient(hunting): authenticate will time out at 1632.582822s 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f4729dbb640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f472408c0d0 0x7f472412c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40468/0 (socket says 10.20.193.106:40468) 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.953+0000 7f4729dbb640 1 -- 10.20.193.106:0/2494471971 learned_addr learned my addr 10.20.193.106:0/2494471971 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077858412 0 0) 0x7f472412c7c0 con 0x7f472413f6c0 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.972 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): my global_id is 5327 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46f40035e0 con 0x7f472413f6c0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736041465 0 0) 0x7f472413e530 con 0x7f472408c0d0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): my global_id is 154125 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f472412c7c0 con 0x7f472408c0d0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2037071538 0 0) 0x7f46f40035e0 con 0x7f472413f6c0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f472413e530 con 0x7f472413f6c0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4718004150 con 0x7f472413f6c0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:03.973 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): dump: 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3529438300 0 0) 0x7f472412c7c0 con 0x7f472408c0d0 2026-02-17T05:45:03.974 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46f40035e0 con 0x7f472408c0d0 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f47100032c0 con 0x7f472408c0d0 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient(hunting): dump: 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.975 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 528181686 0 0) 0x7f472413e530 con 0x7f472413f6c0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6789/0 conn(0x7f47240585c0 legacy=0x7f472412b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.106:6789/0 conn(0x7f472408c0d0 legacy=0x7f472412c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 monclient: found mon.c 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472408c530 con 0x7f472413f6c0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: _finish_auth 0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 5 monclient: authenticate success, global_id 5327 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 10 monclient: _renew_subs 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.976 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f472408b890 con 0x7f472413f6c0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 10 monclient: _renew_subs 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f472412e520 con 0x7f472413f6c0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47180047b0 con 0x7f472413f6c0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f4718004ad0 con 0x7f472413f6c0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 10 monclient: dump: 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.977 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f4728db9640 4 set_mon_vals no callback set 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4724093240 con 0x7f472408d750 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.954+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f4718011a70 con 0x7f472413f6c0 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(870..870 src has 597..870) ==== 3899+0+0 (unknown 3073483933 0 0) 0x7f471804fbd0 con 0x7f472413f6c0 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f4729dbb640 10 monclient: get_auth_request con 0x7f46f4040ac0 auth_method 0 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131419512 0 0) 0x7f4724093240 con 0x7f472408d750 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.978 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient(hunting): my global_id is 134194 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f472413e530 con 0x7f472408d750 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3617078239 0 0) 0x7f472413e530 con 0x7f472408d750 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4724093240 con 0x7f472408d750 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f471c002d20 con 0x7f472408d750 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient: dump: 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.979 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3212960705 0 0) 0x7f4724093240 con 0x7f472408d750 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4724058c70 con 0x7f472408d750 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f471c0050a0 con 0x7f472408d750 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6789/0 conn(0x7f472408d750 legacy=0x7f472408db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.955+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6789/0 conn(0x7f472408d750 legacy=0x7f472408db20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.959+0000 7f472c847640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.959+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4724094410 con 0x7f472408e230 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267226999 0 0) 0x7f4724094410 con 0x7f472408e230 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:03.980 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient(hunting): my global_id is 134197 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4724093240 con 0x7f472408e230 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2252906123 0 0) 0x7f4724093240 con 0x7f472408e230 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4724094410 con 0x7f472408e230 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f471c003690 con 0x7f472408e230 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient: dump: 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:03.981 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3588993270 0 0) 0x7f4724094410 con 0x7f472408e230 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f472405fd90 con 0x7f472408e230 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3387359969) 0x7f471c004bf0 con 0x7f472408e230 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6789/0 conn(0x7f472408e230 legacy=0x7f4724196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.982 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.960+0000 7f470effd640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6789/0 conn(0x7f472408e230 legacy=0x7f4724196dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 128103, 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:03.983 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.984 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.985 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:03.986 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:03.987 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.988 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.989 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:03.990 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:45:03.991 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:03.992 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.118:6812/703720803 conn(0x7f46f4040ac0 legacy=0x7f46f4060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 10 monclient: shutdown 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 >> v1:10.20.193.106:6790/0 conn(0x7f472413f6c0 legacy=0x7f4724194690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472adbd640 1 -- 10.20.193.106:0/2494471971 reap_dead start 2026-02-17T05:45:03.993 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472adbd640 1 -- 10.20.193.106:0/2494471971 reap_dead start 2026-02-17T05:45:03.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 shutdown_connections 2026-02-17T05:45:03.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 >> 10.20.193.106:0/2494471971 conn(0x7f472405e410 msgr2=0x7f4724141650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:03.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 shutdown_connections 2026-02-17T05:45:03.994 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:03.961+0000 7f472c847640 1 -- 10.20.193.106:0/2494471971 wait complete. 2026-02-17T05:45:03.994 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:03.994 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:45:03.994 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:45:04.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.055+0000 7feb7e3a5640 10 monclient: get_monmap_and_config 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.055+0000 7feb7e3a5640 10 monclient: build_initial_monmap 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.055+0000 7feb7e3a5640 10 monclient: monmap: 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:04.056996+0000 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:04.056996+0000 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:04.058 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 1 Processor -- start 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 1 -- start start 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient: init 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-a con 0x7feb78141dc0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-b con 0x7feb78142190 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-c con 0x7feb78184340 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb780575f0 con 0x7feb78141dc0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb780578d0 con 0x7feb78184340 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78057bb0 con 0x7feb78142190 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 10 monclient(hunting): authenticate will time out at 1632.685387s 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb77fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7feb78141dc0 0x7feb7808fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40472/0 (socket says 10.20.193.106:40472) 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb77fff640 1 -- 10.20.193.106:0/3175945239 learned_addr learned my addr 10.20.193.106:0/3175945239 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48196545 0 0) 0x7feb780575f0 con 0x7feb78141dc0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): my global_id is 154128 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c0035e0 con 0x7feb78141dc0 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163424406 0 0) 0x7feb78057bb0 con 0x7feb78142190 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): my global_id is 5330 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb780575f0 con 0x7feb78142190 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806110434 0 0) 0x7feb780578d0 con 0x7feb78184340 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient(hunting): my global_id is 134200 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78057bb0 con 0x7feb78184340 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3948638240 0 0) 0x7feb5c0035e0 con 0x7feb78141dc0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 >> v1:10.20.193.106:6790/0 conn(0x7feb78142190 legacy=0x7feb781425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 >> v1:10.20.193.118:6789/0 conn(0x7feb78184340 legacy=0x7feb781a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 monclient: found mon.noname-a 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb78057e90 con 0x7feb78141dc0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: _finish_auth 0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7feb64002dd0 con 0x7feb78141dc0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 5 monclient: authenticate success, global_id 154128 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb76ffd640 10 monclient: dump: 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.063 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.056+0000 7feb7e3a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb64002fa0 con 0x7feb78141dc0 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 1 -- 10.20.193.106:0/3175945239 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7feb640033b0 con 0x7feb78141dc0 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 4 set_mon_vals no callback set 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb76ffd640 10 monclient: dump: 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 10 monclient: shutdown 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 1 -- 10.20.193.106:0/3175945239 >> v1:10.20.193.106:6789/0 conn(0x7feb78141dc0 legacy=0x7feb7808fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 1 -- 10.20.193.106:0/3175945239 shutdown_connections 2026-02-17T05:45:04.064 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 1 -- 10.20.193.106:0/3175945239 >> 10.20.193.106:0/3175945239 conn(0x7feb7805e3c0 msgr2=0x7feb78095420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 1 -- 10.20.193.106:0/3175945239 shutdown_connections 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 1 -- 10.20.193.106:0/3175945239 wait complete. 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 10 monclient: build_initial_monmap 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.057+0000 7feb7e3a5640 10 monclient: monmap: 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 Processor -- start 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- start start 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: init 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-a con 0x7feb78141dc0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-c con 0x7feb78142190 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient(hunting): picked mon.noname-b con 0x7feb78184340 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7808d8c0 con 0x7feb78141dc0 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb781a40e0 con 0x7feb78184340 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb781a11c0 con 0x7feb78142190 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient(hunting): authenticate will time out at 1632.687313s 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb77fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7feb78141dc0 0x7feb781a03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:40482/0 (socket says 10.20.193.106:40482) 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb77fff640 1 -- 10.20.193.106:0/642397307 learned_addr learned my addr 10.20.193.106:0/642397307 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb777fe640 1 --1- 10.20.193.106:0/642397307 >> v1:10.20.193.106:6790/0 conn(0x7feb78142190 0x7feb781a0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:50450/0 (socket says 10.20.193.106:50450) 2026-02-17T05:45:04.065 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071632846 0 0) 0x7feb781a11c0 con 0x7feb78142190 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): my global_id is 5333 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb480035e0 con 0x7feb78142190 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148168010 0 0) 0x7feb7808d8c0 con 0x7feb78141dc0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): my global_id is 154131 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb781a11c0 con 0x7feb78141dc0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2658761294 0 0) 0x7feb480035e0 con 0x7feb78142190 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb7808d8c0 con 0x7feb78142190 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7feb68002fb0 con 0x7feb78142190 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 351692790 0 0) 0x7feb781a11c0 con 0x7feb78141dc0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb480035e0 con 0x7feb78141dc0 2026-02-17T05:45:04.066 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7feb640032c0 con 0x7feb78141dc0 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860144979 0 0) 0x7feb781a40e0 con 0x7feb78184340 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient(hunting): my global_id is 134203 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb781a11c0 con 0x7feb78184340 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1060014963 0 0) 0x7feb7808d8c0 con 0x7feb78142190 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 >> v1:10.20.193.118:6789/0 conn(0x7feb78184340 legacy=0x7feb7818c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 >> v1:10.20.193.106:6789/0 conn(0x7feb78141dc0 legacy=0x7feb781a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 monclient: found mon.c 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb781a1d80 con 0x7feb78142190 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: _finish_auth 0 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:04.067 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 5 monclient: authenticate success, global_id 5333 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _renew_subs 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb781a3840 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _renew_subs 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7feb781a57d0 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb68003620 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7feb680039c0 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb74ff9640 10 monclient: dump: 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.058+0000 7feb767fc640 4 set_mon_vals no callback set 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb7e3a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb7e3a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb7e3a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb780008d0 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7feb68003b20 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(870..870 src has 597..870) ==== 3899+0+0 (unknown 3073483933 0 0) 0x7feb6804fcc0 con 0x7feb78142190 2026-02-17T05:45:04.068 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.059+0000 7feb77fff640 10 monclient: get_auth_request con 0x7feb48040dd0 auth_method 0 2026-02-17T05:45:04.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.061+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7feb68017350 con 0x7feb78142190 2026-02-17T05:45:04.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.061+0000 7feb74ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:04.069 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.061+0000 7feb74ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.210+0000 7feb7e3a5640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.210+0000 7feb7e3a5640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.210+0000 7feb7e3a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.210+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7feb78094410 con 0x7feb78142190 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.211+0000 7feb74ff9640 1 -- 10.20.193.106:0/642397307 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7feb68016b00 con 0x7feb78142190 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.211+0000 7feb74ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:45:04.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.211+0000 7feb74ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:04.213 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.213 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=13,kv=10,logm=50} crc {auth=573108772,config=1618278320,health=650935996,kv=2318243043,logm=3507423376}) 2026-02-17T05:45:04.213 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=13,kv=11,logm=50} crc {auth=2353033815,config=1618278320,health=650935996,kv=3203686986,logm=1325024809}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=13,kv=10,logm=50} crc {auth=573108772,config=1618278320,health=650935996,kv=2318243043,logm=3507423376}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.211+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=24,config=2,health=13,kv=9,logm=52} crc {auth=2023596778,config=1618278320,health=650935996,kv=2758385709,logm=46367610}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=781155567}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=352176408}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=781155567}) 2026-02-17T05:45:04.214 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.212+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=418639673}) 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 >> v1:10.20.193.118:6812/703720803 conn(0x7feb48040dd0 legacy=0x7feb48061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 10 monclient: shutdown 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 >> v1:10.20.193.106:6790/0 conn(0x7feb78142190 legacy=0x7feb781a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 shutdown_connections 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 >> 10.20.193.106:0/642397307 conn(0x7feb7805e3c0 msgr2=0x7feb78090620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 shutdown_connections 2026-02-17T05:45:04.215 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:04.212+0000 7feb7e3a5640 1 -- 10.20.193.106:0/642397307 wait complete. 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=559266963}) 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=484255638}) 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=559266963}) 2026-02-17T05:45:04.215 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.213+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1619289821}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3696732084}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4033786104}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3696732084}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1764307314}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257769823}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3804342699}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257769823}) 2026-02-17T05:45:04.216 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3736375058}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3402292378}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140071533}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3402292378}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.214+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3855037929}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=854122993}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1026271437}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=854122993}) 2026-02-17T05:45:04.217 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3384582587}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3749605827}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3007466680}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3749605827}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.215+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1027064615}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233479732}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612124482}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233479732}) 2026-02-17T05:45:04.218 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2297503134}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2029180580}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209367946}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2029180580}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.216+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3394067453}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3368594}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3172638271}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3368594}) 2026-02-17T05:45:04.219 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1997551705}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4012720228}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75692154}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4012720228}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1795384695}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=422081462}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2688122110}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=422081462}) 2026-02-17T05:45:04.220 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.217+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3309528717}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1447161285}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583633119}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1447161285}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=105052794}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2244118905}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91676930}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2244118905}) 2026-02-17T05:45:04.221 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.218+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3970565923}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1571101849}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3775918417}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1571101849}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=17569888}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1954149926}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=473472435}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1954149926}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.219+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1178988871}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2585918054}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=603326543}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2585918054}) 2026-02-17T05:45:04.222 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3076476485}) 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2408021249}) 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134569710}) 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2408021249}) 2026-02-17T05:45:04.223 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.220+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4116366699}) 2026-02-17T05:45:04.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2371261684}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1817505942}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2371261684}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3309132243}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2273885013}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4122888576}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2273885013}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.221+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3276538314}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3469225251}) 2026-02-17T05:45:04.225 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=368855799}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3469225251}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=640512811}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=245420452}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2159560544}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=245420452}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1748567694}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3542016849}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4254589000}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3542016849}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.222+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3012680280}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=954506262}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430007457}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=954506262}) 2026-02-17T05:45:04.226 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2575230881}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=637762843}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551549763}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=637762843}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.223+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3560198366}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3571710534}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573996774}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3571710534}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1073167953}) 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.228 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=228493290}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1058550306}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=228493290}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.224+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1171257782}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1454822148}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2637251517}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1454822148}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3400274186}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3249093475}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3397648857}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3249093475}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3352998567}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=562216228}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2602804577}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=562216228}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.225+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892348577}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=381291871}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3921212080}) 2026-02-17T05:45:04.229 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.230 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=381291871}) 2026-02-17T05:45:04.230 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=97906926}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2736821791}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2171442188}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2736821791}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.226+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1785486794}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1493321216}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3921714625}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1493321216}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4188616675}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2210822102}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.227+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3545700755}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2210822102}) 2026-02-17T05:45:04.231 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=90048874}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=727755046}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3091010576}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=727755046}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.228+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3654142931}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=73,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4} crc {logm=157365844,mdsmap=568353036,mgr=322402685,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2674441560,mon_config_key=3610595130}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=77,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11} crc {logm=2184144172,mdsmap=568353036,mgr=1186266238,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2674441560}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=73,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4} crc {logm=157365844,mdsmap=568353036,mgr=322402685,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2674441560,mon_config_key=3610595130}) 2026-02-17T05:45:04.232 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=76,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11} crc {logm=880921148,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=2674441560}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=81} crc {mon_config_key=1070400506,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3249355357,osd_snap=3618025081}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=1070400506,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=1163265349,osd_pg_creating=3249355357,osd_snap=1313690810}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=81} crc {mon_config_key=1070400506,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3249355357,osd_snap=3618025081}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.229+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=5,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3512165768,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=3249355357,osd_snap=1803108166}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=1297432632,osdmap=3597024136}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=1517838682,osdmap=2587278272}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=1297432632,osdmap=3597024136}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=41,osdmap=59} crc {osd_snap=2170949072,osdmap=1906244994}) 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.233 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1750897617}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2303041425}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1750897617}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.230+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1135197387}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3017113081}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2685992795}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3017113081}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.231+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1259719184}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3304813204}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=31059625}) 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.234 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3304813204}) 2026-02-17T05:45:04.235 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.232+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2389285929}) 2026-02-17T05:45:04.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=48} crc {osdmap=1291015614}) 2026-02-17T05:45:04.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=1028941769}) 2026-02-17T05:45:04.236 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:45:04.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=48} crc {osdmap=1291015614}) 2026-02-17T05:45:04.237 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:45:04.234+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=50} crc {osdmap=2102407495}) 2026-02-17T05:45:04.474 INFO:tasks.rados.rados.0.trial118.stdout:3911: done (2 left) 2026-02-17T05:45:04.475 INFO:tasks.rados.rados.0.trial118.stdout:3912: done (1 left) 2026-02-17T05:45:04.475 INFO:tasks.rados.rados.0.trial118.stdout:3913: done (0 left) 2026-02-17T05:45:04.475 INFO:tasks.rados.rados.0.trial118.stdout:3914: snap_remove snap 425 2026-02-17T05:45:05.225 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:45:05.225 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: get_monmap_and_config 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: monmap: 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:05.291495+0000 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:05.291495+0000 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:05.292 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 1 Processor -- start 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 1 -- start start 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: init 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-c con 0x7fc43405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-b con 0x7fc43405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-a con 0x7fc434182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43408b060 con 0x7fc434182720 2026-02-17T05:45:05.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43405dc90 con 0x7fc43405d1b0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43408d6a0 con 0x7fc43405dee0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4395ae640 10 monclient(hunting): authenticate will time out at 1633.919828s 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4327fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc43405dee0 0x7fc434181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38642/0 (socket says 10.20.193.106:38642) 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4327fc640 1 -- 10.20.193.106:0/2723693440 learned_addr learned my addr 10.20.193.106:0/2723693440 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.290+0000 7fc4337fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc434182720 0x7fc4341a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53728/0 (socket says 10.20.193.106:53728) 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615241649 0 0) 0x7fc43408b060 con 0x7fc434182720 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): my global_id is 154134 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4200035e0 con 0x7fc434182720 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966433873 0 0) 0x7fc43408d6a0 con 0x7fc43405dee0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient(hunting): my global_id is 5336 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc43408b060 con 0x7fc43405dee0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3484583408 0 0) 0x7fc4200035e0 con 0x7fc434182720 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 >> v1:10.20.193.106:6790/0 conn(0x7fc43405dee0 legacy=0x7fc434181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 >> v1:10.20.193.118:6789/0 conn(0x7fc43405d1b0 legacy=0x7fc43405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 monclient: found mon.noname-a 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434057960 con 0x7fc434182720 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc424003eb0 con 0x7fc434182720 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: dump: 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.294 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 5 monclient: authenticate success, global_id 154134 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4240040b0 con 0x7fc434182720 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 1 -- 10.20.193.106:0/2723693440 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc4240044c0 con 0x7fc434182720 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc431ffb640 10 monclient: dump: 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 4 set_mon_vals no callback set 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 10 monclient: shutdown 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 1 -- 10.20.193.106:0/2723693440 >> v1:10.20.193.106:6789/0 conn(0x7fc434182720 legacy=0x7fc4341a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 1 -- 10.20.193.106:0/2723693440 shutdown_connections 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 1 -- 10.20.193.106:0/2723693440 >> 10.20.193.106:0/2723693440 conn(0x7fc4340915f0 msgr2=0x7fc4340919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 1 -- 10.20.193.106:0/2723693440 shutdown_connections 2026-02-17T05:45:05.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.291+0000 7fc4395ae640 1 -- 10.20.193.106:0/2723693440 wait complete. 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient: monmap: 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 1 Processor -- start 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 1 -- start start 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient: init 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-c con 0x7fc43405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-a con 0x7fc43405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient(hunting): picked mon.noname-b con 0x7fc434182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43413f160 con 0x7fc43405dee0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43405cd60 con 0x7fc434182720 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43410ee10 con 0x7fc43405d1b0 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.297 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4395ae640 10 monclient(hunting): authenticate will time out at 1633.921729s 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4327fc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc43405dee0 0x7fc434088d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53742/0 (socket says 10.20.193.106:53742) 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4327fc640 1 -- 10.20.193.106:0/3988042973 learned_addr learned my addr 10.20.193.106:0/3988042973 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc432ffd640 1 --1- 10.20.193.106:0/3988042973 >> v1:10.20.193.106:6790/0 conn(0x7fc43405d1b0 0x7fc434088620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38658/0 (socket says 10.20.193.106:38658) 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008885867 0 0) 0x7fc43413f160 con 0x7fc43405dee0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): my global_id is 154137 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4000035e0 con 0x7fc43405dee0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543941063 0 0) 0x7fc43410ee10 con 0x7fc43405d1b0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 10 monclient(hunting): my global_id is 5339 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.292+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc43413f160 con 0x7fc43405d1b0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1427228853 0 0) 0x7fc4000035e0 con 0x7fc43405dee0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc43410ee10 con 0x7fc43405dee0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc41c003090 con 0x7fc43405dee0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): dump: 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1921460689 0 0) 0x7fc43413f160 con 0x7fc43405d1b0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4000035e0 con 0x7fc43405d1b0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc428002ff0 con 0x7fc43405d1b0 2026-02-17T05:45:05.298 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient(hunting): dump: 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2248695495 0 0) 0x7fc43410ee10 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 >> v1:10.20.193.106:6790/0 conn(0x7fc43405d1b0 legacy=0x7fc434088620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 >> v1:10.20.193.118:6789/0 conn(0x7fc434182720 legacy=0x7fc434181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 monclient: found mon.a 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434089440 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 5 monclient: authenticate success, global_id 154137 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _renew_subs 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc43405e8e0 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _renew_subs 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc43410eb30 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc41c0048a0 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc41c004bc0 con 0x7fc43405dee0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4317fa640 4 set_mon_vals no callback set 2026-02-17T05:45:05.299 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 10 monclient: dump: 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc41c011b60 con 0x7fc43405dee0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.293+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4340008d0 con 0x7fc43405dee0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.294+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(871..871 src has 597..871) ==== 3899+0+0 (unknown 2520906198 0 0) 0x7fc41c04fe10 con 0x7fc43405dee0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.294+0000 7fc432ffd640 10 monclient: get_auth_request con 0x7fc400040a70 auth_method 0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.296+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fc41c0136f0 con 0x7fc43405dee0 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.296+0000 7fc4137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.300 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.296+0000 7fc4137fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3914: done (0 left) 2026-02-17T05:45:05.380 INFO:tasks.rados.rados.0.trial118.stdout:3915: read oid 3 snap 437 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3915: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3916: read oid 8 snap -1 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3916: expect (ObjNum 1354 snap 437 seq_num 1354) 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3917: rollback oid 21 current snap is 438 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 21 to 428 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3918: write (excl) oid 19 current snap is 438 2026-02-17T05:45:05.381 INFO:tasks.rados.rados.0.trial118.stdout:3918: seq_num 1356 ranges {790292=748478,2183230=607062} 2026-02-17T05:45:05.386 INFO:tasks.rados.rados.0.trial118.stdout:3918: writing trial11845692-19 from 790292 to 1538770 tid 1 2026-02-17T05:45:05.391 INFO:tasks.rados.rados.0.trial118.stdout:3918: writing trial11845692-19 from 2183230 to 2790292 tid 2 2026-02-17T05:45:05.391 INFO:tasks.rados.rados.0.trial118.stdout:3919: copy_from oid 13 from oid 38 current snap is 438 2026-02-17T05:45:05.391 INFO:tasks.rados.rados.0.trial118.stdout:3915: expect (ObjNum 1077 snap 320 seq_num 1077) 2026-02-17T05:45:05.392 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:05.408 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1750074 2026-02-17T05:45:05.417 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 523692 2026-02-17T05:45:05.428 INFO:tasks.rados.rados.0.trial118.stdout:3917: finishing rollback tid 1 to trial11845692-21 2026-02-17T05:45:05.428 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2392 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-17T05:45:05.428 INFO:tasks.rados.rados.0.trial118.stdout:3916: expect (ObjNum 1354 snap 437 seq_num 1354) 2026-02-17T05:45:05.429 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:05.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.446+0000 7fc4395ae640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:45:05.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.446+0000 7fc4395ae640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:05.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.446+0000 7fc4395ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.446+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc43408e3d0 con 0x7fc43405dee0 2026-02-17T05:45:05.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.447+0000 7fc4137fe640 1 -- 10.20.193.106:0/3988042973 <== mon.0 v1:10.20.193.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 523616985) 0x7fc41c016c50 con 0x7fc43405dee0 2026-02-17T05:45:05.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.447+0000 7fc4137fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:05.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.447+0000 7fc4137fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:05.450 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:45:05.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 >> v1:10.20.193.118:6812/703720803 conn(0x7fc400040a70 legacy=0x7fc400060f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 10 monclient: shutdown 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 >> v1:10.20.193.106:6789/0 conn(0x7fc43405dee0 legacy=0x7fc434088d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 shutdown_connections 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 >> 10.20.193.106:0/3988042973 conn(0x7fc4340915f0 msgr2=0x7fc43408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 shutdown_connections 2026-02-17T05:45:05.452 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.449+0000 7fc4395ae640 1 -- 10.20.193.106:0/3988042973 wait complete. 2026-02-17T05:45:05.460 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:45:05.460 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T05:45:05.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:45:05.460 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:45:05.461 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1658772 2026-02-17T05:45:05.479 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:05.508 INFO:tasks.rados.rados.0.trial118.stdout:3918: finishing write tid 1 to trial11845692-19 2026-02-17T05:45:05.508 INFO:tasks.rados.rados.0.trial118.stdout:3915: done (4 left) 2026-02-17T05:45:05.508 INFO:tasks.rados.rados.0.trial118.stdout:3916: done (3 left) 2026-02-17T05:45:05.508 INFO:tasks.rados.rados.0.trial118.stdout:3917: done (2 left) 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3920: snap_create 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: finishing write tid 2 to trial11845692-19 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: finishing write tid 3 to trial11845692-19 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: finishing write tid 4 to trial11845692-19 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: oid 19 updating version 0 to 2160 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: oid 19 version 2160 is already newer than 2159 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: oid 19 updating version 2160 to 2161 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 19 v 2161 (ObjNum 1356 snap 438 seq_num 1356) dirty exists 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3918: left oid 19 (ObjNum 1356 snap 438 seq_num 1356) 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3919: finishing copy_from racing read to trial11845692-13 2026-02-17T05:45:05.509 INFO:tasks.rados.rados.0.trial118.stdout:3919: finishing copy_from to trial11845692-13 2026-02-17T05:45:05.510 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 2171 (ObjNum 1269 snap 397 seq_num 1269) dirty exists 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.524+0000 7fa89810c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.524+0000 7fa89810c640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.524+0000 7fa89810c640 10 monclient: monmap: 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:05.526153+0000 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:05.526153+0000 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:05.528 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 1 Processor -- start 2026-02-17T05:45:05.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 1 -- start start 2026-02-17T05:45:05.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient: init 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-b con 0x7fa89008dfe0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-c con 0x7fa89008e3b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-a con 0x7fa89008e810 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa890057170 con 0x7fa89008e810 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89005dd60 con 0x7fa89008e3b0 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89005d130 con 0x7fa89008dfe0 2026-02-17T05:45:05.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa89810c640 10 monclient(hunting): authenticate will time out at 1634.154822s 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa895e81640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa89008dfe0 0x7fa8901423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38664/0 (socket says 10.20.193.106:38664) 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.525+0000 7fa895e81640 1 -- 10.20.193.106:0/4174397231 learned_addr learned my addr 10.20.193.106:0/4174397231 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53684806 0 0) 0x7fa89005d130 con 0x7fa89008dfe0 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): my global_id is 5342 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8780035e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850759235 0 0) 0x7fa890057170 con 0x7fa89008e810 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient(hunting): my global_id is 154140 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa89005d130 con 0x7fa89008e810 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1236804752 0 0) 0x7fa8780035e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 >> v1:10.20.193.118:6789/0 conn(0x7fa89008e3b0 legacy=0x7fa890183210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 >> v1:10.20.193.106:6789/0 conn(0x7fa89008e810 legacy=0x7fa8901a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 monclient: found mon.noname-b 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.541 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa890056ec0 con 0x7fa89008dfe0 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa880002dd0 con 0x7fa89008dfe0 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: dump: 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.542 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 5 monclient: authenticate success, global_id 5342 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa880002fd0 con 0x7fa89008dfe0 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 1 -- 10.20.193.106:0/4174397231 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8800033e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:05.543 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 4 set_mon_vals no callback set 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa894e7f640 10 monclient: dump: 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.544 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 10 monclient: shutdown 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 1 -- 10.20.193.106:0/4174397231 >> v1:10.20.193.106:6790/0 conn(0x7fa89008dfe0 legacy=0x7fa8901423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 1 -- 10.20.193.106:0/4174397231 shutdown_connections 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 1 -- 10.20.193.106:0/4174397231 >> 10.20.193.106:0/4174397231 conn(0x7fa890054400 msgr2=0x7fa890054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 1 -- 10.20.193.106:0/4174397231 shutdown_connections 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.526+0000 7fa89810c640 1 -- 10.20.193.106:0/4174397231 wait complete. 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient: monmap: 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.545 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 1 Processor -- start 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 1 -- start start 2026-02-17T05:45:05.546 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient: init 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-a con 0x7fa89008dfe0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-b con 0x7fa89008e3b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient(hunting): picked mon.noname-c con 0x7fa89008e810 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa890089500 con 0x7fa89008dfe0 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89012fb20 con 0x7fa89008e3b0 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89012fe00 con 0x7fa89008e810 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa89810c640 10 monclient(hunting): authenticate will time out at 1634.156636s 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa895e81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fa89008dfe0 0x7fa890152630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53768/0 (socket says 10.20.193.106:53768) 2026-02-17T05:45:05.547 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa895e81640 1 -- 10.20.193.106:0/1914499151 learned_addr learned my addr 10.20.193.106:0/1914499151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561570218 0 0) 0x7fa890089500 con 0x7fa89008dfe0 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): my global_id is 154143 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8600035e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174275468 0 0) 0x7fa89012fe00 con 0x7fa89008e810 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 10 monclient(hunting): my global_id is 5345 2026-02-17T05:45:05.548 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.527+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa890089500 con 0x7fa89008e810 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2378512456 0 0) 0x7fa8600035e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa89012fe00 con 0x7fa89008dfe0 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa880002ce0 con 0x7fa89008dfe0 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): dump: 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.549 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891424537 0 0) 0x7fa89012fb20 con 0x7fa89008e3b0 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.550 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): my global_id is 134215 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8600035e0 con 0x7fa89008e3b0 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 9356365 0 0) 0x7fa890089500 con 0x7fa89008e810 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa89012fb20 con 0x7fa89008e810 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa88c003fd0 con 0x7fa89008e810 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): dump: 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.551 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2498289358 0 0) 0x7fa89012fe00 con 0x7fa89008dfe0 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6790/0 conn(0x7fa89008e810 legacy=0x7fa890194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.118:6789/0 conn(0x7fa89008e3b0 legacy=0x7fa890193380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 monclient: found mon.a 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.552 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8901300e0 con 0x7fa89008dfe0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 5 monclient: authenticate success, global_id 154143 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 10 monclient: _renew_subs 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa890130da0 con 0x7fa89008dfe0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 10 monclient: _renew_subs 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa89012ed60 con 0x7fa89008dfe0 2026-02-17T05:45:05.553 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8800028c0 con 0x7fa89008dfe0 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa880004d00 con 0x7fa89008dfe0 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient: dump: 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.554 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87ffff640 4 set_mon_vals no callback set 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa8900008d0 con 0x7fa890152d40 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438620426 0 0) 0x7fa8900008d0 con 0x7fa890152d40 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 10 monclient(hunting): my global_id is 154146 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa89012fe00 con 0x7fa890152d40 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.528+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa880011ca0 con 0x7fa89008dfe0 2026-02-17T05:45:05.555 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7fa88004fe60 con 0x7fa89008dfe0 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 124293404 0 0) 0x7fa89012fe00 con 0x7fa890152d40 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8900008d0 con 0x7fa890152d40 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa884002e60 con 0x7fa890152d40 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 10 monclient: dump: 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.556 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa896682640 10 monclient: get_auth_request con 0x7fa860040dd0 auth_method 0 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1823082622 0 0) 0x7fa8900008d0 con 0x7fa890152d40 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa890090110 con 0x7fa890152d40 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa884004470 con 0x7fa890152d40 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6789/0 conn(0x7fa890152d40 legacy=0x7fa89004ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.529+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6789/0 conn(0x7fa890152d40 legacy=0x7fa89004ca40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.532+0000 7fa89810c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.532+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa89012daa0 con 0x7fa89012d6a0 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.532+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325986831 0 0) 0x7fa89012daa0 con 0x7fa89012d6a0 2026-02-17T05:45:05.557 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient(hunting): my global_id is 154149 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8900008d0 con 0x7fa89012d6a0 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3065702317 0 0) 0x7fa8900008d0 con 0x7fa89012d6a0 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa89012daa0 con 0x7fa89012d6a0 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa8840034b0 con 0x7fa89012d6a0 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient: dump: 2026-02-17T05:45:05.558 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2611811658 0 0) 0x7fa89012daa0 con 0x7fa89012d6a0 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa890130270 con 0x7fa89012d6a0 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 3260090316) 0x7fa884003910 con 0x7fa89012d6a0 2026-02-17T05:45:05.559 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6789/0 conn(0x7fa89012d6a0 legacy=0x7fa89004d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa87e7fc640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6789/0 conn(0x7fa89012d6a0 legacy=0x7fa89004d150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:05.560 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 17077, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.561 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.562 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:05.563 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.564 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.565 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.566 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.567 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.568 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.569 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:05.570 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:05.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.118:6812/703720803 conn(0x7fa860040dd0 legacy=0x7fa860061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 10 monclient: shutdown 2026-02-17T05:45:05.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 >> v1:10.20.193.106:6789/0 conn(0x7fa89008dfe0 legacy=0x7fa890152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa896682640 1 -- 10.20.193.106:0/1914499151 reap_dead start 2026-02-17T05:45:05.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa896682640 1 -- 10.20.193.106:0/1914499151 reap_dead start 2026-02-17T05:45:05.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 shutdown_connections 2026-02-17T05:45:05.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 >> 10.20.193.106:0/1914499151 conn(0x7fa890054400 msgr2=0x7fa890087e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 shutdown_connections 2026-02-17T05:45:05.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.533+0000 7fa89810c640 1 -- 10.20.193.106:0/1914499151 wait complete. 2026-02-17T05:45:05.572 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:05.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:45:05.572 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.634+0000 7f1e43dc2640 10 monclient: get_monmap_and_config 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.634+0000 7f1e43dc2640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.634+0000 7f1e43dc2640 10 monclient: monmap: 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:05.636273+0000 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:05.636273+0000 2026-02-17T05:45:05.644 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 1 Processor -- start 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 1 -- start start 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient: init 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-b con 0x7f1e3c0585c0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-c con 0x7f1e3c13f6c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-a con 0x7f1e3c08c0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c056bb0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.645 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c0575d0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c0578b0 con 0x7f1e3c0585c0 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e43dc2640 10 monclient(hunting): authenticate will time out at 1634.264654s 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e41b37640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1e3c0585c0 0x7f1e3c13efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38688/0 (socket says 10.20.193.106:38688) 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e41b37640 1 -- 10.20.193.106:0/1341651460 learned_addr learned my addr 10.20.193.106:0/1341651460 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e42338640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1e3c08c0d0 0x7f1e3c1a4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53790/0 (socket says 10.20.193.106:53790) 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737198748 0 0) 0x7f1e3c0578b0 con 0x7f1e3c0585c0 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): my global_id is 5348 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e240035e0 con 0x7f1e3c0585c0 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365319198 0 0) 0x7f1e3c056bb0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.646 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.635+0000 7f1e40b35640 10 monclient(hunting): my global_id is 154152 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e3c0578b0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 302623793 0 0) 0x7f1e3c0578b0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c0585c0 legacy=0x7f1e3c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 >> v1:10.20.193.118:6789/0 conn(0x7f1e3c13f6c0 legacy=0x7f1e3c183200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 monclient: found mon.noname-a 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c057b90 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.647 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e38003eb0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: dump: 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 5 monclient: authenticate success, global_id 154152 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e380040b0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 1 -- 10.20.193.106:0/1341651460 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e380044c0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e40b35640 10 monclient: dump: 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.649 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 4 set_mon_vals no callback set 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 10 monclient: shutdown 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1341651460 >> v1:10.20.193.106:6789/0 conn(0x7f1e3c08c0d0 legacy=0x7f1e3c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1341651460 shutdown_connections 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1341651460 >> 10.20.193.106:0/1341651460 conn(0x7f1e3c05e410 msgr2=0x7f1e3c095340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1341651460 shutdown_connections 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1341651460 wait complete. 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.636+0000 7f1e43dc2640 10 monclient: monmap: 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:05.650 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 Processor -- start 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- start start 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: init 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-b con 0x7f1e3c0585c0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-c con 0x7f1e3c08c0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient(hunting): picked mon.noname-a con 0x7f1e3c13f6c0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c13e450 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c08c530 con 0x7f1e3c0585c0 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c13dad0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient(hunting): authenticate will time out at 1634.266371s 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e42338640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1e3c13f6c0 0x7f1e3c1949e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53794/0 (socket says 10.20.193.106:53794) 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e42338640 1 -- 10.20.193.106:0/1099112640 learned_addr learned my addr 10.20.193.106:0/1099112640 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e41336640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1e3c08c0d0 0x7f1e3c1932c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38704/0 (socket says 10.20.193.106:38704) 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785283603 0 0) 0x7f1e3c13e450 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.652 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): my global_id is 154155 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e0c0035e0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811989395 0 0) 0x7f1e3c13dad0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): my global_id is 5351 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e3c13e450 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 538679 0 0) 0x7f1e0c0035e0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e3c13dad0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e380043d0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): dump: 2026-02-17T05:45:05.653 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2082395908 0 0) 0x7f1e3c13e450 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e0c0035e0 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e30003f70 con 0x7f1e3c08c0d0 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.654 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient(hunting): dump: 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3113923360 0 0) 0x7f1e3c13dad0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c08c0d0 legacy=0x7f1e3c1932c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.118:6789/0 conn(0x7f1e3c0585c0 legacy=0x7f1e3c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.655 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 monclient: found mon.a 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c12e510 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 5 monclient: authenticate success, global_id 154155 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _renew_subs 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3c12e230 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _renew_subs 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e3c08af00 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e38005c30 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.656 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.637+0000 7f1e2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e38005fd0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: dump: 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.657 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2bfff640 4 set_mon_vals no callback set 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e43dc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e3c08b6e0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961487027 0 0) 0x7f1e3c08b6e0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient(hunting): my global_id is 5354 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e3c13dad0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1e38006130 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7f1e38050fb0 con 0x7f1e3c13f6c0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3223280306 0 0) 0x7f1e3c13dad0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e3c08b6e0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e2c003490 con 0x7f1e3c152ae0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.658 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 10 monclient: dump: 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e41336640 10 monclient: get_auth_request con 0x7f1e0c040c60 auth_method 0 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1869964613 0 0) 0x7f1e3c08b6e0 con 0x7f1e3c152ae0 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.638+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e3c093240 con 0x7f1e3c152ae0 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.639+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1e2c002b40 con 0x7f1e3c152ae0 2026-02-17T05:45:05.659 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.639+0000 7f1e2a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.639+0000 7f1e2a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:05.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.639+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c152ae0 legacy=0x7f1e3c08d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.660 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.639+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c152ae0 legacy=0x7f1e3c08d750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e43dc2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:05.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e3c12e030 con 0x7f1e3c08de60 2026-02-17T05:45:05.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92511022 0 0) 0x7f1e3c12e030 con 0x7f1e3c08de60 2026-02-17T05:45:05.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 10 monclient(hunting): my global_id is 5357 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.642+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e3c08b6e0 con 0x7f1e3c08de60 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3548829630 0 0) 0x7f1e3c08b6e0 con 0x7f1e3c08de60 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e3c12e030 con 0x7f1e3c08de60 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1e2c004a50 con 0x7f1e3c08de60 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 10 monclient: dump: 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.662 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1609245651 0 0) 0x7f1e3c12e030 con 0x7f1e3c08de60 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e3c058c70 con 0x7f1e3c08de60 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4517 (unknown 0 0 848348538) 0x7f1e2c004e00 con 0x7f1e3c08de60 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c08de60 legacy=0x7f1e3c197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.663 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e2a7fc640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6790/0 conn(0x7f1e3c08de60 legacy=0x7f1e3c197110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 1030404, 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:05.664 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.665 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.666 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:05.667 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.668 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.669 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.670 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.671 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.672 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:45:05.673 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.674 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.674 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.674 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:05.674 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.118:6812/703720803 conn(0x7f1e0c040c60 legacy=0x7f1e0c061110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 10 monclient: shutdown 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 >> v1:10.20.193.106:6789/0 conn(0x7f1e3c13f6c0 legacy=0x7f1e3c1949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e42338640 1 -- 10.20.193.106:0/1099112640 reap_dead start 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e42338640 1 -- 10.20.193.106:0/1099112640 reap_dead start 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 shutdown_connections 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 >> 10.20.193.106:0/1099112640 conn(0x7f1e3c05e410 msgr2=0x7f1e3c141490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 shutdown_connections 2026-02-17T05:45:05.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.643+0000 7f1e43dc2640 1 -- 10.20.193.106:0/1099112640 wait complete. 2026-02-17T05:45:05.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:05.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:45:05.676 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: get_monmap_and_config 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: monmap: 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:05.740520+0000 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:05.740520+0000 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:05.741 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 1 Processor -- start 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 1 -- start start 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: init 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-c con 0x7fa35805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-b con 0x7fa35805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-a con 0x7fa358182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35808b060 con 0x7fa358182720 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35805dc90 con 0x7fa35805d1b0 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35808d6a0 con 0x7fa35805dee0 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.743 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.739+0000 7fa3607c2640 10 monclient(hunting): authenticate will time out at 1634.368917s 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35dd36640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa35805dee0 0x7fa358181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38728/0 (socket says 10.20.193.106:38728) 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35dd36640 1 -- 10.20.193.106:0/3001060666 learned_addr learned my addr 10.20.193.106:0/3001060666 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35ed38640 1 --1- 10.20.193.106:0/3001060666 >> v1:10.20.193.106:6789/0 conn(0x7fa358182720 0x7fa3581a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:53800/0 (socket says 10.20.193.106:53800) 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964585945 0 0) 0x7fa35808b060 con 0x7fa358182720 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): my global_id is 154158 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3400035e0 con 0x7fa358182720 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778153756 0 0) 0x7fa35808d6a0 con 0x7fa35805dee0 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient(hunting): my global_id is 5360 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35808b060 con 0x7fa35805dee0 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4206145675 0 0) 0x7fa3400035e0 con 0x7fa358182720 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 >> v1:10.20.193.106:6790/0 conn(0x7fa35805dee0 legacy=0x7fa358181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 >> v1:10.20.193.118:6789/0 conn(0x7fa35805d1b0 legacy=0x7fa35805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 monclient: found mon.noname-a 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa358057960 con 0x7fa358182720 2026-02-17T05:45:05.744 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa354003eb0 con 0x7fa358182720 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: dump: 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 5 monclient: authenticate success, global_id 154158 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa354004170 con 0x7fa358182720 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 1 -- 10.20.193.106:0/3001060666 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa354004580 con 0x7fa358182720 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa35d535640 10 monclient: dump: 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.745 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 4 set_mon_vals no callback set 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 10 monclient: shutdown 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 1 -- 10.20.193.106:0/3001060666 >> v1:10.20.193.106:6789/0 conn(0x7fa358182720 legacy=0x7fa3581a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 1 -- 10.20.193.106:0/3001060666 shutdown_connections 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 1 -- 10.20.193.106:0/3001060666 >> 10.20.193.106:0/3001060666 conn(0x7fa3580915f0 msgr2=0x7fa3580919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 1 -- 10.20.193.106:0/3001060666 shutdown_connections 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.740+0000 7fa3607c2640 1 -- 10.20.193.106:0/3001060666 wait complete. 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient: monmap: 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 1 Processor -- start 2026-02-17T05:45:05.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 1 -- start start 2026-02-17T05:45:05.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient: init 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-b con 0x7fa35805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-c con 0x7fa35805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient(hunting): picked mon.noname-a con 0x7fa358182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35810cdf0 con 0x7fa358182720 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35812c310 con 0x7fa35805d1b0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35810bf80 con 0x7fa35805dee0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa3607c2640 10 monclient(hunting): authenticate will time out at 1634.370850s 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa35dd36640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fa35805dee0 0x7fa35812bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38738/0 (socket says 10.20.193.106:38738) 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.741+0000 7fa35dd36640 1 -- 10.20.193.106:0/4088202801 learned_addr learned my addr 10.20.193.106:0/4088202801 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422053566 0 0) 0x7fa35810bf80 con 0x7fa35805dee0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): my global_id is 5363 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3280035e0 con 0x7fa35805dee0 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606340533 0 0) 0x7fa35810cdf0 con 0x7fa358182720 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): my global_id is 154161 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35810bf80 con 0x7fa358182720 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3073350677 0 0) 0x7fa3280035e0 con 0x7fa35805dee0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35810cdf0 con 0x7fa35805dee0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa34c003090 con 0x7fa35805dee0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): dump: 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3635619536 0 0) 0x7fa35810bf80 con 0x7fa358182720 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3280035e0 con 0x7fa358182720 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3540042e0 con 0x7fa358182720 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient(hunting): dump: 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.750 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 726870734 0 0) 0x7fa35810cdf0 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6789/0 conn(0x7fa35805d1b0 legacy=0x7fa35812b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.106:6789/0 conn(0x7fa358182720 legacy=0x7fa358181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 monclient: found mon.c 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35810aa90 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 5 monclient: authenticate success, global_id 5363 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 10 monclient: _renew_subs 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3581824f0 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 10 monclient: _renew_subs 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa35810b820 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa34c0048a0 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa34c004bc0 con 0x7fa35805dee0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 10 monclient: dump: 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa35cd34640 4 set_mon_vals no callback set 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa3580008d0 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.742+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fa34c011b60 con 0x7fa35805dee0 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7fa34c04fdc0 con 0x7fa35805dee0 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263883416 0 0) 0x7fa3580008d0 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient(hunting): my global_id is 134221 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35810cdf0 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa35ed38640 10 monclient: get_auth_request con 0x7fa328040ac0 auth_method 0 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2013468034 0 0) 0x7fa35810cdf0 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3580008d0 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa348002e40 con 0x7fa358128420 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:05.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient: dump: 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2039493405 0 0) 0x7fa3580008d0 con 0x7fa358128420 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa358057cd0 con 0x7fa358128420 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa348003360 con 0x7fa358128420 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6789/0 conn(0x7fa358128420 legacy=0x7fa358058ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.743+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6789/0 conn(0x7fa358128420 legacy=0x7fa358058ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.747+0000 7fa3607c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:05.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.747+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa35808e3d0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098704262 0 0) 0x7fa35808e3d0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient(hunting): my global_id is 134224 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3580008d0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4191087586 0 0) 0x7fa3580008d0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35808e3d0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fa3480038f0 con 0x7fa35810a000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient: dump: 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.754 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1643272438 0 0) 0x7fa35808e3d0 con 0x7fa35810a000 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa358128930 con 0x7fa35810a000 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1737579628) 0x7fa348004700 con 0x7fa35810a000 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6789/0 conn(0x7fa35810a000 legacy=0x7fa3580595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa33effd640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6789/0 conn(0x7fa35810a000 legacy=0x7fa3580595e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 56, 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 129891, 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:05.755 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 2, 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.756 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:05.757 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.758 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.759 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.760 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:05.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.118:6812/703720803 conn(0x7fa328040ac0 legacy=0x7fa328060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 10 monclient: shutdown 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 >> v1:10.20.193.106:6790/0 conn(0x7fa35805dee0 legacy=0x7fa35812bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa35ed38640 1 -- 10.20.193.106:0/4088202801 reap_dead start 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa35ed38640 1 -- 10.20.193.106:0/4088202801 reap_dead start 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 shutdown_connections 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 >> 10.20.193.106:0/4088202801 conn(0x7fa3580915f0 msgr2=0x7fa358054bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 shutdown_connections 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.748+0000 7fa3607c2640 1 -- 10.20.193.106:0/4088202801 wait complete. 2026-02-17T05:45:05.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:45:05.762 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-17T05:45:05.762 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-17T05:45:05.762 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-17T05:45:05.762 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-17T05:45:05.762 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:45:05.762 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:45:05.770 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:45:05.770 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T05:45:05.771 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.872+0000 7f67d62cc640 10 monclient: get_monmap_and_config 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.872+0000 7f67d62cc640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.872+0000 7f67d62cc640 10 monclient: monmap: 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.883 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:05.874299+0000 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:05.874299+0000 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 1 Processor -- start 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 1 -- start start 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient: init 2026-02-17T05:45:05.884 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-c con 0x7f67d005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-b con 0x7f67d005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-a con 0x7f67d0182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d008b060 con 0x7f67d0182720 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d005dc90 con 0x7f67d005d1b0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d008d6a0 con 0x7f67d005dee0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d62cc640 10 monclient(hunting): authenticate will time out at 1634.502691s 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67d4842640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f67d0182720 legacy=0x7f67d01a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:05.885 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67cf7fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f67d005dee0 0x7f67d0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38748/0 (socket says 10.20.193.106:38748) 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.873+0000 7f67cf7fe640 1 -- 10.20.193.106:0/952313313 learned_addr learned my addr 10.20.193.106:0/952313313 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854756164 0 0) 0x7f67d008d6a0 con 0x7f67d005dee0 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient(hunting): my global_id is 5366 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b40035e0 con 0x7f67d005dee0 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268939330 0 0) 0x7f67b40035e0 con 0x7f67d005dee0 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 >> v1:10.20.193.118:6789/0 conn(0x7f67d005d1b0 legacy=0x7f67d005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 >> v1:10.20.193.106:6789/0 conn(0x7f67d0182720 legacy=0x7f67d01a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.886 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 monclient: found mon.noname-b 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0057960 con 0x7f67d005dee0 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67c0002dd0 con 0x7f67d005dee0 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: dump: 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.887 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.888 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 5 monclient: authenticate success, global_id 5366 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67c0003090 con 0x7f67d005dee0 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 4 set_mon_vals no callback set 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 1 -- 10.20.193.106:0/952313313 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67c00034a0 con 0x7f67d005dee0 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67ceffd640 10 monclient: dump: 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.889 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 10 monclient: shutdown 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 1 -- 10.20.193.106:0/952313313 >> v1:10.20.193.106:6790/0 conn(0x7f67d005dee0 legacy=0x7f67d0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 1 -- 10.20.193.106:0/952313313 shutdown_connections 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 1 -- 10.20.193.106:0/952313313 >> 10.20.193.106:0/952313313 conn(0x7f67d00915f0 msgr2=0x7f67d00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 1 -- 10.20.193.106:0/952313313 shutdown_connections 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 1 -- 10.20.193.106:0/952313313 wait complete. 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 10 monclient: build_initial_monmap 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.874+0000 7f67d62cc640 10 monclient: monmap: 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:05.891 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 Processor -- start 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- start start 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: init 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-a con 0x7f67d005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-b con 0x7f67d005dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:05.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient(hunting): picked mon.noname-c con 0x7f67d0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d005e950 con 0x7f67d005d1b0 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d010cb00 con 0x7f67d005dee0 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d012c020 con 0x7f67d0182720 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient(hunting): authenticate will time out at 1634.504414s 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67cffff640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f67d005d1b0 legacy=0x7f67d012b200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d4842640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f67d0182720 0x7f67d0181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38760/0 (socket says 10.20.193.106:38760) 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d4842640 1 -- 10.20.193.106:0/260940774 learned_addr learned my addr 10.20.193.106:0/260940774 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933838404 0 0) 0x7f67d012c020 con 0x7f67d0182720 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): my global_id is 5369 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a00035e0 con 0x7f67d0182720 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 56967141 0 0) 0x7f67a00035e0 con 0x7f67d0182720 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67d012c020 con 0x7f67d0182720 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67c40051c0 con 0x7f67d0182720 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): dump: 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.894 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571085901 0 0) 0x7f67d010cb00 con 0x7f67d005dee0 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:05.895 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient(hunting): my global_id is 134230 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a00035e0 con 0x7f67d005dee0 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4048993281 0 0) 0x7f67d012c020 con 0x7f67d0182720 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 >> v1:10.20.193.118:6789/0 conn(0x7f67d005dee0 legacy=0x7f67d012b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 >> v1:10.20.193.106:6789/0 conn(0x7f67d005d1b0 legacy=0x7f67d012b200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient: _finish_hunting 0 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 monclient: found mon.c 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d010bc90 con 0x7f67d0182720 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient: _finish_auth 0 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 10 monclient: _check_auth_tickets 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:05.896 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 5 monclient: authenticate success, global_id 5369 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _renew_subs 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67d010a7a0 con 0x7f67d0182720 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _renew_subs 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.875+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f67d010b300 con 0x7f67d0182720 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67c4005400 con 0x7f67d0182720 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f67c40057e0 con 0x7f67d0182720 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:05.897 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 10 monclient: dump: 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:05.898 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ce7fc640 4 set_mon_vals no callback set 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67d62cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67d62cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67d62cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d010c660 con 0x7f67d0182720 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f67c4005940 con 0x7f67d0182720 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7f67c4050db0 con 0x7f67d0182720 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.876+0000 7f67cffff640 10 monclient: get_auth_request con 0x7f67a00406d0 auth_method 0 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.879+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f67c4018400 con 0x7f67d0182720 2026-02-17T05:45:05.899 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.879+0000 7f67ccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:05.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:05.879+0000 7f67ccff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:06.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67d62cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:45:06.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67d62cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:06.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67d62cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:06.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67d0057cd0 con 0x7f67d0182720 2026-02-17T05:45:06.025 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67ccff9640 1 -- 10.20.193.106:0/260940774 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 523616985) 0x7f67c4016390 con 0x7f67d0182720 2026-02-17T05:45:06.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67ccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:06.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.022+0000 7f67ccff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:06.026 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:45:06.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 >> v1:10.20.193.118:6812/703720803 conn(0x7f67a00406d0 legacy=0x7f67a0060b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:06.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 10 monclient: shutdown 2026-02-17T05:45:06.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:06.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 >> v1:10.20.193.106:6790/0 conn(0x7f67d0182720 legacy=0x7f67d0181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:06.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 shutdown_connections 2026-02-17T05:45:06.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 >> 10.20.193.106:0/260940774 conn(0x7f67d00915f0 msgr2=0x7f67d005be90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:06.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.023+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 shutdown_connections 2026-02-17T05:45:06.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:06.024+0000 7f67d62cc640 1 -- 10.20.193.106:0/260940774 wait complete. 2026-02-17T05:45:09.035 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:45:09.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: get_monmap_and_config 2026-02-17T05:45:09.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: build_initial_monmap 2026-02-17T05:45:09.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: monmap: 2026-02-17T05:45:09.106 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:09.106 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:09.100585+0000 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:09.100585+0000 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 1 Processor -- start 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 1 -- start start 2026-02-17T05:45:09.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: init 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-c con 0x7fd72405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-b con 0x7fd72405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-a con 0x7fd724182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72408b060 con 0x7fd724182720 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72405dc90 con 0x7fd72405d1b0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72408d6a0 con 0x7fd72405dee0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd72a6cc640 10 monclient(hunting): authenticate will time out at 1637.728924s 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.100+0000 7fd728c42640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fd724182720 legacy=0x7fd7241a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:09.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd7237fe640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd72405dee0 0x7fd724181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38772/0 (socket says 10.20.193.106:38772) 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd7237fe640 1 -- 10.20.193.106:0/345657705 learned_addr learned my addr 10.20.193.106:0/345657705 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21545498 0 0) 0x7fd72408d6a0 con 0x7fd72405dee0 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient(hunting): my global_id is 5372 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7080035e0 con 0x7fd72405dee0 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3555117540 0 0) 0x7fd7080035e0 con 0x7fd72405dee0 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 >> v1:10.20.193.118:6789/0 conn(0x7fd72405d1b0 legacy=0x7fd72405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 >> v1:10.20.193.106:6789/0 conn(0x7fd724182720 legacy=0x7fd7241a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:09.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 monclient: found mon.noname-b 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd724057960 con 0x7fd72405dee0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: _finish_auth 0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd714002dd0 con 0x7fd72405dee0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: dump: 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:09.110 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 5 monclient: authenticate success, global_id 5372 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd714003090 con 0x7fd72405dee0 2026-02-17T05:45:09.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 1 -- 10.20.193.106:0/345657705 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd7140034a0 con 0x7fd72405dee0 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 4 set_mon_vals no callback set 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd722ffd640 10 monclient: dump: 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:09.112 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 10 monclient: shutdown 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 1 -- 10.20.193.106:0/345657705 >> v1:10.20.193.106:6790/0 conn(0x7fd72405dee0 legacy=0x7fd724181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 1 -- 10.20.193.106:0/345657705 shutdown_connections 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 1 -- 10.20.193.106:0/345657705 >> 10.20.193.106:0/345657705 conn(0x7fd7240915f0 msgr2=0x7fd7240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 1 -- 10.20.193.106:0/345657705 shutdown_connections 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.101+0000 7fd72a6cc640 1 -- 10.20.193.106:0/345657705 wait complete. 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient: build_initial_monmap 2026-02-17T05:45:09.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient: monmap: 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:09.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 1 Processor -- start 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 1 -- start start 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient: init 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-b con 0x7fd72405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-a con 0x7fd72405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient(hunting): picked mon.noname-c con 0x7fd724182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72410c6e0 con 0x7fd72405dee0 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72412e430 con 0x7fd72405d1b0 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72405e8e0 con 0x7fd724182720 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd72a6cc640 10 monclient(hunting): authenticate will time out at 1637.730659s 2026-02-17T05:45:09.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd7237fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd72412dd20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 0x7fd724181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:38776/0 (socket says 10.20.193.106:38776) 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 -- 10.20.193.106:0/1573786741 learned_addr learned my addr 10.20.193.106:0/1573786741 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 legacy=0x7fd724181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 legacy=0x7fd724181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 --1- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 0x7fd724181de0 :-1 s=OPENED pgs=695 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd728c42640 1 --1- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 0x7fd724181de0 :-1 s=OPENED pgs=695 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:45:09.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.102+0000 7fd720ff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.106:6790/0 2026-02-17T05:45:09.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.303+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd72412dd20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:09.705 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:09.704+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd72412dd20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:10.506 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:10.505+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd72412dd20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): tick 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 monclient(hunting): continuing hunt 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 legacy=0x7fd724181de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.118:6789/0 conn(0x7fd72405d1b0 legacy=0x7fd72412d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd72412dd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd72405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd72405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd724182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:12.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:12.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72410e0a0 con 0x7fd72405dee0 2026-02-17T05:45:12.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0068e00 con 0x7fd72405d1b0 2026-02-17T05:45:12.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0069ff0 con 0x7fd724182720 2026-02-17T05:45:12.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.102+0000 7fd6ff7fe640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:12.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.304+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:12.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:12.705+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:13.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:13.506+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): tick 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 monclient(hunting): continuing hunt 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd724182720 legacy=0x7fd6f00666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.118:6789/0 conn(0x7fd72405d1b0 legacy=0x7fd6f0044eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:15.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd6f0069140 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd72405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd72405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f006b250 con 0x7fd72405dee0 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72410e0a0 con 0x7fd72405d1b0 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0046620 con 0x7fd6f0069140 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd6ff7fe640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:15.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.103+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:15.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.304+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:15.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:15.705+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:16.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:16.507+0000 7fd7237fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): tick 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 monclient(hunting): continuing hunt 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd6f0069140 legacy=0x7fd6f0069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:18.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.118:6789/0 conn(0x7fd72405d1b0 legacy=0x7fd6f0044eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd72405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd72405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd6f0069140 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00477c0 con 0x7fd72405dee0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f006b250 con 0x7fd72405d1b0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0044ef0 con 0x7fd6f0069140 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:18.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.102+0000 7fd6ff7fe640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:18.305 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.303+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:18.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:18.704+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:19.507 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:19.505+0000 7fd723fff640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444731401 0 0) 0x7fd6f006b250 con 0x7fd72405d1b0 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): my global_id is 134233 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f40035e0 con 0x7fd72405d1b0 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497896039 0 0) 0x7fd6f0044ef0 con 0x7fd6f0069140 2026-02-17T05:45:20.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): my global_id is 5378 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f006b250 con 0x7fd6f0069140 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2024765267 0 0) 0x7fd6f40035e0 con 0x7fd72405d1b0 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f0044ef0 con 0x7fd72405d1b0 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd714004a40 con 0x7fd72405d1b0 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.487 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3130952831 0 0) 0x7fd6f006b250 con 0x7fd6f0069140 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f40035e0 con 0x7fd6f0069140 2026-02-17T05:45:20.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd7180051b0 con 0x7fd6f0069140 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient(hunting): dump: 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.489 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 728133929 0 0) 0x7fd6f0044ef0 con 0x7fd72405d1b0 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6790/0 conn(0x7fd6f0069140 legacy=0x7fd6f0069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.106:6789/0 conn(0x7fd72405dee0 legacy=0x7fd6f00236e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 monclient: found mon.b 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0045140 con 0x7fd72405d1b0 2026-02-17T05:45:20.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: _finish_auth 0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 5 monclient: authenticate success, global_id 134233 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 10 monclient: _renew_subs 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd72410cbb0 con 0x7fd72405d1b0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 10 monclient: _renew_subs 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd72410d710 con 0x7fd72405d1b0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7140029b0 con 0x7fd72405d1b0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd714005000 con 0x7fd72405d1b0 2026-02-17T05:45:20.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd720ff9640 10 monclient: dump: 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.492 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.481+0000 7fd7227fc640 4 set_mon_vals no callback set 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd72a6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd72a6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd72a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724057ca0 con 0x7fd72405d1b0 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd714011fa0 con 0x7fd72405d1b0 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.482+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7fd71404ff10 con 0x7fd72405d1b0 2026-02-17T05:45:20.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.483+0000 7fd723fff640 10 monclient: get_auth_request con 0x7fd6f4040930 auth_method 0 2026-02-17T05:45:20.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.485+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fd714017620 con 0x7fd72405d1b0 2026-02-17T05:45:20.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.485+0000 7fd720ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.485+0000 7fd720ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:20.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd72a6cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd72a6cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd72a6cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.118:6789/0 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 --> v1:10.20.193.118:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd724055570 con 0x7fd72405d1b0 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd720ff9640 1 -- 10.20.193.106:0/1573786741 <== mon.1 v1:10.20.193.118:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1358403132) 0x7fd714016dd0 con 0x7fd72405d1b0 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd720ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:45:20.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.633+0000 7fd720ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:20.637 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":60,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.118:6812/703720803 conn(0x7fd6f4040930 legacy=0x7fd6f4060de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 10 monclient: shutdown 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 >> v1:10.20.193.118:6789/0 conn(0x7fd72405d1b0 legacy=0x7fd6f006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 shutdown_connections 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 >> 10.20.193.106:0/1573786741 conn(0x7fd7240915f0 msgr2=0x7fd724088680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 shutdown_connections 2026-02-17T05:45:20.638 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.634+0000 7fd72a6cc640 1 -- 10.20.193.106:0/1573786741 wait complete. 2026-02-17T05:45:20.645 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T05:45:20.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T05:45:20.645 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.709+0000 7f98bf8c3640 10 monclient: get_monmap_and_config 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.709+0000 7f98bf8c3640 10 monclient: build_initial_monmap 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.709+0000 7f98bf8c3640 10 monclient: monmap: 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:20.711068+0000 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:20.711068+0000 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:20.721 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 1 Processor -- start 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 1 -- start start 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient: init 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f98b805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:20.722 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f98b805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f98b8182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b808b060 con 0x7f98b805d1b0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b805dc90 con 0x7f98b8182720 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b808d6a0 con 0x7f98b805dee0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bd638640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f98b805d1b0 legacy=0x7f98b805d580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bf8c3640 10 monclient(hunting): authenticate will time out at 1649.339470s 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bce37640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f98b805dee0 0x7f98b8181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46494/0 (socket says 10.20.193.106:46494) 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98bce37640 1 -- 10.20.193.106:0/1481000941 learned_addr learned my addr 10.20.193.106:0/1481000941 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601945668 0 0) 0x7f98b808d6a0 con 0x7f98b805dee0 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.723 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 10 monclient(hunting): my global_id is 5381 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a00035e0 con 0x7f98b805dee0 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 636652640 0 0) 0x7f98a00035e0 con 0x7f98b805dee0 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 >> v1:10.20.193.118:6789/0 conn(0x7f98b8182720 legacy=0x7f98b81a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.710+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 >> v1:10.20.193.106:6789/0 conn(0x7f98b805d1b0 legacy=0x7f98b805d580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 1 monclient: found mon.noname-b 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.724 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b8057960 con 0x7f98b805dee0 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: _finish_auth 0 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98ac002dd0 con 0x7f98b805dee0 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 5 monclient: authenticate success, global_id 5381 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: dump: 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.725 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98ac003010 con 0x7f98b805dee0 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 4 set_mon_vals no callback set 2026-02-17T05:45:20.726 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 1 -- 10.20.193.106:0/1481000941 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98ac003420 con 0x7f98b805dee0 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98a7fff640 10 monclient: dump: 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.727 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 10 monclient: shutdown 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- 10.20.193.106:0/1481000941 >> v1:10.20.193.106:6790/0 conn(0x7f98b805dee0 legacy=0x7f98b8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- 10.20.193.106:0/1481000941 shutdown_connections 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- 10.20.193.106:0/1481000941 >> 10.20.193.106:0/1481000941 conn(0x7f98b80915f0 msgr2=0x7f98b80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- 10.20.193.106:0/1481000941 shutdown_connections 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- 10.20.193.106:0/1481000941 wait complete. 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 10 monclient: build_initial_monmap 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 10 monclient: monmap: 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:20.728 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 Processor -- start 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 1 -- start start 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.711+0000 7f98bf8c3640 10 monclient: init 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f98b805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f98b805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f98b8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b810f2e0 con 0x7f98b805dee0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b810e470 con 0x7f98b805d1b0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b810cf80 con 0x7f98b8182720 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient(hunting): authenticate will time out at 1649.341240s 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bce37640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f98b805dee0 legacy=0x7f98b8180dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bde39640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f98b8182720 0x7f98b81198a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46500/0 (socket says 10.20.193.106:46500) 2026-02-17T05:45:20.730 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bde39640 1 -- 10.20.193.106:0/3472433571 learned_addr learned my addr 10.20.193.106:0/3472433571 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345995080 0 0) 0x7f98b810cf80 con 0x7f98b8182720 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): my global_id is 5384 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98880035e0 con 0x7f98b8182720 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311505113 0 0) 0x7f98b810e470 con 0x7f98b805d1b0 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.731 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): my global_id is 134236 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98b810cf80 con 0x7f98b805d1b0 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3865157941 0 0) 0x7f98880035e0 con 0x7f98b8182720 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98b810e470 con 0x7f98b8182720 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98b40041d0 con 0x7f98b8182720 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): dump: 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.732 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 695933378 0 0) 0x7f98b810e470 con 0x7f98b8182720 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.118:6789/0 conn(0x7f98b805d1b0 legacy=0x7f98b813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6789/0 conn(0x7f98b805dee0 legacy=0x7f98b8180dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:20.733 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 monclient: found mon.c 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b81824f0 con 0x7f98b8182720 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: _finish_auth 0 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 5 monclient: authenticate success, global_id 5384 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _renew_subs 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f98b810ea40 con 0x7f98b8182720 2026-02-17T05:45:20.734 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _renew_subs 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f98b810dae0 con 0x7f98b8182720 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98b4004540 con 0x7f98b8182720 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98b4004c10 con 0x7f98b8182720 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a5ffb640 10 monclient: dump: 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.735 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.712+0000 7f98a77fe640 4 set_mon_vals no callback set 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98bf8c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98b8089e60 con 0x7f98b813d510 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895586885 0 0) 0x7f98b810cf80 con 0x7f98b813d510 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.736 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient(hunting): my global_id is 5387 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98b810e470 con 0x7f98b813d510 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f98b4004d70 con 0x7f98b8182720 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7f98b4050e60 con 0x7f98b8182720 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1109699669 0 0) 0x7f98b810e470 con 0x7f98b813d510 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98b810cf80 con 0x7f98b813d510 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98a8004060 con 0x7f98b813d510 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.737 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 10 monclient: dump: 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.738 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98bce37640 10 monclient: get_auth_request con 0x7f98880408b0 auth_method 0 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1442280328 0 0) 0x7f98b810cf80 con 0x7f98b813d510 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.713+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98b8057cd0 con 0x7f98b813d510 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.714+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f98a8004600 con 0x7f98b813d510 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.714+0000 7f98a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.714+0000 7f98a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.714+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6790/0 conn(0x7f98b813d510 legacy=0x7f98b81076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.714+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6790/0 conn(0x7f98b813d510 legacy=0x7f98b81076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98bf8c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98b810eed0 con 0x7f98b812a900 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125699355 0 0) 0x7f98a8004820 con 0x7f98b812a900 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.739 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient(hunting): my global_id is 5390 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98b810cf80 con 0x7f98b812a900 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 126931150 0 0) 0x7f98b810cf80 con 0x7f98b812a900 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98a8004820 con 0x7f98b812a900 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f98a8004dd0 con 0x7f98b812a900 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.717+0000 7f98a5ffb640 10 monclient: dump: 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.740 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1509564479 0 0) 0x7f98a8004820 con 0x7f98b812a900 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f98b813d8e0 con 0x7f98b812a900 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4506 (unknown 0 0 3093387235) 0x7f98a80070d0 con 0x7f98b812a900 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:20.741 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6790/0 conn(0x7f98b812a900 legacy=0x7f98b8107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.742 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98a5ffb640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6790/0 conn(0x7f98b812a900 legacy=0x7f98b8107de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.742 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:20.742 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:20.742 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:20.742 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 60, 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 1045480, 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.743 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.744 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.745 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.748 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.749 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.750 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:20.751 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:45:20.752 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:20.753 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.118:6812/703720803 conn(0x7f98880408b0 legacy=0x7f9888060d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 10 monclient: shutdown 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 >> v1:10.20.193.106:6790/0 conn(0x7f98b8182720 legacy=0x7f98b81198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bde39640 1 -- 10.20.193.106:0/3472433571 reap_dead start 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bde39640 1 -- 10.20.193.106:0/3472433571 reap_dead start 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 shutdown_connections 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 >> 10.20.193.106:0/3472433571 conn(0x7f98b80915f0 msgr2=0x7f98b8089750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 shutdown_connections 2026-02-17T05:45:20.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.718+0000 7f98bf8c3640 1 -- 10.20.193.106:0/3472433571 wait complete. 2026-02-17T05:45:20.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:45:20.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-17T05:45:20.756 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:45:20.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: build_initial_monmap 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: monmap: 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:20.821610+0000 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:20.821610+0000 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.830 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 1 Processor -- start 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 1 -- start start 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: init 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:20.831 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-b con 0x7f345805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-c con 0x7f345805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-a con 0x7f3458182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345808b060 con 0x7f3458182720 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345805dc90 con 0x7f345805dee0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345808d6a0 con 0x7f345805d1b0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f345d88c640 10 monclient(hunting): authenticate will time out at 1649.449981s 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.820+0000 7f34577fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f3458182720 legacy=0x7f34581a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:20.832 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3456ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f345805d1b0 0x7f345805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46522/0 (socket says 10.20.193.106:46522) 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3456ffd640 1 -- 10.20.193.106:0/1318568674 learned_addr learned my addr 10.20.193.106:0/1318568674 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735573873 0 0) 0x7f345808d6a0 con 0x7f345805d1b0 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient(hunting): my global_id is 5393 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34440035e0 con 0x7f345805d1b0 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 439628813 0 0) 0x7f34440035e0 con 0x7f345805d1b0 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 >> v1:10.20.193.118:6789/0 conn(0x7f345805dee0 legacy=0x7f3458181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 >> v1:10.20.193.106:6789/0 conn(0x7f3458182720 legacy=0x7f34581a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:20.833 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 monclient: found mon.noname-b 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3458057960 con 0x7f345805d1b0 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: _finish_auth 0 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f344c002dd0 con 0x7f345805d1b0 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 5 monclient: authenticate success, global_id 5393 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:20.834 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: dump: 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.835 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f344c003010 con 0x7f345805d1b0 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 1 -- 10.20.193.106:0/1318568674 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f344c003420 con 0x7f345805d1b0 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 4 set_mon_vals no callback set 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f3455ffb640 10 monclient: dump: 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.836 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 10 monclient: shutdown 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 1 -- 10.20.193.106:0/1318568674 >> v1:10.20.193.106:6790/0 conn(0x7f345805d1b0 legacy=0x7f345805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 1 -- 10.20.193.106:0/1318568674 shutdown_connections 2026-02-17T05:45:20.837 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 1 -- 10.20.193.106:0/1318568674 >> 10.20.193.106:0/1318568674 conn(0x7f34580915f0 msgr2=0x7f34580919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 1 -- 10.20.193.106:0/1318568674 shutdown_connections 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.821+0000 7f345d88c640 1 -- 10.20.193.106:0/1318568674 wait complete. 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient: build_initial_monmap 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient: monmap: 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:20.838 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 1 Processor -- start 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 1 -- start start 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient: init 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-a con 0x7f345805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-c con 0x7f345805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:20.839 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient(hunting): picked mon.noname-b con 0x7f3458182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345805cdf0 con 0x7f345805d1b0 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345808a050 con 0x7f3458182720 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345805e8e0 con 0x7f345805dee0 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f345d88c640 10 monclient(hunting): authenticate will time out at 1649.451692s 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f3456ffd640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f345805d1b0 legacy=0x7f345813cb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f34567fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f345805dee0 0x7f345813d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:46536/0 (socket says 10.20.193.106:46536) 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f34567fc640 1 -- 10.20.193.106:0/3097507204 learned_addr learned my addr 10.20.193.106:0/3097507204 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708596907 0 0) 0x7f345805e8e0 con 0x7f345805dee0 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 10 monclient(hunting): my global_id is 5396 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.822+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34280035e0 con 0x7f345805dee0 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3105050756 0 0) 0x7f34280035e0 con 0x7f345805dee0 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345805e8e0 con 0x7f345805dee0 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3440003110 con 0x7f345805dee0 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient(hunting): dump: 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.841 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2392717465 0 0) 0x7f345805e8e0 con 0x7f345805dee0 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f3458182720 legacy=0x7f3458181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.106:6789/0 conn(0x7f345805d1b0 legacy=0x7f345813cb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:20.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 monclient: found mon.c 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3458089a90 con 0x7f345805dee0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: _finish_auth 0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 5 monclient: authenticate success, global_id 5396 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 10 monclient: _renew_subs 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34581824f0 con 0x7f345805dee0 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 10 monclient: _renew_subs 2026-02-17T05:45:20.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f345810e7c0 con 0x7f345805dee0 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3440003480 con 0x7f345805dee0 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3440003b70 con 0x7f345805dee0 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 10 monclient: dump: 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.844 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f34557fa640 4 set_mon_vals no callback set 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f345812db10 con 0x7f345812d740 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.823+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3440003cd0 con 0x7f345805dee0 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(872..872 src has 597..872) ==== 3955+0+0 (unknown 1727014996 0 0) 0x7f344004fe90 con 0x7f345805dee0 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f34577fe640 10 monclient: get_auth_request con 0x7f34280406d0 auth_method 0 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628698406 0 0) 0x7f345812db10 con 0x7f345812d740 2026-02-17T05:45:20.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 10 monclient(hunting): my global_id is 134239 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345805e8e0 con 0x7f345812d740 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f3456ffd640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 legacy=0x7f3458059f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f3456ffd640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 legacy=0x7f3458059f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f3456ffd640 1 --1- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 0x7f3458059f80 :-1 s=OPENED pgs=482 gs=5 cs=1 l=1).handle_message read tag failed 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f3456ffd640 1 --1- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 0x7f3458059f80 :-1 s=OPENED pgs=482 gs=5 cs=1 l=1).fault on lossy channel, failing 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 legacy=0x7f3458059f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345812d740 legacy=0x7f3458059f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.824+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f345812db10 con 0x7f34280655b0 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12734552 0 0) 0x7f345812db10 con 0x7f34280655b0 2026-02-17T05:45:20.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient(hunting): my global_id is 134242 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345805cdf0 con 0x7f34280655b0 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1113475294 0 0) 0x7f345805cdf0 con 0x7f34280655b0 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345812db10 con 0x7f34280655b0 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f344c0033c0 con 0x7f34280655b0 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient: dump: 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.847 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2699751498 0 0) 0x7f345812db10 con 0x7f34280655b0 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3428067210 con 0x7f34280655b0 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f344c002760 con 0x7f34280655b0 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f34280655b0 legacy=0x7f3428065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.825+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f34280655b0 legacy=0x7f3428065980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f345d88c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3458055570 con 0x7f345804d200 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371332551 0 0) 0x7f3458055570 con 0x7f345804d200 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:20.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient(hunting): my global_id is 134245 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345812db10 con 0x7f345804d200 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2413967027 0 0) 0x7f345812db10 con 0x7f345804d200 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3458055570 con 0x7f345804d200 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f344c004f40 con 0x7f345804d200 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.829+0000 7f342ffff640 10 monclient: dump: 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:20.851 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1297569354 0 0) 0x7f3458055570 con 0x7f345804d200 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f345808e3d0 con 0x7f345804d200 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 2028042167) 0x7f344c0071a0 con 0x7f345804d200 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345804d200 legacy=0x7f345811b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f342ffff640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6789/0 conn(0x7f345804d200 legacy=0x7f345811b620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:45:20.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f34577fe640 1 -- 10.20.193.106:0/3097507204 reap_dead start 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 60, 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 144973, 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:20.853 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.854 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.855 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:45:20.856 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:45:20.857 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:45:20.858 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.859 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:45:20.860 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:45:20.861 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "num": 2 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:45:20.862 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:45:20.863 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:45:20.863 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:45:20.863 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:45:20.863 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:45:20.863 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.118:6812/703720803 conn(0x7f34280406d0 legacy=0x7f3428060b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 10 monclient: shutdown 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 >> v1:10.20.193.106:6790/0 conn(0x7f345805dee0 legacy=0x7f345813d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 shutdown_connections 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 >> 10.20.193.106:0/3097507204 conn(0x7f34580915f0 msgr2=0x7f345808c270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 shutdown_connections 2026-02-17T05:45:20.864 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:20.830+0000 7f345d88c640 1 -- 10.20.193.106:0/3097507204 wait complete. 2026-02-17T05:45:20.864 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T05:45:20.865 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T05:45:21.483 INFO:tasks.rados.rados.0.trial118.stdout:3918: done (2 left) 2026-02-17T05:45:21.484 INFO:tasks.rados.rados.0.trial118.stdout:3919: done (1 left) 2026-02-17T05:45:21.484 INFO:tasks.rados.rados.0.trial118.stdout:3920: done (0 left) 2026-02-17T05:45:21.484 INFO:tasks.rados.rados.0.trial118.stdout:3921: write oid 13 current snap is 439 2026-02-17T05:45:21.484 INFO:tasks.rados.rados.0.trial118.stdout:3921: seq_num 1357 ranges {407099=423727,1441712=515472,2582060=225039} 2026-02-17T05:45:21.487 INFO:tasks.rados.rados.0.trial118.stdout:3921: writing trial11845692-13 from 407099 to 830826 tid 1 2026-02-17T05:45:21.491 INFO:tasks.rados.rados.0.trial118.stdout:3921: writing trial11845692-13 from 1441712 to 1957184 tid 2 2026-02-17T05:45:21.495 INFO:tasks.rados.rados.0.trial118.stdout:3921: writing trial11845692-13 from 2582060 to 2807099 tid 3 2026-02-17T05:45:21.495 INFO:tasks.rados.rados.0.trial118.stdout:3922: read oid 44 snap -1 2026-02-17T05:45:21.495 INFO:tasks.rados.rados.0.trial118.stdout:3922: expect (ObjNum 1350 snap 435 seq_num 1350) 2026-02-17T05:45:21.495 INFO:tasks.rados.rados.0.trial118.stdout:3923: write oid 6 current snap is 439 2026-02-17T05:45:21.495 INFO:tasks.rados.rados.0.trial118.stdout:3923: seq_num 1358 ranges {423906=498976,1500194=659130,2609483=214423} 2026-02-17T05:45:21.498 INFO:tasks.rados.rados.0.trial118.stdout:3923: writing trial11845692-6 from 423906 to 922882 tid 1 2026-02-17T05:45:21.504 INFO:tasks.rados.rados.0.trial118.stdout:3923: writing trial11845692-6 from 1500194 to 2159324 tid 2 2026-02-17T05:45:21.507 INFO:tasks.rados.rados.0.trial118.stdout:3923: writing trial11845692-6 from 2609483 to 2823906 tid 3 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3924: rollback oid 50 current snap is 439 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 427 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: finishing write tid 1 to trial11845692-13 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: finishing write tid 2 to trial11845692-13 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: finishing write tid 3 to trial11845692-13 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: finishing write tid 4 to trial11845692-13 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: finishing write tid 5 to trial11845692-13 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: oid 13 updating version 0 to 2175 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: oid 13 version 2175 is already newer than 2172 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: oid 13 version 2175 is already newer than 2174 2026-02-17T05:45:21.508 INFO:tasks.rados.rados.0.trial118.stdout:3921: oid 13 version 2175 is already newer than 2173 2026-02-17T05:45:21.509 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 2175 (ObjNum 1357 snap 439 seq_num 1357) dirty exists 2026-02-17T05:45:21.509 INFO:tasks.rados.rados.0.trial118.stdout:3921: left oid 13 (ObjNum 1357 snap 439 seq_num 1357) 2026-02-17T05:45:21.509 INFO:tasks.rados.rados.0.trial118.stdout:3922: expect (ObjNum 1350 snap 435 seq_num 1350) 2026-02-17T05:45:21.509 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:21.626 INFO:tasks.rados.rados.0.trial118.stdout:3923: finishing write tid 1 to trial11845692-6 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3921: done (3 left) 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3922: done (2 left) 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3925: delete oid 30 current snap is 439 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: finishing write tid 2 to trial11845692-6 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: finishing write tid 3 to trial11845692-6 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: finishing write tid 4 to trial11845692-6 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: finishing write tid 5 to trial11845692-6 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: oid 6 updating version 0 to 1741 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: oid 6 version 1741 is already newer than 1740 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: oid 6 version 1741 is already newer than 1739 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: oid 6 version 1741 is already newer than 1738 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1741 (ObjNum 1358 snap 439 seq_num 1358) dirty exists 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3923: left oid 6 (ObjNum 1358 snap 439 seq_num 1358) 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3924: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:3924: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:45:21.627 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2159 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:45:21.628 INFO:tasks.rados.rados.0.trial118.stdout:3923: done (2 left) 2026-02-17T05:45:21.628 INFO:tasks.rados.rados.0.trial118.stdout:3924: done (1 left) 2026-02-17T05:45:21.628 INFO:tasks.rados.rados.0.trial118.stdout:3925: done (0 left) 2026-02-17T05:45:21.629 INFO:tasks.rados.rados.0.trial118.stdout:3926: read oid 34 snap -1 2026-02-17T05:45:21.629 INFO:tasks.rados.rados.0.trial118.stdout:3926: expect (ObjNum 1305 snap 407 seq_num 1305) 2026-02-17T05:45:21.629 INFO:tasks.rados.rados.0.trial118.stdout:3927: read oid 35 snap -1 2026-02-17T05:45:21.629 INFO:tasks.rados.rados.0.trial118.stdout:3927: expect deleted 2026-02-17T05:45:21.629 INFO:tasks.rados.rados.0.trial118.stdout:3928: snap_remove snap 405 2026-02-17T05:45:22.490 INFO:tasks.rados.rados.0.trial118.stdout:3928: done (2 left) 2026-02-17T05:45:22.490 INFO:tasks.rados.rados.0.trial118.stdout:3929: read oid 24 snap -1 2026-02-17T05:45:22.490 INFO:tasks.rados.rados.0.trial118.stdout:3929: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:45:22.490 INFO:tasks.rados.rados.0.trial118.stdout:3930: delete oid 41 current snap is 439 2026-02-17T05:45:22.490 INFO:tasks.rados.rados.0.trial118.stdout:3926: expect (ObjNum 1305 snap 407 seq_num 1305) 2026-02-17T05:45:22.491 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:22.604 INFO:tasks.rados.rados.0.trial118.stdout:3929: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:45:22.644 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2055094 2026-02-17T05:45:22.663 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3926: done (3 left) 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3927: done (2 left) 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3929: done (1 left) 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3930: done (0 left) 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3931: rollback oid 13 current snap is 439 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 13 to 384 2026-02-17T05:45:22.700 INFO:tasks.rados.rados.0.trial118.stdout:3932: delete oid 37 current snap is 439 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3932: done (1 left) 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3933: read oid 9 snap -1 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3933: expect deleted 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3934: read oid 50 snap -1 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3934: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3935: read oid 2 snap -1 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3935: expect (ObjNum 1326 snap 415 seq_num 1326) 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:3936: rollback oid 35 current snap is 439 2026-02-17T05:45:22.702 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 35 to 401 2026-02-17T05:45:22.703 INFO:tasks.rados.rados.0.trial118.stdout:3937: rollback oid 31 current snap is 439 2026-02-17T05:45:22.703 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 31 to 392 2026-02-17T05:45:22.703 INFO:tasks.rados.rados.0.trial118.stdout:3938: copy_from oid 36 from oid 21 current snap is 439 2026-02-17T05:45:22.703 INFO:tasks.rados.rados.0.trial118.stdout:3939: write oid 11 current snap is 439 2026-02-17T05:45:22.703 INFO:tasks.rados.rados.0.trial118.stdout:3939: seq_num 1362 ranges {491134=516325,1734122=666468} 2026-02-17T05:45:22.704 INFO:tasks.rados.rados.0.trial118.stdout:3939: writing trial11845692-11 from 491134 to 1007459 tid 1 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3939: writing trial11845692-11 from 1734122 to 2400590 tid 2 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3940: rollback oid 18 current snap is 439 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 18 to 428 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3938: finishing copy_from to trial11845692-36 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3938: got expected ENOENT (src dne) 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3938: finishing copy_from racing read to trial11845692-36 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3936: finishing rollback tid 1 to trial11845692-35 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1756 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-17T05:45:22.711 INFO:tasks.rados.rados.0.trial118.stdout:3931: finishing rollback tid 0 to trial11845692-13 2026-02-17T05:45:22.712 INFO:tasks.rados.rados.0.trial118.stdout:3931: finishing rollback tid 1 to trial11845692-13 2026-02-17T05:45:22.712 INFO:tasks.rados.rados.0.trial118.stdout:3931: finishing rollback tid 2 to trial11845692-13 2026-02-17T05:45:22.712 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 13 v 2178 (ObjNum 1199 snap 379 seq_num 1199) dirty exists 2026-02-17T05:45:22.712 INFO:tasks.rados.rados.0.trial118.stdout:3935: expect (ObjNum 1326 snap 415 seq_num 1326) 2026-02-17T05:45:22.726 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 1594680 2026-02-17T05:45:22.756 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 344507 2026-02-17T05:45:22.782 INFO:tasks.rados.rados.0.trial118.stdout:3934: expect (ObjNum 1169 snap 365 seq_num 1169) 2026-02-17T05:45:22.782 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3937: finishing rollback tid 1 to trial11845692-31 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3937: finishing rollback tid 2 to trial11845692-31 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 2578 (ObjNum 1128 snap 343 seq_num 1128) dirty exists 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3939: finishing write tid 1 to trial11845692-11 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3939: finishing write tid 2 to trial11845692-11 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3931: done (8 left) 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3933: done (7 left) 2026-02-17T05:45:22.938 INFO:tasks.rados.rados.0.trial118.stdout:3934: done (6 left) 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3935: done (5 left) 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3936: done (4 left) 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3937: done (3 left) 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3938: done (2 left) 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3941: rollback oid 8 current snap is 439 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 8 to 401 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3939: finishing write tid 3 to trial11845692-11 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3939: finishing write tid 4 to trial11845692-11 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3939: oid 11 updating version 0 to 2580 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3939: oid 11 updating version 2580 to 2581 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:3939: oid 11 version 2581 is already newer than 2579 2026-02-17T05:45:22.939 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2581 (ObjNum 1362 snap 439 seq_num 1362) dirty exists 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3939: left oid 11 (ObjNum 1362 snap 439 seq_num 1362) 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3940: finishing rollback tid 0 to trial11845692-18 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3940: finishing rollback tid 1 to trial11845692-18 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3940: finishing rollback tid 2 to trial11845692-18 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 18 v 2244 (ObjNum 1334 snap 418 seq_num 1334) dirty exists 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3939: done (2 left) 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3940: done (1 left) 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3942: read oid 49 snap -1 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3942: expect (ObjNum 1301 snap 407 seq_num 1301) 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3943: write oid 37 current snap is 439 2026-02-17T05:45:22.940 INFO:tasks.rados.rados.0.trial118.stdout:3943: seq_num 1363 ranges {507941=591574,1676251=526479,2746598=161343} 2026-02-17T05:45:22.941 INFO:tasks.rados.rados.0.trial118.stdout:3943: writing trial11845692-37 from 507941 to 1099515 tid 1 2026-02-17T05:45:22.945 INFO:tasks.rados.rados.0.trial118.stdout:3943: writing trial11845692-37 from 1676251 to 2202730 tid 2 2026-02-17T05:45:22.948 INFO:tasks.rados.rados.0.trial118.stdout:3943: writing trial11845692-37 from 2746598 to 2907941 tid 3 2026-02-17T05:45:22.948 INFO:tasks.rados.rados.0.trial118.stdout:3944: delete oid 7 current snap is 439 2026-02-17T05:45:22.948 INFO:tasks.rados.rados.0.trial118.stdout:3941: finishing rollback tid 0 to trial11845692-8 2026-02-17T05:45:22.949 INFO:tasks.rados.rados.0.trial118.stdout:3941: finishing rollback tid 1 to trial11845692-8 2026-02-17T05:45:22.949 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 8 v 2584 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:45:22.949 INFO:tasks.rados.rados.0.trial118.stdout:3942: expect (ObjNum 1301 snap 407 seq_num 1301) 2026-02-17T05:45:22.996 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 196906 2026-02-17T05:45:23.078 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 2737674 2026-02-17T05:45:23.089 INFO:tasks.rados.rados.0.trial118.stdout:3943: finishing write tid 1 to trial11845692-37 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: finishing write tid 2 to trial11845692-37 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: finishing write tid 3 to trial11845692-37 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: finishing write tid 4 to trial11845692-37 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: finishing write tid 5 to trial11845692-37 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: oid 37 updating version 0 to 2162 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: oid 37 updating version 2162 to 2163 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: oid 37 version 2163 is already newer than 2161 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:3943: oid 37 updating version 2163 to 2164 2026-02-17T05:45:23.090 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 2164 (ObjNum 1363 snap 439 seq_num 1363) dirty exists 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3943: left oid 37 (ObjNum 1363 snap 439 seq_num 1363) 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3941: done (3 left) 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3942: done (2 left) 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3943: done (1 left) 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3944: done (0 left) 2026-02-17T05:45:23.091 INFO:tasks.rados.rados.0.trial118.stdout:3945: snap_remove snap 437 2026-02-17T05:45:23.493 INFO:tasks.rados.rados.0.trial118.stdout:3945: done (0 left) 2026-02-17T05:45:23.493 INFO:tasks.rados.rados.0.trial118.stdout:3946: write oid 30 current snap is 439 2026-02-17T05:45:23.493 INFO:tasks.rados.rados.0.trial118.stdout:3946: seq_num 1365 ranges {541555=742072,1793215=530148,2801444=140111} 2026-02-17T05:45:23.498 INFO:tasks.rados.rados.0.trial118.stdout:3946: writing trial11845692-30 from 541555 to 1283627 tid 1 2026-02-17T05:45:23.502 INFO:tasks.rados.rados.0.trial118.stdout:3946: writing trial11845692-30 from 1793215 to 2323363 tid 2 2026-02-17T05:45:23.504 INFO:tasks.rados.rados.0.trial118.stdout:3946: writing trial11845692-30 from 2801444 to 2941555 tid 3 2026-02-17T05:45:23.504 INFO:tasks.rados.rados.0.trial118.stdout:3947: snap_create 2026-02-17T05:45:23.504 INFO:tasks.rados.rados.0.trial118.stdout:3946: finishing write tid 1 to trial11845692-30 2026-02-17T05:45:23.504 INFO:tasks.rados.rados.0.trial118.stdout:3946: finishing write tid 2 to trial11845692-30 2026-02-17T05:45:23.505 INFO:tasks.rados.rados.0.trial118.stdout:3946: finishing write tid 3 to trial11845692-30 2026-02-17T05:45:23.505 INFO:tasks.rados.rados.0.trial118.stdout:3946: finishing write tid 4 to trial11845692-30 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: finishing write tid 5 to trial11845692-30 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: oid 30 updating version 0 to 2548 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: oid 30 updating version 2548 to 2549 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: oid 30 updating version 2549 to 2550 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: oid 30 updating version 2550 to 2551 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2551 (ObjNum 1365 snap 439 seq_num 1365) dirty exists 2026-02-17T05:45:23.506 INFO:tasks.rados.rados.0.trial118.stdout:3946: left oid 30 (ObjNum 1365 snap 439 seq_num 1365) 2026-02-17T05:45:24.499 INFO:tasks.rados.rados.0.trial118.stdout:3946: done (1 left) 2026-02-17T05:45:24.499 INFO:tasks.rados.rados.0.trial118.stdout:3947: done (0 left) 2026-02-17T05:45:24.499 INFO:tasks.rados.rados.0.trial118.stdout:3948: write (excl) oid 35 current snap is 440 2026-02-17T05:45:24.499 INFO:tasks.rados.rados.0.trial118.stdout:3948: seq_num 1366 ranges {558362=417321,1451697=673806,2712514=245848} 2026-02-17T05:45:24.502 INFO:tasks.rados.rados.0.trial118.stdout:3948: writing trial11845692-35 from 558362 to 975683 tid 1 2026-02-17T05:45:24.507 INFO:tasks.rados.rados.0.trial118.stdout:3948: writing trial11845692-35 from 1451697 to 2125503 tid 2 2026-02-17T05:45:24.510 INFO:tasks.rados.rados.0.trial118.stdout:3948: writing trial11845692-35 from 2712514 to 2958362 tid 3 2026-02-17T05:45:24.510 INFO:tasks.rados.rados.0.trial118.stdout:3949: write (excl) oid 30 current snap is 440 2026-02-17T05:45:24.510 INFO:tasks.rados.rados.0.trial118.stdout:3949: seq_num 1367 ranges {575169=492570,1793826=417464,2623584=351585} 2026-02-17T05:45:24.514 INFO:tasks.rados.rados.0.trial118.stdout:3949: writing trial11845692-30 from 575169 to 1067739 tid 1 2026-02-17T05:45:24.518 INFO:tasks.rados.rados.0.trial118.stdout:3949: writing trial11845692-30 from 1793826 to 2211290 tid 2 2026-02-17T05:45:24.521 INFO:tasks.rados.rados.0.trial118.stdout:3949: writing trial11845692-30 from 2623584 to 2975169 tid 3 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3950: rollback oid 34 current snap is 440 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: finishing write tid 1 to trial11845692-35 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: finishing write tid 2 to trial11845692-35 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: finishing write tid 3 to trial11845692-35 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 34 to 422 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: finishing write tid 4 to trial11845692-35 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: finishing write tid 5 to trial11845692-35 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: oid 35 updating version 0 to 1763 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: oid 35 version 1763 is already newer than 1761 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: oid 35 version 1763 is already newer than 1760 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: oid 35 version 1763 is already newer than 1762 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1763 (ObjNum 1366 snap 440 seq_num 1366) dirty exists 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: left oid 35 (ObjNum 1366 snap 440 seq_num 1366) 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3949: finishing write tid 1 to trial11845692-30 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3949: finishing write tid 2 to trial11845692-30 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3948: done (2 left) 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3951: write (excl) oid 11 current snap is 440 2026-02-17T05:45:24.522 INFO:tasks.rados.rados.0.trial118.stdout:3951: seq_num 1368 ranges {591976=567819,1852308=677475} 2026-02-17T05:45:24.526 INFO:tasks.rados.rados.0.trial118.stdout:3951: writing trial11845692-11 from 591976 to 1159795 tid 1 2026-02-17T05:45:24.531 INFO:tasks.rados.rados.0.trial118.stdout:3951: writing trial11845692-11 from 1852308 to 2529783 tid 2 2026-02-17T05:45:24.531 INFO:tasks.rados.rados.0.trial118.stdout:3952: snap_remove snap 423 2026-02-17T05:45:25.382 INFO:tasks.rados.rados.0.trial118.stdout:3952: done (3 left) 2026-02-17T05:45:25.382 INFO:tasks.rados.rados.0.trial118.stdout:3953: write (excl) oid 47 current snap is 440 2026-02-17T05:45:25.382 INFO:tasks.rados.rados.0.trial118.stdout:3953: seq_num 1369 ranges {608783=759421,2027143=421133} 2026-02-17T05:45:25.387 INFO:tasks.rados.rados.0.trial118.stdout:3953: writing trial11845692-47 from 608783 to 1368204 tid 1 2026-02-17T05:45:25.391 INFO:tasks.rados.rados.0.trial118.stdout:3953: writing trial11845692-47 from 2027143 to 2448276 tid 2 2026-02-17T05:45:25.392 INFO:tasks.rados.rados.0.trial118.stdout:3954: write (excl) oid 37 current snap is 440 2026-02-17T05:45:25.392 INFO:tasks.rados.rados.0.trial118.stdout:3954: seq_num 1370 ranges {625590=434670,1685625=681144,2822206=203384} 2026-02-17T05:45:25.395 INFO:tasks.rados.rados.0.trial118.stdout:3954: writing trial11845692-37 from 625590 to 1060260 tid 1 2026-02-17T05:45:25.400 INFO:tasks.rados.rados.0.trial118.stdout:3954: writing trial11845692-37 from 1685625 to 2366769 tid 2 2026-02-17T05:45:25.403 INFO:tasks.rados.rados.0.trial118.stdout:3954: writing trial11845692-37 from 2822206 to 3025590 tid 3 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:3955: rollback oid 36 current snap is 440 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 36 to 367 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:3949: finishing write tid 3 to trial11845692-30 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:3949: finishing write tid 4 to trial11845692-30 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:3956: write oid 45 current snap is 440 2026-02-17T05:45:25.404 INFO:tasks.rados.rados.0.trial118.stdout:3956: seq_num 1371 ranges {642397=509919,1627754=424802,2733276=309121} 2026-02-17T05:45:25.407 INFO:tasks.rados.rados.0.trial118.stdout:3956: writing trial11845692-45 from 642397 to 1152316 tid 1 2026-02-17T05:45:25.410 INFO:tasks.rados.rados.0.trial118.stdout:3956: writing trial11845692-45 from 1627754 to 2052556 tid 2 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3956: writing trial11845692-45 from 2733276 to 3042397 tid 3 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3957: copy_from oid 6 from oid 23 current snap is 440 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3949: finishing write tid 5 to trial11845692-30 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3949: oid 30 updating version 0 to 2556 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3949: oid 30 version 2556 is already newer than 2554 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3949: oid 30 version 2556 is already newer than 2553 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:3949: oid 30 version 2556 is already newer than 2555 2026-02-17T05:45:25.417 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2556 (ObjNum 1367 snap 440 seq_num 1367) dirty exists 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3949: left oid 30 (ObjNum 1367 snap 440 seq_num 1367) 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3950: finishing rollback tid 0 to trial11845692-34 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3950: finishing rollback tid 1 to trial11845692-34 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3950: finishing rollback tid 2 to trial11845692-34 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 34 v 2247 (ObjNum 1305 snap 407 seq_num 1305) dirty exists 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: finishing write tid 1 to trial11845692-11 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: finishing write tid 2 to trial11845692-11 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: finishing write tid 3 to trial11845692-11 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: finishing write tid 4 to trial11845692-11 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: oid 11 updating version 0 to 2590 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: oid 11 version 2590 is already newer than 2589 2026-02-17T05:45:25.418 INFO:tasks.rados.rados.0.trial118.stdout:3951: oid 11 version 2590 is already newer than 2588 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 11 v 2590 (ObjNum 1368 snap 440 seq_num 1368) dirty exists 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3951: left oid 11 (ObjNum 1368 snap 440 seq_num 1368) 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: finishing write tid 1 to trial11845692-47 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: finishing write tid 2 to trial11845692-47 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: finishing write tid 3 to trial11845692-47 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: finishing write tid 4 to trial11845692-47 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: oid 47 updating version 0 to 2399 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: oid 47 version 2399 is already newer than 2397 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: oid 47 version 2399 is already newer than 2398 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 47 v 2399 (ObjNum 1369 snap 440 seq_num 1369) dirty exists 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3953: left oid 47 (ObjNum 1369 snap 440 seq_num 1369) 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3954: finishing write tid 1 to trial11845692-37 2026-02-17T05:45:25.419 INFO:tasks.rados.rados.0.trial118.stdout:3949: done (7 left) 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3950: done (6 left) 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3951: done (5 left) 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3953: done (4 left) 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3958: read oid 35 snap -1 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3958: expect (ObjNum 1366 snap 440 seq_num 1366) 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3959: delete oid 42 current snap is 440 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: finishing write tid 2 to trial11845692-37 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: finishing write tid 3 to trial11845692-37 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: finishing write tid 4 to trial11845692-37 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: finishing write tid 5 to trial11845692-37 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: oid 37 updating version 0 to 2166 2026-02-17T05:45:25.420 INFO:tasks.rados.rados.0.trial118.stdout:3954: oid 37 updating version 2166 to 2168 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3954: oid 37 version 2168 is already newer than 2165 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3954: oid 37 version 2168 is already newer than 2167 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 37 v 2168 (ObjNum 1370 snap 440 seq_num 1370) dirty exists 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3954: left oid 37 (ObjNum 1370 snap 440 seq_num 1370) 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3955: finishing rollback tid 0 to trial11845692-36 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3955: finishing rollback tid 1 to trial11845692-36 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 36 v 2134 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3956: finishing write tid 1 to trial11845692-45 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3956: finishing write tid 2 to trial11845692-45 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3957: finishing copy_from to trial11845692-6 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3957: got expected ENOENT (src dne) 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3957: finishing copy_from racing read to trial11845692-6 2026-02-17T05:45:25.421 INFO:tasks.rados.rados.0.trial118.stdout:3956: finishing write tid 3 to trial11845692-45 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: finishing write tid 4 to trial11845692-45 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: finishing write tid 5 to trial11845692-45 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: oid 45 updating version 0 to 2136 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: oid 45 updating version 2136 to 2138 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: oid 45 version 2138 is already newer than 2135 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: oid 45 version 2138 is already newer than 2137 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 45 v 2138 (ObjNum 1371 snap 440 seq_num 1371) dirty exists 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: left oid 45 (ObjNum 1371 snap 440 seq_num 1371) 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3954: done (5 left) 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3955: done (4 left) 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3956: done (3 left) 2026-02-17T05:45:25.422 INFO:tasks.rados.rados.0.trial118.stdout:3957: done (2 left) 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:3959: done (1 left) 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:3960: read oid 16 snap -1 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:3960: expect (ObjNum 1348 snap 434 seq_num 1348) 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:3961: rollback oid 33 current snap is 440 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 33 to 439 2026-02-17T05:45:25.423 INFO:tasks.rados.rados.0.trial118.stdout:3962: snap_remove snap 412 2026-02-17T05:45:26.385 INFO:tasks.rados.rados.0.trial118.stdout:3962: done (3 left) 2026-02-17T05:45:26.385 INFO:tasks.rados.rados.0.trial118.stdout:3963: snap_create 2026-02-17T05:45:26.385 INFO:tasks.rados.rados.0.trial118.stdout:3961: finishing rollback tid 1 to trial11845692-33 2026-02-17T05:45:26.385 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 33 v 2376 (ObjNum 33 snap 0 seq_num 4560176) dirty dne 2026-02-17T05:45:26.385 INFO:tasks.rados.rados.0.trial118.stdout:3958: expect (ObjNum 1366 snap 440 seq_num 1366) 2026-02-17T05:45:26.436 INFO:tasks.rados.rados.0.trial118.stdout:3960: expect (ObjNum 1348 snap 434 seq_num 1348) 2026-02-17T05:45:26.489 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3958: done (3 left) 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3960: done (2 left) 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3961: done (1 left) 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3963: done (0 left) 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3964: rollback oid 32 current snap is 441 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 32 to 408 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3965: copy_from oid 18 from oid 9 current snap is 441 2026-02-17T05:45:27.386 INFO:tasks.rados.rados.0.trial118.stdout:3966: write oid 21 current snap is 441 2026-02-17T05:45:27.387 INFO:tasks.rados.rados.0.trial118.stdout:3966: seq_num 1373 ranges {676011=660417,1744718=428471,2788122=287889} 2026-02-17T05:45:27.391 INFO:tasks.rados.rados.0.trial118.stdout:3966: writing trial11845692-21 from 676011 to 1336428 tid 1 2026-02-17T05:45:27.394 INFO:tasks.rados.rados.0.trial118.stdout:3966: writing trial11845692-21 from 1744718 to 2173189 tid 2 2026-02-17T05:45:27.397 INFO:tasks.rados.rados.0.trial118.stdout:3966: writing trial11845692-21 from 2788122 to 3076011 tid 3 2026-02-17T05:45:27.397 INFO:tasks.rados.rados.0.trial118.stdout:3967: write oid 10 current snap is 441 2026-02-17T05:45:27.397 INFO:tasks.rados.rados.0.trial118.stdout:3967: seq_num 1374 ranges {692818=735666,2203200=688482} 2026-02-17T05:45:27.402 INFO:tasks.rados.rados.0.trial118.stdout:3967: writing trial11845692-10 from 692818 to 1428484 tid 1 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3967: writing trial11845692-10 from 2203200 to 2891682 tid 2 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3968: read oid 48 snap 394 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3968: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3969: rollback oid 50 current snap is 441 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 50 to 424 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3965: finishing copy_from to trial11845692-18 2026-02-17T05:45:27.408 INFO:tasks.rados.rados.0.trial118.stdout:3965: got expected ENOENT (src dne) 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3965: finishing copy_from racing read to trial11845692-18 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3964: finishing rollback tid 0 to trial11845692-32 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3964: finishing rollback tid 1 to trial11845692-32 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3964: finishing rollback tid 2 to trial11845692-32 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 32 v 1906 (ObjNum 1263 snap 394 seq_num 1263) dirty exists 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3966: finishing write tid 1 to trial11845692-21 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3966: finishing write tid 2 to trial11845692-21 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3964: done (5 left) 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3965: done (4 left) 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3970: write (excl) oid 35 current snap is 441 2026-02-17T05:45:27.409 INFO:tasks.rados.rados.0.trial118.stdout:3970: seq_num 1375 ranges {709625=410915,1745329=432140,2726615=383010} 2026-02-17T05:45:27.412 INFO:tasks.rados.rados.0.trial118.stdout:3970: writing trial11845692-35 from 709625 to 1120540 tid 1 2026-02-17T05:45:27.416 INFO:tasks.rados.rados.0.trial118.stdout:3970: writing trial11845692-35 from 1745329 to 2177469 tid 2 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3970: writing trial11845692-35 from 2726615 to 3109625 tid 3 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3971: rollback oid 6 current snap is 441 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 6 to 427 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: finishing write tid 3 to trial11845692-21 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: finishing write tid 4 to trial11845692-21 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: finishing write tid 5 to trial11845692-21 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: oid 21 updating version 0 to 2574 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: oid 21 updating version 2574 to 2575 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: oid 21 version 2575 is already newer than 2572 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: oid 21 version 2575 is already newer than 2573 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2575 (ObjNum 1373 snap 441 seq_num 1373) dirty exists 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3966: left oid 21 (ObjNum 1373 snap 441 seq_num 1373) 2026-02-17T05:45:27.420 INFO:tasks.rados.rados.0.trial118.stdout:3967: finishing write tid 1 to trial11845692-10 2026-02-17T05:45:27.421 INFO:tasks.rados.rados.0.trial118.stdout:3966: done (5 left) 2026-02-17T05:45:27.421 INFO:tasks.rados.rados.0.trial118.stdout:3972: write oid 21 current snap is 441 2026-02-17T05:45:27.421 INFO:tasks.rados.rados.0.trial118.stdout:3972: seq_num 1376 ranges {726432=486164,1803811=692151} 2026-02-17T05:45:27.424 INFO:tasks.rados.rados.0.trial118.stdout:3972: writing trial11845692-21 from 726432 to 1212596 tid 1 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3972: writing trial11845692-21 from 1803811 to 2495962 tid 2 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3973: read oid 46 snap -1 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3973: expect deleted 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3974: read oid 27 snap -1 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3974: expect deleted 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3975: read oid 11 snap -1 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3975: expect (ObjNum 1368 snap 440 seq_num 1368) 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3976: write oid 30 current snap is 441 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3967: finishing write tid 2 to trial11845692-10 2026-02-17T05:45:27.430 INFO:tasks.rados.rados.0.trial118.stdout:3967: finishing write tid 3 to trial11845692-10 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3967: finishing write tid 4 to trial11845692-10 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3967: oid 10 updating version 0 to 1909 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3967: oid 10 version 1909 is already newer than 1908 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3967: oid 10 version 1909 is already newer than 1907 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1909 (ObjNum 1374 snap 441 seq_num 1374) dirty exists 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3967: left oid 10 (ObjNum 1374 snap 441 seq_num 1374) 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3969: finishing rollback tid 0 to trial11845692-50 2026-02-17T05:45:27.431 INFO:tasks.rados.rados.0.trial118.stdout:3976: seq_num 1377 ranges {743239=677766,1978646=435809,2897814=245425} 2026-02-17T05:45:27.435 INFO:tasks.rados.rados.0.trial118.stdout:3976: writing trial11845692-30 from 743239 to 1421005 tid 1 2026-02-17T05:45:27.439 INFO:tasks.rados.rados.0.trial118.stdout:3976: writing trial11845692-30 from 1978646 to 2414455 tid 2 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3976: writing trial11845692-30 from 2897814 to 3143239 tid 3 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3967: done (9 left) 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3977: copy_from oid 44 from oid 5 current snap is 441 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3969: finishing rollback tid 1 to trial11845692-50 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3969: finishing rollback tid 2 to trial11845692-50 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 50 v 2162 (ObjNum 1169 snap 365 seq_num 1169) dirty exists 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:3968: expect (ObjNum 1161 snap 363 seq_num 1161) 2026-02-17T05:45:27.442 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 356967 2026-02-17T05:45:27.513 INFO:tasks.rados.rados.0.trial118.stdout:3970: finishing write tid 1 to trial11845692-35 2026-02-17T05:45:27.513 INFO:tasks.rados.rados.0.trial118.stdout:3970: finishing write tid 2 to trial11845692-35 2026-02-17T05:45:27.513 INFO:tasks.rados.rados.0.trial118.stdout:3968: done (9 left) 2026-02-17T05:45:27.513 INFO:tasks.rados.rados.0.trial118.stdout:3969: done (8 left) 2026-02-17T05:45:27.513 INFO:tasks.rados.rados.0.trial118.stdout:3978: snap_create 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: finishing write tid 3 to trial11845692-35 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: finishing write tid 4 to trial11845692-35 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: finishing write tid 5 to trial11845692-35 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: oid 35 updating version 0 to 1765 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: oid 35 version 1765 is already newer than 1764 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: oid 35 updating version 1765 to 1767 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: oid 35 version 1767 is already newer than 1766 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1767 (ObjNum 1375 snap 441 seq_num 1375) dirty exists 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3970: left oid 35 (ObjNum 1375 snap 441 seq_num 1375) 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3971: finishing rollback tid 0 to trial11845692-6 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3971: finishing rollback tid 1 to trial11845692-6 2026-02-17T05:45:27.514 INFO:tasks.rados.rados.0.trial118.stdout:3971: finishing rollback tid 2 to trial11845692-6 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 6 v 1744 (ObjNum 1339 snap 423 seq_num 1339) dirty exists 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: finishing write tid 1 to trial11845692-21 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: finishing write tid 2 to trial11845692-21 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: finishing write tid 3 to trial11845692-21 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: finishing write tid 4 to trial11845692-21 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: oid 21 updating version 0 to 2578 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: oid 21 version 2578 is already newer than 2577 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: oid 21 version 2578 is already newer than 2576 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2578 (ObjNum 1376 snap 441 seq_num 1376) dirty exists 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3972: left oid 21 (ObjNum 1376 snap 441 seq_num 1376) 2026-02-17T05:45:27.515 INFO:tasks.rados.rados.0.trial118.stdout:3975: expect (ObjNum 1368 snap 440 seq_num 1368) 2026-02-17T05:45:27.516 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 622499 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: finishing write tid 1 to trial11845692-30 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: finishing write tid 2 to trial11845692-30 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3977: finishing copy_from to trial11845692-44 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3977: got expected ENOENT (src dne) 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3977: finishing copy_from racing read to trial11845692-44 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: finishing write tid 3 to trial11845692-30 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: finishing write tid 4 to trial11845692-30 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: finishing write tid 5 to trial11845692-30 2026-02-17T05:45:27.600 INFO:tasks.rados.rados.0.trial118.stdout:3976: oid 30 updating version 0 to 2582 2026-02-17T05:45:27.601 INFO:tasks.rados.rados.0.trial118.stdout:3976: oid 30 updating version 2582 to 2583 2026-02-17T05:45:27.601 INFO:tasks.rados.rados.0.trial118.stdout:3976: oid 30 version 2583 is already newer than 2580 2026-02-17T05:45:27.601 INFO:tasks.rados.rados.0.trial118.stdout:3976: oid 30 version 2583 is already newer than 2581 2026-02-17T05:45:27.601 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 30 v 2583 (ObjNum 1377 snap 441 seq_num 1377) dirty exists 2026-02-17T05:45:27.601 INFO:tasks.rados.rados.0.trial118.stdout:3976: left oid 30 (ObjNum 1377 snap 441 seq_num 1377) 2026-02-17T05:45:28.390 INFO:tasks.rados.rados.0.trial118.stdout:3970: done (8 left) 2026-02-17T05:45:28.390 INFO:tasks.rados.rados.0.trial118.stdout:3971: done (7 left) 2026-02-17T05:45:28.390 INFO:tasks.rados.rados.0.trial118.stdout:3972: done (6 left) 2026-02-17T05:45:28.390 INFO:tasks.rados.rados.0.trial118.stdout:3973: done (5 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3974: done (4 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3975: done (3 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3976: done (2 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3977: done (1 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3978: done (0 left) 2026-02-17T05:45:28.391 INFO:tasks.rados.rados.0.trial118.stdout:3979: write oid 28 current snap is 442 2026-02-17T05:45:28.392 INFO:tasks.rados.rados.0.trial118.stdout:3979: seq_num 1378 ranges {760046=753015,2037128=695820} 2026-02-17T05:45:28.395 INFO:tasks.rados.rados.0.trial118.stdout:3979: writing trial11845692-28 from 760046 to 1513061 tid 1 2026-02-17T05:45:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3979: writing trial11845692-28 from 2037128 to 2732948 tid 2 2026-02-17T05:45:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3980: delete oid 6 current snap is 442 2026-02-17T05:45:28.400 INFO:tasks.rados.rados.0.trial118.stdout:3979: finishing write tid 1 to trial11845692-28 2026-02-17T05:45:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3979: finishing write tid 2 to trial11845692-28 2026-02-17T05:45:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3979: finishing write tid 3 to trial11845692-28 2026-02-17T05:45:28.402 INFO:tasks.rados.rados.0.trial118.stdout:3979: finishing write tid 4 to trial11845692-28 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3979: oid 28 updating version 0 to 2250 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3979: oid 28 version 2250 is already newer than 2249 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3979: oid 28 version 2250 is already newer than 2248 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2250 (ObjNum 1378 snap 442 seq_num 1378) dirty exists 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3979: left oid 28 (ObjNum 1378 snap 442 seq_num 1378) 2026-02-17T05:45:28.403 INFO:tasks.rados.rados.0.trial118.stdout:3979: done (1 left) 2026-02-17T05:45:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3980: done (0 left) 2026-02-17T05:45:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3981: write (excl) oid 35 current snap is 442 2026-02-17T05:45:28.404 INFO:tasks.rados.rados.0.trial118.stdout:3981: seq_num 1380 ranges {793660=503513,2037739=583136} 2026-02-17T05:45:28.407 INFO:tasks.rados.rados.0.trial118.stdout:3981: writing trial11845692-35 from 793660 to 1297173 tid 1 2026-02-17T05:45:28.412 INFO:tasks.rados.rados.0.trial118.stdout:3981: writing trial11845692-35 from 2037739 to 2620875 tid 2 2026-02-17T05:45:28.412 INFO:tasks.rados.rados.0.trial118.stdout:3982: snap_create 2026-02-17T05:45:28.412 INFO:tasks.rados.rados.0.trial118.stdout:3981: finishing write tid 1 to trial11845692-35 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: finishing write tid 2 to trial11845692-35 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: finishing write tid 3 to trial11845692-35 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: finishing write tid 4 to trial11845692-35 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: oid 35 updating version 0 to 1770 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: oid 35 version 1770 is already newer than 1769 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: oid 35 version 1770 is already newer than 1768 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 35 v 1770 (ObjNum 1380 snap 442 seq_num 1380) dirty exists 2026-02-17T05:45:28.414 INFO:tasks.rados.rados.0.trial118.stdout:3981: left oid 35 (ObjNum 1380 snap 442 seq_num 1380) 2026-02-17T05:45:29.391 INFO:tasks.rados.rados.0.trial118.stdout:3981: done (1 left) 2026-02-17T05:45:29.391 INFO:tasks.rados.rados.0.trial118.stdout:3982: done (0 left) 2026-02-17T05:45:29.391 INFO:tasks.rados.rados.0.trial118.stdout:3983: read oid 5 snap 417 2026-02-17T05:45:29.391 INFO:tasks.rados.rados.0.trial118.stdout:3983: expect deleted 2026-02-17T05:45:29.391 INFO:tasks.rados.rados.0.trial118.stdout:3984: snap_remove snap 384 2026-02-17T05:45:30.381 INFO:tasks.rados.rados.0.trial118.stdout:3984: done (1 left) 2026-02-17T05:45:30.381 INFO:tasks.rados.rados.0.trial118.stdout:3985: snap_remove snap 394 2026-02-17T05:45:31.382 INFO:tasks.rados.rados.0.trial118.stdout:3985: done (1 left) 2026-02-17T05:45:31.382 INFO:tasks.rados.rados.0.trial118.stdout:3986: write oid 31 current snap is 443 2026-02-17T05:45:31.383 INFO:tasks.rados.rados.0.trial118.stdout:3986: seq_num 1381 ranges {410467=578762,1696221=443147,2891153=319314} 2026-02-17T05:45:31.387 INFO:tasks.rados.rados.0.trial118.stdout:3986: writing trial11845692-31 from 410467 to 989229 tid 1 2026-02-17T05:45:31.391 INFO:tasks.rados.rados.0.trial118.stdout:3986: writing trial11845692-31 from 1696221 to 2139368 tid 2 2026-02-17T05:45:31.396 INFO:tasks.rados.rados.0.trial118.stdout:3986: writing trial11845692-31 from 2891153 to 3210467 tid 3 2026-02-17T05:45:31.396 INFO:tasks.rados.rados.0.trial118.stdout:3987: write oid 10 current snap is 443 2026-02-17T05:45:31.396 INFO:tasks.rados.rados.0.trial118.stdout:3987: seq_num 1382 ranges {427274=654011,1754703=586805,2918576=308698} 2026-02-17T05:45:31.400 INFO:tasks.rados.rados.0.trial118.stdout:3987: writing trial11845692-10 from 427274 to 1081285 tid 1 2026-02-17T05:45:31.404 INFO:tasks.rados.rados.0.trial118.stdout:3987: writing trial11845692-10 from 1754703 to 2341508 tid 2 2026-02-17T05:45:31.408 INFO:tasks.rados.rados.0.trial118.stdout:3987: writing trial11845692-10 from 2918576 to 3227274 tid 3 2026-02-17T05:45:31.408 INFO:tasks.rados.rados.0.trial118.stdout:3988: write oid 9 current snap is 443 2026-02-17T05:45:31.408 INFO:tasks.rados.rados.0.trial118.stdout:3988: seq_num 1383 ranges {444081=729260,1813185=446816,2945999=298082} 2026-02-17T05:45:31.412 INFO:tasks.rados.rados.0.trial118.stdout:3988: writing trial11845692-9 from 444081 to 1173341 tid 1 2026-02-17T05:45:31.416 INFO:tasks.rados.rados.0.trial118.stdout:3988: writing trial11845692-9 from 1813185 to 2260001 tid 2 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3988: writing trial11845692-9 from 2945999 to 3244081 tid 3 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3989: delete oid 18 current snap is 443 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: finishing write tid 1 to trial11845692-31 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: finishing write tid 2 to trial11845692-31 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: finishing write tid 3 to trial11845692-31 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: finishing write tid 4 to trial11845692-31 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: finishing write tid 5 to trial11845692-31 2026-02-17T05:45:31.421 INFO:tasks.rados.rados.0.trial118.stdout:3986: oid 31 updating version 0 to 2611 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3986: oid 31 updating version 2611 to 2613 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3986: oid 31 version 2613 is already newer than 2612 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3986: oid 31 version 2613 is already newer than 2610 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 31 v 2613 (ObjNum 1381 snap 443 seq_num 1381) dirty exists 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3986: left oid 31 (ObjNum 1381 snap 443 seq_num 1381) 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: finishing write tid 1 to trial11845692-10 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: finishing write tid 2 to trial11845692-10 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: finishing write tid 3 to trial11845692-10 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: finishing write tid 4 to trial11845692-10 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: finishing write tid 5 to trial11845692-10 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: oid 10 updating version 0 to 1910 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: oid 10 updating version 1910 to 1912 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: oid 10 version 1912 is already newer than 1911 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: oid 10 updating version 1912 to 1913 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 10 v 1913 (ObjNum 1382 snap 443 seq_num 1382) dirty exists 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3987: left oid 10 (ObjNum 1382 snap 443 seq_num 1382) 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3988: finishing write tid 1 to trial11845692-9 2026-02-17T05:45:31.422 INFO:tasks.rados.rados.0.trial118.stdout:3988: finishing write tid 2 to trial11845692-9 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3983: done (4 left) 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3986: done (3 left) 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3987: done (2 left) 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3989: done (1 left) 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3990: rollback oid 28 current snap is 443 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:rollback oid 28 to 392 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3988: finishing write tid 3 to trial11845692-9 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3991: snap_create 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3988: finishing write tid 4 to trial11845692-9 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3988: finishing write tid 5 to trial11845692-9 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3988: oid 9 updating version 0 to 2565 2026-02-17T05:45:31.423 INFO:tasks.rados.rados.0.trial118.stdout:3988: oid 9 updating version 2565 to 2568 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3988: oid 9 version 2568 is already newer than 2566 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3988: oid 9 version 2568 is already newer than 2567 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 9 v 2568 (ObjNum 1383 snap 443 seq_num 1383) dirty exists 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3988: left oid 9 (ObjNum 1383 snap 443 seq_num 1383) 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3990: finishing rollback tid 0 to trial11845692-28 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3990: finishing rollback tid 1 to trial11845692-28 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:3990: finishing rollback tid 2 to trial11845692-28 2026-02-17T05:45:31.424 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 28 v 2254 (ObjNum 1207 snap 380 seq_num 1207) dirty exists 2026-02-17T05:45:32.396 INFO:tasks.rados.rados.0.trial118.stdout:3988: done (2 left) 2026-02-17T05:45:32.396 INFO:tasks.rados.rados.0.trial118.stdout:3990: done (1 left) 2026-02-17T05:45:32.396 INFO:tasks.rados.rados.0.trial118.stdout:3991: done (0 left) 2026-02-17T05:45:32.396 INFO:tasks.rados.rados.0.trial118.stdout:3992: delete oid 10 current snap is 444 2026-02-17T05:45:32.400 INFO:tasks.rados.rados.0.trial118.stdout:3992: done (0 left) 2026-02-17T05:45:32.400 INFO:tasks.rados.rados.0.trial118.stdout:3993: copy_from oid 21 from oid 29 current snap is 444 2026-02-17T05:45:32.400 INFO:tasks.rados.rados.0.trial118.stdout:3994: read oid 24 snap -1 2026-02-17T05:45:32.400 INFO:tasks.rados.rados.0.trial118.stdout:3994: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:45:32.400 INFO:tasks.rados.rados.0.trial118.stdout:3995: write (excl) oid 17 current snap is 444 2026-02-17T05:45:32.401 INFO:tasks.rados.rados.0.trial118.stdout:3995: seq_num 1386 ranges {494502=671360,1588631=594143,2628268=477951} 2026-02-17T05:45:32.404 INFO:tasks.rados.rados.0.trial118.stdout:3995: writing trial11845692-17 from 494502 to 1165862 tid 1 2026-02-17T05:45:32.408 INFO:tasks.rados.rados.0.trial118.stdout:3995: writing trial11845692-17 from 1588631 to 2182774 tid 2 2026-02-17T05:45:32.412 INFO:tasks.rados.rados.0.trial118.stdout:3995: writing trial11845692-17 from 2628268 to 3106219 tid 3 2026-02-17T05:45:32.412 INFO:tasks.rados.rados.0.trial118.stdout:3996: delete oid 13 current snap is 444 2026-02-17T05:45:32.412 INFO:tasks.rados.rados.0.trial118.stdout:3994: expect (ObjNum 1290 snap 405 seq_num 1290) 2026-02-17T05:45:32.412 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:32.483 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:32.521 INFO:tasks.rados.rados.0.trial118.stdout:3995: finishing write tid 1 to trial11845692-17 2026-02-17T05:45:32.521 INFO:tasks.rados.rados.0.trial118.stdout:3995: finishing write tid 2 to trial11845692-17 2026-02-17T05:45:32.521 INFO:tasks.rados.rados.0.trial118.stdout:3993: finishing copy_from racing read to trial11845692-21 2026-02-17T05:45:32.521 INFO:tasks.rados.rados.0.trial118.stdout:3993: finishing copy_from to trial11845692-21 2026-02-17T05:45:32.521 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 21 v 2496 (ObjNum 1355 snap 437 seq_num 1355) dirty exists 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: finishing write tid 3 to trial11845692-17 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: finishing write tid 4 to trial11845692-17 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: finishing write tid 5 to trial11845692-17 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: oid 17 updating version 0 to 1521 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: oid 17 version 1521 is already newer than 1519 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: oid 17 version 1521 is already newer than 1520 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:3995: oid 17 updating version 1521 to 1522 2026-02-17T05:45:32.522 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 17 v 1522 (ObjNum 1386 snap 444 seq_num 1386) dirty exists 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3995: left oid 17 (ObjNum 1386 snap 444 seq_num 1386) 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3993: done (3 left) 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3994: done (2 left) 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3995: done (1 left) 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3996: done (0 left) 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3997: read oid 9 snap -1 2026-02-17T05:45:32.523 INFO:tasks.rados.rados.0.trial118.stdout:3997: expect (ObjNum 1383 snap 443 seq_num 1383) 2026-02-17T05:45:32.524 INFO:tasks.rados.rados.0.trial118.stdout:3998: copy_from oid 3 from oid 39 current snap is 444 2026-02-17T05:45:32.524 INFO:tasks.rados.rados.0.trial118.stdout:3999: write (excl) oid 40 current snap is 444 2026-02-17T05:45:32.524 INFO:tasks.rados.rados.0.trial118.stdout:3999: seq_num 1388 ranges {528116=421858,1589242=597812,2966761=361355} 2026-02-17T05:45:32.525 INFO:tasks.rados.rados.0.trial118.stdout:3999: writing trial11845692-40 from 528116 to 949974 tid 1 2026-02-17T05:45:32.528 INFO:tasks.rados.rados.0.trial118.stdout:3999: writing trial11845692-40 from 1589242 to 2187054 tid 2 2026-02-17T05:45:32.533 INFO:tasks.rados.rados.0.trial118.stdout:3999: writing trial11845692-40 from 2966761 to 3328116 tid 3 2026-02-17T05:45:32.533 INFO:tasks.rados.rados.0.trial118.stdout: waiting on 3 2026-02-17T05:45:32.533 INFO:tasks.rados.rados.0.trial118.stdout:3998: finishing copy_from to trial11845692-3 2026-02-17T05:45:32.534 INFO:tasks.rados.rados.0.trial118.stdout:3998: got expected ENOENT (src dne) 2026-02-17T05:45:32.534 INFO:tasks.rados.rados.0.trial118.stdout:3998: finishing copy_from racing read to trial11845692-3 2026-02-17T05:45:32.534 INFO:tasks.rados.rados.0.trial118.stdout:3997: expect (ObjNum 1383 snap 443 seq_num 1383) 2026-02-17T05:45:32.552 INFO:tasks.rados.rados.0.trial118.stdout:seeking to 0 2026-02-17T05:45:32.587 INFO:tasks.rados.rados.0.trial118.stdout:3999: finishing write tid 1 to trial11845692-40 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: finishing write tid 2 to trial11845692-40 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: finishing write tid 3 to trial11845692-40 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: finishing write tid 4 to trial11845692-40 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: finishing write tid 5 to trial11845692-40 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: oid 40 updating version 0 to 2610 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: oid 40 version 2610 is already newer than 2608 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: oid 40 version 2610 is already newer than 2607 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: oid 40 version 2610 is already newer than 2609 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:update_object_version oid 40 v 2610 (ObjNum 1388 snap 444 seq_num 1388) dirty exists 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3999: left oid 40 (ObjNum 1388 snap 444 seq_num 1388) 2026-02-17T05:45:32.588 INFO:tasks.rados.rados.0.trial118.stdout:3997: done (2 left) 2026-02-17T05:45:32.589 INFO:tasks.rados.rados.0.trial118.stdout:3998: done (1 left) 2026-02-17T05:45:32.589 INFO:tasks.rados.rados.0.trial118.stdout:3999: done (0 left) 2026-02-17T05:45:32.589 INFO:tasks.rados.rados.0.trial118.stderr:0 errors. 2026-02-17T05:45:32.589 INFO:tasks.rados.rados.0.trial118.stderr: 2026-02-17T05:45:32.766 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:32.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.831+0000 7fbd6bf0c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:32.840 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.831+0000 7fbd6bf0c640 10 monclient: build_initial_monmap 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.831+0000 7fbd6bf0c640 10 monclient: monmap: 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:32.833373+0000 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:32.833373+0000 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:32.841 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 1 Processor -- start 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 1 -- start start 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient: init 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbd6405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-b con 0x7fbd6405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbd64182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6408b060 con 0x7fbd64182720 2026-02-17T05:45:32.842 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6405dc90 con 0x7fbd6405d1b0 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6408d6a0 con 0x7fbd6405dee0 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6bf0c640 10 monclient(hunting): authenticate will time out at 1661.461730s 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd6a482640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fbd64182720 legacy=0x7fbd641a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd69480640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbd6405dee0 0x7fbd64181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36342/0 (socket says 10.20.193.106:36342) 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd69480640 1 -- 10.20.193.106:0/48535802 learned_addr learned my addr 10.20.193.106:0/48535802 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.832+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098082718 0 0) 0x7fbd6408d6a0 con 0x7fbd6405dee0 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient(hunting): _negotiate 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:32.843 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient(hunting): my global_id is 5399 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd4c0035e0 con 0x7fbd6405dee0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3255119237 0 0) 0x7fbd4c0035e0 con 0x7fbd6405dee0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 >> v1:10.20.193.118:6789/0 conn(0x7fbd6405d1b0 legacy=0x7fbd6405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 >> v1:10.20.193.106:6789/0 conn(0x7fbd64182720 legacy=0x7fbd641a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: _finish_hunting 0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 monclient: found mon.noname-b 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd64057960 con 0x7fbd6405dee0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: _finish_auth 0 2026-02-17T05:45:32.844 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: _check_auth_tickets 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 5 monclient: authenticate success, global_id 5399 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd58002dd0 con 0x7fbd6405dee0 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: dump: 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.845 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd58003090 con 0x7fbd6405dee0 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 1 -- 10.20.193.106:0/48535802 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd580034a0 con 0x7fbd6405dee0 2026-02-17T05:45:32.846 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 4 set_mon_vals no callback set 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd68c7f640 10 monclient: dump: 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:32.847 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 10 monclient: shutdown 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/48535802 >> v1:10.20.193.106:6790/0 conn(0x7fbd6405dee0 legacy=0x7fbd64181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/48535802 shutdown_connections 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/48535802 >> 10.20.193.106:0/48535802 conn(0x7fbd640915f0 msgr2=0x7fbd640919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/48535802 shutdown_connections 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/48535802 wait complete. 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 10 monclient: build_initial_monmap 2026-02-17T05:45:32.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.833+0000 7fbd6bf0c640 10 monclient: monmap: 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:32.849 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:32.850 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:32.850 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:32.850 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 Processor -- start 2026-02-17T05:45:32.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- start start 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: init 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-b con 0x7fbd6405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbd6405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbd64182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:32.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd64089b20 con 0x7fbd6405dee0 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6410e910 con 0x7fbd6405d1b0 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6410eed0 con 0x7fbd64182720 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient(hunting): authenticate will time out at 1661.463386s 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd69480640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fbd6405dee0 legacy=0x7fbd6412a780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6a482640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fbd64182720 0x7fbd64181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36344/0 (socket says 10.20.193.106:36344) 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6a482640 1 -- 10.20.193.106:0/1319321189 learned_addr learned my addr 10.20.193.106:0/1319321189 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209331826 0 0) 0x7fbd6410eed0 con 0x7fbd64182720 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:32.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): my global_id is 5402 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd340035e0 con 0x7fbd64182720 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1970399153 0 0) 0x7fbd340035e0 con 0x7fbd64182720 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd6410eed0 con 0x7fbd64182720 2026-02-17T05:45:32.853 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd600051c0 con 0x7fbd64182720 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): dump: 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:32.854 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3067756475 0 0) 0x7fbd6410eed0 con 0x7fbd64182720 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 >> v1:10.20.193.118:6789/0 conn(0x7fbd6405d1b0 legacy=0x7fbd6412a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 >> v1:10.20.193.106:6789/0 conn(0x7fbd6405dee0 legacy=0x7fbd6412a780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient: _finish_hunting 0 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 monclient: found mon.c 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.855 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6412ae90 con 0x7fbd64182720 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient: _finish_auth 0 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 10 monclient: _check_auth_tickets 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 5 monclient: authenticate success, global_id 5402 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _renew_subs 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6408a140 con 0x7fbd64182720 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _renew_subs 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.834+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd641824f0 con 0x7fbd64182720 2026-02-17T05:45:32.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd60005400 con 0x7fbd64182720 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fbd600057e0 con 0x7fbd64182720 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd53fff640 4 set_mon_vals no callback set 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 10 monclient: dump: 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:32.857 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd6bf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd6bf0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd6bf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6410e2a0 con 0x7fbd64182720 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fbd60005940 con 0x7fbd64182720 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(884..884 src has 597..884) ==== 3947+0+0 (unknown 1843063814 0 0) 0x7fbd60050d90 con 0x7fbd64182720 2026-02-17T05:45:32.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.835+0000 7fbd69c81640 10 monclient: get_auth_request con 0x7fbd340405a0 auth_method 0 2026-02-17T05:45:32.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.838+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fbd600183f0 con 0x7fbd64182720 2026-02-17T05:45:32.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.838+0000 7fbd527fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:32.859 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.838+0000 7fbd527fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:32.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.942+0000 7fbd6bf0c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:45:32.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.942+0000 7fbd6bf0c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.942+0000 7fbd6bf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.942+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd6410eac0 con 0x7fbd64182720 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.943+0000 7fbd527fc640 1 -- 10.20.193.106:0/1319321189 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v884) ==== 74+0+12895 (unknown 3396660661 0 3409558165) 0x7fbd6410eac0 con 0x7fbd64182720 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.943+0000 7fbd527fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.943+0000 7fbd527fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:45:32.946 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":884,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:45:32.392818+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T05:28:04.479659+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2026-02-17T05:28:32.023362+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"884","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":452,"snap_epoch":884,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":392,"length":1},{"begin":403,"length":1},{"begin":421,"length":1},{"begin":432,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:32.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 >> v1:10.20.193.118:6812/703720803 conn(0x7fbd340405a0 legacy=0x7fbd34060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:32.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 10 monclient: shutdown 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 >> v1:10.20.193.106:6790/0 conn(0x7fbd64182720 legacy=0x7fbd64181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 shutdown_connections 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 >> 10.20.193.106:0/1319321189 conn(0x7fbd640915f0 msgr2=0x7fbd6408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 shutdown_connections 2026-02-17T05:45:32.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:32.944+0000 7fbd6bf0c640 1 -- 10.20.193.106:0/1319321189 wait complete. 2026-02-17T05:45:32.954 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:45:33.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: get_monmap_and_config 2026-02-17T05:45:33.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: build_initial_monmap 2026-02-17T05:45:33.028 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: monmap: 2026-02-17T05:45:33.028 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:33.028 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.028 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:33.020564+0000 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:33.020564+0000 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:33.029 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 1 Processor -- start 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 1 -- start start 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: init 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:33.030 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f91b805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f91b805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f91b8182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b808b060 con 0x7f91b8182720 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b805dc90 con 0x7f91b805dee0 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b808d6a0 con 0x7f91b805d1b0 2026-02-17T05:45:33.031 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bfb0c640 10 monclient(hunting): authenticate will time out at 1661.648919s 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91be082640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f91b8182720 legacy=0x7f91b81a2b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.019+0000 7f91bd881640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f91b805d1b0 0x7f91b805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36358/0 (socket says 10.20.193.106:36358) 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bd881640 1 -- 10.20.193.106:0/3547304736 learned_addr learned my addr 10.20.193.106:0/3547304736 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786554635 0 0) 0x7f91b808d6a0 con 0x7f91b805d1b0 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient(hunting): _negotiate 2026-02-17T05:45:33.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient(hunting): my global_id is 5405 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a00035e0 con 0x7f91b805d1b0 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003691937 0 0) 0x7f91a00035e0 con 0x7f91b805d1b0 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 >> v1:10.20.193.118:6789/0 conn(0x7f91b805dee0 legacy=0x7f91b8181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.033 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 >> v1:10.20.193.106:6789/0 conn(0x7f91b8182720 legacy=0x7f91b81a2b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: _finish_hunting 0 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 monclient: found mon.noname-b 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b8057960 con 0x7f91b805d1b0 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: _finish_auth 0 2026-02-17T05:45:33.034 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: _check_auth_tickets 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91a8002dd0 con 0x7f91b805d1b0 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 5 monclient: authenticate success, global_id 5405 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.035 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: dump: 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.036 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.037 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91a8003010 con 0x7f91b805d1b0 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 1 -- 10.20.193.106:0/3547304736 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91a8003420 con 0x7f91b805d1b0 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 4 set_mon_vals no callback set 2026-02-17T05:45:33.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bc87f640 10 monclient: dump: 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.039 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 10 monclient: shutdown 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3547304736 >> v1:10.20.193.106:6790/0 conn(0x7f91b805d1b0 legacy=0x7f91b805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3547304736 shutdown_connections 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3547304736 >> 10.20.193.106:0/3547304736 conn(0x7f91b80915f0 msgr2=0x7f91b80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3547304736 shutdown_connections 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.020+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3547304736 wait complete. 2026-02-17T05:45:33.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient: build_initial_monmap 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient: monmap: 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:33.042 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 1 Processor -- start 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 1 -- start start 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient: init 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f91b805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:33.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f91b805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f91b8182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b810cd70 con 0x7f91b805dee0 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b812c290 con 0x7f91b805d1b0 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b810bf00 con 0x7f91b8182720 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:33.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bfb0c640 10 monclient(hunting): authenticate will time out at 1661.650673s 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91bd080640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7f91b805dee0 legacy=0x7f91b812bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91be082640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f91b8182720 0x7f91b8181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36374/0 (socket says 10.20.193.106:36374) 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91be082640 1 -- 10.20.193.106:0/3148888993 learned_addr learned my addr 10.20.193.106:0/3148888993 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550456680 0 0) 0x7f91b810bf00 con 0x7f91b8182720 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 10 monclient(hunting): _negotiate 2026-02-17T05:45:33.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 10 monclient(hunting): my global_id is 5408 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.021+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91880035e0 con 0x7f91b8182720 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2129366733 0 0) 0x7f91880035e0 con 0x7f91b8182720 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91b810bf00 con 0x7f91b8182720 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91b40051c0 con 0x7f91b8182720 2026-02-17T05:45:33.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient(hunting): dump: 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.048 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.049 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 811507685 0 0) 0x7f91b810bf00 con 0x7f91b8182720 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 >> v1:10.20.193.118:6789/0 conn(0x7f91b805d1b0 legacy=0x7f91b812b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 >> v1:10.20.193.106:6789/0 conn(0x7f91b805dee0 legacy=0x7f91b812bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: _finish_hunting 0 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 monclient: found mon.c 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b810aa10 con 0x7f91b8182720 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: _finish_auth 0 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: _check_auth_tickets 2026-02-17T05:45:33.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 5 monclient: authenticate success, global_id 5408 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _renew_subs 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91b81824f0 con 0x7f91b8182720 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _renew_subs 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f91b810b710 con 0x7f91b8182720 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91b4005400 con 0x7f91b8182720 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f91b40057e0 con 0x7f91b8182720 2026-02-17T05:45:33.051 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 10 monclient: dump: 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a7fff640 4 set_mon_vals no callback set 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b810c960 con 0x7f91b8182720 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.022+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f91b4005940 con 0x7f91b8182720 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.023+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(884..884 src has 597..884) ==== 3947+0+0 (unknown 1843063814 0 0) 0x7f91b4050d90 con 0x7f91b8182720 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.023+0000 7f91bd881640 10 monclient: get_auth_request con 0x7f9188040740 auth_method 0 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.025+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f91b810c960 con 0x7f91b8182720 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.025+0000 7f91a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.025+0000 7f91a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:33.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.127+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91b8057ca0 con 0x7f9188040740 2026-02-17T05:45:33.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.129+0000 7f91a67fc640 1 -- 10.20.193.106:0/3148888993 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78030 (unknown 2965378022 0 2444121044) 0x7f91b8057ca0 con 0x7f9188040740 2026-02-17T05:45:33.132 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:45:33.132 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:45:33.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 >> v1:10.20.193.118:6812/703720803 conn(0x7f9188040740 legacy=0x7f9188060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.133 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 10 monclient: shutdown 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 >> v1:10.20.193.106:6790/0 conn(0x7f91b8182720 legacy=0x7f91b8181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 shutdown_connections 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 >> 10.20.193.106:0/3148888993 conn(0x7f91b80915f0 msgr2=0x7f91b81a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 shutdown_connections 2026-02-17T05:45:33.134 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.130+0000 7f91bfb0c640 1 -- 10.20.193.106:0/3148888993 wait complete. 2026-02-17T05:45:33.139 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1403,"stamp":"2026-02-17T05:45:32.394170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":509024379,"num_objects":235,"num_object_clones":182,"num_object_copies":470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":15,"num_read":7652,"num_read_kb":5779991,"num_write":5801,"num_write_kb":2206933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21850,"ondisk_log_size":21850,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":954852,"kb_used_data":738948,"kb_used_omap":10622,"kb_used_meta":205185,"kb_avail":565276188,"statfs":{"total":579820584960,"available":578842816512,"internally_reserved":0,"allocated":756682752,"data_stored":1030543917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10877428,"internal_metadata":210109964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10525166,"num_objects":6,"num_object_clones":6,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":21389,"num_write":50,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.006345"},"pg_stats":[{"pgid":"3.f","version":"882'2554","reported_seq":6661,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.388808+0000","last_change":"2026-02-17T05:45:30.388908+0000","last_active":"2026-02-17T05:45:30.388808+0000","last_peered":"2026-02-17T05:45:30.388808+0000","last_clean":"2026-02-17T05:45:30.388808+0000","last_became_active":"2026-02-17T05:28:33.078962+0000","last_became_peered":"2026-02-17T05:28:33.078962+0000","last_unstale":"2026-02-17T05:45:30.388808+0000","last_undegraded":"2026-02-17T05:45:30.388808+0000","last_fullsized":"2026-02-17T05:45:30.388808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":2554,"log_dups_size":0,"ondisk_log_size":2554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:22:16.496701+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0081449279999999992,"stat_sum":{"num_bytes":59303794,"num_objects":30,"num_object_clones":24,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":3,"num_read":923,"num_read_kb":763799,"num_write":634,"num_write_kb":236700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"188","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"}]},{"pgid":"3.e","version":"882'2602","reported_seq":6701,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.389144+0000","last_change":"2026-02-17T05:45:30.389234+0000","last_active":"2026-02-17T05:45:30.389144+0000","last_peered":"2026-02-17T05:45:30.389144+0000","last_clean":"2026-02-17T05:45:30.389144+0000","last_became_active":"2026-02-17T05:28:33.079387+0000","last_became_peered":"2026-02-17T05:28:33.079387+0000","last_unstale":"2026-02-17T05:45:30.389144+0000","last_undegraded":"2026-02-17T05:45:30.389144+0000","last_fullsized":"2026-02-17T05:45:30.389144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":2602,"log_dups_size":0,"ondisk_log_size":2602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:50:46.185291+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0083555000000000001,"stat_sum":{"num_bytes":53090957,"num_objects":23,"num_object_clones":18,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":2,"num_read":949,"num_read_kb":754497,"num_write":612,"num_write_kb":268667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"188","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"}]},{"pgid":"3.d","version":"878'2142","reported_seq":6260,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389476+0000","last_change":"2026-02-17T05:45:26.388967+0000","last_active":"2026-02-17T05:45:29.389476+0000","last_peered":"2026-02-17T05:45:29.389476+0000","last_clean":"2026-02-17T05:45:29.389476+0000","last_became_active":"2026-02-17T05:28:33.081001+0000","last_became_peered":"2026-02-17T05:28:33.081001+0000","last_unstale":"2026-02-17T05:45:29.389476+0000","last_undegraded":"2026-02-17T05:45:29.389476+0000","last_fullsized":"2026-02-17T05:45:29.389476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:01.914644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037412729999999998,"stat_sum":{"num_bytes":45483329,"num_objects":20,"num_object_clones":15,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":2,"num_read":759,"num_read_kb":584261,"num_write":569,"num_write_kb":221985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"3.c","version":"882'349","reported_seq":4565,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.385408+0000","last_change":"2026-02-17T05:45:30.385573+0000","last_active":"2026-02-17T05:45:30.385408+0000","last_peered":"2026-02-17T05:45:30.385408+0000","last_clean":"2026-02-17T05:45:30.385408+0000","last_became_active":"2026-02-17T05:28:33.079421+0000","last_became_peered":"2026-02-17T05:28:33.079421+0000","last_unstale":"2026-02-17T05:45:30.385408+0000","last_undegraded":"2026-02-17T05:45:30.385408+0000","last_fullsized":"2026-02-17T05:45:30.385408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:36:58.311197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046999249999999998,"stat_sum":{"num_bytes":13399207,"num_objects":5,"num_object_clones":4,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":72,"num_read_kb":47617,"num_write":94,"num_write_kb":35514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"188","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"}]},{"pgid":"3.b","version":"878'986","reported_seq":5171,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391429+0000","last_change":"2026-02-17T05:45:26.389460+0000","last_active":"2026-02-17T05:45:29.391429+0000","last_peered":"2026-02-17T05:45:29.391429+0000","last_clean":"2026-02-17T05:45:29.391429+0000","last_became_active":"2026-02-17T05:28:33.081784+0000","last_became_peered":"2026-02-17T05:28:33.081784+0000","last_unstale":"2026-02-17T05:45:29.391429+0000","last_undegraded":"2026-02-17T05:45:29.391429+0000","last_fullsized":"2026-02-17T05:45:29.391429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:19:04.820273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002876006,"stat_sum":{"num_bytes":19583041,"num_objects":8,"num_object_clones":6,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":332,"num_read_kb":232654,"num_write":251,"num_write_kb":105478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"3.a","version":"879'1082","reported_seq":5306,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389485+0000","last_change":"2026-02-17T05:45:26.387323+0000","last_active":"2026-02-17T05:45:29.389485+0000","last_peered":"2026-02-17T05:45:29.389485+0000","last_clean":"2026-02-17T05:45:29.389485+0000","last_became_active":"2026-02-17T05:28:33.078391+0000","last_became_peered":"2026-02-17T05:28:33.078391+0000","last_unstale":"2026-02-17T05:45:29.389485+0000","last_undegraded":"2026-02-17T05:45:29.389485+0000","last_fullsized":"2026-02-17T05:45:29.389485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1082,"log_dups_size":0,"ondisk_log_size":1082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:05:02.840792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020597879999999999,"stat_sum":{"num_bytes":25070261,"num_objects":13,"num_object_clones":10,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":452,"num_read_kb":402386,"num_write":259,"num_write_kb":108539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":4172,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.699472+0000","last_change":"2026-02-17T05:45:26.387415+0000","last_active":"2026-02-17T05:45:28.699472+0000","last_peered":"2026-02-17T05:45:28.699472+0000","last_clean":"2026-02-17T05:45:28.699472+0000","last_became_active":"2026-02-17T05:28:33.080628+0000","last_became_peered":"2026-02-17T05:28:33.080628+0000","last_unstale":"2026-02-17T05:45:28.699472+0000","last_undegraded":"2026-02-17T05:45:28.699472+0000","last_fullsized":"2026-02-17T05:45:28.699472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:31:49.629595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032474400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"3.8","version":"874'905","reported_seq":5097,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.400540+0000","last_change":"2026-02-17T05:45:26.386491+0000","last_active":"2026-02-17T05:45:28.400540+0000","last_peered":"2026-02-17T05:45:28.400540+0000","last_clean":"2026-02-17T05:45:28.400540+0000","last_became_active":"2026-02-17T05:28:33.081843+0000","last_became_peered":"2026-02-17T05:28:33.081843+0000","last_unstale":"2026-02-17T05:45:28.400540+0000","last_undegraded":"2026-02-17T05:45:28.400540+0000","last_fullsized":"2026-02-17T05:45:28.400540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":905,"log_dups_size":0,"ondisk_log_size":905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:00:35.930042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000330293,"stat_sum":{"num_bytes":15792224,"num_objects":8,"num_object_clones":6,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":288,"num_read_kb":205757,"num_write":261,"num_write_kb":93955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":1870,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389377+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:45:29.389377+0000","last_peered":"2026-02-17T05:45:29.389377+0000","last_clean":"2026-02-17T05:45:29.389377+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:45:29.389377+0000","last_undegraded":"2026-02-17T05:45:29.389377+0000","last_fullsized":"2026-02-17T05:45:29.389377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1731,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.380618+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:45:30.380618+0000","last_peered":"2026-02-17T05:45:30.380618+0000","last_clean":"2026-02-17T05:45:30.380618+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:45:30.380618+0000","last_undegraded":"2026-02-17T05:45:30.380618+0000","last_fullsized":"2026-02-17T05:45:30.380618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"878'1293","reported_seq":5497,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391432+0000","last_change":"2026-02-17T05:45:26.388422+0000","last_active":"2026-02-17T05:45:29.391432+0000","last_peered":"2026-02-17T05:45:29.391432+0000","last_clean":"2026-02-17T05:45:29.391432+0000","last_became_active":"2026-02-17T05:28:33.081592+0000","last_became_peered":"2026-02-17T05:28:33.081592+0000","last_unstale":"2026-02-17T05:45:29.391432+0000","last_undegraded":"2026-02-17T05:45:29.391432+0000","last_fullsized":"2026-02-17T05:45:29.391432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:08:19.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019366940000000001,"stat_sum":{"num_bytes":36188909,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":509,"num_read_kb":390521,"num_write":345,"num_write_kb":120301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":1733,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389312+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:45:29.389312+0000","last_peered":"2026-02-17T05:45:29.389312+0000","last_clean":"2026-02-17T05:45:29.389312+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:45:29.389312+0000","last_undegraded":"2026-02-17T05:45:29.389312+0000","last_fullsized":"2026-02-17T05:45:29.389312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"862'417","reported_seq":4619,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.396401+0000","last_change":"2026-02-17T05:45:26.385399+0000","last_active":"2026-02-17T05:45:28.396401+0000","last_peered":"2026-02-17T05:45:28.396401+0000","last_clean":"2026-02-17T05:45:28.396401+0000","last_became_active":"2026-02-17T05:28:33.079393+0000","last_became_peered":"2026-02-17T05:28:33.079393+0000","last_unstale":"2026-02-17T05:45:28.396401+0000","last_undegraded":"2026-02-17T05:45:28.396401+0000","last_fullsized":"2026-02-17T05:45:28.396401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:47:05.854779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043058899999999999,"stat_sum":{"num_bytes":6443486,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":37189,"num_write":128,"num_write_kb":49684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":1727,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.400563+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:45:28.400563+0000","last_peered":"2026-02-17T05:45:28.400563+0000","last_clean":"2026-02-17T05:45:28.400563+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:45:28.400563+0000","last_undegraded":"2026-02-17T05:45:28.400563+0000","last_fullsized":"2026-02-17T05:45:28.400563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"878'1981","reported_seq":6128,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391343+0000","last_change":"2026-02-17T05:45:26.389596+0000","last_active":"2026-02-17T05:45:29.391343+0000","last_peered":"2026-02-17T05:45:29.391343+0000","last_clean":"2026-02-17T05:45:29.391343+0000","last_became_active":"2026-02-17T05:28:33.082275+0000","last_became_peered":"2026-02-17T05:28:33.082275+0000","last_unstale":"2026-02-17T05:45:29.391343+0000","last_undegraded":"2026-02-17T05:45:29.391343+0000","last_fullsized":"2026-02-17T05:45:29.391343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:10:01.763507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003224593,"stat_sum":{"num_bytes":50001886,"num_objects":22,"num_object_clones":18,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":2,"num_read":676,"num_read_kb":454667,"num_write":567,"num_write_kb":213941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":1732,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.380630+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:45:30.380630+0000","last_peered":"2026-02-17T05:45:30.380630+0000","last_clean":"2026-02-17T05:45:30.380630+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:45:30.380630+0000","last_undegraded":"2026-02-17T05:45:30.380630+0000","last_fullsized":"2026-02-17T05:45:30.380630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"879'1367","reported_seq":5530,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.699454+0000","last_change":"2026-02-17T05:45:26.389238+0000","last_active":"2026-02-17T05:45:28.699454+0000","last_peered":"2026-02-17T05:45:28.699454+0000","last_clean":"2026-02-17T05:45:28.699454+0000","last_became_active":"2026-02-17T05:28:33.079121+0000","last_became_peered":"2026-02-17T05:28:33.079121+0000","last_unstale":"2026-02-17T05:45:28.699454+0000","last_undegraded":"2026-02-17T05:45:28.699454+0000","last_fullsized":"2026-02-17T05:45:28.699454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1367,"log_dups_size":0,"ondisk_log_size":1367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:26:51.169041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022212489999999998,"stat_sum":{"num_bytes":33936715,"num_objects":13,"num_object_clones":10,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":475,"num_read_kb":359031,"num_write":350,"num_write_kb":161390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"3.5","version":"882'896","reported_seq":5113,"reported_epoch":882,"state":"active+clean","last_fresh":"2026-02-17T05:45:30.383813+0000","last_change":"2026-02-17T05:45:30.383976+0000","last_active":"2026-02-17T05:45:30.383813+0000","last_peered":"2026-02-17T05:45:30.383813+0000","last_clean":"2026-02-17T05:45:30.383813+0000","last_became_active":"2026-02-17T05:28:33.081028+0000","last_became_peered":"2026-02-17T05:28:33.081028+0000","last_unstale":"2026-02-17T05:45:30.383813+0000","last_undegraded":"2026-02-17T05:45:30.383813+0000","last_fullsized":"2026-02-17T05:45:30.383813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:42:43.838620+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0032224490000000001,"stat_sum":{"num_bytes":15335875,"num_objects":10,"num_object_clones":8,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":350,"num_read_kb":282403,"num_write":215,"num_write_kb":97209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"188","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":1727,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391372+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:45:29.391372+0000","last_peered":"2026-02-17T05:45:29.391372+0000","last_clean":"2026-02-17T05:45:29.391372+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:45:29.391372+0000","last_undegraded":"2026-02-17T05:45:29.391372+0000","last_fullsized":"2026-02-17T05:45:29.391372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"879'2583","reported_seq":6648,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391432+0000","last_change":"2026-02-17T05:45:26.392173+0000","last_active":"2026-02-17T05:45:29.391432+0000","last_peered":"2026-02-17T05:45:29.391432+0000","last_clean":"2026-02-17T05:45:29.391432+0000","last_became_active":"2026-02-17T05:28:33.081814+0000","last_became_peered":"2026-02-17T05:28:33.081814+0000","last_unstale":"2026-02-17T05:45:29.391432+0000","last_undegraded":"2026-02-17T05:45:29.391432+0000","last_fullsized":"2026-02-17T05:45:29.391432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":2583,"log_dups_size":0,"ondisk_log_size":2583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:41:31.167712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055308529999999996,"stat_sum":{"num_bytes":66639761,"num_objects":30,"num_object_clones":24,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":2,"num_read":808,"num_read_kb":582636,"num_write":688,"num_write_kb":230830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":1733,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389407+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:45:29.389407+0000","last_peered":"2026-02-17T05:45:29.389407+0000","last_clean":"2026-02-17T05:45:29.389407+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:45:29.389407+0000","last_undegraded":"2026-02-17T05:45:29.389407+0000","last_fullsized":"2026-02-17T05:45:29.389407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"880'1265","reported_seq":5447,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.413512+0000","last_change":"2026-02-17T05:45:26.388484+0000","last_active":"2026-02-17T05:45:28.413512+0000","last_peered":"2026-02-17T05:45:28.413512+0000","last_clean":"2026-02-17T05:45:28.413512+0000","last_became_active":"2026-02-17T05:28:33.082224+0000","last_became_peered":"2026-02-17T05:28:33.082224+0000","last_unstale":"2026-02-17T05:45:28.413512+0000","last_undegraded":"2026-02-17T05:45:28.413512+0000","last_fullsized":"2026-02-17T05:45:28.413512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:16:13.550059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022401069999999999,"stat_sum":{"num_bytes":31573141,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":452,"num_read_kb":354707,"num_write":330,"num_write_kb":133222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":1727,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.391412+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:45:29.391412+0000","last_peered":"2026-02-17T05:45:29.391412+0000","last_clean":"2026-02-17T05:45:29.391412+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:45:29.391412+0000","last_undegraded":"2026-02-17T05:45:29.391412+0000","last_fullsized":"2026-02-17T05:45:29.391412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"880'1313","reported_seq":5460,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-17T05:45:28.400694+0000","last_change":"2026-02-17T05:45:26.387826+0000","last_active":"2026-02-17T05:45:28.400694+0000","last_peered":"2026-02-17T05:45:28.400694+0000","last_clean":"2026-02-17T05:45:28.400694+0000","last_became_active":"2026-02-17T05:28:33.082183+0000","last_became_peered":"2026-02-17T05:28:33.082183+0000","last_unstale":"2026-02-17T05:45:28.400694+0000","last_undegraded":"2026-02-17T05:45:28.400694+0000","last_fullsized":"2026-02-17T05:45:28.400694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:32.073449+0000","last_clean_scrub_stamp":"2026-02-17T05:28:32.073449+0000","objects_scrubbed":0,"log_size":1313,"log_dups_size":0,"ondisk_log_size":1313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:03:49.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027602920000000001,"stat_sum":{"num_bytes":36591406,"num_objects":16,"num_object_clones":13,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":428,"num_read_kb":327793,"num_write":351,"num_write_kb":126844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19e","length":"1"},{"start":"1a5","length":"1"},{"start":"1b0","length":"1"},{"start":"1be","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":1733,"reported_epoch":881,"state":"active+clean","last_fresh":"2026-02-17T05:45:29.389529+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:45:29.389529+0000","last_peered":"2026-02-17T05:45:29.389529+0000","last_clean":"2026-02-17T05:45:29.389529+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:45:29.389529+0000","last_undegraded":"2026-02-17T05:45:29.389529+0000","last_fullsized":"2026-02-17T05:45:29.389529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":508433992,"num_objects":231,"num_object_clones":182,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":15,"num_read":7566,"num_read_kb":5779918,"num_write":5654,"num_write_kb":2204259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":741437440,"data_stored":1021627775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21735,"ondisk_log_size":21735,"up":32,"acting":32,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640468,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171984,"kb_used_data":126976,"kb_used_omap":1909,"kb_used_meta":43082,"kb_avail":94199856,"statfs":{"total":96636764160,"available":96460652544,"internally_reserved":0,"allocated":130023424,"data_stored":175600973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1954999,"internal_metadata":44116809},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640469,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121348,"kb_used_data":94388,"kb_used_omap":1507,"kb_used_meta":25436,"kb_avail":94250492,"statfs":{"total":96636764160,"available":96512503808,"internally_reserved":0,"allocated":96653312,"data_stored":129660969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1544133,"internal_metadata":26046523},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640468,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125932,"kb_used_data":98972,"kb_used_omap":1397,"kb_used_meta":25546,"kb_avail":94245908,"statfs":{"total":96636764160,"available":96507809792,"internally_reserved":0,"allocated":101347328,"data_stored":136972782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1431170,"internal_metadata":26159486},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640468,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202760,"kb_used_data":157752,"kb_used_omap":2181,"kb_used_meta":42810,"kb_avail":94169080,"statfs":{"total":96636764160,"available":96429137920,"internally_reserved":0,"allocated":161538048,"data_stored":222674019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2233896,"internal_metadata":43837912},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640468,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223816,"kb_used_data":178808,"kb_used_omap":2294,"kb_used_meta":42697,"kb_avail":94148024,"statfs":{"total":96636764160,"available":96407576576,"internally_reserved":0,"allocated":183099392,"data_stored":255366291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2349435,"internal_metadata":43722373},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640468,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109012,"kb_used_data":82052,"kb_used_omap":1331,"kb_used_meta":25612,"kb_avail":94262828,"statfs":{"total":96636764160,"available":96525135872,"internally_reserved":0,"allocated":84021248,"data_stored":110268883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1363795,"internal_metadata":26226861},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81088512,"data_stored":108390805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180756480,"data_stored":254078562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159199232,"data_stored":221386309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98414592,"data_stored":135094704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94314496,"data_stored":128373259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":127664128,"data_stored":174304136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:45:33.142 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T05:45:33.142 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T05:45:33.216 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.207+0000 7fdec55b9640 10 monclient: get_monmap_and_config 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.207+0000 7fdec55b9640 10 monclient: build_initial_monmap 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.207+0000 7fdec55b9640 10 monclient: monmap: 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:45:33.209012+0000 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:45:33.209012+0000 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.217 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.207+0000 7fdec55b9640 1 Processor -- start 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 1 -- start start 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient: init 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-c con 0x7fdec008e0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-b con 0x7fdec008c940 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:33.218 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-a con 0x7fdec008cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec008e4a0 con 0x7fdec008cd80 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec008bf90 con 0x7fdec008e0d0 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec008d8d0 con 0x7fdec008c940 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdec55b9640 10 monclient(hunting): authenticate will time out at 1661.837385s 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebf7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fdec008cd80 legacy=0x7fdec01a2600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebe7fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdec008c940 0x7fdec0180ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36378/0 (socket says 10.20.193.106:36378) 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebe7fc640 1 -- 10.20.193.106:0/3244858126 learned_addr learned my addr 10.20.193.106:0/3244858126 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823306139 0 0) 0x7fdec008d8d0 con 0x7fdec008c940 2026-02-17T05:45:33.219 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 10 monclient(hunting): _negotiate 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 10 monclient(hunting): my global_id is 5411 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.208+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeac0035e0 con 0x7fdec008c940 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653735215 0 0) 0x7fdeac0035e0 con 0x7fdec008c940 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 >> v1:10.20.193.118:6789/0 conn(0x7fdec008e0d0 legacy=0x7fdec008c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 >> v1:10.20.193.106:6789/0 conn(0x7fdec008cd80 legacy=0x7fdec01a2600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: _finish_hunting 0 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 monclient: found mon.noname-b 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:33.220 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec008af70 con 0x7fdec008c940 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: _finish_auth 0 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: _check_auth_tickets 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdea8002dd0 con 0x7fdec008c940 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 5 monclient: authenticate success, global_id 5411 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: dump: 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.221 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdea8003010 con 0x7fdec008c940 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:33.222 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 10 monclient: get_monmap_and_config success 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 4 set_mon_vals no callback set 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 1 -- 10.20.193.106:0/3244858126 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdea8003420 con 0x7fdec008c940 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdebdffb640 10 monclient: dump: 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.223 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 10 monclient: shutdown 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 1 -- 10.20.193.106:0/3244858126 >> v1:10.20.193.106:6790/0 conn(0x7fdec008c940 legacy=0x7fdec0180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 1 -- 10.20.193.106:0/3244858126 shutdown_connections 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 1 -- 10.20.193.106:0/3244858126 >> 10.20.193.106:0/3244858126 conn(0x7fdec00915f0 msgr2=0x7fdec00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 1 -- 10.20.193.106:0/3244858126 shutdown_connections 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 1 -- 10.20.193.106:0/3244858126 wait complete. 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 10 monclient: build_initial_monmap 2026-02-17T05:45:33.224 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.209+0000 7fdec55b9640 10 monclient: monmap: 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 Processor -- start 2026-02-17T05:45:33.225 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- start start 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: init 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-c con 0x7fdec008c940 addr v1:10.20.193.106:6790/0 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-b con 0x7fdec008cd80 addr v1:10.20.193.118:6789/0 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient(hunting): picked mon.noname-a con 0x7fdec008e0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec008d6a0 con 0x7fdec008e0d0 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec0152fd0 con 0x7fdec008cd80 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec005c810 con 0x7fdec008c940 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient(hunting): authenticate will time out at 1661.839347s 2026-02-17T05:45:33.226 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdebf7fe640 1 -- >> v1:10.20.193.106:6789/0 conn(0x7fdec008e0d0 legacy=0x7fdec0194ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.106:6789/0 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdebeffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fdec008c940 0x7fdec013cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:36382/0 (socket says 10.20.193.106:36382) 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdebeffd640 1 -- 10.20.193.106:0/418603017 learned_addr learned my addr 10.20.193.106:0/418603017 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151908265 0 0) 0x7fdec008bf90 con 0x7fdec008c940 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): my global_id is 5414 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde8c0035e0 con 0x7fdec008c940 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2585941582 0 0) 0x7fde8c0035e0 con 0x7fdec008c940 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdec008bf90 con 0x7fdec008c940 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeb4003170 con 0x7fdec008c940 2026-02-17T05:45:33.227 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): dump: 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.228 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1813612560 0 0) 0x7fdec008bf90 con 0x7fdec008c940 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 >> v1:10.20.193.118:6789/0 conn(0x7fdec008cd80 legacy=0x7fdec01933b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 >> v1:10.20.193.106:6789/0 conn(0x7fdec008e0d0 legacy=0x7fdec0194ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 monclient: found mon.c 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec005e930 con 0x7fdec008c940 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: _finish_auth 0 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:45:33.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 5 monclient: authenticate success, global_id 5414 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _renew_subs 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdec01308c0 con 0x7fdec008c940 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _renew_subs 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdec012f0c0 con 0x7fdec008c940 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdeb4003340 con 0x7fdec008c940 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdeb4003b70 con 0x7fdec008c940 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:45:33.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fde9f7fe640 10 monclient: dump: 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:45:33.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.210+0000 7fdebd7fa640 4 set_mon_vals no callback set 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fdec55b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fdec55b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fdec55b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec0130260 con 0x7fdec008c940 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fdeb4003cd0 con 0x7fdec008c940 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(884..884 src has 597..884) ==== 3947+0+0 (unknown 1843063814 0 0) 0x7fdeb404fd20 con 0x7fdec008c940 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.211+0000 7fdebe7fc640 10 monclient: get_auth_request con 0x7fde8c040740 auth_method 0 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.213+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fdeb40041f0 con 0x7fdec008c940 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.213+0000 7fde9f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:45:33.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.213+0000 7fde9f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:45:33.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.321+0000 7fdec55b9640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T05:45:33.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.321+0000 7fdec55b9640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T05:45:33.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.321+0000 7fdec55b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:45:33.323 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.321+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdec005c810 con 0x7fdec008c940 2026-02-17T05:45:33.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.396+0000 7fde9f7fe640 1 -- 10.20.193.106:0/418603017 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]=0 pool 'unique_pool_0' removed v885) ==== 175+0+0 (unknown 2189080690 0 0) 0x7fdec005c810 con 0x7fdec008c940 2026-02-17T05:45:33.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.396+0000 7fde9f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-17T05:45:33.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.396+0000 7fde9f7fe640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' removed 2026-02-17T05:45:33.399 INFO:teuthology.orchestra.run.trial106.stderr:pool 'unique_pool_0' removed 2026-02-17T05:45:33.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 >> v1:10.20.193.118:6812/703720803 conn(0x7fde8c040740 legacy=0x7fde8c060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 10 monclient: shutdown 2026-02-17T05:45:33.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:45:33.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 >> v1:10.20.193.106:6790/0 conn(0x7fdec008c940 legacy=0x7fdec013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:45:33.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 shutdown_connections 2026-02-17T05:45:33.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 >> 10.20.193.106:0/418603017 conn(0x7fdec00915f0 msgr2=0x7fdec013f330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:45:33.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 shutdown_connections 2026-02-17T05:45:33.401 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:45:33.397+0000 7fdec55b9640 1 -- 10.20.193.106:0/418603017 wait complete. 2026-02-17T05:45:33.408 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-17T05:45:33.425 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-17T05:46:50.865 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:46:50.865 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-17T05:46:50.865 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:46:50.865 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:46:50.880 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:46:50.880 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:46:50.880 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:46:50.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.944+0000 7f38b2647640 10 monclient: get_monmap_and_config 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.944+0000 7f38b2647640 10 monclient: build_initial_monmap 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.944+0000 7f38b2647640 10 monclient: monmap: 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:50.946191+0000 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:50.946191+0000 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:50.947 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 1 Processor -- start 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 1 -- start start 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient: init 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-b con 0x7f38ac05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-c con 0x7f38ac05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-a con 0x7f38ac182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac08b060 con 0x7f38ac182720 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac05dc90 con 0x7f38ac05dee0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac08d6a0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38b2647640 10 monclient(hunting): authenticate will time out at 1739.574550s 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38abfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f38ac05d1b0 0x7f38ac05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43628/0 (socket says 10.20.193.106:43628) 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38abfff640 1 -- 10.20.193.106:0/2683623938 learned_addr learned my addr 10.20.193.106:0/2683623938 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140142238 0 0) 0x7f38ac08d6a0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): my global_id is 5417 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38900035e0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365579542 0 0) 0x7f38ac05dc90 con 0x7f38ac05dee0 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 10 monclient(hunting): my global_id is 134266 2026-02-17T05:46:50.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.945+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ac08d6a0 con 0x7f38ac05dee0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1806538011 0 0) 0x7f38900035e0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 >> v1:10.20.193.118:6789/0 conn(0x7f38ac05dee0 legacy=0x7f38ac181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 >> v1:10.20.193.106:6789/0 conn(0x7f38ac182720 legacy=0x7f38ac1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 monclient: found mon.noname-b 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac057960 con 0x7f38ac05d1b0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3898002dd0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 5 monclient: authenticate success, global_id 5417 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: dump: 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3898003010 con 0x7f38ac05d1b0 2026-02-17T05:46:50.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 1 -- 10.20.193.106:0/2683623938 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3898003420 con 0x7f38ac05d1b0 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 4 set_mon_vals no callback set 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38aaffd640 10 monclient: dump: 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 10 monclient: shutdown 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 1 -- 10.20.193.106:0/2683623938 >> v1:10.20.193.106:6790/0 conn(0x7f38ac05d1b0 legacy=0x7f38ac05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 1 -- 10.20.193.106:0/2683623938 shutdown_connections 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 1 -- 10.20.193.106:0/2683623938 >> 10.20.193.106:0/2683623938 conn(0x7f38ac0915f0 msgr2=0x7f38ac0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 1 -- 10.20.193.106:0/2683623938 shutdown_connections 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 1 -- 10.20.193.106:0/2683623938 wait complete. 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 10 monclient: build_initial_monmap 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.946+0000 7f38b2647640 10 monclient: monmap: 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:50.951 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 1 Processor -- start 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 1 -- start start 2026-02-17T05:46:50.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient: init 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-c con 0x7f38ac05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-b con 0x7f38ac05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient(hunting): picked mon.noname-a con 0x7f38ac182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac10c9e0 con 0x7f38ac182720 2026-02-17T05:46:50.953 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac05e8e0 con 0x7f38ac05dee0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac10e440 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38b2647640 10 monclient(hunting): authenticate will time out at 1739.576401s 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38abfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f38ac05d1b0 0x7f38ac13cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43632/0 (socket says 10.20.193.106:43632) 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38abfff640 1 -- 10.20.193.106:0/3842196016 learned_addr learned my addr 10.20.193.106:0/3842196016 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861890791 0 0) 0x7f38ac10e440 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): _negotiate 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): my global_id is 5420 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f387c0035e0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1220521483 0 0) 0x7f387c0035e0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38ac10e440 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3898002ce0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): dump: 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.947+0000 7f38a8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3521610495 0 0) 0x7f38ac10e440 con 0x7f38ac05d1b0 2026-02-17T05:46:50.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 >> v1:10.20.193.118:6789/0 conn(0x7f38ac05dee0 legacy=0x7f38ac180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 >> v1:10.20.193.106:6789/0 conn(0x7f38ac182720 legacy=0x7f38ac119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: _finish_hunting 0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 monclient: found mon.c 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac10cf50 con 0x7f38ac05d1b0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: _finish_auth 0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: _check_auth_tickets 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 5 monclient: authenticate success, global_id 5420 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _renew_subs 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac1824f0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _renew_subs 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f38ac12a940 con 0x7f38ac05d1b0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3898004c00 con 0x7f38ac05d1b0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3898002eb0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 10 monclient: dump: 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:50.955 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38aa7fc640 4 set_mon_vals no callback set 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f3898004fe0 con 0x7f38ac05d1b0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.948+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ac10ef30 con 0x7f38ac05d1b0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.949+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f3898017f80 con 0x7f38ac05d1b0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.949+0000 7f38ab7fe640 10 monclient: get_auth_request con 0x7f387c040800 auth_method 0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.951+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f3898017630 con 0x7f38ac05d1b0 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.951+0000 7f38a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:50.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:50.951+0000 7f38a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38b2647640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38b2647640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38b2647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f38ac057ca0 con 0x7f38ac05d1b0 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38a8ff9640 1 -- 10.20.193.106:0/3842196016 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1082205071) 0x7f3898016de0 con 0x7f38ac05d1b0 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.105+0000 7f38a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:51.107 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 >> v1:10.20.193.118:6812/703720803 conn(0x7f387c040800 legacy=0x7f387c060cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 10 monclient: shutdown 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 >> v1:10.20.193.106:6790/0 conn(0x7f38ac05d1b0 legacy=0x7f38ac13cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 shutdown_connections 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 >> 10.20.193.106:0/3842196016 conn(0x7f38ac0915f0 msgr2=0x7f38ac054bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 shutdown_connections 2026-02-17T05:46:51.109 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.106+0000 7f38b2647640 1 -- 10.20.193.106:0/3842196016 wait complete. 2026-02-17T05:46:51.116 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:46:51.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T05:46:51.116 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 10 monclient: get_monmap_and_config 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 10 monclient: monmap: 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:51.182860+0000 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:51.182860+0000 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:51.183 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:51.184 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 1 Processor -- start 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 1 -- start start 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.181+0000 7f77b8447640 10 monclient: init 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-c con 0x7f77b013bb70 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-b con 0x7f77b008d4f0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-a con 0x7f77b01849f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b005cca0 con 0x7f77b01849f0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b013c650 con 0x7f77b013bb70 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b005e010 con 0x7f77b008d4f0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b8447640 10 monclient(hunting): authenticate will time out at 1739.811230s 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b59bb640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f77b008d4f0 0x7f77b01832d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43636/0 (socket says 10.20.193.106:43636) 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b59bb640 1 -- 10.20.193.106:0/2593386461 learned_addr learned my addr 10.20.193.106:0/2593386461 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538859982 0 0) 0x7f77b005e010 con 0x7f77b008d4f0 2026-02-17T05:46:51.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): my global_id is 5423 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77980035e0 con 0x7f77b008d4f0 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143570042 0 0) 0x7f77b013c650 con 0x7f77b013bb70 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 10 monclient(hunting): my global_id is 134272 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.182+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b005e010 con 0x7f77b013bb70 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415465304 0 0) 0x7f77b005e010 con 0x7f77b013bb70 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 >> v1:10.20.193.106:6790/0 conn(0x7f77b008d4f0 legacy=0x7f77b01832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 >> v1:10.20.193.106:6789/0 conn(0x7f77b01849f0 legacy=0x7f77b01a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 monclient: found mon.noname-c 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.118:6789/0 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 --> v1:10.20.193.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b008d950 con 0x7f77b013bb70 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a0002dd0 con 0x7f77b013bb70 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 5 monclient: authenticate success, global_id 134272 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: dump: 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.186 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.1 v1:10.20.193.118:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77a0003020 con 0x7f77b013bb70 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 1 -- 10.20.193.106:0/2593386461 <== mon.1 v1:10.20.193.118:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a00033f0 con 0x7f77b013bb70 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b51ba640 10 monclient: dump: 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:51.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 4 set_mon_vals no callback set 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 10 monclient: shutdown 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 1 -- 10.20.193.106:0/2593386461 >> v1:10.20.193.118:6789/0 conn(0x7f77b013bb70 legacy=0x7f77b013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 1 -- 10.20.193.106:0/2593386461 shutdown_connections 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 1 -- 10.20.193.106:0/2593386461 >> 10.20.193.106:0/2593386461 conn(0x7f77b00915f0 msgr2=0x7f77b00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 1 -- 10.20.193.106:0/2593386461 shutdown_connections 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.183+0000 7f77b8447640 1 -- 10.20.193.106:0/2593386461 wait complete. 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient: monmap: 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:51.190 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 1 Processor -- start 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 1 -- start start 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient: init 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-a con 0x7f77b008d4f0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-c con 0x7f77b013bb70 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient(hunting): picked mon.noname-b con 0x7f77b01849f0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b0089eb0 con 0x7f77b008d4f0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b010bc10 con 0x7f77b01849f0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b010d9b0 con 0x7f77b013bb70 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b8447640 10 monclient(hunting): authenticate will time out at 1739.813618s 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b61bc640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f77b008d4f0 0x7f77b013aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51332/0 (socket says 10.20.193.106:51332) 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f77b61bc640 1 -- 10.20.193.106:0/3521275478 learned_addr learned my addr 10.20.193.106:0/3521275478 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825173972 0 0) 0x7f77b010d9b0 con 0x7f77b013bb70 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): my global_id is 5426 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77800035e0 con 0x7f77b013bb70 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182810662 0 0) 0x7f77b0089eb0 con 0x7f77b008d4f0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): my global_id is 164097 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b010d9b0 con 0x7f77b008d4f0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345694370 0 0) 0x7f77b010bc10 con 0x7f77b01849f0 2026-02-17T05:46:51.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 10 monclient(hunting): my global_id is 134275 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.184+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b0089eb0 con 0x7f77b01849f0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4070484860 0 0) 0x7f77800035e0 con 0x7f77b013bb70 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77b010bc10 con 0x7f77b013bb70 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a4003090 con 0x7f77b013bb70 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1693589321 0 0) 0x7f77b010d9b0 con 0x7f77b008d4f0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77800035e0 con 0x7f77b008d4f0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a0002d90 con 0x7f77b008d4f0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.192 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3901992250 0 0) 0x7f77b0089eb0 con 0x7f77b01849f0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77b010d9b0 con 0x7f77b01849f0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77ac003fd0 con 0x7f77b01849f0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2201724899 0 0) 0x7f77b010bc10 con 0x7f77b013bb70 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.118:6789/0 conn(0x7f77b01849f0 legacy=0x7f77b0180b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6789/0 conn(0x7f77b008d4f0 legacy=0x7f77b013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 monclient: found mon.c 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b010d6d0 con 0x7f77b013bb70 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 5 monclient: authenticate success, global_id 5426 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 10 monclient: _renew_subs 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77b010b590 con 0x7f77b013bb70 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 10 monclient: _renew_subs 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f77b010c910 con 0x7f77b013bb70 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77a40034d0 con 0x7f77b013bb70 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a4004a50 con 0x7f77b013bb70 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b49b9640 4 set_mon_vals no callback set 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient: dump: 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77b00008d0 con 0x7f77b01295b0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663335768 0 0) 0x7f77b00008d0 con 0x7f77b01295b0 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.185+0000 7f7796ffd640 10 monclient(hunting): my global_id is 164100 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b010bc10 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f77a40119f0 con 0x7f77b013bb70 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f77a404fa70 con 0x7f77b013bb70 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3526072101 0 0) 0x7f77b010bc10 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77b00008d0 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a0003d30 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 10 monclient: dump: 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f77b69bd640 10 monclient: get_auth_request con 0x7f7780040f90 auth_method 0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3305798380 0 0) 0x7f77b00008d0 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77b010d170 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f77a0004170 con 0x7f77b01295b0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6789/0 conn(0x7f77b01295b0 legacy=0x7f77b013cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.186+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6789/0 conn(0x7f77b01295b0 legacy=0x7f77b013cf20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.189+0000 7f77b8447640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77b010ddb0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293288935 0 0) 0x7f77b010ddb0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient(hunting): my global_id is 164103 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b00008d0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2680041156 0 0) 0x7f77b00008d0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77b010ddb0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f77a00059a0 con 0x7f77b013d630 2026-02-17T05:46:51.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient: dump: 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1907834001 0 0) 0x7f77b010ddb0 con 0x7f77b013d630 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 --> v1:10.20.193.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77b005d940 con 0x7f77b013d630 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 <== mon.0 v1:10.20.193.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 2289193579) 0x7f77a0006820 con 0x7f77b013d630 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6789/0 conn(0x7f77b013d630 legacy=0x7f77b0183280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f7796ffd640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6789/0 conn(0x7f77b013d630 legacy=0x7f77b0183280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 62, 2026-02-17T05:46:51.197 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 255, 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.198 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.199 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.200 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.201 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:46:51.202 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.118:6812/703720803 conn(0x7f7780040f90 legacy=0x7f7780061440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 10 monclient: shutdown 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 >> v1:10.20.193.106:6790/0 conn(0x7f77b013bb70 legacy=0x7f77b013b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b69bd640 1 -- 10.20.193.106:0/3521275478 reap_dead start 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b69bd640 1 -- 10.20.193.106:0/3521275478 reap_dead start 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 shutdown_connections 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 >> 10.20.193.106:0/3521275478 conn(0x7f77b00915f0 msgr2=0x7f77b013ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 shutdown_connections 2026-02-17T05:46:51.203 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.190+0000 7f77b8447640 1 -- 10.20.193.106:0/3521275478 wait complete. 2026-02-17T05:46:51.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:46:51.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T05:46:51.204 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: get_monmap_and_config 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: monmap: 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:51.268705+0000 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:51.268705+0000 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:51.269 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 1 Processor -- start 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 1 -- start start 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: init 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.267+0000 7effba01b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:51.271 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient(hunting): picked mon.noname-a con 0x7effb405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient(hunting): picked mon.noname-c con 0x7effb405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient(hunting): picked mon.noname-b con 0x7effb4182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb408b060 con 0x7effb405d1b0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb405dc90 con 0x7effb405dee0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb408d6a0 con 0x7effb4182720 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient(hunting): authenticate will time out at 1739.897051s 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb37fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7effb405d1b0 0x7effb405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51366/0 (socket says 10.20.193.106:51366) 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb37fe640 1 -- 10.20.193.106:0/1835841265 learned_addr learned my addr 10.20.193.106:0/1835841265 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675617612 0 0) 0x7effb408b060 con 0x7effb405d1b0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): my global_id is 164106 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff980035e0 con 0x7effb405d1b0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85305761 0 0) 0x7effb408d6a0 con 0x7effb4182720 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient(hunting): my global_id is 5429 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb408b060 con 0x7effb4182720 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 202234445 0 0) 0x7eff980035e0 con 0x7effb405d1b0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 >> v1:10.20.193.106:6790/0 conn(0x7effb4182720 legacy=0x7effb41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 >> v1:10.20.193.118:6789/0 conn(0x7effb405dee0 legacy=0x7effb4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 monclient: found mon.noname-a 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.272 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4057960 con 0x7effb405d1b0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa0002dd0 con 0x7effb405d1b0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: dump: 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 5 monclient: authenticate success, global_id 164106 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effa0003010 con 0x7effb405d1b0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 1 -- 10.20.193.106:0/1835841265 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa0003420 con 0x7effb405d1b0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effb27fc640 10 monclient: dump: 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.273 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 4 set_mon_vals no callback set 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 10 monclient: shutdown 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- 10.20.193.106:0/1835841265 >> v1:10.20.193.106:6789/0 conn(0x7effb405d1b0 legacy=0x7effb405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- 10.20.193.106:0/1835841265 shutdown_connections 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- 10.20.193.106:0/1835841265 >> 10.20.193.106:0/1835841265 conn(0x7effb40915f0 msgr2=0x7effb40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- 10.20.193.106:0/1835841265 shutdown_connections 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.268+0000 7effba01b640 1 -- 10.20.193.106:0/1835841265 wait complete. 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient: monmap: 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 1 Processor -- start 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 1 -- start start 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient: init 2026-02-17T05:46:51.274 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient(hunting): picked mon.noname-b con 0x7effb405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient(hunting): picked mon.noname-c con 0x7effb405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient(hunting): picked mon.noname-a con 0x7effb4182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb405e950 con 0x7effb4182720 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb410f0a0 con 0x7effb405d1b0 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb410e230 con 0x7effb405dee0 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effba01b640 10 monclient(hunting): authenticate will time out at 1739.898735s 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effb2ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7effb405dee0 0x7effb413d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43662/0 (socket says 10.20.193.106:43662) 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effb3fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7effb4182720 0x7effb4181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51378/0 (socket says 10.20.193.106:51378) 2026-02-17T05:46:51.275 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7effb2ffd640 1 -- 10.20.193.106:0/2181365774 learned_addr learned my addr 10.20.193.106:0/2181365774 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424480429 0 0) 0x7effb408b060 con 0x7effb4182720 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7eff8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7eff8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.269+0000 7eff8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): my global_id is 164109 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff840035e0 con 0x7effb4182720 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478954897 0 0) 0x7effb410e230 con 0x7effb405dee0 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.277 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): my global_id is 5432 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb408b060 con 0x7effb405dee0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 126163232 0 0) 0x7eff840035e0 con 0x7effb4182720 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effb410e230 con 0x7effb4182720 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa8004170 con 0x7effb4182720 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): dump: 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1499698984 0 0) 0x7effb408b060 con 0x7effb405dee0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff840035e0 con 0x7effb405dee0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa4003010 con 0x7effb405dee0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): dump: 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.278 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137102435 0 0) 0x7effb410f0a0 con 0x7effb405d1b0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient(hunting): my global_id is 134281 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb408b060 con 0x7effb405d1b0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2480527003 0 0) 0x7effb410e230 con 0x7effb4182720 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6790/0 conn(0x7effb405dee0 legacy=0x7effb413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.118:6789/0 conn(0x7effb405d1b0 legacy=0x7effb413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 monclient: found mon.a 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb410cd40 con 0x7effb4182720 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 5 monclient: authenticate success, global_id 164109 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 10 monclient: _renew_subs 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effb41824f0 con 0x7effb4182720 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 10 monclient: _renew_subs 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7effb410d8a0 con 0x7effb4182720 2026-02-17T05:46:51.279 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effa80047b0 con 0x7effb4182720 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa8004b90 con 0x7effb4182720 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 10 monclient: dump: 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effb1ffb640 4 set_mon_vals no callback set 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7effb410e910 con 0x7effb412a6c0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.270+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7effa8004cf0 con 0x7effb4182720 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7effa8050b10 con 0x7effb4182720 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930027827 0 0) 0x7effb410e910 con 0x7effb412a6c0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient(hunting): my global_id is 5435 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb410e230 con 0x7effb412a6c0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7effb2ffd640 10 monclient: get_auth_request con 0x7eff84040e00 auth_method 0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 657829556 0 0) 0x7effb410e230 con 0x7effb412a6c0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effb410e910 con 0x7effb412a6c0 2026-02-17T05:46:51.280 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa0002a20 con 0x7effb412a6c0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 10 monclient: dump: 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3590653060 0 0) 0x7effb410e910 con 0x7effb412a6c0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.271+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effb4057cd0 con 0x7effb412a6c0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.272+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7effa0002e30 con 0x7effb412a6c0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.272+0000 7eff8ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.272+0000 7eff8ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.272+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6790/0 conn(0x7effb412a6c0 legacy=0x7effb41076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.272+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6790/0 conn(0x7effb412a6c0 legacy=0x7effb41076d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7effba01b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7effb405e950 con 0x7effb4107de0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810861805 0 0) 0x7effb408b060 con 0x7effb4107de0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient(hunting): my global_id is 5438 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb410e910 con 0x7effb4107de0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2445824421 0 0) 0x7effb410e910 con 0x7effb4107de0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effb408b060 con 0x7effb4107de0 2026-02-17T05:46:51.281 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7effa0004cc0 con 0x7effb4107de0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient: dump: 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1793438154 0 0) 0x7effb408b060 con 0x7effb4107de0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 --> v1:10.20.193.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7effb4055570 con 0x7effb4107de0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 <== mon.2 v1:10.20.193.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4517 (unknown 0 0 430762958) 0x7effa0005000 con 0x7effb4107de0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6790/0 conn(0x7effb4107de0 legacy=0x7effb411b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.282 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.275+0000 7eff8ffff640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6790/0 conn(0x7effb4107de0 legacy=0x7effb411b680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "state": "leader", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 62, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 1136037, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.283 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:46:51.284 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.285 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.286 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: "osd": [ 2026-02-17T05:46:51.287 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "num": 6 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "num": 5 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:46:51.288 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.118:6812/703720803 conn(0x7eff84040e00 legacy=0x7eff840612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 10 monclient: shutdown 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 >> v1:10.20.193.106:6789/0 conn(0x7effb4182720 legacy=0x7effb4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effb3fff640 1 -- 10.20.193.106:0/2181365774 reap_dead start 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effb3fff640 1 -- 10.20.193.106:0/2181365774 reap_dead start 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 shutdown_connections 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 >> 10.20.193.106:0/2181365774 conn(0x7effb40915f0 msgr2=0x7effb40887f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 shutdown_connections 2026-02-17T05:46:51.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.276+0000 7effba01b640 1 -- 10.20.193.106:0/2181365774 wait complete. 2026-02-17T05:46:51.289 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:46:51.289 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T05:46:51.289 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: monmap: 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:51.355652+0000 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:51.355652+0000 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:51.356 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 1 Processor -- start 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 1 -- start start 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: init 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f65fc05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f65fc05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.354+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f65fc182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc08b060 con 0x7f65fc05dee0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc05dc90 con 0x7f65fc05d1b0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc08d6a0 con 0x7f65fc182720 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 10 monclient(hunting): authenticate will time out at 1739.984021s 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6601080640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f65fc05dee0 0x7f65fc181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51384/0 (socket says 10.20.193.106:51384) 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6601080640 1 -- 10.20.193.106:0/2485453206 learned_addr learned my addr 10.20.193.106:0/2485453206 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261190737 0 0) 0x7f65fc08b060 con 0x7f65fc05dee0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): my global_id is 164112 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e40035e0 con 0x7f65fc05dee0 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632375522 0 0) 0x7f65fc08d6a0 con 0x7f65fc182720 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient(hunting): my global_id is 5441 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65fc08b060 con 0x7f65fc182720 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039967632 0 0) 0x7f65e40035e0 con 0x7f65fc05dee0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 >> v1:10.20.193.106:6790/0 conn(0x7f65fc182720 legacy=0x7f65fc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 >> v1:10.20.193.118:6789/0 conn(0x7f65fc05d1b0 legacy=0x7f65fc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 monclient: found mon.noname-a 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc057960 con 0x7f65fc05dee0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65f0002dd0 con 0x7f65fc05dee0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: dump: 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 5 monclient: authenticate success, global_id 164112 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:51.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65f0003010 con 0x7f65fc05dee0 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 1 -- 10.20.193.106:0/2485453206 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65f0003420 con 0x7f65fc05dee0 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f660087f640 10 monclient: dump: 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 4 set_mon_vals no callback set 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 10 monclient: shutdown 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- 10.20.193.106:0/2485453206 >> v1:10.20.193.106:6789/0 conn(0x7f65fc05dee0 legacy=0x7f65fc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- 10.20.193.106:0/2485453206 shutdown_connections 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- 10.20.193.106:0/2485453206 >> 10.20.193.106:0/2485453206 conn(0x7f65fc0915f0 msgr2=0x7f65fc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- 10.20.193.106:0/2485453206 shutdown_connections 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.355+0000 7f6603b0c640 1 -- 10.20.193.106:0/2485453206 wait complete. 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient: monmap: 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:51.360 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.361 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:51.361 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.361 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:51.361 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:51.361 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 1 Processor -- start 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 1 -- start start 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient: init 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f65fc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f65fc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f65fc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc10ea90 con 0x7f65fc182720 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc10f050 con 0x7f65fc05dee0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc08a0e0 con 0x7f65fc05d1b0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6603b0c640 10 monclient(hunting): authenticate will time out at 1739.985698s 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6601881640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f65fc05d1b0 0x7f65fc13cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43704/0 (socket says 10.20.193.106:43704) 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6601881640 1 -- 10.20.193.106:0/3606779151 learned_addr learned my addr 10.20.193.106:0/3606779151 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f6602082640 1 --1- 10.20.193.106:0/3606779151 >> v1:10.20.193.106:6789/0 conn(0x7f65fc182720 0x7f65fc181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51394/0 (socket says 10.20.193.106:51394) 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501830428 0 0) 0x7f65fc10ea90 con 0x7f65fc182720 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): my global_id is 164115 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65cc0035e0 con 0x7f65fc182720 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769628966 0 0) 0x7f65fc08a0e0 con 0x7f65fc05d1b0 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.363 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 10 monclient(hunting): my global_id is 5444 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.356+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65fc10ea90 con 0x7f65fc05d1b0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1931305884 0 0) 0x7f65cc0035e0 con 0x7f65fc182720 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65fc08a0e0 con 0x7f65fc182720 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65f8004170 con 0x7f65fc182720 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): dump: 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1541570588 0 0) 0x7f65fc10ea90 con 0x7f65fc05d1b0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65cc0035e0 con 0x7f65fc05d1b0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65ec003170 con 0x7f65fc05d1b0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient(hunting): dump: 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.364 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 413531474 0 0) 0x7f65fc08a0e0 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.106:6790/0 conn(0x7f65fc05d1b0 legacy=0x7f65fc13cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6789/0 conn(0x7f65fc05dee0 legacy=0x7f65fc13d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 monclient: found mon.a 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc12e1f0 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 5 monclient: authenticate success, global_id 164115 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 10 monclient: _renew_subs 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1824f0 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 10 monclient: _renew_subs 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65fc10e7b0 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65f80047b0 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65f8004b90 con 0x7f65fc182720 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 10 monclient: dump: 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.365 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ebfff640 4 set_mon_vals no callback set 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65fc10e420 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.357+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f65f8004cf0 con 0x7f65fc182720 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f65f8050c90 con 0x7f65fc182720 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f6601080640 10 monclient: get_auth_request con 0x7f65cc040b60 auth_method 0 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838260447 0 0) 0x7f65fc10e420 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient(hunting): my global_id is 134287 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65fc08a0e0 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1922562419 0 0) 0x7f65fc08a0e0 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65fc10e420 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65ec003940 con 0x7f65fc10d850 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 10 monclient: dump: 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.366 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3899253751 0 0) 0x7f65fc10e420 con 0x7f65fc10d850 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.358+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65fc057cd0 con 0x7f65fc10d850 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.359+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f65ec005880 con 0x7f65fc10d850 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.359+0000 7f65ea7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.359+0000 7f65ea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.359+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6789/0 conn(0x7f65fc10d850 legacy=0x7f65fc05a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.359+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6789/0 conn(0x7f65fc10d850 legacy=0x7f65fc05a010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.367 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f6603b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65fc12db40 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730571408 0 0) 0x7f65fc12db40 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 10 monclient(hunting): my global_id is 134290 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.362+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65fc10e420 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1456104604 0 0) 0x7f65fc10e420 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65fc12db40 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f65ec004160 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 10 monclient: dump: 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3573113128 0 0) 0x7f65fc12db40 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 --> v1:10.20.193.118:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65fc04d910 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 <== mon.1 v1:10.20.193.118:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2608983945) 0x7f65ec004540 con 0x7f65fc12d770 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T05:46:51.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6789/0 conn(0x7f65fc12d770 legacy=0x7f65fc04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f65ea7fc640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6789/0 conn(0x7f65fc12d770 legacy=0x7f65fc04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "state": "peon", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "election_epoch": 62, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "uptime": 235506, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "quorum": [ 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: 0, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: 1, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: 2 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_age": 0, 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "required_con": "2453899407728394244", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "required_mon": [ 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.369 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_con": "4544132024016699391", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "quorum_mon": [ 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "outside_quorum": [], 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "extra_probe_peers": [], 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "sync_provider": [], 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "monmap": { 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "epoch": 1, 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "fsid": "f9284388-9cba-4b6a-8ae7-6bff755d8682", 2026-02-17T05:46:51.370 INFO:teuthology.orchestra.run.trial106.stdout: "modified": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "created": "2026-02-17T05:27:44.165842Z", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release": 20, 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "election_strategy": 3, 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "disallowed_leaders": "", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false, 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "tiebreaker_mon": "", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "removed_ranks": "", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "features": { 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "persistent": [ 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "kraken", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "luminous", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "mimic", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "osdmap-prune", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "nautilus", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "octopus", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "pacific", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "elector-pinging", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "quincy", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "reef", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "squid", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "tentacle", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "nvmeof_beacon_diff" 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "optional": [] 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "mons": [ 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 0, 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "name": "a", 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.371 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6789/0", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165890+0000", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 1, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "name": "b", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.118:6789/0", 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.372 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165891+0000", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "rank": 2, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "name": "c", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addrs": { 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "addrvec": [ 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 0 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "public_addr": "10.20.193.106:6790/0", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "priority": 0, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "weight": 0, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "time_added": "2026-02-17T05:27:44:165892+0000", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "crush_location": [] 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "feature_map": { 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "mon": [ 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.373 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "client": [ 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: ], 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "mgr": [ 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: { 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "features": "0x3f0ffffffffdffff", 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "release": "squid", 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "num": 1 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout: "stretch_mode": false 2026-02-17T05:46:51.374 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.118:6812/703720803 conn(0x7f65cc040b60 legacy=0x7f65cc061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 10 monclient: shutdown 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 >> v1:10.20.193.106:6789/0 conn(0x7f65fc182720 legacy=0x7f65fc181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6602082640 1 -- 10.20.193.106:0/3606779151 reap_dead start 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6602082640 1 -- 10.20.193.106:0/3606779151 reap_dead start 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 shutdown_connections 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 >> 10.20.193.106:0/3606779151 conn(0x7f65fc0915f0 msgr2=0x7f65fc08c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 shutdown_connections 2026-02-17T05:46:51.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.363+0000 7f6603b0c640 1 -- 10.20.193.106:0/3606779151 wait complete. 2026-02-17T05:46:51.375 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T05:46:51.375 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T05:46:51.375 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 10 monclient: monmap: 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:51.438754+0000 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:51.438754+0000 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:51.439 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 1 Processor -- start 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 1 -- start start 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.437+0000 7f153de8c640 10 monclient: init 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-c con 0x7f153805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-b con 0x7f153805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-a con 0x7f1538182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153808b060 con 0x7f1538182720 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153805dc90 con 0x7f153805d1b0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153808d6a0 con 0x7f153805dee0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient(hunting): authenticate will time out at 1740.067139s 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f1537fff640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1538182720 0x7f15381a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51402/0 (socket says 10.20.193.106:51402) 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f1537fff640 1 -- 10.20.193.106:0/3184476593 learned_addr learned my addr 10.20.193.106:0/3184476593 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f1536ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f153805dee0 0x7f1538181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43720/0 (socket says 10.20.193.106:43720) 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749713679 0 0) 0x7f153808d6a0 con 0x7f153805dee0 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.441 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): my global_id is 5447 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f151c0035e0 con 0x7f153805dee0 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705665307 0 0) 0x7f153808b060 con 0x7f1538182720 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient(hunting): my global_id is 164118 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f153808d6a0 con 0x7f1538182720 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 611262801 0 0) 0x7f153808d6a0 con 0x7f1538182720 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 >> v1:10.20.193.106:6790/0 conn(0x7f153805dee0 legacy=0x7f1538181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 >> v1:10.20.193.118:6789/0 conn(0x7f153805d1b0 legacy=0x7f153805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 monclient: found mon.noname-a 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1538057960 con 0x7f1538182720 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f152c003eb0 con 0x7f1538182720 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: dump: 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.442 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 5 monclient: authenticate success, global_id 164118 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f152c0040b0 con 0x7f1538182720 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 1 -- 10.20.193.106:0/3184476593 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f152c0044c0 con 0x7f1538182720 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 4 set_mon_vals no callback set 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f15367fc640 10 monclient: dump: 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 10 monclient: shutdown 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.438+0000 7f153de8c640 1 -- 10.20.193.106:0/3184476593 >> v1:10.20.193.106:6789/0 conn(0x7f1538182720 legacy=0x7f15381a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- 10.20.193.106:0/3184476593 shutdown_connections 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- 10.20.193.106:0/3184476593 >> 10.20.193.106:0/3184476593 conn(0x7f15380915f0 msgr2=0x7f15380919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.443 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- 10.20.193.106:0/3184476593 shutdown_connections 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- 10.20.193.106:0/3184476593 wait complete. 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient: build_initial_monmap 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient: monmap: 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:51.444 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 Processor -- start 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- start start 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient: init 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-b con 0x7f153805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-c con 0x7f153805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient(hunting): picked mon.noname-a con 0x7f1538182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153810e980 con 0x7f1538182720 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153810ef40 con 0x7f153805d1b0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153812af00 con 0x7f153805dee0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f153de8c640 10 monclient(hunting): authenticate will time out at 1740.068891s 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f1536ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f153805dee0 0x7f153812a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43736/0 (socket says 10.20.193.106:43736) 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.439+0000 7f1536ffd640 1 -- 10.20.193.106:0/1117235828 learned_addr learned my addr 10.20.193.106:0/1117235828 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083973698 0 0) 0x7f153812af00 con 0x7f153805dee0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): my global_id is 5450 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15080035e0 con 0x7f153805dee0 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57607217 0 0) 0x7f153810e980 con 0x7f1538182720 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:51.446 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): my global_id is 164121 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f153812af00 con 0x7f1538182720 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1950201274 0 0) 0x7f15080035e0 con 0x7f153805dee0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f153810e980 con 0x7f153805dee0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1528003170 con 0x7f153805dee0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): dump: 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2733964383 0 0) 0x7f153812af00 con 0x7f1538182720 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15080035e0 con 0x7f1538182720 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f152c003890 con 0x7f1538182720 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient(hunting): dump: 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.447 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3143401560 0 0) 0x7f153810e980 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 >> v1:10.20.193.118:6789/0 conn(0x7f153805d1b0 legacy=0x7f153812a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 >> v1:10.20.193.106:6789/0 conn(0x7f1538182720 legacy=0x7f1538181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 monclient: found mon.c 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153808a0e0 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: _finish_auth 0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 5 monclient: authenticate success, global_id 5450 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _renew_subs 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15381824f0 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _renew_subs 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f153812e0c0 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15280048a0 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1528004bc0 con 0x7f153805dee0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:51.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 10 monclient: dump: 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1535ffb640 4 set_mon_vals no callback set 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1528011b60 con 0x7f153805dee0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.440+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153810e310 con 0x7f153805dee0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.441+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f152804fbd0 con 0x7f153805dee0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.441+0000 7f15377fe640 10 monclient: get_auth_request con 0x7f1508040bb0 auth_method 0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.443+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f1528017400 con 0x7f153805dee0 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.443+0000 7f1513fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:51.449 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.443+0000 7f1513fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:51.592 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.590+0000 7f153de8c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.590+0000 7f153de8c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.590+0000 7f153de8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.590+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f1538055570 con 0x7f153805dee0 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.591+0000 7f1513fff640 1 -- 10.20.193.106:0/1117235828 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f1528016bb0 con 0x7f153805dee0 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.591+0000 7f1513fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T05:46:51.593 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.591+0000 7f1513fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=11,kv=10,logm=53} crc {auth=1485170054,config=1618278320,health=2206008969,kv=27218079,logm=1882721771}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=25,config=2,health=13,kv=11,logm=49} crc {auth=3338425272,config=1618278320,health=398243806,kv=675723720,logm=2608070924}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=11,kv=10,logm=53} crc {auth=1485170054,config=1618278320,health=2206008969,kv=27218079,logm=1882721771}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.591+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=26,config=2,health=12,kv=10,logm=50} crc {auth=4139561837,config=1618278320,health=2885620519,kv=675723720,logm=4213387547}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2725384680}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480732748}) 2026-02-17T05:46:51.594 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.595 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2725384680}) 2026-02-17T05:46:51.595 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.592+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=123810600}) 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 >> v1:10.20.193.118:6812/703720803 conn(0x7f1508040bb0 legacy=0x7f1508061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 10 monclient: shutdown 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 >> v1:10.20.193.106:6790/0 conn(0x7f153805dee0 legacy=0x7f153812a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 shutdown_connections 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 >> 10.20.193.106:0/1117235828 conn(0x7f15380915f0 msgr2=0x7f153808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 shutdown_connections 2026-02-17T05:46:51.595 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:51.592+0000 7f153de8c640 1 -- 10.20.193.106:0/1117235828 wait complete. 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=134151848}) 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1010101561}) 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=134151848}) 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1162657449}) 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.596 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2272576052}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=674323396}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2272576052}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.593+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4017051114}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=279544343}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3195493155}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=279544343}) 2026-02-17T05:46:51.597 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3371887866}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.594+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2275503213}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=880604083}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2275503213}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2880720285}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=64196385}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117167517}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=64196385}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.595+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=575141569}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2547083074}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4083159890}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2547083074}) 2026-02-17T05:46:51.598 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1304417176}) 2026-02-17T05:46:51.599 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.599 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=190460426}) 2026-02-17T05:46:51.599 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282548117}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=190460426}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4049527430}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=434203750}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3085639541}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=434203750}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.596+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=901347272}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2683619579}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2852244900}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2683619579}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=469962283}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311880168}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=296942130}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311880168}) 2026-02-17T05:46:51.600 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.597+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=260326677}) 2026-02-17T05:46:51.601 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.601 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3872622879}) 2026-02-17T05:46:51.601 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1292563929}) 2026-02-17T05:46:51.601 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.601 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3872622879}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1713769735}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3465206465}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032548248}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3465206465}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.598+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3863592279}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1928853560}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=494582292}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1928853560}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=167623926}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4133189664}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170606412}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4133189664}) 2026-02-17T05:46:51.602 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.599+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2674456851}) 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2015642171}) 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=346399891}) 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2015642171}) 2026-02-17T05:46:51.603 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2515491572}) 2026-02-17T05:46:51.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3432252660}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064575515}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3432252660}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.600+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=846192272}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=738197566}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101899428}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=738197566}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=643995247}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2432783020}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2961212302}) 2026-02-17T05:46:51.605 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2432783020}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1547280641}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=961486564}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304703822}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=961486564}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.601+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2882187619}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3017599840}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859670554}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3017599840}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3611645889}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3989112205}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3999940093}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3989112205}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.602+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=174402425}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2778997411}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2802711145}) 2026-02-17T05:46:51.606 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.607 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2778997411}) 2026-02-17T05:46:51.607 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3510362535}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3323884484}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405135416}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3323884484}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.603+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1223974222}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2899976763}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270202435}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2899976763}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=731127388}) 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.608 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1423437756}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1114965744}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1423437756}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3170790742}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4293407378}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3434026994}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4293407378}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.604+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=733307883}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2930496124}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2394304933}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2930496124}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=208059640}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544503337}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2113274104}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544503337}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.605+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=334868911}) 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.609 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3633762860}) 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283467086}) 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3633762860}) 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1164646388}) 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.610 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2128254385}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142354284}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2128254385}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.606+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2429987420}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2095399849}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31400318}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2095399849}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2091003303}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3618890387}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1054605374}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3618890387}) 2026-02-17T05:46:51.611 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.608+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=929357639}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=700896982}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3096667125}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=700896982}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=472396934}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4117809723}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016035173}) 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.612 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4117809723}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=619799787}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364389438}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.609+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3618996704}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364389438}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=870211448}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4028408716}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2204038769}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4028408716}) 2026-02-17T05:46:51.613 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2428074661}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2193003175}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2389715102}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2193003175}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.610+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=147853643}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2199367821}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944761217}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2199367821}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2959921203}) 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.614 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=45,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=14} crc {logm=115623068,mdsmap=568353036,mgr=4284612823,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1575553668,mon_config_key=713144630,monmap=1459694897,nvmeofgw=3360707893,osd_metadata=2084529926,osd_snap=3573088152}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=11} crc {logm=2414752581,mdsmap=443047005,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1008256543,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=603886948,osd_snap=688964085}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=45,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=14} crc {logm=115623068,mdsmap=568353036,mgr=4284612823,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1575553668,mon_config_key=713144630,monmap=1459694897,nvmeofgw=3360707893,osd_metadata=2084529926,osd_snap=3573088152}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.611+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=10} crc {logm=1178280621,mdsmap=568353036,mgr=1160408324,mgr_command_descs=1585555342,mgr_metadata=2028857886,mgrstat=1008256543,mon_config_key=597233681,monmap=1459694897,nvmeofgw=3360707892,osd_metadata=2084529926,osd_pg_creating=603886948,osd_snap=2470809465}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=4172926918}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=2350849351}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=4172926918}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=2526761401}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=15,osdmap=85} crc {osd_snap=573955913,osdmap=184500474}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=14,osdmap=86} crc {osd_snap=180856755,osdmap=2529253118}) 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.615 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=15,osdmap=85} crc {osd_snap=573955913,osdmap=184500474}) 2026-02-17T05:46:51.616 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.612+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=15,osdmap=85} crc {osd_snap=573955913,osdmap=3632347616}) 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=87} crc {osdmap=2632649287}) 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=82} crc {osdmap=543574409}) 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=87} crc {osdmap=2632649287}) 2026-02-17T05:46:51.617 INFO:tasks.ceph.mon.c.trial106.stderr:2026-02-17T05:46:51.615+0000 7fab121f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=87} crc {osdmap=2056831833}) 2026-02-17T05:46:52.605 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T05:46:52.605 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T05:46:52.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: get_monmap_and_config 2026-02-17T05:46:52.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: build_initial_monmap 2026-02-17T05:46:52.681 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: monmap: 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:52.671580+0000 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:52.671580+0000 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.682 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 1 Processor -- start 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 1 -- start start 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: init 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-a con 0x7f97f405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-c con 0x7f97f405dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-b con 0x7f97f4182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f408b060 con 0x7f97f405d1b0 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f405dc90 con 0x7f97f405dee0 2026-02-17T05:46:52.683 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f408d6a0 con 0x7f97f4182720 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.670+0000 7f97fbf94640 10 monclient(hunting): authenticate will time out at 1741.299918s 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f9d09640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f97f405d1b0 0x7f97f405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51420/0 (socket says 10.20.193.106:51420) 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f9d09640 1 -- 10.20.193.106:0/93006372 learned_addr learned my addr 10.20.193.106:0/93006372 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fa50a640 1 --1- 10.20.193.106:0/93006372 >> v1:10.20.193.106:6790/0 conn(0x7f97f4182720 0x7f97f41a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43752/0 (socket says 10.20.193.106:43752) 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294225916 0 0) 0x7f97f408d6a0 con 0x7f97f4182720 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): my global_id is 5453 2026-02-17T05:46:52.684 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97dc0035e0 con 0x7f97f4182720 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224170856 0 0) 0x7f97f408b060 con 0x7f97f405d1b0 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): my global_id is 164124 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f408d6a0 con 0x7f97f405d1b0 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258525869 0 0) 0x7f97f405dc90 con 0x7f97f405dee0 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient(hunting): my global_id is 134299 2026-02-17T05:46:52.685 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f408b060 con 0x7f97f405dee0 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3755717557 0 0) 0x7f97dc0035e0 con 0x7f97f4182720 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 >> v1:10.20.193.118:6789/0 conn(0x7f97f405dee0 legacy=0x7f97f4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 >> v1:10.20.193.106:6789/0 conn(0x7f97f405d1b0 legacy=0x7f97f405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: _finish_hunting 0 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 monclient: found mon.noname-b 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f4057960 con 0x7f97f4182720 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: _finish_auth 0 2026-02-17T05:46:52.686 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: _check_auth_tickets 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97f0003eb0 con 0x7f97f4182720 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: dump: 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.687 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 5 monclient: authenticate success, global_id 5453 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97f00040b0 con 0x7f97f4182720 2026-02-17T05:46:52.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 1 -- 10.20.193.106:0/93006372 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97f00044c0 con 0x7f97f4182720 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97f8d07640 10 monclient: dump: 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.689 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 4 set_mon_vals no callback set 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 10 monclient: shutdown 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 1 -- 10.20.193.106:0/93006372 >> v1:10.20.193.106:6790/0 conn(0x7f97f4182720 legacy=0x7f97f41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 1 -- 10.20.193.106:0/93006372 shutdown_connections 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 1 -- 10.20.193.106:0/93006372 >> 10.20.193.106:0/93006372 conn(0x7f97f40915f0 msgr2=0x7f97f40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 1 -- 10.20.193.106:0/93006372 shutdown_connections 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.671+0000 7f97fbf94640 1 -- 10.20.193.106:0/93006372 wait complete. 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient: build_initial_monmap 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient: monmap: 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:52.691 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 1 Processor -- start 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 1 -- start start 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient: init 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:52.692 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-c con 0x7f97f405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-a con 0x7f97f405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient(hunting): picked mon.noname-b con 0x7f97f4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f4109480 con 0x7f97f405dee0 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f413f4c0 con 0x7f97f4182720 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f405cec0 con 0x7f97f405d1b0 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97fbf94640 10 monclient(hunting): authenticate will time out at 1741.301716s 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97f9d09640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f97f405d1b0 0x7f97f4132380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43758/0 (socket says 10.20.193.106:43758) 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97f9508640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f97f405dee0 0x7f97f4180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51424/0 (socket says 10.20.193.106:51424) 2026-02-17T05:46:52.693 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97f9d09640 1 -- 10.20.193.106:0/1169296592 learned_addr learned my addr 10.20.193.106:0/1169296592 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280900074 0 0) 0x7f97f405cec0 con 0x7f97f405d1b0 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): my global_id is 5456 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97c40035e0 con 0x7f97f405d1b0 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214257544 0 0) 0x7f97f4109480 con 0x7f97f405dee0 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 10 monclient(hunting): my global_id is 164127 2026-02-17T05:46:52.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.672+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f405cec0 con 0x7f97f405dee0 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2280000657 0 0) 0x7f97c40035e0 con 0x7f97f405d1b0 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97f4109480 con 0x7f97f405d1b0 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97e4003150 con 0x7f97f405d1b0 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): dump: 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.695 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3234678988 0 0) 0x7f97f405cec0 con 0x7f97f405dee0 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97c40035e0 con 0x7f97f405dee0 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97e8003040 con 0x7f97f405dee0 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient(hunting): dump: 2026-02-17T05:46:52.696 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3108983148 0 0) 0x7f97f4109480 con 0x7f97f405d1b0 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 >> v1:10.20.193.118:6789/0 conn(0x7f97f4182720 legacy=0x7f97f4133390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 >> v1:10.20.193.106:6789/0 conn(0x7f97f405dee0 legacy=0x7f97f4180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 monclient: found mon.c 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f410a9a0 con 0x7f97f405d1b0 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 5 monclient: authenticate success, global_id 5456 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _renew_subs 2026-02-17T05:46:52.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97f410ac80 con 0x7f97f405d1b0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _renew_subs 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f97f41824f0 con 0x7f97f405d1b0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97e40034c0 con 0x7f97f405d1b0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f97e4004d00 con 0x7f97f405d1b0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 10 monclient: dump: 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.699 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e3fff640 4 set_mon_vals no callback set 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.700 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f40008d0 con 0x7f97f405d1b0 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.673+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f97e4011ca0 con 0x7f97f405d1b0 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.674+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f97e404fd30 con 0x7f97f405d1b0 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.674+0000 7f97f9508640 10 monclient: get_auth_request con 0x7f97c4040b10 auth_method 0 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.676+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f97e4017500 con 0x7f97f405d1b0 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.676+0000 7f97e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.701 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.676+0000 7f97e27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:52.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97fbf94640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T05:46:52.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97fbf94640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T05:46:52.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97fbf94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.826 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f97f408e3d0 con 0x7f97f405d1b0 2026-02-17T05:46:52.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97e27fc640 1 -- 10.20.193.106:0/1169296592 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1461935087) 0x7f97e4016cb0 con 0x7f97f405d1b0 2026-02-17T05:46:52.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T05:46:52.827 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.823+0000 7f97e27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:52.827 INFO:teuthology.orchestra.run.trial106.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","modified":"2026-02-17T05:27:44.165842Z","created":"2026-02-17T05:27:44.165842Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165890+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6789","nonce":0}]},"addr":"10.20.193.118:6789/0","public_addr":"10.20.193.118:6789/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165891+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6790","nonce":0}]},"addr":"10.20.193.106:6790/0","public_addr":"10.20.193.106:6790/0","priority":0,"weight":0,"time_added":"2026-02-17T05:27:44:165892+0000","crush_location":[]}]}} 2026-02-17T05:46:52.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 >> v1:10.20.193.118:6812/703720803 conn(0x7f97c4040b10 legacy=0x7f97c4060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.828 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 10 monclient: shutdown 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 >> v1:10.20.193.106:6790/0 conn(0x7f97f405d1b0 legacy=0x7f97f4132380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 shutdown_connections 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 >> 10.20.193.106:0/1169296592 conn(0x7f97f40915f0 msgr2=0x7f97f408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 shutdown_connections 2026-02-17T05:46:52.829 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.824+0000 7f97fbf94640 1 -- 10.20.193.106:0/1169296592 wait complete. 2026-02-17T05:46:52.834 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T05:46:52.835 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T05:46:52.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T05:46:52.853 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:52.926 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 10 monclient: get_monmap_and_config 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 10 monclient: build_initial_monmap 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 10 monclient: monmap: 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:52.917840+0000 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:52.917840+0000 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:52.927 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 1 Processor -- start 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 1 -- start start 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.916+0000 7fb608652640 10 monclient: init 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:52.928 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient(hunting): picked mon.noname-c con 0x7fb60005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient(hunting): picked mon.noname-a con 0x7fb60005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient(hunting): picked mon.noname-b con 0x7fb600182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60008b060 con 0x7fb60005dee0 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60005dc90 con 0x7fb60005d1b0 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60008d6a0 con 0x7fb600182720 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient(hunting): authenticate will time out at 1741.546229s 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb606bc8640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb600182720 0x7fb6001a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43772/0 (socket says 10.20.193.106:43772) 2026-02-17T05:46:52.929 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb605bc6640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb60005dee0 0x7fb600181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51436/0 (socket says 10.20.193.106:51436) 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb606bc8640 1 -- 10.20.193.106:0/957705313 learned_addr learned my addr 10.20.193.106:0/957705313 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572333362 0 0) 0x7fb60008b060 con 0x7fb60005dee0 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): my global_id is 164130 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e80035e0 con 0x7fb60005dee0 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611634895 0 0) 0x7fb60008d6a0 con 0x7fb600182720 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.930 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient(hunting): my global_id is 5459 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb60008b060 con 0x7fb600182720 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 564685921 0 0) 0x7fb5e80035e0 con 0x7fb60005dee0 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 >> v1:10.20.193.106:6790/0 conn(0x7fb600182720 legacy=0x7fb6001a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 >> v1:10.20.193.118:6789/0 conn(0x7fb60005d1b0 legacy=0x7fb60005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: _finish_hunting 0 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 monclient: found mon.noname-a 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:52.931 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb600057960 con 0x7fb60005dee0 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: _finish_auth 0 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: _check_auth_tickets 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb5f4002dd0 con 0x7fb60005dee0 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 5 monclient: authenticate success, global_id 164130 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: dump: 2026-02-17T05:46:52.932 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:52.933 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5f4002fa0 con 0x7fb60005dee0 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 1 -- 10.20.193.106:0/957705313 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb5f40033b0 con 0x7fb60005dee0 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb608652640 4 set_mon_vals no callback set 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.917+0000 7fb6053c5640 10 monclient: dump: 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.934 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: shutdown 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- 10.20.193.106:0/957705313 >> v1:10.20.193.106:6789/0 conn(0x7fb60005dee0 legacy=0x7fb600181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.935 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- 10.20.193.106:0/957705313 shutdown_connections 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- 10.20.193.106:0/957705313 >> 10.20.193.106:0/957705313 conn(0x7fb6000915f0 msgr2=0x7fb6000919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- 10.20.193.106:0/957705313 shutdown_connections 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- 10.20.193.106:0/957705313 wait complete. 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: build_initial_monmap 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: monmap: 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:52.936 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 Processor -- start 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- start start 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: init 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:52.937 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient(hunting): picked mon.noname-b con 0x7fb60005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient(hunting): picked mon.noname-a con 0x7fb60005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient(hunting): picked mon.noname-c con 0x7fb600182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60005c610 con 0x7fb60005dee0 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60010a7d0 con 0x7fb60005d1b0 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60010c570 con 0x7fb600182720 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb608652640 10 monclient(hunting): authenticate will time out at 1741.547933s 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb606bc8640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb600182720 0x7fb6001140a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43784/0 (socket says 10.20.193.106:43784) 2026-02-17T05:46:52.938 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb605bc6640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb60005dee0 0x7fb600180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51450/0 (socket says 10.20.193.106:51450) 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.918+0000 7fb606bc8640 1 -- 10.20.193.106:0/136640544 learned_addr learned my addr 10.20.193.106:0/136640544 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074190207 0 0) 0x7fb60010c570 con 0x7fb600182720 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): my global_id is 5462 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d00035e0 con 0x7fb600182720 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94650111 0 0) 0x7fb600057960 con 0x7fb60005dee0 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:52.939 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): my global_id is 164133 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb60010c570 con 0x7fb60005dee0 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4209169792 0 0) 0x7fb5d00035e0 con 0x7fb600182720 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb600057960 con 0x7fb600182720 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb5fc004250 con 0x7fb600182720 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.940 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3284114042 0 0) 0x7fb60010c570 con 0x7fb60005dee0 2026-02-17T05:46:52.941 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5d00035e0 con 0x7fb60005dee0 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb5f4002ce0 con 0x7fb60005dee0 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.942 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4173251581 0 0) 0x7fb600057960 con 0x7fb600182720 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 >> v1:10.20.193.118:6789/0 conn(0x7fb60005d1b0 legacy=0x7fb60012b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 >> v1:10.20.193.106:6789/0 conn(0x7fb60005dee0 legacy=0x7fb600180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 monclient: found mon.c 2026-02-17T05:46:52.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60010c850 con 0x7fb600182720 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 5 monclient: authenticate success, global_id 5462 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _renew_subs 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb60010b390 con 0x7fb600182720 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _renew_subs 2026-02-17T05:46:52.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb60012c080 con 0x7fb600182720 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5fc005980 con 0x7fb600182720 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb5fc005ca0 con 0x7fb600182720 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb5e6ffd640 10 monclient: dump: 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:52.945 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb604bc4640 4 set_mon_vals no callback set 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.919+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600182550 con 0x7fb600182720 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.920+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb5fc012c40 con 0x7fb600182720 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.920+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fb5fc050b20 con 0x7fb600182720 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.920+0000 7fb6063c7640 10 monclient: get_auth_request con 0x7fb5d0040bb0 auth_method 0 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.922+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb5fc0182f0 con 0x7fb600182720 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.922+0000 7fb5e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:52.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:52.922+0000 7fb5e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:53.026 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.023+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb600057ca0 con 0x7fb5d0040bb0 2026-02-17T05:46:53.027 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.024+0000 7fb5e6ffd640 1 -- 10.20.193.106:0/136640544 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33976 (unknown 2965378022 0 1584652880) 0x7fb5f0007880 con 0x7fb5d0040bb0 2026-02-17T05:46:53.027 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 >> v1:10.20.193.118:6812/703720803 conn(0x7fb5d0040bb0 legacy=0x7fb5d0061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 10 monclient: shutdown 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 >> v1:10.20.193.106:6790/0 conn(0x7fb600182720 legacy=0x7fb6001140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 shutdown_connections 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 >> 10.20.193.106:0/136640544 conn(0x7fb6000915f0 msgr2=0x7fb6001a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 shutdown_connections 2026-02-17T05:46:53.029 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.025+0000 7fb608652640 1 -- 10.20.193.106:0/136640544 wait complete. 2026-02-17T05:46:53.035 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1444,"stamp":"2026-02-17T05:46:51.837168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":231040,"kb_used_data":15136,"kb_used_omap":10831,"kb_used_meta":204976,"kb_avail":566000000,"statfs":{"total":579820584960,"available":579584000000,"internally_reserved":0,"allocated":15499264,"data_stored":9040828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11091027,"internal_metadata":209896365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001018"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1879,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879690+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:45:33.879690+0000","last_peered":"2026-02-17T05:45:33.879690+0000","last_clean":"2026-02-17T05:45:33.879690+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:45:33.879690+0000","last_undegraded":"2026-02-17T05:45:33.879690+0000","last_fullsized":"2026-02-17T05:45:33.879690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879267+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:45:33.879267+0000","last_peered":"2026-02-17T05:45:33.879267+0000","last_clean":"2026-02-17T05:45:33.879267+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:45:33.879267+0000","last_undegraded":"2026-02-17T05:45:33.879267+0000","last_fullsized":"2026-02-17T05:45:33.879267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1742,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879568+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:45:33.879568+0000","last_peered":"2026-02-17T05:45:33.879568+0000","last_clean":"2026-02-17T05:45:33.879568+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:45:33.879568+0000","last_undegraded":"2026-02-17T05:45:33.879568+0000","last_fullsized":"2026-02-17T05:45:33.879568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.490045+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:45:33.490045+0000","last_peered":"2026-02-17T05:45:33.490045+0000","last_clean":"2026-02-17T05:45:33.490045+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:45:33.490045+0000","last_undegraded":"2026-02-17T05:45:33.490045+0000","last_fullsized":"2026-02-17T05:45:33.490045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879262+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:45:33.879262+0000","last_peered":"2026-02-17T05:45:33.879262+0000","last_clean":"2026-02-17T05:45:33.879262+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:45:33.879262+0000","last_undegraded":"2026-02-17T05:45:33.879262+0000","last_fullsized":"2026-02-17T05:45:33.879262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398518+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:45:33.398518+0000","last_peered":"2026-02-17T05:45:33.398518+0000","last_clean":"2026-02-17T05:45:33.398518+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:45:33.398518+0000","last_undegraded":"2026-02-17T05:45:33.398518+0000","last_fullsized":"2026-02-17T05:45:33.398518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879658+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:45:33.879658+0000","last_peered":"2026-02-17T05:45:33.879658+0000","last_clean":"2026-02-17T05:45:33.879658+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:45:33.879658+0000","last_undegraded":"2026-02-17T05:45:33.879658+0000","last_fullsized":"2026-02-17T05:45:33.879658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398545+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:45:33.398545+0000","last_peered":"2026-02-17T05:45:33.398545+0000","last_clean":"2026-02-17T05:45:33.398545+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:45:33.398545+0000","last_undegraded":"2026-02-17T05:45:33.398545+0000","last_fullsized":"2026-02-17T05:45:33.398545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879717+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:45:33.879717+0000","last_peered":"2026-02-17T05:45:33.879717+0000","last_clean":"2026-02-17T05:45:33.879717+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:45:33.879717+0000","last_undegraded":"2026-02-17T05:45:33.879717+0000","last_fullsized":"2026-02-17T05:45:33.879717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":1947,"kb_used_meta":43044,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1994144,"internal_metadata":44077664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2328,"kb_used_omap":1525,"kb_used_meta":25418,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1562458,"internal_metadata":26028198},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1409,"kb_used_meta":25534,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1442817,"internal_metadata":26147839},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47336,"kb_used_data":2328,"kb_used_omap":2230,"kb_used_meta":42761,"kb_avail":94324504,"statfs":{"total":96636764160,"available":96588292096,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2284468,"internal_metadata":43787340},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":2358,"kb_used_meta":42633,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2415385,"internal_metadata":43656423},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1359,"kb_used_meta":25584,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1391755,"internal_metadata":26198901},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:53.037 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:53.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.099+0000 7f0aec05b640 10 monclient: get_monmap_and_config 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.099+0000 7f0aec05b640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.099+0000 7f0aec05b640 10 monclient: monmap: 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:53.100995+0000 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:53.100995+0000 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.102 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.103 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.103 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:53.103 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:53.103 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 1 Processor -- start 2026-02-17T05:46:53.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 1 -- start start 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient: init 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-b con 0x7f0ae405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-a con 0x7f0ae405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-c con 0x7f0ae4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae408b060 con 0x7f0ae405dee0 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae405dc90 con 0x7f0ae4182720 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae408d6a0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0aec05b640 10 monclient(hunting): authenticate will time out at 1741.729651s 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae9dd0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f0ae405d1b0 0x7f0ae405d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43792/0 (socket says 10.20.193.106:43792) 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae9dd0640 1 -- 10.20.193.106:0/1253973581 learned_addr learned my addr 10.20.193.106:0/1253973581 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765755929 0 0) 0x7f0ae408b060 con 0x7f0ae405dee0 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): my global_id is 164136 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0acc0035e0 con 0x7f0ae405dee0 2026-02-17T05:46:53.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14339786 0 0) 0x7f0ae408d6a0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 10 monclient(hunting): my global_id is 5465 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.100+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae408b060 con 0x7f0ae405d1b0 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1929474095 0 0) 0x7f0acc0035e0 con 0x7f0ae405dee0 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 >> v1:10.20.193.106:6790/0 conn(0x7f0ae405d1b0 legacy=0x7f0ae405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 >> v1:10.20.193.118:6789/0 conn(0x7f0ae4182720 legacy=0x7f0ae41a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 monclient: found mon.noname-a 2026-02-17T05:46:53.115 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae4057960 con 0x7f0ae405dee0 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ad8002dd0 con 0x7f0ae405dee0 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: dump: 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.116 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 5 monclient: authenticate success, global_id 164136 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:53.117 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ad8003090 con 0x7f0ae405dee0 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 1 -- 10.20.193.106:0/1253973581 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ad80034a0 con 0x7f0ae405dee0 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0ae8dce640 10 monclient: dump: 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.118 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 4 set_mon_vals no callback set 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 10 monclient: shutdown 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 1 -- 10.20.193.106:0/1253973581 >> v1:10.20.193.106:6789/0 conn(0x7f0ae405dee0 legacy=0x7f0ae4181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 1 -- 10.20.193.106:0/1253973581 shutdown_connections 2026-02-17T05:46:53.119 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 1 -- 10.20.193.106:0/1253973581 >> 10.20.193.106:0/1253973581 conn(0x7f0ae40915f0 msgr2=0x7f0ae40919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 1 -- 10.20.193.106:0/1253973581 shutdown_connections 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.101+0000 7f0aec05b640 1 -- 10.20.193.106:0/1253973581 wait complete. 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient: monmap: 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:53.120 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 1 Processor -- start 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 1 -- start start 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient: init 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-c con 0x7f0ae405d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-a con 0x7f0ae405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient(hunting): picked mon.noname-b con 0x7f0ae4182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae405e8e0 con 0x7f0ae405dee0 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae410e260 con 0x7f0ae4182720 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae408a000 con 0x7f0ae405d1b0 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0aec05b640 10 monclient(hunting): authenticate will time out at 1741.731638s 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ae95cf640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f0ae405dee0 0x7f0ae413d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51460/0 (socket says 10.20.193.106:51460) 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ae9dd0640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f0ae405d1b0 0x7f0ae413cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43808/0 (socket says 10.20.193.106:43808) 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ae95cf640 1 -- 10.20.193.106:0/251449053 learned_addr learned my addr 10.20.193.106:0/251449053 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106410834 0 0) 0x7f0ae408a000 con 0x7f0ae405d1b0 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): my global_id is 5468 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab40035e0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123860527 0 0) 0x7f0ae405e8e0 con 0x7f0ae405dee0 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 10 monclient(hunting): my global_id is 164139 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae408a000 con 0x7f0ae405dee0 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3429938871 0 0) 0x7f0ab40035e0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.102+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae405e8e0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ad4003090 con 0x7f0ae405d1b0 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): dump: 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.124 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728578607 0 0) 0x7f0ae410e260 con 0x7f0ae4182720 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): my global_id is 134311 2026-02-17T05:46:53.125 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab40035e0 con 0x7f0ae4182720 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3247718484 0 0) 0x7f0ae408a000 con 0x7f0ae405dee0 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae410e260 con 0x7f0ae405dee0 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ad80033b0 con 0x7f0ae405dee0 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient(hunting): dump: 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.126 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1439031194 0 0) 0x7f0ae405e8e0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 >> v1:10.20.193.118:6789/0 conn(0x7f0ae4182720 legacy=0x7f0ae4181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 >> v1:10.20.193.106:6789/0 conn(0x7f0ae405dee0 legacy=0x7f0ae413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 monclient: found mon.c 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.127 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae41824f0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 5 monclient: authenticate success, global_id 5468 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _renew_subs 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae410f0d0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.128 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _renew_subs 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ae410d8d0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ad4003530 con 0x7f0ae405d1b0 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0ad4004a50 con 0x7f0ae405d1b0 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad3fff640 4 set_mon_vals no callback set 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 10 monclient: dump: 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.129 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.130 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae40008d0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f0ad40119f0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.103+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f0ad404fbe0 con 0x7f0ae405d1b0 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.104+0000 7f0ae95cf640 10 monclient: get_auth_request con 0x7f0ab4040dd0 auth_method 0 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.106+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f0ad4013200 con 0x7f0ae405d1b0 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.106+0000 7f0ad27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.131 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.106+0000 7f0ad27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:53.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.208+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ae4089ba0 con 0x7f0ab4040dd0 2026-02-17T05:46:53.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.208+0000 7f0ad27fc640 1 -- 10.20.193.106:0/251449053 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33976 (unknown 2965378022 0 1584652880) 0x7f0ad8007920 con 0x7f0ab4040dd0 2026-02-17T05:46:53.212 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:46:53.213 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:46:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 >> v1:10.20.193.118:6812/703720803 conn(0x7f0ab4040dd0 legacy=0x7f0ab4061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 10 monclient: shutdown 2026-02-17T05:46:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 >> v1:10.20.193.106:6790/0 conn(0x7f0ae405d1b0 legacy=0x7f0ae413cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 shutdown_connections 2026-02-17T05:46:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 >> 10.20.193.106:0/251449053 conn(0x7f0ae40915f0 msgr2=0x7f0ae408c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 shutdown_connections 2026-02-17T05:46:53.214 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.209+0000 7f0aec05b640 1 -- 10.20.193.106:0/251449053 wait complete. 2026-02-17T05:46:53.219 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1444,"stamp":"2026-02-17T05:46:51.837168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":231040,"kb_used_data":15136,"kb_used_omap":10831,"kb_used_meta":204976,"kb_avail":566000000,"statfs":{"total":579820584960,"available":579584000000,"internally_reserved":0,"allocated":15499264,"data_stored":9040828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11091027,"internal_metadata":209896365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001018"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1879,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879690+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:45:33.879690+0000","last_peered":"2026-02-17T05:45:33.879690+0000","last_clean":"2026-02-17T05:45:33.879690+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:45:33.879690+0000","last_undegraded":"2026-02-17T05:45:33.879690+0000","last_fullsized":"2026-02-17T05:45:33.879690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879267+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:45:33.879267+0000","last_peered":"2026-02-17T05:45:33.879267+0000","last_clean":"2026-02-17T05:45:33.879267+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:45:33.879267+0000","last_undegraded":"2026-02-17T05:45:33.879267+0000","last_fullsized":"2026-02-17T05:45:33.879267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1742,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879568+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:45:33.879568+0000","last_peered":"2026-02-17T05:45:33.879568+0000","last_clean":"2026-02-17T05:45:33.879568+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:45:33.879568+0000","last_undegraded":"2026-02-17T05:45:33.879568+0000","last_fullsized":"2026-02-17T05:45:33.879568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.490045+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:45:33.490045+0000","last_peered":"2026-02-17T05:45:33.490045+0000","last_clean":"2026-02-17T05:45:33.490045+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:45:33.490045+0000","last_undegraded":"2026-02-17T05:45:33.490045+0000","last_fullsized":"2026-02-17T05:45:33.490045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879262+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:45:33.879262+0000","last_peered":"2026-02-17T05:45:33.879262+0000","last_clean":"2026-02-17T05:45:33.879262+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:45:33.879262+0000","last_undegraded":"2026-02-17T05:45:33.879262+0000","last_fullsized":"2026-02-17T05:45:33.879262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398518+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:45:33.398518+0000","last_peered":"2026-02-17T05:45:33.398518+0000","last_clean":"2026-02-17T05:45:33.398518+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:45:33.398518+0000","last_undegraded":"2026-02-17T05:45:33.398518+0000","last_fullsized":"2026-02-17T05:45:33.398518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879658+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:45:33.879658+0000","last_peered":"2026-02-17T05:45:33.879658+0000","last_clean":"2026-02-17T05:45:33.879658+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:45:33.879658+0000","last_undegraded":"2026-02-17T05:45:33.879658+0000","last_fullsized":"2026-02-17T05:45:33.879658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398545+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:45:33.398545+0000","last_peered":"2026-02-17T05:45:33.398545+0000","last_clean":"2026-02-17T05:45:33.398545+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:45:33.398545+0000","last_undegraded":"2026-02-17T05:45:33.398545+0000","last_fullsized":"2026-02-17T05:45:33.398545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879717+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:45:33.879717+0000","last_peered":"2026-02-17T05:45:33.879717+0000","last_clean":"2026-02-17T05:45:33.879717+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:45:33.879717+0000","last_undegraded":"2026-02-17T05:45:33.879717+0000","last_fullsized":"2026-02-17T05:45:33.879717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":1947,"kb_used_meta":43044,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1994144,"internal_metadata":44077664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2328,"kb_used_omap":1525,"kb_used_meta":25418,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1562458,"internal_metadata":26028198},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1409,"kb_used_meta":25534,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1442817,"internal_metadata":26147839},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47336,"kb_used_data":2328,"kb_used_omap":2230,"kb_used_meta":42761,"kb_avail":94324504,"statfs":{"total":96636764160,"available":96588292096,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2284468,"internal_metadata":43787340},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":2358,"kb_used_meta":42633,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2415385,"internal_metadata":43656423},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1359,"kb_used_meta":25584,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1391755,"internal_metadata":26198901},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:53.221 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T05:46:53.221 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: get_monmap_and_config 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: monmap: 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:53.286624+0000 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:53.286624+0000 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:53.287 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 1 Processor -- start 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 1 -- start start 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: init 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:53.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-b con 0x7f1b4805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-c con 0x7f1b4805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.285+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-a con 0x7f1b48182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4808b060 con 0x7f1b48182720 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4805dc90 con 0x7f1b4805dee0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4808d6a0 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 10 monclient(hunting): authenticate will time out at 1741.915024s 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4e590640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1b4805d1b0 0x7f1b4805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43816/0 (socket says 10.20.193.106:43816) 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4ed91640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f1b48182720 0x7f1b481a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51468/0 (socket says 10.20.193.106:51468) 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4e590640 1 -- 10.20.193.106:0/404818150 learned_addr learned my addr 10.20.193.106:0/404818150 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348828889 0 0) 0x7f1b4808b060 con 0x7f1b48182720 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): my global_id is 164142 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b380035e0 con 0x7f1b48182720 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091976515 0 0) 0x7f1b4808d6a0 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient(hunting): my global_id is 5471 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4808b060 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1911805463 0 0) 0x7f1b4808b060 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 >> v1:10.20.193.118:6789/0 conn(0x7f1b4805dee0 legacy=0x7f1b48181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 >> v1:10.20.193.106:6789/0 conn(0x7f1b48182720 legacy=0x7f1b481a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 monclient: found mon.noname-b 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b48057960 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1b40002dd0 con 0x7f1b4805d1b0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: dump: 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.289 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 5 monclient: authenticate success, global_id 5471 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b40002f60 con 0x7f1b4805d1b0 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 1 -- 10.20.193.106:0/404818150 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1b40003370 con 0x7f1b4805d1b0 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b4d58e640 10 monclient: dump: 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 4 set_mon_vals no callback set 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 10 monclient: shutdown 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- 10.20.193.106:0/404818150 >> v1:10.20.193.106:6790/0 conn(0x7f1b4805d1b0 legacy=0x7f1b4805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- 10.20.193.106:0/404818150 shutdown_connections 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- 10.20.193.106:0/404818150 >> 10.20.193.106:0/404818150 conn(0x7f1b480915f0 msgr2=0x7f1b480919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- 10.20.193.106:0/404818150 shutdown_connections 2026-02-17T05:46:53.290 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.286+0000 7f1b5081b640 1 -- 10.20.193.106:0/404818150 wait complete. 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient: monmap: 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 1 Processor -- start 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 1 -- start start 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient: init 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-b con 0x7f1b4805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-c con 0x7f1b4805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient(hunting): picked mon.noname-a con 0x7f1b48182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4805e950 con 0x7f1b48182720 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4810cb70 con 0x7f1b4805d1b0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4812c090 con 0x7f1b4805dee0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.287+0000 7f1b5081b640 10 monclient(hunting): authenticate will time out at 1741.916963s 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b4dd8f640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1b4805dee0 0x7f1b4812b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43826/0 (socket says 10.20.193.106:43826) 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b4dd8f640 1 -- 10.20.193.106:0/225687795 learned_addr learned my addr 10.20.193.106:0/225687795 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844951493 0 0) 0x7f1b4812c090 con 0x7f1b4805dee0 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.292 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): my global_id is 5474 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b180035e0 con 0x7f1b4805dee0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080225195 0 0) 0x7f1b3c003ad0 con 0x7f1b48182720 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): my global_id is 164145 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4812c090 con 0x7f1b48182720 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3208489459 0 0) 0x7f1b180035e0 con 0x7f1b4805dee0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b3c003ad0 con 0x7f1b4805dee0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1b34003110 con 0x7f1b4805dee0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3953575240 0 0) 0x7f1b4812c090 con 0x7f1b48182720 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b180035e0 con 0x7f1b48182720 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1b3c0042d0 con 0x7f1b48182720 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 774347836 0 0) 0x7f1b3c003ad0 con 0x7f1b4805dee0 2026-02-17T05:46:53.293 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 >> v1:10.20.193.118:6789/0 conn(0x7f1b4805d1b0 legacy=0x7f1b4812b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 >> v1:10.20.193.106:6789/0 conn(0x7f1b48182720 legacy=0x7f1b48181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 monclient: found mon.c 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4810bd00 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 5 monclient: authenticate success, global_id 5474 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _renew_subs 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4810a810 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _renew_subs 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1b4810b370 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b34003480 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1b34003b30 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 10 monclient: dump: 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b4cd8d640 4 set_mon_vals no callback set 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1b34003c90 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.288+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b480008d0 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.289+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f1b3404fce0 con 0x7f1b4805dee0 2026-02-17T05:46:53.294 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.289+0000 7f1b4e590640 10 monclient: get_auth_request con 0x7f1b18040b60 auth_method 0 2026-02-17T05:46:53.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.291+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f1b34004520 con 0x7f1b4805dee0 2026-02-17T05:46:53.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.291+0000 7f1b32ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.295 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.291+0000 7f1b32ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:53.395 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.393+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b48057ca0 con 0x7f1b18040b60 2026-02-17T05:46:53.396 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.393+0000 7f1b32ffd640 1 -- 10.20.193.106:0/225687795 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33976 (unknown 2965378022 0 1584652880) 0x7f1b40002be0 con 0x7f1b18040b60 2026-02-17T05:46:53.397 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:46:53.398 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:46:53.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 >> v1:10.20.193.118:6812/703720803 conn(0x7f1b18040b60 legacy=0x7f1b18061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 10 monclient: shutdown 2026-02-17T05:46:53.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.398 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 >> v1:10.20.193.106:6790/0 conn(0x7f1b4805dee0 legacy=0x7f1b4812b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 shutdown_connections 2026-02-17T05:46:53.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.394+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 >> 10.20.193.106:0/225687795 conn(0x7f1b480915f0 msgr2=0x7f1b4808b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.395+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 shutdown_connections 2026-02-17T05:46:53.399 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.395+0000 7f1b5081b640 1 -- 10.20.193.106:0/225687795 wait complete. 2026-02-17T05:46:53.405 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1444,"stamp":"2026-02-17T05:46:51.837168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":231040,"kb_used_data":15136,"kb_used_omap":10831,"kb_used_meta":204976,"kb_avail":566000000,"statfs":{"total":579820584960,"available":579584000000,"internally_reserved":0,"allocated":15499264,"data_stored":9040828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11091027,"internal_metadata":209896365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001018"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1879,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879690+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:45:33.879690+0000","last_peered":"2026-02-17T05:45:33.879690+0000","last_clean":"2026-02-17T05:45:33.879690+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:45:33.879690+0000","last_undegraded":"2026-02-17T05:45:33.879690+0000","last_fullsized":"2026-02-17T05:45:33.879690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879267+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:45:33.879267+0000","last_peered":"2026-02-17T05:45:33.879267+0000","last_clean":"2026-02-17T05:45:33.879267+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:45:33.879267+0000","last_undegraded":"2026-02-17T05:45:33.879267+0000","last_fullsized":"2026-02-17T05:45:33.879267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1742,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879568+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:45:33.879568+0000","last_peered":"2026-02-17T05:45:33.879568+0000","last_clean":"2026-02-17T05:45:33.879568+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:45:33.879568+0000","last_undegraded":"2026-02-17T05:45:33.879568+0000","last_fullsized":"2026-02-17T05:45:33.879568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.490045+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:45:33.490045+0000","last_peered":"2026-02-17T05:45:33.490045+0000","last_clean":"2026-02-17T05:45:33.490045+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:45:33.490045+0000","last_undegraded":"2026-02-17T05:45:33.490045+0000","last_fullsized":"2026-02-17T05:45:33.490045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879262+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:45:33.879262+0000","last_peered":"2026-02-17T05:45:33.879262+0000","last_clean":"2026-02-17T05:45:33.879262+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:45:33.879262+0000","last_undegraded":"2026-02-17T05:45:33.879262+0000","last_fullsized":"2026-02-17T05:45:33.879262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398518+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:45:33.398518+0000","last_peered":"2026-02-17T05:45:33.398518+0000","last_clean":"2026-02-17T05:45:33.398518+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:45:33.398518+0000","last_undegraded":"2026-02-17T05:45:33.398518+0000","last_fullsized":"2026-02-17T05:45:33.398518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879658+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:45:33.879658+0000","last_peered":"2026-02-17T05:45:33.879658+0000","last_clean":"2026-02-17T05:45:33.879658+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:45:33.879658+0000","last_undegraded":"2026-02-17T05:45:33.879658+0000","last_fullsized":"2026-02-17T05:45:33.879658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398545+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:45:33.398545+0000","last_peered":"2026-02-17T05:45:33.398545+0000","last_clean":"2026-02-17T05:45:33.398545+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:45:33.398545+0000","last_undegraded":"2026-02-17T05:45:33.398545+0000","last_fullsized":"2026-02-17T05:45:33.398545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879717+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:45:33.879717+0000","last_peered":"2026-02-17T05:45:33.879717+0000","last_clean":"2026-02-17T05:45:33.879717+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:45:33.879717+0000","last_undegraded":"2026-02-17T05:45:33.879717+0000","last_fullsized":"2026-02-17T05:45:33.879717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":1947,"kb_used_meta":43044,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1994144,"internal_metadata":44077664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2328,"kb_used_omap":1525,"kb_used_meta":25418,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1562458,"internal_metadata":26028198},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1409,"kb_used_meta":25534,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1442817,"internal_metadata":26147839},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47336,"kb_used_data":2328,"kb_used_omap":2230,"kb_used_meta":42761,"kb_avail":94324504,"statfs":{"total":96636764160,"available":96588292096,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2284468,"internal_metadata":43787340},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":2358,"kb_used_meta":42633,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2415385,"internal_metadata":43656423},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1359,"kb_used_meta":25584,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1391755,"internal_metadata":26198901},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:53.406 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:46:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: get_monmap_and_config 2026-02-17T05:46:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.482 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: monmap: 2026-02-17T05:46:53.482 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.482 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:53.473660+0000 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:53.473660+0000 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 1 Processor -- start 2026-02-17T05:46:53.483 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 1 -- start start 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: init 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-a con 0x7fb01005d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-b con 0x7fb01005dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-c con 0x7fb010182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.472+0000 7fb0155c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01008b060 con 0x7fb01005d1b0 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01005dc90 con 0x7fb010182720 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01008d6a0 con 0x7fb01005dee0 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.484 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 10 monclient(hunting): authenticate will time out at 1742.102015s 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00effd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb01005d1b0 0x7fb01005d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:51484/0 (socket says 10.20.193.106:51484) 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00e7fc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb01005dee0 0x7fb010181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43834/0 (socket says 10.20.193.106:43834) 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00effd640 1 -- 10.20.193.106:0/3219384862 learned_addr learned my addr 10.20.193.106:0/3219384862 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599942862 0 0) 0x7fb01008d6a0 con 0x7fb01005dee0 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): my global_id is 5477 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faffc0035e0 con 0x7fb01005dee0 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769198678 0 0) 0x7fb01008b060 con 0x7fb01005d1b0 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.485 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient(hunting): my global_id is 164148 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb01008d6a0 con 0x7fb01005d1b0 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 552413007 0 0) 0x7faffc0035e0 con 0x7fb01005dee0 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 >> v1:10.20.193.118:6789/0 conn(0x7fb010182720 legacy=0x7fb0101a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 >> v1:10.20.193.106:6789/0 conn(0x7fb01005d1b0 legacy=0x7fb01005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 monclient: found mon.noname-b 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb010057960 con 0x7fb01005dee0 2026-02-17T05:46:53.486 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faff8002dd0 con 0x7fb01005dee0 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: dump: 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.487 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 5 monclient: authenticate success, global_id 5477 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faff8003090 con 0x7fb01005dee0 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 4 set_mon_vals no callback set 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 1 -- 10.20.193.106:0/3219384862 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faff80034a0 con 0x7fb01005dee0 2026-02-17T05:46:53.488 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb00dffb640 10 monclient: dump: 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.489 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 10 monclient: shutdown 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- 10.20.193.106:0/3219384862 >> v1:10.20.193.106:6790/0 conn(0x7fb01005dee0 legacy=0x7fb010181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- 10.20.193.106:0/3219384862 shutdown_connections 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- 10.20.193.106:0/3219384862 >> 10.20.193.106:0/3219384862 conn(0x7fb0100915f0 msgr2=0x7fb0100919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- 10.20.193.106:0/3219384862 shutdown_connections 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.473+0000 7fb0155c2640 1 -- 10.20.193.106:0/3219384862 wait complete. 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient: build_initial_monmap 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient: monmap: 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:53.490 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 1 Processor -- start 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 1 -- start start 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient: init 2026-02-17T05:46:53.491 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-c con 0x7fb01005d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-a con 0x7fb01005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient(hunting): picked mon.noname-b con 0x7fb010182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01005e950 con 0x7fb01005dee0 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01010cc80 con 0x7fb010182720 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01012c1a0 con 0x7fb01005d1b0 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.474+0000 7fb0155c2640 10 monclient(hunting): authenticate will time out at 1742.104007s 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb00effd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb01005d1b0 0x7fb01012b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:43840/0 (socket says 10.20.193.106:43840) 2026-02-17T05:46:53.492 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb00effd640 1 -- 10.20.193.106:0/3933411439 learned_addr learned my addr 10.20.193.106:0/3933411439 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147038324 0 0) 0x7fb01012c1a0 con 0x7fb01005d1b0 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): my global_id is 5480 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafdc0035e0 con 0x7fb01005d1b0 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797205191 0 0) 0x7fb010057960 con 0x7fb01005dee0 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): my global_id is 164151 2026-02-17T05:46:53.493 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb01012c1a0 con 0x7fb01005dee0 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853753736 0 0) 0x7fb01010cc80 con 0x7fb010182720 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): my global_id is 134317 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb010057960 con 0x7fb010182720 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2546299188 0 0) 0x7fafdc0035e0 con 0x7fb01005d1b0 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb01010cc80 con 0x7fb01005d1b0 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb0040030d0 con 0x7fb01005d1b0 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:53.494 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): dump: 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.495 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2834906997 0 0) 0x7fb01012c1a0 con 0x7fb01005dee0 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafdc0035e0 con 0x7fb01005dee0 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7faff80033b0 con 0x7fb01005dee0 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient(hunting): dump: 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.496 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3449259606 0 0) 0x7fb01010cc80 con 0x7fb01005d1b0 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 >> v1:10.20.193.118:6789/0 conn(0x7fb010182720 legacy=0x7fb010181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 >> v1:10.20.193.106:6789/0 conn(0x7fb01005dee0 legacy=0x7fb01012ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 monclient: found mon.c 2026-02-17T05:46:53.497 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01010be10 con 0x7fb01005d1b0 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: _finish_auth 0 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 5 monclient: authenticate success, global_id 5480 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _renew_subs 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb01010a920 con 0x7fb01005d1b0 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _renew_subs 2026-02-17T05:46:53.498 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb01010b6b0 con 0x7fb01005d1b0 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0040048a0 con 0x7fb01005d1b0 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb004004bc0 con 0x7fb01005d1b0 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb00d7fa640 4 set_mon_vals no callback set 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fafef7fe640 10 monclient: dump: 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.499 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.475+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0100008d0 con 0x7fb01005d1b0 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.476+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb004011b60 con 0x7fb01005d1b0 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.476+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fb00404fbf0 con 0x7fb01005d1b0 2026-02-17T05:46:53.500 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.476+0000 7fb00e7fc640 10 monclient: get_auth_request con 0x7fafdc040cb0 auth_method 0 2026-02-17T05:46:53.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.478+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb004017440 con 0x7fb01005d1b0 2026-02-17T05:46:53.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.478+0000 7fafef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:53.501 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.478+0000 7fafef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fb0155c2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fb0155c2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fb0155c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb010057ca0 con 0x7fb01005d1b0 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fafef7fe640 1 -- 10.20.193.106:0/3933411439 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v885) ==== 74+0+11038 (unknown 882084882 0 787094860) 0x7fb004016bf0 con 0x7fb01005d1b0 2026-02-17T05:46:53.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fafef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T05:46:53.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.581+0000 7fafef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:46:53.585 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:46:53.585 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":885,"fsid":"f9284388-9cba-4b6a-8ae7-6bff755d8682","created":"2026-02-17T05:27:55.470110+0000","modified":"2026-02-17T05:45:33.396088+0000","last_up_change":"2026-02-17T05:27:59.682513+0000","last_in_change":"2026-02-17T05:27:56.679957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T05:27:59.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T05:28:04.479659+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be23feaa-a891-4188-82fa-da6a1555577a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6804","nonce":3242040173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6805","nonce":3242040173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6808","nonce":3242040173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6806","nonce":3242040173}]},"public_addr":"10.20.193.106:6804/3242040173","cluster_addr":"10.20.193.106:6805/3242040173","heartbeat_back_addr":"10.20.193.106:6808/3242040173","heartbeat_front_addr":"10.20.193.106:6806/3242040173","state":["exists","up"]},{"osd":1,"uuid":"b4eb1865-e288-4485-a460-ff9dc40e9ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6807","nonce":319256485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6809","nonce":319256485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6811","nonce":319256485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6810","nonce":319256485}]},"public_addr":"10.20.193.106:6807/319256485","cluster_addr":"10.20.193.106:6809/319256485","heartbeat_back_addr":"10.20.193.106:6811/319256485","heartbeat_front_addr":"10.20.193.106:6810/319256485","state":["exists","up"]},{"osd":2,"uuid":"9e4e4e8f-99fc-479a-92ae-882940fe62cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6800","nonce":3659912429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6801","nonce":3659912429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6803","nonce":3659912429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.106:6802","nonce":3659912429}]},"public_addr":"10.20.193.106:6800/3659912429","cluster_addr":"10.20.193.106:6801/3659912429","heartbeat_back_addr":"10.20.193.106:6803/3659912429","heartbeat_front_addr":"10.20.193.106:6802/3659912429","state":["exists","up"]},{"osd":3,"uuid":"ef20611a-4a38-4302-abe1-22c33d1f4fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6808","nonce":334549894}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6809","nonce":334549894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6811","nonce":334549894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6810","nonce":334549894}]},"public_addr":"10.20.193.118:6808/334549894","cluster_addr":"10.20.193.118:6809/334549894","heartbeat_back_addr":"10.20.193.118:6811/334549894","heartbeat_front_addr":"10.20.193.118:6810/334549894","state":["exists","up"]},{"osd":4,"uuid":"616997f6-105f-4a7b-8be3-bd39e505540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6800","nonce":25351596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6801","nonce":25351596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6803","nonce":25351596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6802","nonce":25351596}]},"public_addr":"10.20.193.118:6800/25351596","cluster_addr":"10.20.193.118:6801/25351596","heartbeat_back_addr":"10.20.193.118:6803/25351596","heartbeat_front_addr":"10.20.193.118:6802/25351596","state":["exists","up"]},{"osd":5,"uuid":"d500ce8b-c1a1-41f6-993d-4bd3f1a9f145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6804","nonce":2938654647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6805","nonce":2938654647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6807","nonce":2938654647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.118:6806","nonce":2938654647}]},"public_addr":"10.20.193.118:6804/2938654647","cluster_addr":"10.20.193.118:6805/2938654647","heartbeat_back_addr":"10.20.193.118:6807/2938654647","heartbeat_front_addr":"10.20.193.118:6806/2938654647","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.467492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.489922+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.422368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.664205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.560383+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:27:58.614399+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":392,"length":1},{"begin":403,"length":1},{"begin":421,"length":1},{"begin":432,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:46:53.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 >> v1:10.20.193.118:6812/703720803 conn(0x7fafdc040cb0 legacy=0x7fafdc061160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 10 monclient: shutdown 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 >> v1:10.20.193.106:6790/0 conn(0x7fb01005d1b0 legacy=0x7fb01012b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 shutdown_connections 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 >> 10.20.193.106:0/3933411439 conn(0x7fb0100915f0 msgr2=0x7fb01005bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 shutdown_connections 2026-02-17T05:46:53.587 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:53.582+0000 7fb0155c2640 1 -- 10.20.193.106:0/3933411439 wait complete. 2026-02-17T05:46:54.594 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T05:46:54.594 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.661+0000 7fb7c390c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.661+0000 7fb7c390c640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient: monmap: 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:54.663403+0000 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:54.663403+0000 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:54.664 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 1 Processor -- start 2026-02-17T05:46:54.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 1 -- start start 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient: init 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-a con 0x7fb7bc13f000 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-c con 0x7fb7bc058a80 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-b con 0x7fb7bc058ee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0582f0 con 0x7fb7bc13f000 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc08f100 con 0x7fb7bc058a80 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc057d30 con 0x7fb7bc058ee0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c390c640 10 monclient(hunting): authenticate will time out at 1743.291862s 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c1e82640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb7bc058ee0 0x7fb7bc1a48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60618/0 (socket says 10.20.193.106:60618) 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c1e82640 1 -- 10.20.193.106:0/2708719890 learned_addr learned my addr 10.20.193.106:0/2708719890 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.662+0000 7fb7c1681640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb7bc13f000 0x7fb7bc13f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59396/0 (socket says 10.20.193.106:59396) 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706103846 0 0) 0x7fb7bc057d30 con 0x7fb7bc058ee0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): my global_id is 5483 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a40035e0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369917362 0 0) 0x7fb7bc0582f0 con 0x7fb7bc13f000 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient(hunting): my global_id is 164154 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7bc057d30 con 0x7fb7bc13f000 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2397878908 0 0) 0x7fb7a40035e0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 >> v1:10.20.193.118:6789/0 conn(0x7fb7bc058a80 legacy=0x7fb7bc183180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 >> v1:10.20.193.106:6789/0 conn(0x7fb7bc13f000 legacy=0x7fb7bc13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 monclient: found mon.noname-b 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc058010 con 0x7fb7bc058ee0 2026-02-17T05:46:54.666 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7b8003eb0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 5 monclient: authenticate success, global_id 5483 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: dump: 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7b8004040 con 0x7fb7bc058ee0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 4 set_mon_vals no callback set 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 1 -- 10.20.193.106:0/2708719890 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7b8004450 con 0x7fb7bc058ee0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7abfff640 10 monclient: dump: 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.667 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 10 monclient: shutdown 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 1 -- 10.20.193.106:0/2708719890 >> v1:10.20.193.106:6790/0 conn(0x7fb7bc058ee0 legacy=0x7fb7bc1a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 1 -- 10.20.193.106:0/2708719890 shutdown_connections 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 1 -- 10.20.193.106:0/2708719890 >> 10.20.193.106:0/2708719890 conn(0x7fb7bc056960 msgr2=0x7fb7bc093400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 1 -- 10.20.193.106:0/2708719890 shutdown_connections 2026-02-17T05:46:54.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.663+0000 7fb7c390c640 1 -- 10.20.193.106:0/2708719890 wait complete. 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient: monmap: 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.669 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 1 Processor -- start 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 1 -- start start 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient: init 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-a con 0x7fb7bc058a80 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-c con 0x7fb7bc058ee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient(hunting): picked mon.noname-b con 0x7fb7bc13f000 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc132160 con 0x7fb7bc058a80 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc08a5f0 con 0x7fb7bc13f000 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc132720 con 0x7fb7bc058ee0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c390c640 10 monclient(hunting): authenticate will time out at 1743.293617s 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c1681640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb7bc058a80 0x7fb7bc13dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59404/0 (socket says 10.20.193.106:59404) 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7c1681640 1 -- 10.20.193.106:0/2570803522 learned_addr learned my addr 10.20.193.106:0/2570803522 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491681041 0 0) 0x7fb7bc132720 con 0x7fb7bc058ee0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): my global_id is 5486 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c0035e0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2813364949 0 0) 0x7fb7bc132160 con 0x7fb7bc058a80 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): my global_id is 164157 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7bc132720 con 0x7fb7bc058a80 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020809726 0 0) 0x7fb7bc08a5f0 con 0x7fb7bc13f000 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.664+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): my global_id is 134323 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7bc132160 con 0x7fb7bc13f000 2026-02-17T05:46:54.670 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2064854888 0 0) 0x7fb78c0035e0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7bc08a5f0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7b0003070 con 0x7fb7bc058ee0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1915992091 0 0) 0x7fb7bc132720 con 0x7fb7bc058a80 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb78c0035e0 con 0x7fb7bc058a80 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7ac003070 con 0x7fb7bc058a80 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3075682005 0 0) 0x7fb7bc08a5f0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 >> v1:10.20.193.118:6789/0 conn(0x7fb7bc13f000 legacy=0x7fb7bc1947d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 >> v1:10.20.193.106:6789/0 conn(0x7fb7bc058a80 legacy=0x7fb7bc13dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 monclient: found mon.c 2026-02-17T05:46:54.671 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc1303c0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 5 monclient: authenticate success, global_id 5486 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 10 monclient: _renew_subs 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc131e80 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 10 monclient: _renew_subs 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7bc13e400 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7b00035b0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb7b00038d0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 10 monclient: dump: 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7ab7fe640 4 set_mon_vals no callback set 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb7bc05feb0 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.665+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb7b0010870 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fb7b004e970 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6804/3242040173 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb78c087590 con 0x7fb78c065930 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7fb7b004ed80 con 0x7fb7bc058ee0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7a9ffb640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7c1e82640 10 monclient: get_auth_request con 0x7fb78c065930 auth_method 0 2026-02-17T05:46:54.672 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7c1681640 10 monclient: get_auth_request con 0x7fb78c040cb0 auth_method 0 2026-02-17T05:46:54.673 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.666+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== osd.0 v1:10.20.193.106:6804/3242040173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fb78c087590 con 0x7fb78c065930 2026-02-17T05:46:54.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.673+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 --> v1:10.20.193.106:6804/3242040173 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb7bc151d50 con 0x7fb78c065930 2026-02-17T05:46:54.675 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7a9ffb640 1 -- 10.20.193.106:0/2570803522 <== osd.0 v1:10.20.193.106:6804/3242040173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb7bc151d50 con 0x7fb78c065930 2026-02-17T05:46:54.676 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:54.676 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:54.676 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 >> v1:10.20.193.106:6804/3242040173 conn(0x7fb78c065930 legacy=0x7fb78c085d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 >> v1:10.20.193.118:6812/703720803 conn(0x7fb78c040cb0 legacy=0x7fb78c061160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 10 monclient: shutdown 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 >> v1:10.20.193.106:6790/0 conn(0x7fb7bc058ee0 legacy=0x7fb7bc1930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c1e82640 1 -- 10.20.193.106:0/2570803522 reap_dead start 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 shutdown_connections 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 >> 10.20.193.106:0/2570803522 conn(0x7fb7bc056960 msgr2=0x7fb7bc088660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.677 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 shutdown_connections 2026-02-17T05:46:54.678 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.674+0000 7fb7c390c640 1 -- 10.20.193.106:0/2570803522 wait complete. 2026-02-17T05:46:54.682 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T05:46:54.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.744+0000 7fd56cccc640 10 monclient: get_monmap_and_config 2026-02-17T05:46:54.746 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.744+0000 7fd56cccc640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.744+0000 7fd56cccc640 10 monclient: monmap: 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:54.746053+0000 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:54.746053+0000 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:54.747 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 1 Processor -- start 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 1 -- start start 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient: init 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-c con 0x7fd56805d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-b con 0x7fd56805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-a con 0x7fd568182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56808b060 con 0x7fd568182720 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56805dc90 con 0x7fd56805d1b0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56808d6a0 con 0x7fd56805dee0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 10 monclient(hunting): authenticate will time out at 1743.374459s 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd56805dee0 0x7fd568181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60632/0 (socket says 10.20.193.106:60632) 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565d74640 1 -- 10.20.193.106:0/177164386 learned_addr learned my addr 10.20.193.106:0/177164386 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd566d76640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd568182720 0x7fd5681a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59410/0 (socket says 10.20.193.106:59410) 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882488573 0 0) 0x7fd56808b060 con 0x7fd568182720 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): my global_id is 164160 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5540035e0 con 0x7fd568182720 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004193071 0 0) 0x7fd56808d6a0 con 0x7fd56805dee0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient(hunting): my global_id is 5489 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd56808b060 con 0x7fd56805dee0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3985968007 0 0) 0x7fd56808b060 con 0x7fd56805dee0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 >> v1:10.20.193.118:6789/0 conn(0x7fd56805d1b0 legacy=0x7fd56805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 >> v1:10.20.193.106:6789/0 conn(0x7fd568182720 legacy=0x7fd5681a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 monclient: found mon.noname-b 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd568057960 con 0x7fd56805dee0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd550002dd0 con 0x7fd56805dee0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd565573640 10 monclient: dump: 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 5 monclient: authenticate success, global_id 5489 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.745+0000 7fd56cccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd550003090 con 0x7fd56805dee0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 1 -- 10.20.193.106:0/177164386 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd5500034a0 con 0x7fd56805dee0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 4 set_mon_vals no callback set 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd565573640 10 monclient: dump: 2026-02-17T05:46:54.752 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 10 monclient: shutdown 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- 10.20.193.106:0/177164386 >> v1:10.20.193.106:6790/0 conn(0x7fd56805dee0 legacy=0x7fd568181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- 10.20.193.106:0/177164386 shutdown_connections 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- 10.20.193.106:0/177164386 >> 10.20.193.106:0/177164386 conn(0x7fd5680915f0 msgr2=0x7fd5680919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- 10.20.193.106:0/177164386 shutdown_connections 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- 10.20.193.106:0/177164386 wait complete. 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 10 monclient: monmap: 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:54.753 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 Processor -- start 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 1 -- start start 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.746+0000 7fd56cccc640 10 monclient: init 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-a con 0x7fd56805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-c con 0x7fd56805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient(hunting): picked mon.noname-b con 0x7fd568182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56810d500 con 0x7fd56805d1b0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56810ea20 con 0x7fd568182720 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56810ed00 con 0x7fd56805dee0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient(hunting): authenticate will time out at 1743.376160s 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd565d74640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd56805dee0 0x7fd568180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60634/0 (socket says 10.20.193.106:60634) 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd565d74640 1 -- 10.20.193.106:0/2500889309 learned_addr learned my addr 10.20.193.106:0/2500889309 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734885356 0 0) 0x7fd56810ed00 con 0x7fd56805dee0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): my global_id is 5492 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5340035e0 con 0x7fd56805dee0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726817436 0 0) 0x7fd56810d500 con 0x7fd56805d1b0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): my global_id is 164163 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd56810ed00 con 0x7fd56805d1b0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 168054485 0 0) 0x7fd5340035e0 con 0x7fd56805dee0 2026-02-17T05:46:54.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd56810d500 con 0x7fd56805dee0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd5500033b0 con 0x7fd56805dee0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): dump: 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 914522077 0 0) 0x7fd56810ed00 con 0x7fd56805d1b0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5340035e0 con 0x7fd56805d1b0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd55c002ca0 con 0x7fd56805d1b0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient(hunting): dump: 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.755 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 769033896 0 0) 0x7fd56810d500 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 >> v1:10.20.193.118:6789/0 conn(0x7fd568182720 legacy=0x7fd568118290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 >> v1:10.20.193.106:6789/0 conn(0x7fd56805d1b0 legacy=0x7fd56812dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 monclient: found mon.c 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56805e8e0 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 5 monclient: authenticate success, global_id 5492 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _renew_subs 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd56813f530 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _renew_subs 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd56810e740 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd550004cf0 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd550005010 con 0x7fd56805dee0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd54effd640 10 monclient: dump: 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.756 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.747+0000 7fd564d72640 4 set_mon_vals no callback set 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd56cccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd56cccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd56cccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd568057ca0 con 0x7fd56805dee0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd550011fb0 con 0x7fd56805dee0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fd55004fd60 con 0x7fd56805dee0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.748+0000 7fd566575640 10 monclient: get_auth_request con 0x7fd534040bb0 auth_method 0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.750+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fd5500138e0 con 0x7fd56805dee0 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.750+0000 7fd54effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:54.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.750+0000 7fd54effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:54.856 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.854+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd56810e580 con 0x7fd534040bb0 2026-02-17T05:46:54.857 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.854+0000 7fd54effd640 1 -- 10.20.193.106:0/2500889309 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fd56810e580 con 0x7fd534040bb0 2026-02-17T05:46:54.857 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 >> v1:10.20.193.118:6812/703720803 conn(0x7fd534040bb0 legacy=0x7fd534061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 10 monclient: shutdown 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 >> v1:10.20.193.106:6790/0 conn(0x7fd56805dee0 legacy=0x7fd568180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 shutdown_connections 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 >> 10.20.193.106:0/2500889309 conn(0x7fd5680915f0 msgr2=0x7fd56808c610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 shutdown_connections 2026-02-17T05:46:54.858 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.855+0000 7fd56cccc640 1 -- 10.20.193.106:0/2500889309 wait complete. 2026-02-17T05:46:54.865 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T05:46:54.865 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:54.942 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.930+0000 7fd0c2f0c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.930+0000 7fd0c2f0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.930+0000 7fd0c2f0c640 10 monclient: monmap: 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:54.932198+0000 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:54.932198+0000 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.943 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 1 Processor -- start 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 1 -- start start 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient: init 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.944 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd0bc08e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd0bc08c940 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd0bc08cd80 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc08e4a0 con 0x7fd0bc08c940 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc08bf90 con 0x7fd0bc08cd80 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc08d8d0 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c2f0c640 10 monclient(hunting): authenticate will time out at 1743.560546s 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c0c81640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd0bc08e0d0 0x7fd0bc08c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60636/0 (socket says 10.20.193.106:60636) 2026-02-17T05:46:54.945 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0c0c81640 1 -- 10.20.193.106:0/228081001 learned_addr learned my addr 10.20.193.106:0/228081001 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b3fff640 1 --1- 10.20.193.106:0/228081001 >> v1:10.20.193.106:6789/0 conn(0x7fd0bc08c940 0x7fd0bc180ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59430/0 (socket says 10.20.193.106:59430) 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899523734 0 0) 0x7fd0bc08d8d0 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): my global_id is 5495 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a80035e0 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736406683 0 0) 0x7fd0bc08e4a0 con 0x7fd0bc08c940 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.946 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 10 monclient(hunting): my global_id is 164166 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.931+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc08d8d0 con 0x7fd0bc08c940 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489815634 0 0) 0x7fd0bc08bf90 con 0x7fd0bc08cd80 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient(hunting): my global_id is 134329 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc08e4a0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.947 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1240689351 0 0) 0x7fd0bc08d8d0 con 0x7fd0bc08c940 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 >> v1:10.20.193.106:6790/0 conn(0x7fd0bc08e0d0 legacy=0x7fd0bc08c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 >> v1:10.20.193.118:6789/0 conn(0x7fd0bc08cd80 legacy=0x7fd0bc1a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 monclient: found mon.noname-a 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc08af70 con 0x7fd0bc08c940 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.948 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd0a4002c80 con 0x7fd0bc08c940 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: dump: 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.949 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 5 monclient: authenticate success, global_id 164166 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0a4002e50 con 0x7fd0bc08c940 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 4 set_mon_vals no callback set 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 1 -- 10.20.193.106:0/228081001 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd0a4003260 con 0x7fd0bc08c940 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.950 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0b37fe640 10 monclient: dump: 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.951 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 10 monclient: shutdown 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/228081001 >> v1:10.20.193.106:6789/0 conn(0x7fd0bc08c940 legacy=0x7fd0bc180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/228081001 shutdown_connections 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/228081001 >> 10.20.193.106:0/228081001 conn(0x7fd0bc0915f0 msgr2=0x7fd0bc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/228081001 shutdown_connections 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/228081001 wait complete. 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:54.952 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.932+0000 7fd0c2f0c640 10 monclient: monmap: 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:54.953 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 Processor -- start 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- start start 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: init 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd0bc08c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd0bc08cd80 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd0bc08e0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc130370 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc130650 con 0x7fd0bc08c940 2026-02-17T05:46:54.954 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc130c10 con 0x7fd0bc08cd80 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient(hunting): authenticate will time out at 1743.562356s 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b3fff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd0bc08cd80 0x7fd0bc088d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60646/0 (socket says 10.20.193.106:60646) 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b3fff640 1 -- 10.20.193.106:0/959329909 learned_addr learned my addr 10.20.193.106:0/959329909 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407215221 0 0) 0x7fd0bc130c10 con 0x7fd0bc08cd80 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): my global_id is 5498 2026-02-17T05:46:54.955 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd08c0035e0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611677210 0 0) 0x7fd0bc130370 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): my global_id is 164169 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc130c10 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 429276637 0 0) 0x7fd08c0035e0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0bc130370 con 0x7fd0bc08cd80 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd0a4003230 con 0x7fd0bc08cd80 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.956 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): dump: 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.957 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2509047338 0 0) 0x7fd0bc130c10 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd08c0035e0 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd0b80040d0 con 0x7fd0bc08e0d0 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): dump: 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.958 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865173590 0 0) 0x7fd0bc130650 con 0x7fd0bc08c940 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _negotiate 2026-02-17T05:46:54.959 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient(hunting): my global_id is 134332 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc130c10 con 0x7fd0bc08c940 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1521208723 0 0) 0x7fd0bc130370 con 0x7fd0bc08cd80 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 >> v1:10.20.193.118:6789/0 conn(0x7fd0bc08c940 legacy=0x7fd0bc088620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 >> v1:10.20.193.106:6789/0 conn(0x7fd0bc08e0d0 legacy=0x7fd0bc089440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: _finish_hunting 0 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 monclient: found mon.c 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc05cbf0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.960 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: _finish_auth 0 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: _check_auth_tickets 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 5 monclient: authenticate success, global_id 5498 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _renew_subs 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc05e8e0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _renew_subs 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0bc12f7c0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0a4003390 con 0x7fd0bc08cd80 2026-02-17T05:46:54.961 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd0a4004d00 con 0x7fd0bc08cd80 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b17fa640 10 monclient: dump: 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:54.962 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.933+0000 7fd0b2ffd640 4 set_mon_vals no callback set 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0c2f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd0bc08d670 con 0x7fd0bc08cd80 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd0a4011ca0 con 0x7fd0bc08cd80 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fd0a404fb70 con 0x7fd0bc08cd80 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6807/319256485 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd08c0874e0 con 0x7fd08c065880 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7fd0a404ff80 con 0x7fd0bc08cd80 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0b17fa640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0c1482640 10 monclient: get_auth_request con 0x7fd08c065880 auth_method 0 2026-02-17T05:46:54.963 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.934+0000 7fd0c0c81640 10 monclient: get_auth_request con 0x7fd08c040cd0 auth_method 0 2026-02-17T05:46:54.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.935+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== osd.1 v1:10.20.193.106:6807/319256485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fd08c0874e0 con 0x7fd08c065880 2026-02-17T05:46:54.964 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 --> v1:10.20.193.106:6807/319256485 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd0bc04ca40 con 0x7fd08c065880 2026-02-17T05:46:54.965 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0b17fa640 1 -- 10.20.193.106:0/959329909 <== osd.1 v1:10.20.193.106:6807/319256485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd0bc04ca40 con 0x7fd08c065880 2026-02-17T05:46:54.965 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:54.965 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:54.965 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:54.966 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 >> v1:10.20.193.106:6807/319256485 conn(0x7fd08c065880 legacy=0x7fd08c085c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 >> v1:10.20.193.118:6812/703720803 conn(0x7fd08c040cd0 legacy=0x7fd08c061180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 10 monclient: shutdown 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 >> v1:10.20.193.106:6790/0 conn(0x7fd0bc08cd80 legacy=0x7fd0bc088d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c1482640 1 -- 10.20.193.106:0/959329909 reap_dead start 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 shutdown_connections 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 >> 10.20.193.106:0/959329909 conn(0x7fd0bc0915f0 msgr2=0x7fd0bc13f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 shutdown_connections 2026-02-17T05:46:54.967 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:54.942+0000 7fd0c2f0c640 1 -- 10.20.193.106:0/959329909 wait complete. 2026-02-17T05:46:54.968 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T05:46:55.041 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: monmap: 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.032681+0000 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.032681+0000 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.042 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 1 Processor -- start 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 1 -- start start 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: init 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.031+0000 7f864cbb9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-a con 0x7f864805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.043 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-b con 0x7f864805dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-c con 0x7f8648182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864808b060 con 0x7f864805d1b0 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864805dc90 con 0x7f8648182720 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864808d6a0 con 0x7f864805dee0 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient(hunting): authenticate will time out at 1743.661057s 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8646575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f864805d1b0 0x7f864805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59450/0 (socket says 10.20.193.106:59450) 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8646575640 1 -- 10.20.193.106:0/1204216452 learned_addr learned my addr 10.20.193.106:0/1204216452 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802411705 0 0) 0x7f864808b060 con 0x7f864805d1b0 2026-02-17T05:46:55.044 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): my global_id is 164172 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86340035e0 con 0x7f864805d1b0 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087320447 0 0) 0x7f864808d6a0 con 0x7f864805dee0 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient(hunting): my global_id is 5501 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f864808b060 con 0x7f864805dee0 2026-02-17T05:46:55.045 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1491961663 0 0) 0x7f864808b060 con 0x7f864805dee0 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 >> v1:10.20.193.118:6789/0 conn(0x7f8648182720 legacy=0x7f86481a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 >> v1:10.20.193.106:6789/0 conn(0x7f864805d1b0 legacy=0x7f864805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 monclient: found mon.noname-b 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8648057960 con 0x7f864805dee0 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.046 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8630002d50 con 0x7f864805dee0 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: dump: 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.047 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 5 monclient: authenticate success, global_id 5501 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8630002fd0 con 0x7f864805dee0 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 1 -- 10.20.193.106:0/1204216452 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f86300033e0 con 0x7f864805dee0 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 4 set_mon_vals no callback set 2026-02-17T05:46:55.048 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f8645573640 10 monclient: dump: 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.049 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 10 monclient: shutdown 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- 10.20.193.106:0/1204216452 >> v1:10.20.193.106:6790/0 conn(0x7f864805dee0 legacy=0x7f8648181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- 10.20.193.106:0/1204216452 shutdown_connections 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- 10.20.193.106:0/1204216452 >> 10.20.193.106:0/1204216452 conn(0x7f86480915f0 msgr2=0x7f86480919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- 10.20.193.106:0/1204216452 shutdown_connections 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.032+0000 7f864cbb9640 1 -- 10.20.193.106:0/1204216452 wait complete. 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.050 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient: monmap: 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.051 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 1 Processor -- start 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 1 -- start start 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient: init 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-c con 0x7f864805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-a con 0x7f864805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient(hunting): picked mon.noname-b con 0x7f8648182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864810e730 con 0x7f864805dee0 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864810ecf0 con 0x7f8648182720 2026-02-17T05:46:55.052 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864812e210 con 0x7f864805d1b0 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.033+0000 7f864cbb9640 10 monclient(hunting): authenticate will time out at 1743.662951s 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f8646575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f864805d1b0 0x7f864812d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60668/0 (socket says 10.20.193.106:60668) 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f8646575640 1 -- 10.20.193.106:0/455116526 learned_addr learned my addr 10.20.193.106:0/455116526 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793464312 0 0) 0x7f864812e210 con 0x7f864805d1b0 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): my global_id is 5504 2026-02-17T05:46:55.053 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86140035e0 con 0x7f864805d1b0 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1185706320 0 0) 0x7f864810e730 con 0x7f864805dee0 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): my global_id is 164175 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f864812e210 con 0x7f864805dee0 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000756745 0 0) 0x7f864810ecf0 con 0x7f8648182720 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): my global_id is 134335 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f864810e730 con 0x7f8648182720 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1728465890 0 0) 0x7f86140035e0 con 0x7f864805d1b0 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f864810ecf0 con 0x7f864805d1b0 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f863c003170 con 0x7f864805d1b0 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.055 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2616587729 0 0) 0x7f864812e210 con 0x7f864805dee0 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86140035e0 con 0x7f864805dee0 2026-02-17T05:46:55.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f8630002d10 con 0x7f864805dee0 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.057 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3584265168 0 0) 0x7f864810ecf0 con 0x7f864805d1b0 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 >> v1:10.20.193.118:6789/0 conn(0x7f8648182720 legacy=0x7f8648181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 >> v1:10.20.193.106:6789/0 conn(0x7f864805dee0 legacy=0x7f864812db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 monclient: found mon.c 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864810de80 con 0x7f864805d1b0 2026-02-17T05:46:55.058 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 5 monclient: authenticate success, global_id 5504 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 10 monclient: _renew_subs 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f864810c990 con 0x7f864805d1b0 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 10 monclient: _renew_subs 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f864810d720 con 0x7f864805d1b0 2026-02-17T05:46:55.059 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f863c003500 con 0x7f864805d1b0 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f863c004d00 con 0x7f864805d1b0 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f862effd640 10 monclient: dump: 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.060 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f8644d72640 4 set_mon_vals no callback set 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.034+0000 7f864cbb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f864cbb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f864cbb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86480008d0 con 0x7f864805d1b0 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f863c011ca0 con 0x7f864805d1b0 2026-02-17T05:46:55.061 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f863c04fca0 con 0x7f864805d1b0 2026-02-17T05:46:55.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.035+0000 7f8645d74640 10 monclient: get_auth_request con 0x7f8614040d00 auth_method 0 2026-02-17T05:46:55.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.037+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f863c0174d0 con 0x7f864805d1b0 2026-02-17T05:46:55.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.037+0000 7f862effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.062 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.037+0000 7f862effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:55.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.139+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8648057ca0 con 0x7f8614040d00 2026-02-17T05:46:55.142 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.140+0000 7f862effd640 1 -- 10.20.193.106:0/455116526 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f8630005960 con 0x7f8614040d00 2026-02-17T05:46:55.142 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T05:46:55.143 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 >> v1:10.20.193.118:6812/703720803 conn(0x7f8614040d00 legacy=0x7f86140611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 10 monclient: shutdown 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 >> v1:10.20.193.106:6790/0 conn(0x7f864805d1b0 legacy=0x7f864812d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 shutdown_connections 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 >> 10.20.193.106:0/455116526 conn(0x7f86480915f0 msgr2=0x7f8648054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 shutdown_connections 2026-02-17T05:46:55.144 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.141+0000 7f864cbb9640 1 -- 10.20.193.106:0/455116526 wait complete. 2026-02-17T05:46:55.151 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T05:46:55.151 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:55.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.217+0000 7f3213a47640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.217+0000 7f3213a47640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.229 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.217+0000 7f3213a47640 10 monclient: monmap: 2026-02-17T05:46:55.229 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.229 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.219281+0000 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.219281+0000 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 1 Processor -- start 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 1 -- start start 2026-02-17T05:46:55.230 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient: init 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-b con 0x7f320c08e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-c con 0x7f320c08c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-a con 0x7f320c08cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c08e4a0 con 0x7f320c08cd80 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c08bf90 con 0x7f320c08c940 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c08d8d0 con 0x7f320c08e0d0 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.231 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f3213a47640 10 monclient(hunting): authenticate will time out at 1743.847719s 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f32117bc640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f320c08e0d0 0x7f320c08c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60682/0 (socket says 10.20.193.106:60682) 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f32117bc640 1 -- 10.20.193.106:0/3203517074 learned_addr learned my addr 10.20.193.106:0/3203517074 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.218+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783525063 0 0) 0x7f320c08e4a0 con 0x7f320c08cd80 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): my global_id is 164178 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31f40035e0 con 0x7f320c08cd80 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647048815 0 0) 0x7f320c08d8d0 con 0x7f320c08e0d0 2026-02-17T05:46:55.232 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient(hunting): my global_id is 5507 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f320c08e4a0 con 0x7f320c08e0d0 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814402583 0 0) 0x7f31f40035e0 con 0x7f320c08cd80 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 >> v1:10.20.193.106:6790/0 conn(0x7f320c08e0d0 legacy=0x7f320c08c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 >> v1:10.20.193.118:6789/0 conn(0x7f320c08c940 legacy=0x7f320c180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 monclient: found mon.noname-a 2026-02-17T05:46:55.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c08af70 con 0x7f320c08cd80 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3208003eb0 con 0x7f320c08cd80 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 5 monclient: authenticate success, global_id 164178 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: dump: 2026-02-17T05:46:55.234 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.235 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32080040f0 con 0x7f320c08cd80 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 1 -- 10.20.193.106:0/3203517074 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3208004500 con 0x7f320c08cd80 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 4 set_mon_vals no callback set 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f31fbfff640 10 monclient: dump: 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.236 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 10 monclient: shutdown 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 1 -- 10.20.193.106:0/3203517074 >> v1:10.20.193.106:6789/0 conn(0x7f320c08cd80 legacy=0x7f320c1a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.237 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 1 -- 10.20.193.106:0/3203517074 shutdown_connections 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 1 -- 10.20.193.106:0/3203517074 >> 10.20.193.106:0/3203517074 conn(0x7f320c0915f0 msgr2=0x7f320c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 1 -- 10.20.193.106:0/3203517074 shutdown_connections 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 1 -- 10.20.193.106:0/3203517074 wait complete. 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.219+0000 7f3213a47640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient: monmap: 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.238 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 1 Processor -- start 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 1 -- start start 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient: init 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:55.239 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-b con 0x7f320c08c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-a con 0x7f320c08cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient(hunting): picked mon.noname-c con 0x7f320c08e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c05cbb0 con 0x7f320c08cd80 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c05e8e0 con 0x7f320c08c940 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c12c610 con 0x7f320c08e0d0 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3213a47640 10 monclient(hunting): authenticate will time out at 1743.849497s 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3210fbb640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f320c08cd80 0x7f320c191100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59464/0 (socket says 10.20.193.106:59464) 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3210fbb640 1 -- 10.20.193.106:0/126603508 learned_addr learned my addr 10.20.193.106:0/126603508 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f3211fbd640 1 --1- 10.20.193.106:0/126603508 >> v1:10.20.193.106:6790/0 conn(0x7f320c08e0d0 0x7f320c192820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60690/0 (socket says 10.20.193.106:60690) 2026-02-17T05:46:55.240 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954761233 0 0) 0x7f320c05cbb0 con 0x7f320c08cd80 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): my global_id is 164181 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31dc0035e0 con 0x7f320c08cd80 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953439798 0 0) 0x7f320c12c610 con 0x7f320c08e0d0 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): my global_id is 5510 2026-02-17T05:46:55.241 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f320c05cbb0 con 0x7f320c08e0d0 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3291890767 0 0) 0x7f31dc0035e0 con 0x7f320c08cd80 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f320c12c610 con 0x7f320c08cd80 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3200004010 con 0x7f320c08cd80 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.242 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3768299041 0 0) 0x7f320c05cbb0 con 0x7f320c08e0d0 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31dc0035e0 con 0x7f320c08e0d0 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3208003dc0 con 0x7f320c08e0d0 2026-02-17T05:46:55.243 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.244 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573328751 0 0) 0x7f320c05e8e0 con 0x7f320c08c940 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient(hunting): my global_id is 134338 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f320c05cbb0 con 0x7f320c08c940 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1148388817 0 0) 0x7f320c12c610 con 0x7f320c08cd80 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 >> v1:10.20.193.106:6790/0 conn(0x7f320c08e0d0 legacy=0x7f320c192820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 >> v1:10.20.193.118:6789/0 conn(0x7f320c08c940 legacy=0x7f320c13cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.245 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 monclient: found mon.a 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c12e0d0 con 0x7f320c08cd80 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.220+0000 7f31f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 5 monclient: authenticate success, global_id 164181 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 10 monclient: _renew_subs 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.246 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f320c12e3b0 con 0x7f320c08cd80 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 10 monclient: _renew_subs 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f320c13d820 con 0x7f320c08cd80 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32000041e0 con 0x7f320c08cd80 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f3200002850 con 0x7f320c08cd80 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 10 monclient: dump: 2026-02-17T05:46:55.247 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31fb7fe640 4 set_mon_vals no callback set 2026-02-17T05:46:55.248 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f320c08d640 con 0x7f320c08cd80 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f32000029b0 con 0x7f320c08cd80 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f320004fb40 con 0x7f320c08cd80 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6800/3659912429 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31dc087620 con 0x7f31dc0659c0 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7f320004ff50 con 0x7f320c08cd80 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f31f9ffb640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f3211fbd640 10 monclient: get_auth_request con 0x7f31dc0659c0 auth_method 0 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.221+0000 7f32117bc640 10 monclient: get_auth_request con 0x7f31dc040d80 auth_method 0 2026-02-17T05:46:55.249 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.222+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== osd.2 v1:10.20.193.106:6800/3659912429 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f31dc087620 con 0x7f31dc0659c0 2026-02-17T05:46:55.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.229+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 --> v1:10.20.193.106:6800/3659912429 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f320c12d170 con 0x7f31dc0659c0 2026-02-17T05:46:55.250 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.229+0000 7f31f9ffb640 1 -- 10.20.193.106:0/126603508 <== osd.2 v1:10.20.193.106:6800/3659912429 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f320c12d170 con 0x7f31dc0659c0 2026-02-17T05:46:55.251 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:55.251 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:55.251 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.229+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 >> v1:10.20.193.106:6800/3659912429 conn(0x7f31dc0659c0 legacy=0x7f31dc085dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 >> v1:10.20.193.118:6812/703720803 conn(0x7f31dc040d80 legacy=0x7f31dc061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 10 monclient: shutdown 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 >> v1:10.20.193.106:6789/0 conn(0x7f320c08cd80 legacy=0x7f320c191100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3211fbd640 1 -- 10.20.193.106:0/126603508 reap_dead start 2026-02-17T05:46:55.253 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 shutdown_connections 2026-02-17T05:46:55.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 >> 10.20.193.106:0/126603508 conn(0x7f320c0915f0 msgr2=0x7f320c13f670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 shutdown_connections 2026-02-17T05:46:55.254 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.230+0000 7f3213a47640 1 -- 10.20.193.106:0/126603508 wait complete. 2026-02-17T05:46:55.254 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T05:46:55.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.317+0000 7fd2f75f6640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.317+0000 7fd2f75f6640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.317+0000 7fd2f75f6640 10 monclient: monmap: 2026-02-17T05:46:55.328 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.328 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.319248+0000 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.319248+0000 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 1 Processor -- start 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 1 -- start start 2026-02-17T05:46:55.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient: init 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f008b060 con 0x7fd2f005dee0 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f005dc90 con 0x7fd2f005d1b0 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f008d6a0 con 0x7fd2f0182720 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f75f6640 10 monclient(hunting): authenticate will time out at 1743.947615s 2026-02-17T05:46:55.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f4b6a640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fd2f005dee0 0x7fd2f0181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59468/0 (socket says 10.20.193.106:59468) 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2f4b6a640 1 -- 10.20.193.106:0/2940415170 learned_addr learned my addr 10.20.193.106:0/2940415170 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219252487 0 0) 0x7fd2f008b060 con 0x7fd2f005dee0 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): my global_id is 164184 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d80035e0 con 0x7fd2f005dee0 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633734692 0 0) 0x7fd2f008d6a0 con 0x7fd2f0182720 2026-02-17T05:46:55.331 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 10 monclient(hunting): my global_id is 5513 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.318+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f008b060 con 0x7fd2f0182720 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2585926783 0 0) 0x7fd2f008b060 con 0x7fd2f0182720 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 >> v1:10.20.193.118:6789/0 conn(0x7fd2f005d1b0 legacy=0x7fd2f005d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 >> v1:10.20.193.106:6789/0 conn(0x7fd2f005dee0 legacy=0x7fd2f0181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 monclient: found mon.noname-b 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f0057960 con 0x7fd2f0182720 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2ec003eb0 con 0x7fd2f0182720 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: dump: 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.334 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 5 monclient: authenticate success, global_id 5513 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2ec0040f0 con 0x7fd2f0182720 2026-02-17T05:46:55.335 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 4 set_mon_vals no callback set 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 1 -- 10.20.193.106:0/2940415170 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2ec004500 con 0x7fd2f0182720 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2dffff640 10 monclient: dump: 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.336 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 10 monclient: shutdown 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 1 -- 10.20.193.106:0/2940415170 >> v1:10.20.193.106:6790/0 conn(0x7fd2f0182720 legacy=0x7fd2f01a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 1 -- 10.20.193.106:0/2940415170 shutdown_connections 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 1 -- 10.20.193.106:0/2940415170 >> 10.20.193.106:0/2940415170 conn(0x7fd2f00915f0 msgr2=0x7fd2f00919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 1 -- 10.20.193.106:0/2940415170 shutdown_connections 2026-02-17T05:46:55.337 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 1 -- 10.20.193.106:0/2940415170 wait complete. 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.319+0000 7fd2f75f6640 10 monclient: monmap: 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.338 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 Processor -- start 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- start start 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: init 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f005d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f005dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f0182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f005e8e0 con 0x7fd2f005dee0 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f0129e80 con 0x7fd2f005d1b0 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f012b940 con 0x7fd2f0182720 2026-02-17T05:46:55.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient(hunting): authenticate will time out at 1743.949349s 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f5b6c640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fd2f0182720 0x7fd2f01707d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60702/0 (socket says 10.20.193.106:60702) 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f5b6c640 1 -- 10.20.193.106:0/1772378915 learned_addr learned my addr 10.20.193.106:0/1772378915 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f4b6a640 1 --1- 10.20.193.106:0/1772378915 >> v1:10.20.193.106:6789/0 conn(0x7fd2f005dee0 0x7fd2f016f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59478/0 (socket says 10.20.193.106:59478) 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643928359 0 0) 0x7fd2f012b940 con 0x7fd2f0182720 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): my global_id is 5516 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c00035e0 con 0x7fd2f0182720 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529267942 0 0) 0x7fd2f005e8e0 con 0x7fd2f005dee0 2026-02-17T05:46:55.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): my global_id is 164187 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f012b940 con 0x7fd2f005dee0 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2731608563 0 0) 0x7fd2c00035e0 con 0x7fd2f0182720 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2f005e8e0 con 0x7fd2f0182720 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2ec004410 con 0x7fd2f0182720 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): dump: 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.341 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 530585669 0 0) 0x7fd2f005e8e0 con 0x7fd2f0182720 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 >> v1:10.20.193.118:6789/0 conn(0x7fd2f005d1b0 legacy=0x7fd2f013c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 >> v1:10.20.193.106:6789/0 conn(0x7fd2f005dee0 legacy=0x7fd2f016f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 monclient: found mon.c 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f012bc20 con 0x7fd2f0182720 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.343 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 5 monclient: authenticate success, global_id 5516 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _renew_subs 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f012b630 con 0x7fd2f0182720 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _renew_subs 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2f012a9e0 con 0x7fd2f0182720 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2ec004b00 con 0x7fd2f0182720 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fd2ec004e90 con 0x7fd2f0182720 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.344 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2ddffb640 10 monclient: dump: 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.345 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.320+0000 7fd2df7fe640 4 set_mon_vals no callback set 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2f75f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2f75f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2f75f6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f00008d0 con 0x7fd2f0182720 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fd2ec004ff0 con 0x7fd2f0182720 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fd2ec050be0 con 0x7fd2f0182720 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.321+0000 7fd2f536b640 10 monclient: get_auth_request con 0x7fd2c00407c0 auth_method 0 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.323+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fd2ec018550 con 0x7fd2f0182720 2026-02-17T05:46:55.346 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.323+0000 7fd2ddffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.347 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.323+0000 7fd2ddffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:55.430 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.428+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd2f012bf00 con 0x7fd2c00407c0 2026-02-17T05:46:55.430 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.428+0000 7fd2ddffb640 1 -- 10.20.193.106:0/1772378915 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fd2f012bf00 con 0x7fd2c00407c0 2026-02-17T05:46:55.430 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T05:46:55.432 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 >> v1:10.20.193.118:6812/703720803 conn(0x7fd2c00407c0 legacy=0x7fd2c0060c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 10 monclient: shutdown 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 >> v1:10.20.193.106:6790/0 conn(0x7fd2f0182720 legacy=0x7fd2f01707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 shutdown_connections 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 >> 10.20.193.106:0/1772378915 conn(0x7fd2f00915f0 msgr2=0x7fd2f008b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 shutdown_connections 2026-02-17T05:46:55.433 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.430+0000 7fd2f75f6640 1 -- 10.20.193.106:0/1772378915 wait complete. 2026-02-17T05:46:55.440 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T05:46:55.440 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.503+0000 7fee6ad0c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.503+0000 7fee6ad0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.513 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.503+0000 7fee6ad0c640 10 monclient: monmap: 2026-02-17T05:46:55.513 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.505159+0000 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.505159+0000 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.514 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 1 Processor -- start 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 1 -- start start 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient: init 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-a con 0x7fee6408e0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-c con 0x7fee6408c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-b con 0x7fee6408cd80 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6408e4a0 con 0x7fee6408e0d0 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6408bf90 con 0x7fee6408c940 2026-02-17T05:46:55.515 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6408d8d0 con 0x7fee6408cd80 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 10 monclient(hunting): authenticate will time out at 1744.133536s 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee68a81640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fee6408e0d0 0x7fee6408c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59482/0 (socket says 10.20.193.106:59482) 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee68a81640 1 -- 10.20.193.106:0/3354476565 learned_addr learned my addr 10.20.193.106:0/3354476565 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee69282640 1 --1- 10.20.193.106:0/3354476565 >> v1:10.20.193.106:6790/0 conn(0x7fee6408cd80 0x7fee641a2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60716/0 (socket says 10.20.193.106:60716) 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617118535 0 0) 0x7fee6408d8d0 con 0x7fee6408cd80 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.516 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): my global_id is 5519 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee500035e0 con 0x7fee6408cd80 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143755676 0 0) 0x7fee6408e4a0 con 0x7fee6408e0d0 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient(hunting): my global_id is 164190 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6408d8d0 con 0x7fee6408e0d0 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1172035585 0 0) 0x7fee500035e0 con 0x7fee6408cd80 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 >> v1:10.20.193.118:6789/0 conn(0x7fee6408c940 legacy=0x7fee64180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.517 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 >> v1:10.20.193.106:6789/0 conn(0x7fee6408e0d0 legacy=0x7fee6408c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 monclient: found mon.noname-b 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6408af70 con 0x7fee6408cd80 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fee60003eb0 con 0x7fee6408cd80 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:55.518 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee5b7fe640 10 monclient: dump: 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.519 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.504+0000 7fee6ad0c640 5 monclient: authenticate success, global_id 5519 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee60004170 con 0x7fee6408cd80 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 1 -- 10.20.193.106:0/3354476565 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fee60004580 con 0x7fee6408cd80 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee5b7fe640 10 monclient: dump: 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.520 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.521 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 4 set_mon_vals no callback set 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 10 monclient: shutdown 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- 10.20.193.106:0/3354476565 >> v1:10.20.193.106:6790/0 conn(0x7fee6408cd80 legacy=0x7fee641a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- 10.20.193.106:0/3354476565 shutdown_connections 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- 10.20.193.106:0/3354476565 >> 10.20.193.106:0/3354476565 conn(0x7fee640915f0 msgr2=0x7fee640919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- 10.20.193.106:0/3354476565 shutdown_connections 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- 10.20.193.106:0/3354476565 wait complete. 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 10 monclient: monmap: 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.522 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 Processor -- start 2026-02-17T05:46:55.523 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 1 -- start start 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.505+0000 7fee6ad0c640 10 monclient: init 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-c con 0x7fee6408c940 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-b con 0x7fee6408cd80 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient(hunting): picked mon.noname-a con 0x7fee6408e0d0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6412e560 con 0x7fee6408e0d0 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6412d040 con 0x7fee6408cd80 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6412e840 con 0x7fee6408c940 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.524 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient(hunting): authenticate will time out at 1744.135237s 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee68a81640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fee6408c940 0x7fee6414fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60724/0 (socket says 10.20.193.106:60724) 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee68a81640 1 -- 10.20.193.106:0/2440529482 learned_addr learned my addr 10.20.193.106:0/2440529482 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563505594 0 0) 0x7fee6412e840 con 0x7fee6408c940 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): my global_id is 5522 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee340035e0 con 0x7fee6408c940 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727691578 0 0) 0x7fee6412e560 con 0x7fee6408e0d0 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.525 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): my global_id is 164193 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6412e840 con 0x7fee6408e0d0 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3660070768 0 0) 0x7fee340035e0 con 0x7fee6408c940 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee6412e560 con 0x7fee6408c940 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fee54003010 con 0x7fee6408c940 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): dump: 2026-02-17T05:46:55.526 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.527 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4232911004 0 0) 0x7fee6412e840 con 0x7fee6408e0d0 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee340035e0 con 0x7fee6408e0d0 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fee60004490 con 0x7fee6408e0d0 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient(hunting): dump: 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.528 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3460268774 0 0) 0x7fee6412e560 con 0x7fee6408c940 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 >> v1:10.20.193.118:6789/0 conn(0x7fee6408cd80 legacy=0x7fee6413ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 >> v1:10.20.193.106:6789/0 conn(0x7fee6408e0d0 legacy=0x7fee64192170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 monclient: found mon.c 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.529 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6412d6b0 con 0x7fee6408c940 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 5 monclient: authenticate success, global_id 5522 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _renew_subs 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fee6412c4e0 con 0x7fee6408c940 2026-02-17T05:46:55.530 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _renew_subs 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fee6413d550 con 0x7fee6408c940 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee540048a0 con 0x7fee6408c940 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fee54004bc0 con 0x7fee6408c940 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee597fa640 10 monclient: dump: 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.531 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.506+0000 7fee5affd640 4 set_mon_vals no callback set 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee6ad0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fee6408d640 con 0x7fee6408c940 2026-02-17T05:46:55.532 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fee54011b60 con 0x7fee6408c940 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fee5404fbf0 con 0x7fee6408c940 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.118:6808/334549894 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee340874e0 con 0x7fee34065880 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7fee54050000 con 0x7fee6408c940 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee597fa640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee5bfff640 10 monclient: get_auth_request con 0x7fee34040bb0 auth_method 0 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.507+0000 7fee69282640 10 monclient: get_auth_request con 0x7fee34065880 auth_method 0 2026-02-17T05:46:55.533 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.508+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== osd.3 v1:10.20.193.118:6808/334549894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7fee340874e0 con 0x7fee34065880 2026-02-17T05:46:55.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.515+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 --> v1:10.20.193.118:6808/334549894 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fee6413d850 con 0x7fee34065880 2026-02-17T05:46:55.534 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee597fa640 1 -- 10.20.193.106:0/2440529482 <== osd.3 v1:10.20.193.118:6808/334549894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fee6413d850 con 0x7fee34065880 2026-02-17T05:46:55.535 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:55.535 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:55.535 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 >> v1:10.20.193.118:6808/334549894 conn(0x7fee34065880 legacy=0x7fee34085c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 >> v1:10.20.193.118:6812/703720803 conn(0x7fee34040bb0 legacy=0x7fee34061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 10 monclient: shutdown 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 >> v1:10.20.193.106:6790/0 conn(0x7fee6408c940 legacy=0x7fee6414fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee69282640 1 -- 10.20.193.106:0/2440529482 reap_dead start 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 shutdown_connections 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 >> 10.20.193.106:0/2440529482 conn(0x7fee640915f0 msgr2=0x7fee6413f330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 shutdown_connections 2026-02-17T05:46:55.538 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.516+0000 7fee6ad0c640 1 -- 10.20.193.106:0/2440529482 wait complete. 2026-02-17T05:46:55.538 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T05:46:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.602+0000 7fc80c2cc640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.612 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.602+0000 7fc80c2cc640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.602+0000 7fc80c2cc640 10 monclient: monmap: 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.604020+0000 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.604020+0000 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.613 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 1 Processor -- start 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 1 -- start start 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient: init 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc80405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc80405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc804182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80408b060 con 0x7fc80405dee0 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80405dc90 con 0x7fc80405d1b0 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80408d6a0 con 0x7fc804182720 2026-02-17T05:46:55.614 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient(hunting): authenticate will time out at 1744.232384s 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80a842640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fc804182720 0x7fc8041a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60736/0 (socket says 10.20.193.106:60736) 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc809840640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc80405dee0 0x7fc804181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59502/0 (socket says 10.20.193.106:59502) 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80a842640 1 -- 10.20.193.106:0/1030136136 learned_addr learned my addr 10.20.193.106:0/1030136136 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215183495 0 0) 0x7fc80408d6a0 con 0x7fc804182720 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): my global_id is 5525 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7ec0035e0 con 0x7fc804182720 2026-02-17T05:46:55.615 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590030567 0 0) 0x7fc80408b060 con 0x7fc80405dee0 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): my global_id is 164196 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc80408d6a0 con 0x7fc80405dee0 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965377252 0 0) 0x7fc80405dc90 con 0x7fc80405d1b0 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient(hunting): my global_id is 134353 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc80408b060 con 0x7fc80405d1b0 2026-02-17T05:46:55.616 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1913191113 0 0) 0x7fc80408d6a0 con 0x7fc80405dee0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 >> v1:10.20.193.106:6790/0 conn(0x7fc804182720 legacy=0x7fc8041a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 >> v1:10.20.193.118:6789/0 conn(0x7fc80405d1b0 legacy=0x7fc80405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 monclient: found mon.noname-a 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc804057960 con 0x7fc80405dee0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc7f8002dd0 con 0x7fc80405dee0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.617 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: dump: 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.618 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 5 monclient: authenticate success, global_id 164196 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7f8002fa0 con 0x7fc80405dee0 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 1 -- 10.20.193.106:0/1030136136 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc7f8003370 con 0x7fc80405dee0 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80903f640 10 monclient: dump: 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.619 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.603+0000 7fc80c2cc640 4 set_mon_vals no callback set 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 10 monclient: shutdown 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- 10.20.193.106:0/1030136136 >> v1:10.20.193.106:6789/0 conn(0x7fc80405dee0 legacy=0x7fc804181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- 10.20.193.106:0/1030136136 shutdown_connections 2026-02-17T05:46:55.620 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- 10.20.193.106:0/1030136136 >> 10.20.193.106:0/1030136136 conn(0x7fc8040915f0 msgr2=0x7fc8040919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- 10.20.193.106:0/1030136136 shutdown_connections 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- 10.20.193.106:0/1030136136 wait complete. 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 10 monclient: monmap: 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.621 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 Processor -- start 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 1 -- start start 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.604+0000 7fc80c2cc640 10 monclient: init 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc80405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc80405dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc804182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80410ef40 con 0x7fc80405dee0 2026-02-17T05:46:55.622 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80412ae70 con 0x7fc80405d1b0 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc804089a60 con 0x7fc804182720 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient(hunting): authenticate will time out at 1744.234081s 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc809840640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fc80405dee0 0x7fc80412a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59518/0 (socket says 10.20.193.106:59518) 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc809840640 1 -- 10.20.193.106:0/314775306 learned_addr learned my addr 10.20.193.106:0/314775306 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478410226 0 0) 0x7fc804089a60 con 0x7fc804182720 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): my global_id is 5528 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7d40035e0 con 0x7fc804182720 2026-02-17T05:46:55.623 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756685741 0 0) 0x7fc80410ef40 con 0x7fc80405dee0 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): my global_id is 164199 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc804089a60 con 0x7fc80405dee0 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3467520539 0 0) 0x7fc7d40035e0 con 0x7fc804182720 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc80410ef40 con 0x7fc804182720 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc800004180 con 0x7fc804182720 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.624 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 504400809 0 0) 0x7fc804089a60 con 0x7fc80405dee0 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7d40035e0 con 0x7fc80405dee0 2026-02-17T05:46:55.625 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc7f8002ce0 con 0x7fc80405dee0 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.626 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048730289 0 0) 0x7fc80412ae70 con 0x7fc80405d1b0 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient(hunting): my global_id is 134356 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc804089a60 con 0x7fc80405d1b0 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1612029741 0 0) 0x7fc80410ef40 con 0x7fc804182720 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 >> v1:10.20.193.118:6789/0 conn(0x7fc80405d1b0 legacy=0x7fc80412a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 >> v1:10.20.193.106:6789/0 conn(0x7fc80405dee0 legacy=0x7fc80412a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.627 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 monclient: found mon.c 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80413f720 con 0x7fc804182720 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 5 monclient: authenticate success, global_id 5528 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _renew_subs 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc80405e8e0 con 0x7fc804182720 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _renew_subs 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.628 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8041824f0 con 0x7fc804182720 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc800003d90 con 0x7fc804182720 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fc800005b30 con 0x7fc804182720 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc7eaffd640 10 monclient: dump: 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.629 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.605+0000 7fc80883e640 4 set_mon_vals no callback set 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc80c2cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc80c2cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc80c2cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80410daf0 con 0x7fc804182720 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fc800012ad0 con 0x7fc804182720 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fc800050b70 con 0x7fc804182720 2026-02-17T05:46:55.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.606+0000 7fc80a041640 10 monclient: get_auth_request con 0x7fc7d4040d80 auth_method 0 2026-02-17T05:46:55.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.608+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fc8000183a0 con 0x7fc804182720 2026-02-17T05:46:55.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.608+0000 7fc7eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.631 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.608+0000 7fc7eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:55.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.711+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc80410ecc0 con 0x7fc7d4040d80 2026-02-17T05:46:55.714 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.712+0000 7fc7eaffd640 1 -- 10.20.193.106:0/314775306 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fc80410ecc0 con 0x7fc7d4040d80 2026-02-17T05:46:55.714 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T05:46:55.715 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 >> v1:10.20.193.118:6812/703720803 conn(0x7fc7d4040d80 legacy=0x7fc7d4061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 10 monclient: shutdown 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 >> v1:10.20.193.106:6790/0 conn(0x7fc804182720 legacy=0x7fc804181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 shutdown_connections 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 >> 10.20.193.106:0/314775306 conn(0x7fc8040915f0 msgr2=0x7fc80408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 shutdown_connections 2026-02-17T05:46:55.716 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.713+0000 7fc80c2cc640 1 -- 10.20.193.106:0/314775306 wait complete. 2026-02-17T05:46:55.723 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T05:46:55.723 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:55.800 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: monmap: 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.791524+0000 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.791524+0000 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.801 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 1 Processor -- start 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 1 -- start start 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: init 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient(hunting): picked mon.noname-b con 0x7f032408e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.802 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient(hunting): picked mon.noname-c con 0x7f032408c940 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient(hunting): picked mon.noname-a con 0x7f032408cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032408e4a0 con 0x7f032408cd80 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032408bf90 con 0x7f032408c940 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032408d8d0 con 0x7f032408e0d0 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f032970c640 10 monclient(hunting): authenticate will time out at 1744.419882s 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f03237fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f032408cd80 0x7f03241a2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59524/0 (socket says 10.20.193.106:59524) 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f0322ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f032408e0d0 0x7f032408c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60754/0 (socket says 10.20.193.106:60754) 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.790+0000 7f03237fe640 1 -- 10.20.193.106:0/3851632287 learned_addr learned my addr 10.20.193.106:0/3851632287 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754842347 0 0) 0x7f032408e4a0 con 0x7f032408cd80 2026-02-17T05:46:55.803 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): my global_id is 164202 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03100035e0 con 0x7f032408cd80 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189987174 0 0) 0x7f032408d8d0 con 0x7f032408e0d0 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient(hunting): my global_id is 5531 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f032408e4a0 con 0x7f032408e0d0 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4217740026 0 0) 0x7f032408e4a0 con 0x7f032408e0d0 2026-02-17T05:46:55.804 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 >> v1:10.20.193.118:6789/0 conn(0x7f032408c940 legacy=0x7f0324180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 >> v1:10.20.193.106:6789/0 conn(0x7f032408cd80 legacy=0x7f03241a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 monclient: found mon.noname-b 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032408af70 con 0x7f032408e0d0 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0318002d50 con 0x7f032408e0d0 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 5 monclient: authenticate success, global_id 5531 2026-02-17T05:46:55.805 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: dump: 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.806 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0318002fd0 con 0x7f032408e0d0 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 1 -- 10.20.193.106:0/3851632287 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f03180033e0 con 0x7f032408e0d0 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 4 set_mon_vals no callback set 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f0321ffb640 10 monclient: dump: 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.807 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 10 monclient: shutdown 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 1 -- 10.20.193.106:0/3851632287 >> v1:10.20.193.106:6790/0 conn(0x7f032408e0d0 legacy=0x7f032408c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 1 -- 10.20.193.106:0/3851632287 shutdown_connections 2026-02-17T05:46:55.808 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 1 -- 10.20.193.106:0/3851632287 >> 10.20.193.106:0/3851632287 conn(0x7f03240915f0 msgr2=0x7f03240919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 1 -- 10.20.193.106:0/3851632287 shutdown_connections 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.791+0000 7f032970c640 1 -- 10.20.193.106:0/3851632287 wait complete. 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient: monmap: 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.809 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 1 Processor -- start 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 1 -- start start 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient: init 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient(hunting): picked mon.noname-c con 0x7f032408c940 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient(hunting): picked mon.noname-a con 0x7f032408cd80 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient(hunting): picked mon.noname-b con 0x7f032408e0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0324130780 con 0x7f032408cd80 2026-02-17T05:46:55.810 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032405c4a0 con 0x7f032408e0d0 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03241405d0 con 0x7f032408c940 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f032970c640 10 monclient(hunting): authenticate will time out at 1744.421606s 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f0322ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f032408c940 0x7f032413cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60770/0 (socket says 10.20.193.106:60770) 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f0322ffd640 1 -- 10.20.193.106:0/76384356 learned_addr learned my addr 10.20.193.106:0/76384356 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887407028 0 0) 0x7f03241405d0 con 0x7f032408c940 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): my global_id is 5534 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f00035e0 con 0x7f032408c940 2026-02-17T05:46:55.811 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099565037 0 0) 0x7f0324130780 con 0x7f032408cd80 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): my global_id is 164205 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03241405d0 con 0x7f032408cd80 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 47379206 0 0) 0x7f02f00035e0 con 0x7f032408c940 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0324130780 con 0x7f032408c940 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0318002d10 con 0x7f032408c940 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): dump: 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.812 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.792+0000 7f03037fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 396121524 0 0) 0x7f03241405d0 con 0x7f032408cd80 2026-02-17T05:46:55.813 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02f00035e0 con 0x7f032408cd80 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f030c002eb0 con 0x7f032408cd80 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): dump: 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.814 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847706681 0 0) 0x7f032405c4a0 con 0x7f032408e0d0 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient(hunting): my global_id is 134359 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03241405d0 con 0x7f032408e0d0 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1935101086 0 0) 0x7f0324130780 con 0x7f032408c940 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 >> v1:10.20.193.118:6789/0 conn(0x7f032408e0d0 legacy=0x7f03241948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 >> v1:10.20.193.106:6789/0 conn(0x7f032408cd80 legacy=0x7f03241931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.815 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 monclient: found mon.c 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032405e8e0 con 0x7f032408c940 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 5 monclient: authenticate success, global_id 5534 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 10 monclient: _renew_subs 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f032408a090 con 0x7f032408c940 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 10 monclient: _renew_subs 2026-02-17T05:46:55.816 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f032412ef80 con 0x7f032408c940 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0318002930 con 0x7f032408c940 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f0318004d00 con 0x7f032408c940 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 10 monclient: dump: 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.817 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03217fa640 4 set_mon_vals no callback set 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.106:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f032408d670 con 0x7f032408c940 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.793+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f0318004e60 con 0x7f032408c940 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f031804fd70 con 0x7f032408c940 2026-02-17T05:46:55.818 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.118:6800/25351596 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02f0087660 con 0x7f02f0065a00 2026-02-17T05:46:55.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7f0318050180 con 0x7f032408c940 2026-02-17T05:46:55.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03037fe640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:55.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03227fc640 10 monclient: get_auth_request con 0x7f02f0040e10 auth_method 0 2026-02-17T05:46:55.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.794+0000 7f03237fe640 10 monclient: get_auth_request con 0x7f02f0065a00 auth_method 0 2026-02-17T05:46:55.819 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.795+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== osd.4 v1:10.20.193.118:6800/25351596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f02f0087660 con 0x7f02f0065a00 2026-02-17T05:46:55.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.802+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 --> v1:10.20.193.118:6800/25351596 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0324130070 con 0x7f02f0065a00 2026-02-17T05:46:55.820 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.802+0000 7f03037fe640 1 -- 10.20.193.106:0/76384356 <== osd.4 v1:10.20.193.118:6800/25351596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0324130070 con 0x7f02f0065a00 2026-02-17T05:46:55.820 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:55.820 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:55.820 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 >> v1:10.20.193.118:6800/25351596 conn(0x7f02f0065a00 legacy=0x7f02f0085e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 >> v1:10.20.193.118:6812/703720803 conn(0x7f02f0040e10 legacy=0x7f02f00612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 10 monclient: shutdown 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 >> v1:10.20.193.106:6790/0 conn(0x7f032408c940 legacy=0x7f032413cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.822 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f03237fe640 1 -- 10.20.193.106:0/76384356 reap_dead start 2026-02-17T05:46:55.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 shutdown_connections 2026-02-17T05:46:55.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 >> 10.20.193.106:0/76384356 conn(0x7f03240915f0 msgr2=0x7f0324058ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 shutdown_connections 2026-02-17T05:46:55.823 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.803+0000 7f032970c640 1 -- 10.20.193.106:0/76384356 wait complete. 2026-02-17T05:46:55.823 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.888+0000 7f1ac0ba5640 10 monclient: get_monmap_and_config 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.888+0000 7f1ac0ba5640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.888+0000 7f1ac0ba5640 10 monclient: monmap: 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:55.890231+0000 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:55.890231+0000 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.891 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.892 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.892 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:55.892 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:55.892 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 1 Processor -- start 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 1 -- start start 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient: init 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-b con 0x7f1abc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.900 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-c con 0x7f1abc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-a con 0x7f1abc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc08b060 con 0x7f1abc182720 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc05dc90 con 0x7f1abc05dee0 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc08d6a0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1ac0ba5640 10 monclient(hunting): authenticate will time out at 1744.518912s 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1aba575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1abc05d1b0 0x7f1abc05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60772/0 (socket says 10.20.193.106:60772) 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.889+0000 7f1aba575640 1 -- 10.20.193.106:0/2993573540 learned_addr learned my addr 10.20.193.106:0/2993573540 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427229333 0 0) 0x7f1abc08b060 con 0x7f1abc182720 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.901 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): my global_id is 164208 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa80035e0 con 0x7f1abc182720 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495933379 0 0) 0x7f1abc08d6a0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient(hunting): my global_id is 5537 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1abc08b060 con 0x7f1abc05d1b0 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3050054692 0 0) 0x7f1aa80035e0 con 0x7f1abc182720 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 >> v1:10.20.193.106:6790/0 conn(0x7f1abc05d1b0 legacy=0x7f1abc05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 >> v1:10.20.193.118:6789/0 conn(0x7f1abc05dee0 legacy=0x7f1abc181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.902 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 monclient: found mon.noname-a 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc057960 con 0x7f1abc182720 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1aac003eb0 con 0x7f1abc182720 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: dump: 2026-02-17T05:46:55.903 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 5 monclient: authenticate success, global_id 164208 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aac004170 con 0x7f1abc182720 2026-02-17T05:46:55.904 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 1 -- 10.20.193.106:0/2993573540 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1aac004580 con 0x7f1abc182720 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ab9573640 10 monclient: dump: 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.905 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 4 set_mon_vals no callback set 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 10 monclient: shutdown 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/2993573540 >> v1:10.20.193.106:6789/0 conn(0x7f1abc182720 legacy=0x7f1abc1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/2993573540 shutdown_connections 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/2993573540 >> 10.20.193.106:0/2993573540 conn(0x7f1abc0915f0 msgr2=0x7f1abc0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/2993573540 shutdown_connections 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.890+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/2993573540 wait complete. 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient: build_initial_monmap 2026-02-17T05:46:55.906 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient: monmap: 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 1 Processor -- start 2026-02-17T05:46:55.907 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 1 -- start start 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient: init 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-c con 0x7f1abc05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-b con 0x7f1abc05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient(hunting): picked mon.noname-a con 0x7f1abc182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc10eaf0 con 0x7f1abc182720 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc10f0b0 con 0x7f1abc05dee0 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc08a0e0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1ac0ba5640 10 monclient(hunting): authenticate will time out at 1744.520696s 2026-02-17T05:46:55.908 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aba575640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f1abc05d1b0 0x7f1abc13cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60780/0 (socket says 10.20.193.106:60780) 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aba575640 1 -- 10.20.193.106:0/76296326 learned_addr learned my addr 10.20.193.106:0/76296326 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198901106 0 0) 0x7f1abc10eaf0 con 0x7f1abc182720 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): my global_id is 164211 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a880035e0 con 0x7f1abc182720 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930652314 0 0) 0x7f1abc08a0e0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.909 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 10 monclient(hunting): my global_id is 5540 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.891+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1abc10eaf0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1206771470 0 0) 0x7f1a880035e0 con 0x7f1abc182720 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1abc08a0e0 con 0x7f1abc182720 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1aac004490 con 0x7f1abc182720 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.910 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106564239 0 0) 0x7f1abc10f0b0 con 0x7f1abc05dee0 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): my global_id is 134365 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a880035e0 con 0x7f1abc05dee0 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 328245872 0 0) 0x7f1abc10eaf0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.911 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1abc10f0b0 con 0x7f1abc05d1b0 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1ab0003050 con 0x7f1abc05d1b0 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient(hunting): dump: 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.912 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1851469493 0 0) 0x7f1abc08a0e0 con 0x7f1abc182720 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 >> v1:10.20.193.106:6790/0 conn(0x7f1abc05d1b0 legacy=0x7f1abc13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 >> v1:10.20.193.118:6789/0 conn(0x7f1abc05dee0 legacy=0x7f1abc13d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 monclient: found mon.a 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc12e250 con 0x7f1abc182720 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:55.913 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 5 monclient: authenticate success, global_id 164211 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _renew_subs 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc1824f0 con 0x7f1abc182720 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _renew_subs 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1abc10e810 con 0x7f1abc182720 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aac004630 con 0x7f1abc182720 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f1aac003a90 con 0x7f1abc182720 2026-02-17T05:46:55.914 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 10 monclient: dump: 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:55.915 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ab8d72640 4 set_mon_vals no callback set 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc10e480 con 0x7f1abc182720 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.892+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f1aac011af0 con 0x7f1abc182720 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.893+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f1aac04faf0 con 0x7f1abc182720 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.893+0000 7f1aba575640 10 monclient: get_auth_request con 0x7f1a88040e10 auth_method 0 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.895+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f1aac017320 con 0x7f1abc182720 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.895+0000 7f1aa2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:55.916 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:55.895+0000 7f1aa2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:56.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.000+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1abc057ca0 con 0x7f1a88040e10 2026-02-17T05:46:56.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.000+0000 7f1aa2ffd640 1 -- 10.20.193.106:0/76296326 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f1abc057ca0 con 0x7f1a88040e10 2026-02-17T05:46:56.002 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 >> v1:10.20.193.118:6812/703720803 conn(0x7f1a88040e10 legacy=0x7f1a880612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 10 monclient: shutdown 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 >> v1:10.20.193.106:6789/0 conn(0x7f1abc182720 legacy=0x7f1abc181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 shutdown_connections 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 >> 10.20.193.106:0/76296326 conn(0x7f1abc0915f0 msgr2=0x7f1abc08c390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.004 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 shutdown_connections 2026-02-17T05:46:56.005 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.001+0000 7f1ac0ba5640 1 -- 10.20.193.106:0/76296326 wait complete. 2026-02-17T05:46:56.012 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T05:46:56.012 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:56.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:56.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.088 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: monmap: 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:56.079561+0000 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:56.079561+0000 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:56.089 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 1 Processor -- start 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 1 -- start start 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: init 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-c con 0x7f16f808e0d0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-a con 0x7f16f808c940 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-b con 0x7f16f808cd80 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f808e4a0 con 0x7f16f808c940 2026-02-17T05:46:56.090 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f808bf90 con 0x7f16f808e0d0 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f808d8d0 con 0x7f16f808cd80 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.078+0000 7f16fcb4c640 10 monclient(hunting): authenticate will time out at 1744.707981s 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5d74640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f16f808c940 0x7f16f8180ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59556/0 (socket says 10.20.193.106:59556) 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5d74640 1 -- 10.20.193.106:0/1735472270 learned_addr learned my addr 10.20.193.106:0/1735472270 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674180752 0 0) 0x7f16f808e4a0 con 0x7f16f808c940 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): my global_id is 164214 2026-02-17T05:46:56.091 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16e40035e0 con 0x7f16f808c940 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000222081 0 0) 0x7f16f808d8d0 con 0x7f16f808cd80 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient(hunting): my global_id is 5543 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f808e4a0 con 0x7f16f808cd80 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1232805636 0 0) 0x7f16e40035e0 con 0x7f16f808c940 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 >> v1:10.20.193.106:6790/0 conn(0x7f16f808cd80 legacy=0x7f16f81a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 >> v1:10.20.193.118:6789/0 conn(0x7f16f808e0d0 legacy=0x7f16f808c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.092 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 monclient: found mon.noname-a 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.106:6789/0 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f808af70 con 0x7f16f808c940 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16e0002dd0 con 0x7f16f808c940 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 5 monclient: authenticate success, global_id 164214 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:56.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: dump: 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.094 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.0 v1:10.20.193.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16e0003010 con 0x7f16f808c940 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 1 -- 10.20.193.106:0/1735472270 <== mon.0 v1:10.20.193.106:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16e0003420 con 0x7f16f808c940 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 4 set_mon_vals no callback set 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:56.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16f5573640 10 monclient: dump: 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.096 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 10 monclient: shutdown 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 1 -- 10.20.193.106:0/1735472270 >> v1:10.20.193.106:6789/0 conn(0x7f16f808c940 legacy=0x7f16f8180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 1 -- 10.20.193.106:0/1735472270 shutdown_connections 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 1 -- 10.20.193.106:0/1735472270 >> 10.20.193.106:0/1735472270 conn(0x7f16f80915f0 msgr2=0x7f16f80919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 1 -- 10.20.193.106:0/1735472270 shutdown_connections 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.079+0000 7f16fcb4c640 1 -- 10.20.193.106:0/1735472270 wait complete. 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient: monmap: 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:56.097 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 1 Processor -- start 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 1 -- start start 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient: init 2026-02-17T05:46:56.098 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-a con 0x7f16f808c940 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-b con 0x7f16f808cd80 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient(hunting): picked mon.noname-c con 0x7f16f808e0d0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f812e200 con 0x7f16f808c940 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f805e8e0 con 0x7f16f808cd80 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f805cc20 con 0x7f16f808e0d0 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16fcb4c640 10 monclient(hunting): authenticate will time out at 1744.709850s 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16f6575640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f16f808c940 0x7f16f813cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59558/0 (socket says 10.20.193.106:59558) 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.080+0000 7f16f6575640 1 -- 10.20.193.106:0/333764463 learned_addr learned my addr 10.20.193.106:0/333764463 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.099 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354695395 0 0) 0x7f16f808bf90 con 0x7f16f808c940 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): my global_id is 164217 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c40035e0 con 0x7f16f808c940 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646000904 0 0) 0x7f16f805cc20 con 0x7f16f808e0d0 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): my global_id is 5546 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f808bf90 con 0x7f16f808e0d0 2026-02-17T05:46:56.100 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1719684034 0 0) 0x7f16c40035e0 con 0x7f16f808c940 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16f805cc20 con 0x7f16f808c940 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16ec003170 con 0x7f16f808c940 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): dump: 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.101 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2603043096 0 0) 0x7f16f808bf90 con 0x7f16f808e0d0 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16c40035e0 con 0x7f16f808e0d0 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16e8004140 con 0x7f16f808e0d0 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient(hunting): dump: 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.102 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 619687070 0 0) 0x7f16f805cc20 con 0x7f16f808c940 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 >> v1:10.20.193.106:6790/0 conn(0x7f16f808e0d0 legacy=0x7f16f8194c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 >> v1:10.20.193.118:6789/0 conn(0x7f16f808cd80 legacy=0x7f16f8193570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.103 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 monclient: found mon.a 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f812e630 con 0x7f16f808c940 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 5 monclient: authenticate success, global_id 164217 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 10 monclient: _renew_subs 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16f8130990 con 0x7f16f808c940 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 10 monclient: _renew_subs 2026-02-17T05:46:56.104 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f16f813d820 con 0x7f16f808c940 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16ec0034e0 con 0x7f16f808c940 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f16ec003b30 con 0x7f16f808c940 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16f4d72640 4 set_mon_vals no callback set 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16deffd640 10 monclient: dump: 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.105 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.081+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f16f808d670 con 0x7f16f808c940 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f16ec003c90 con 0x7f16f808c940 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f16ec04fb50 con 0x7f16f808c940 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.118:6804/2938654647 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16c4087400 con 0x7f16c40657a0 2026-02-17T05:46:56.106 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=885) ==== 24+0+0 (unknown 3189296679 0 0) 0x7f16ec04ff30 con 0x7f16f808c940 2026-02-17T05:46:56.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16deffd640 10 monclient: handle_get_version_reply finishing 1 version 885 2026-02-17T05:46:56.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16f5d74640 10 monclient: get_auth_request con 0x7f16c4040bf0 auth_method 0 2026-02-17T05:46:56.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.082+0000 7f16f6d76640 10 monclient: get_auth_request con 0x7f16c40657a0 auth_method 0 2026-02-17T05:46:56.107 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.083+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== osd.5 v1:10.20.193.118:6804/2938654647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (unknown 0 0 1763635307) 0x7f16c4087400 con 0x7f16c40657a0 2026-02-17T05:46:56.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.090+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 --> v1:10.20.193.118:6804/2938654647 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f16f812e200 con 0x7f16c40657a0 2026-02-17T05:46:56.108 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16deffd640 1 -- 10.20.193.106:0/333764463 <== osd.5 v1:10.20.193.118:6804/2938654647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f16f812e200 con 0x7f16c40657a0 2026-02-17T05:46:56.108 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-17T05:46:56.108 INFO:teuthology.orchestra.run.trial106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:56.108 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 >> v1:10.20.193.118:6804/2938654647 conn(0x7f16c40657a0 legacy=0x7f16c4085bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 >> v1:10.20.193.118:6812/703720803 conn(0x7f16c4040bf0 legacy=0x7f16c40610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 10 monclient: shutdown 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 >> v1:10.20.193.106:6789/0 conn(0x7f16f808c940 legacy=0x7f16f813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.110 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16f6d76640 1 -- 10.20.193.106:0/333764463 reap_dead start 2026-02-17T05:46:56.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 shutdown_connections 2026-02-17T05:46:56.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 >> 10.20.193.106:0/333764463 conn(0x7f16f80915f0 msgr2=0x7f16f813f480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 shutdown_connections 2026-02-17T05:46:56.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.091+0000 7f16fcb4c640 1 -- 10.20.193.106:0/333764463 wait complete. 2026-02-17T05:46:56.111 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.173+0000 7fe00f607640 10 monclient: get_monmap_and_config 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.173+0000 7fe00f607640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.173+0000 7fe00f607640 10 monclient: monmap: 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:56.175289+0000 2026-02-17T05:46:56.183 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:56.175289+0000 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 1 Processor -- start 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 1 -- start start 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient: init 2026-02-17T05:46:56.184 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-b con 0x7fe00805d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-a con 0x7fe00805dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-c con 0x7fe008182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00808b060 con 0x7fe00805dee0 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00805dc90 con 0x7fe008182720 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00808d6a0 con 0x7fe00805d1b0 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00f607640 10 monclient(hunting): authenticate will time out at 1744.803650s 2026-02-17T05:46:56.185 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00cb7b640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe00805dee0 0x7fe008181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59572/0 (socket says 10.20.193.106:59572) 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00cb7b640 1 -- 10.20.193.106:0/40729690 learned_addr learned my addr 10.20.193.106:0/40729690 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fe00d37c640 1 --1- 10.20.193.106:0/40729690 >> v1:10.20.193.106:6790/0 conn(0x7fe00805d1b0 0x7fe00805d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60794/0 (socket says 10.20.193.106:60794) 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339933639 0 0) 0x7fe00808d6a0 con 0x7fe00805d1b0 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fdff7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fdff7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.174+0000 7fdff7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient(hunting): my global_id is 5549 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdff00035e0 con 0x7fe00805d1b0 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224462186 0 0) 0x7fe00808b060 con 0x7fe00805dee0 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.186 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient(hunting): my global_id is 164220 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe00808d6a0 con 0x7fe00805dee0 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1252441148 0 0) 0x7fdff00035e0 con 0x7fe00805d1b0 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 >> v1:10.20.193.118:6789/0 conn(0x7fe008182720 legacy=0x7fe0081a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 >> v1:10.20.193.106:6789/0 conn(0x7fe00805dee0 legacy=0x7fe008181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 monclient: found mon.noname-b 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe008057960 con 0x7fe00805d1b0 2026-02-17T05:46:56.187 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdff8002dd0 con 0x7fe00805d1b0 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: dump: 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.188 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 5 monclient: authenticate success, global_id 5549 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdff8003090 con 0x7fe00805d1b0 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 1 -- 10.20.193.106:0/40729690 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdff80034a0 con 0x7fe00805d1b0 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fdff7fff640 10 monclient: dump: 2026-02-17T05:46:56.189 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:56.190 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 4 set_mon_vals no callback set 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 10 monclient: shutdown 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 1 -- 10.20.193.106:0/40729690 >> v1:10.20.193.106:6790/0 conn(0x7fe00805d1b0 legacy=0x7fe00805d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 1 -- 10.20.193.106:0/40729690 shutdown_connections 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 1 -- 10.20.193.106:0/40729690 >> 10.20.193.106:0/40729690 conn(0x7fe0080915f0 msgr2=0x7fe0080919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 1 -- 10.20.193.106:0/40729690 shutdown_connections 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 1 -- 10.20.193.106:0/40729690 wait complete. 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.175+0000 7fe00f607640 10 monclient: monmap: 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.191 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 1 Processor -- start 2026-02-17T05:46:56.192 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 1 -- start start 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient: init 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-a con 0x7fe00805d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-b con 0x7fe00805dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient(hunting): picked mon.noname-c con 0x7fe008182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00812c2c0 con 0x7fe00805d1b0 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00805e8e0 con 0x7fe00805dee0 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00810bf30 con 0x7fe008182720 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00f607640 10 monclient(hunting): authenticate will time out at 1744.805467s 2026-02-17T05:46:56.193 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00d37c640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fe00805d1b0 0x7fe00812b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59588/0 (socket says 10.20.193.106:59588) 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fe00d37c640 1 -- 10.20.193.106:0/2199330739 learned_addr learned my addr 10.20.193.106:0/2199330739 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781200948 0 0) 0x7fe00812c2c0 con 0x7fe00805d1b0 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): my global_id is 164223 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd80035e0 con 0x7fe00805d1b0 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351656383 0 0) 0x7fe00810bf30 con 0x7fe008182720 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.194 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): my global_id is 5552 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe00812c2c0 con 0x7fe008182720 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3236650314 0 0) 0x7fe00812c2c0 con 0x7fe008182720 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe00810bf30 con 0x7fe008182720 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe0040040d0 con 0x7fe008182720 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.195 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1377646172 0 0) 0x7fdfd80035e0 con 0x7fe00805d1b0 2026-02-17T05:46:56.196 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe00812c2c0 con 0x7fe00805d1b0 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fdff80033b0 con 0x7fe00805d1b0 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.176+0000 7fdff5ffb640 10 monclient(hunting): dump: 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.197 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 681285017 0 0) 0x7fe00810bf30 con 0x7fe008182720 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 >> v1:10.20.193.118:6789/0 conn(0x7fe00805dee0 legacy=0x7fe00812bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 >> v1:10.20.193.106:6789/0 conn(0x7fe00805d1b0 legacy=0x7fe00812b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 monclient: found mon.c 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00810aa40 con 0x7fe008182720 2026-02-17T05:46:56.198 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 5 monclient: authenticate success, global_id 5552 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _renew_subs 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe00810a570 con 0x7fe008182720 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _renew_subs 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe00810cda0 con 0x7fe008182720 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0040042a0 con 0x7fe008182720 2026-02-17T05:46:56.199 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fe0040049a0 con 0x7fe008182720 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 10 monclient: dump: 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.200 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff77fe640 4 set_mon_vals no callback set 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00810ca20 con 0x7fe008182720 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fe004004b00 con 0x7fe008182720 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.177+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fe00404fa20 con 0x7fe008182720 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.178+0000 7fe00d37c640 10 monclient: get_auth_request con 0x7fdfd8040bb0 auth_method 0 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.180+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fe0040172b0 con 0x7fe008182720 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.180+0000 7fdff5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.201 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.180+0000 7fdff5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:56.285 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.283+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe008057ca0 con 0x7fdfd8040bb0 2026-02-17T05:46:56.286 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.283+0000 7fdff5ffb640 1 -- 10.20.193.106:0/2199330739 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fe008057ca0 con 0x7fdfd8040bb0 2026-02-17T05:46:56.286 INFO:teuthology.orchestra.run.trial106.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 >> v1:10.20.193.118:6812/703720803 conn(0x7fdfd8040bb0 legacy=0x7fdfd8061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 10 monclient: shutdown 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 >> v1:10.20.193.106:6790/0 conn(0x7fe008182720 legacy=0x7fe008181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 shutdown_connections 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 >> 10.20.193.106:0/2199330739 conn(0x7fe0080915f0 msgr2=0x7fe0081a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.287 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 shutdown_connections 2026-02-17T05:46:56.288 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.284+0000 7fe00f607640 1 -- 10.20.193.106:0/2199330739 wait complete. 2026-02-17T05:46:56.295 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:56.368 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 10 monclient: get_monmap_and_config 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 10 monclient: monmap: 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:46:56.358929+0000 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:46:56.358929+0000 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.369 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 1 Processor -- start 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 1 -- start start 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.357+0000 7fb331f0c640 10 monclient: init 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb32c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.370 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb32c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb32c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c08b060 con 0x7fb32c05dee0 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c05dc90 con 0x7fb32c05d1b0 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c08d6a0 con 0x7fb32c182720 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb331f0c640 10 monclient(hunting): authenticate will time out at 1744.987401s 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32affd640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb32c05dee0 0x7fb32c181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59602/0 (socket says 10.20.193.106:59602) 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32affd640 1 -- 10.20.193.106:0/3336005661 learned_addr learned my addr 10.20.193.106:0/3336005661 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb32c182720 0x7fb32c1a2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60816/0 (socket says 10.20.193.106:60816) 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225301574 0 0) 0x7fb32c08d6a0 con 0x7fb32c182720 2026-02-17T05:46:56.371 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): my global_id is 5555 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3100035e0 con 0x7fb32c182720 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512913981 0 0) 0x7fb32c08b060 con 0x7fb32c05dee0 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 10 monclient(hunting): my global_id is 164226 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c08d6a0 con 0x7fb32c05dee0 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2748249620 0 0) 0x7fb3100035e0 con 0x7fb32c182720 2026-02-17T05:46:56.372 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 >> v1:10.20.193.118:6789/0 conn(0x7fb32c05d1b0 legacy=0x7fb32c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.358+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 >> v1:10.20.193.106:6789/0 conn(0x7fb32c05dee0 legacy=0x7fb32c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 1 monclient: found mon.noname-b 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c057960 con 0x7fb32c182720 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb320003eb0 con 0x7fb32c182720 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 5 monclient: authenticate success, global_id 5555 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:56.373 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: dump: 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.374 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb320004130 con 0x7fb32c182720 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 10 monclient: get_monmap_and_config success 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 4 set_mon_vals no callback set 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 1 -- 10.20.193.106:0/3336005661 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb320004540 con 0x7fb32c182720 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb32a7fc640 10 monclient: dump: 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.375 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 10 monclient: shutdown 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 1 -- 10.20.193.106:0/3336005661 >> v1:10.20.193.106:6790/0 conn(0x7fb32c182720 legacy=0x7fb32c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 1 -- 10.20.193.106:0/3336005661 shutdown_connections 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 1 -- 10.20.193.106:0/3336005661 >> 10.20.193.106:0/3336005661 conn(0x7fb32c0915f0 msgr2=0x7fb32c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.376 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 1 -- 10.20.193.106:0/3336005661 shutdown_connections 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 1 -- 10.20.193.106:0/3336005661 wait complete. 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 10 monclient: build_initial_monmap 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.359+0000 7fb331f0c640 10 monclient: monmap: 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:46:56.377 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 1 Processor -- start 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 1 -- start start 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient: init 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient: _reopen_session rank -1 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb32c05d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb32c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb32c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c12c1c0 con 0x7fb32c05d1b0 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c05e8e0 con 0x7fb32c05dee0 2026-02-17T05:46:56.378 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c10be30 con 0x7fb32c182720 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient(hunting): _renew_subs 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb331f0c640 10 monclient(hunting): authenticate will time out at 1744.989451s 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb32b7fe640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7fb32c05d1b0 0x7fb32c12b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:59612/0 (socket says 10.20.193.106:59612) 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb32b7fe640 1 -- 10.20.193.106:0/1649925798 learned_addr learned my addr 10.20.193.106:0/1649925798 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb32bfff640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fb32c182720 0x7fb32c181de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:60830/0 (socket says 10.20.193.106:60830) 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407042262 0 0) 0x7fb32c10be30 con 0x7fb32c182720 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): my global_id is 5558 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2fc0035e0 con 0x7fb32c182720 2026-02-17T05:46:56.379 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142775956 0 0) 0x7fb32c12c1c0 con 0x7fb32c05d1b0 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): my global_id is 164229 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c10be30 con 0x7fb32c05d1b0 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1587732241 0 0) 0x7fb2fc0035e0 con 0x7fb32c182720 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb32c12c1c0 con 0x7fb32c182720 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3200042a0 con 0x7fb32c182720 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): dump: 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.380 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1702030152 0 0) 0x7fb32c10be30 con 0x7fb32c05d1b0 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2fc0035e0 con 0x7fb32c05d1b0 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb318003070 con 0x7fb32c05d1b0 2026-02-17T05:46:56.381 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): dump: 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.382 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119800448 0 0) 0x7fb32c05e8e0 con 0x7fb32c05dee0 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _negotiate 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 10 monclient(hunting): my global_id is 134383 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.360+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c10be30 con 0x7fb32c05dee0 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2646648576 0 0) 0x7fb32c12c1c0 con 0x7fb32c182720 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 >> v1:10.20.193.118:6789/0 conn(0x7fb32c05dee0 legacy=0x7fb32c12bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 >> v1:10.20.193.106:6789/0 conn(0x7fb32c05d1b0 legacy=0x7fb32c12b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: _finish_hunting 0 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 monclient: found mon.c 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:46:56.383 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c10a940 con 0x7fb32c182720 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: _finish_auth 0 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: _check_auth_tickets 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 5 monclient: authenticate success, global_id 5558 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _renew_subs 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c1824f0 con 0x7fb32c182720 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _renew_subs 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb32c10b6d0 con 0x7fb32c182720 2026-02-17T05:46:56.384 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb320004640 con 0x7fb32c182720 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fb3200044c0 con 0x7fb32c182720 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb329ffb640 4 set_mon_vals no callback set 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 10 monclient: dump: 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:46:56.385 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c10c920 con 0x7fb32c182720 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.361+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fb320012cc0 con 0x7fb32c182720 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.362+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fb320050d80 con 0x7fb32c182720 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.362+0000 7fb32b7fe640 10 monclient: get_auth_request con 0x7fb2fc0452c0 auth_method 0 2026-02-17T05:46:56.386 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.364+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fb320018670 con 0x7fb32c182720 2026-02-17T05:46:56.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.364+0000 7fb307fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:46:56.387 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.364+0000 7fb307fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:46:56.467 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.465+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb32c057ca0 con 0x7fb2fc0452c0 2026-02-17T05:46:56.468 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.466+0000 7fb307fff640 1 -- 10.20.193.106:0/1649925798 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33976 (unknown 2965378022 0 1989892549) 0x7fb3180078a0 con 0x7fb2fc0452c0 2026-02-17T05:46:56.469 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:46:56.470 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:46:56.470 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 >> v1:10.20.193.118:6812/703720803 conn(0x7fb2fc0452c0 legacy=0x7fb2fc065770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.470 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 10 monclient: shutdown 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 >> v1:10.20.193.106:6790/0 conn(0x7fb32c182720 legacy=0x7fb32c181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 shutdown_connections 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 >> 10.20.193.106:0/1649925798 conn(0x7fb32c0915f0 msgr2=0x7fb32c1a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 shutdown_connections 2026-02-17T05:46:56.471 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:46:56.467+0000 7fb331f0c640 1 -- 10.20.193.106:0/1649925798 wait complete. 2026-02-17T05:46:56.477 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2026-02-17T05:46:55.837485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":231040,"kb_used_data":15136,"kb_used_omap":10831,"kb_used_meta":204976,"kb_avail":566000000,"statfs":{"total":579820584960,"available":579584000000,"internally_reserved":0,"allocated":15499264,"data_stored":9040828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11091027,"internal_metadata":209896365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001008"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1879,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879690+0000","last_change":"2026-02-17T05:28:01.721082+0000","last_active":"2026-02-17T05:45:33.879690+0000","last_peered":"2026-02-17T05:45:33.879690+0000","last_clean":"2026-02-17T05:45:33.879690+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:45:33.879690+0000","last_undegraded":"2026-02-17T05:45:33.879690+0000","last_fullsized":"2026-02-17T05:45:33.879690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:00.718106+0000","last_clean_scrub_stamp":"2026-02-17T05:28:00.718106+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:14:11.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1738,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879307+0000","last_change":"2026-02-17T05:28:07.739072+0000","last_active":"2026-02-17T05:45:33.879307+0000","last_peered":"2026-02-17T05:45:33.879307+0000","last_clean":"2026-02-17T05:45:33.879307+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:45:33.879307+0000","last_undegraded":"2026-02-17T05:45:33.879307+0000","last_fullsized":"2026-02-17T05:45:33.879307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:33:48.881209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1742,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879568+0000","last_change":"2026-02-17T05:28:07.738152+0000","last_active":"2026-02-17T05:45:33.879568+0000","last_peered":"2026-02-17T05:45:33.879568+0000","last_clean":"2026-02-17T05:45:33.879568+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:45:33.879568+0000","last_undegraded":"2026-02-17T05:45:33.879568+0000","last_fullsized":"2026-02-17T05:45:33.879568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:27.463474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1737,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.490045+0000","last_change":"2026-02-17T05:28:07.739136+0000","last_active":"2026-02-17T05:45:33.490045+0000","last_peered":"2026-02-17T05:45:33.490045+0000","last_clean":"2026-02-17T05:45:33.490045+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:45:33.490045+0000","last_undegraded":"2026-02-17T05:45:33.490045+0000","last_fullsized":"2026-02-17T05:45:33.490045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:48:35.179549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1739,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879294+0000","last_change":"2026-02-17T05:28:07.739313+0000","last_active":"2026-02-17T05:45:33.879294+0000","last_peered":"2026-02-17T05:45:33.879294+0000","last_clean":"2026-02-17T05:45:33.879294+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:45:33.879294+0000","last_undegraded":"2026-02-17T05:45:33.879294+0000","last_fullsized":"2026-02-17T05:45:33.879294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:50:33.712052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1736,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398556+0000","last_change":"2026-02-17T05:28:07.739035+0000","last_active":"2026-02-17T05:45:33.398556+0000","last_peered":"2026-02-17T05:45:33.398556+0000","last_clean":"2026-02-17T05:45:33.398556+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:45:33.398556+0000","last_undegraded":"2026-02-17T05:45:33.398556+0000","last_fullsized":"2026-02-17T05:45:33.398556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:16:41.391933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879658+0000","last_change":"2026-02-17T05:28:07.738148+0000","last_active":"2026-02-17T05:45:33.879658+0000","last_peered":"2026-02-17T05:45:33.879658+0000","last_clean":"2026-02-17T05:45:33.879658+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:45:33.879658+0000","last_undegraded":"2026-02-17T05:45:33.879658+0000","last_fullsized":"2026-02-17T05:45:33.879658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:58:19.024429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1735,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.398545+0000","last_change":"2026-02-17T05:28:07.738997+0000","last_active":"2026-02-17T05:45:33.398545+0000","last_peered":"2026-02-17T05:45:33.398545+0000","last_clean":"2026-02-17T05:45:33.398545+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:45:33.398545+0000","last_undegraded":"2026-02-17T05:45:33.398545+0000","last_fullsized":"2026-02-17T05:45:33.398545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:36:55.434063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1741,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:45:33.879717+0000","last_change":"2026-02-17T05:28:07.738260+0000","last_active":"2026-02-17T05:45:33.879717+0000","last_peered":"2026-02-17T05:45:33.879717+0000","last_clean":"2026-02-17T05:45:33.879717+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:45:33.879717+0000","last_undegraded":"2026-02-17T05:45:33.879717+0000","last_fullsized":"2026-02-17T05:45:33.879717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:28:04.725307+0000","last_clean_scrub_stamp":"2026-02-17T05:28:04.725307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:53:38.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640485,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":1947,"kb_used_meta":43044,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1994144,"internal_metadata":44077664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2328,"kb_used_omap":1525,"kb_used_meta":25418,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1562458,"internal_metadata":26028198},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640485,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1409,"kb_used_meta":25534,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1442817,"internal_metadata":26147839},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640485,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47336,"kb_used_data":2328,"kb_used_omap":2230,"kb_used_meta":42761,"kb_avail":94324504,"statfs":{"total":96636764160,"available":96588292096,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2284468,"internal_metadata":43787340},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640485,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":2358,"kb_used_meta":42633,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2415385,"internal_metadata":43656423},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1359,"kb_used_meta":25584,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1391755,"internal_metadata":26198901},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:56.482 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T05:28:00.718106+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.482 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.482 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.482 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T05:28:04.725307+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=4, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=5, tm_min=46, tm_sec=53, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T05:46:56.483 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T05:47:16.484 DEBUG:teuthology.orchestra.run.trial106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.549+0000 7f2b643b9640 10 monclient: get_monmap_and_config 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.549+0000 7f2b643b9640 10 monclient: build_initial_monmap 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.549+0000 7f2b643b9640 10 monclient: monmap: 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.560 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:47:16.550926+0000 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:47:16.550926+0000 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.549+0000 7f2b643b9640 1 Processor -- start 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 1 -- start start 2026-02-17T05:47:16.561 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient: init 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-b con 0x7f2b5c05d1b0 addr v1:10.20.193.106:6790/0 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-c con 0x7f2b5c05dee0 addr v1:10.20.193.118:6789/0 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-a con 0x7f2b5c182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c08b060 con 0x7f2b5c182720 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c05dc90 con 0x7f2b5c05dee0 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c08d6a0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 10 monclient(hunting): authenticate will time out at 1765.179401s 2026-02-17T05:47:16.562 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6212e640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7f2b5c05d1b0 0x7f2b5c05d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42704/0 (socket says 10.20.193.106:42704) 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6212e640 1 -- 10.20.193.106:0/3618919306 learned_addr learned my addr 10.20.193.106:0/3618919306 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113307365 0 0) 0x7f2b5c08d6a0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): my global_id is 5561 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b440035e0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019804232 0 0) 0x7f2b5c08b060 con 0x7f2b5c182720 2026-02-17T05:47:16.563 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient(hunting): my global_id is 164232 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5c08d6a0 con 0x7f2b5c182720 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2091254945 0 0) 0x7f2b440035e0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 >> v1:10.20.193.118:6789/0 conn(0x7f2b5c05dee0 legacy=0x7f2b5c181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 >> v1:10.20.193.106:6789/0 conn(0x7f2b5c182720 legacy=0x7f2b5c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: _finish_hunting 0 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 monclient: found mon.noname-b 2026-02-17T05:47:16.564 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c057960 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: _finish_auth 0 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: _check_auth_tickets 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2b4c002dd0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 5 monclient: authenticate success, global_id 5561 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:47:16.565 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b6112c640 10 monclient: dump: 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.566 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.550+0000 7f2b643b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b4c003050 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 10 monclient: handle_config config(0 keys) 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 10 monclient: get_monmap_and_config success 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 4 set_mon_vals no callback set 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 1 -- 10.20.193.106:0/3618919306 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2b4c003420 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b6112c640 10 monclient: dump: 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.567 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 10 monclient: shutdown 2026-02-17T05:47:16.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- 10.20.193.106:0/3618919306 >> v1:10.20.193.106:6790/0 conn(0x7f2b5c05d1b0 legacy=0x7f2b5c05d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- 10.20.193.106:0/3618919306 shutdown_connections 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- 10.20.193.106:0/3618919306 >> 10.20.193.106:0/3618919306 conn(0x7f2b5c0915f0 msgr2=0x7f2b5c0919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- 10.20.193.106:0/3618919306 shutdown_connections 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- 10.20.193.106:0/3618919306 wait complete. 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 10 monclient: build_initial_monmap 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 10 monclient: monmap: 2026-02-17T05:47:16.569 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 Processor -- start 2026-02-17T05:47:16.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 1 -- start start 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.551+0000 7f2b643b9640 10 monclient: init 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _reopen_session rank -1 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-b con 0x7f2b5c05d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-a con 0x7f2b5c05dee0 addr v1:10.20.193.106:6789/0 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient(hunting): picked mon.noname-c con 0x7f2b5c182720 addr v1:10.20.193.106:6790/0 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c13f600 con 0x7f2b5c05dee0 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c12c0b0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c05e8e0 con 0x7f2b5c182720 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient(hunting): _renew_subs 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient(hunting): authenticate will time out at 1765.181181s 2026-02-17T05:47:16.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b6192d640 1 --1- >> v1:10.20.193.106:6789/0 conn(0x7f2b5c05dee0 0x7f2b5c180dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:34518/0 (socket says 10.20.193.106:34518) 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b6192d640 1 -- 10.20.193.106:0/350283510 learned_addr learned my addr 10.20.193.106:0/350283510 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841803712 0 0) 0x7f2b5c13f600 con 0x7f2b5c05dee0 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): my global_id is 164235 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c0035e0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095656729 0 0) 0x7f2b5c05e8e0 con 0x7f2b5c182720 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): my global_id is 5564 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5c13f600 con 0x7f2b5c182720 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 946393902 0 0) 0x7f2b2c0035e0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b5c05e8e0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2b50003110 con 0x7f2b5c05dee0 2026-02-17T05:47:16.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): dump: 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.574 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152571814 0 0) 0x7f2b5c12c0b0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): my global_id is 134389 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c0035e0 con 0x7f2b5c05d1b0 2026-02-17T05:47:16.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 608189073 0 0) 0x7f2b5c13f600 con 0x7f2b5c182720 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b5c12c0b0 con 0x7f2b5c182720 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2b580040a0 con 0x7f2b5c182720 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient(hunting): dump: 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.576 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1382763168 0 0) 0x7f2b5c05e8e0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 >> v1:10.20.193.106:6790/0 conn(0x7f2b5c182720 legacy=0x7f2b5c195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 >> v1:10.20.193.118:6789/0 conn(0x7f2b5c05d1b0 legacy=0x7f2b5c194300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: _finish_hunting 0 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 monclient: found mon.a 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:47:16.577 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c13d690 con 0x7f2b5c05dee0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: _finish_auth 0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: _check_auth_tickets 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 5 monclient: authenticate success, global_id 164235 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _renew_subs 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c129d50 con 0x7f2b5c05dee0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _renew_subs 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b5c12bdd0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b50003480 con 0x7f2b5c05dee0 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7f2b50003b30 con 0x7f2b5c05dee0 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b42ffd640 10 monclient: dump: 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.579 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.580 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.552+0000 7f2b6092b640 4 set_mon_vals no callback set 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b643b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b643b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b643b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.106:6789/0 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c12b9a0 con 0x7f2b5c05dee0 2026-02-17T05:47:16.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7f2b50003c90 con 0x7f2b5c05dee0 2026-02-17T05:47:16.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7f2b5004fc90 con 0x7f2b5c05dee0 2026-02-17T05:47:16.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.553+0000 7f2b6212e640 10 monclient: get_auth_request con 0x7f2b2c040e10 auth_method 0 2026-02-17T05:47:16.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.555+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mon.0 v1:10.20.193.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7f2b50017460 con 0x7f2b5c05dee0 2026-02-17T05:47:16.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.555+0000 7f2b42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.555+0000 7f2b42ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:47:16.664 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.662+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 --> v1:10.20.193.118:6812/703720803 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b5c057ca0 con 0x7f2b2c040e10 2026-02-17T05:47:16.665 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.663+0000 7f2b42ffd640 1 -- 10.20.193.106:0/350283510 <== mgr.4105 v1:10.20.193.118:6812/703720803 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33995 (unknown 2965378022 0 663482621) 0x7f2b4c002d70 con 0x7f2b2c040e10 2026-02-17T05:47:16.666 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-17T05:47:16.667 INFO:teuthology.orchestra.run.trial106.stderr:dumped all 2026-02-17T05:47:16.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 >> v1:10.20.193.118:6812/703720803 conn(0x7f2b2c040e10 legacy=0x7f2b2c0612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 10 monclient: shutdown 2026-02-17T05:47:16.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:47:16.667 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 >> v1:10.20.193.106:6789/0 conn(0x7f2b5c05dee0 legacy=0x7f2b5c180dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 shutdown_connections 2026-02-17T05:47:16.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 >> 10.20.193.106:0/350283510 conn(0x7f2b5c0915f0 msgr2=0x7f2b5c0885f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:47:16.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 shutdown_connections 2026-02-17T05:47:16.668 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.664+0000 7f2b643b9640 1 -- 10.20.193.106:0/350283510 wait complete. 2026-02-17T05:47:16.673 INFO:teuthology.orchestra.run.trial106.stdout:{"pg_ready":true,"pg_map":{"version":1456,"stamp":"2026-02-17T05:47:15.839203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":231040,"kb_used_data":15136,"kb_used_omap":10831,"kb_used_meta":204976,"kb_avail":566000000,"statfs":{"total":579820584960,"available":579584000000,"internally_reserved":0,"allocated":15499264,"data_stored":9040828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11091027,"internal_metadata":209896365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000992"},"pg_stats":[{"pgid":"1.0","version":"885'114","reported_seq":1889,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:59.072117+0000","last_change":"2026-02-17T05:46:59.072117+0000","last_active":"2026-02-17T05:46:59.072117+0000","last_peered":"2026-02-17T05:46:59.072117+0000","last_clean":"2026-02-17T05:46:59.072117+0000","last_became_active":"2026-02-17T05:28:01.720612+0000","last_became_peered":"2026-02-17T05:28:01.720612+0000","last_unstale":"2026-02-17T05:46:59.072117+0000","last_undegraded":"2026-02-17T05:46:59.072117+0000","last_fullsized":"2026-02-17T05:46:59.072117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"885'114","last_scrub_stamp":"2026-02-17T05:46:59.072067+0000","last_deep_scrub":"885'114","last_deep_scrub_stamp":"2026-02-17T05:46:59.072067+0000","last_clean_scrub_stamp":"2026-02-17T05:46:59.072067+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:24:03.002459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"885'2","reported_seq":1747,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:57.421350+0000","last_change":"2026-02-17T05:46:57.421350+0000","last_active":"2026-02-17T05:46:57.421350+0000","last_peered":"2026-02-17T05:46:57.421350+0000","last_clean":"2026-02-17T05:46:57.421350+0000","last_became_active":"2026-02-17T05:28:05.734572+0000","last_became_peered":"2026-02-17T05:28:05.734572+0000","last_unstale":"2026-02-17T05:46:57.421350+0000","last_undegraded":"2026-02-17T05:46:57.421350+0000","last_fullsized":"2026-02-17T05:46:57.421350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"885'2","last_scrub_stamp":"2026-02-17T05:46:57.421322+0000","last_deep_scrub":"885'2","last_deep_scrub_stamp":"2026-02-17T05:46:57.421322+0000","last_clean_scrub_stamp":"2026-02-17T05:46:57.421322+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:57:58.316651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00018387199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1750,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:58.095963+0000","last_change":"2026-02-17T05:46:58.095963+0000","last_active":"2026-02-17T05:46:58.095963+0000","last_peered":"2026-02-17T05:46:58.095963+0000","last_clean":"2026-02-17T05:46:58.095963+0000","last_became_active":"2026-02-17T05:28:05.735479+0000","last_became_peered":"2026-02-17T05:28:05.735479+0000","last_unstale":"2026-02-17T05:46:58.095963+0000","last_undegraded":"2026-02-17T05:46:58.095963+0000","last_fullsized":"2026-02-17T05:46:58.095963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:58.095922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:58.095922+0000","last_clean_scrub_stamp":"2026-02-17T05:46:58.095922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:05.799573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000252279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1745,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:56.130127+0000","last_change":"2026-02-17T05:46:56.130127+0000","last_active":"2026-02-17T05:46:56.130127+0000","last_peered":"2026-02-17T05:46:56.130127+0000","last_clean":"2026-02-17T05:46:56.130127+0000","last_became_active":"2026-02-17T05:28:05.736491+0000","last_became_peered":"2026-02-17T05:28:05.736491+0000","last_unstale":"2026-02-17T05:46:56.130127+0000","last_undegraded":"2026-02-17T05:46:56.130127+0000","last_fullsized":"2026-02-17T05:46:56.130127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:56.130087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:56.130087+0000","last_clean_scrub_stamp":"2026-02-17T05:46:56.130087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:03:03.169057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000177419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"885'3","reported_seq":1748,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:56.467773+0000","last_change":"2026-02-17T05:46:56.467773+0000","last_active":"2026-02-17T05:46:56.467773+0000","last_peered":"2026-02-17T05:46:56.467773+0000","last_clean":"2026-02-17T05:46:56.467773+0000","last_became_active":"2026-02-17T05:28:05.735533+0000","last_became_peered":"2026-02-17T05:28:05.735533+0000","last_unstale":"2026-02-17T05:46:56.467773+0000","last_undegraded":"2026-02-17T05:46:56.467773+0000","last_fullsized":"2026-02-17T05:46:56.467773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"885'3","last_scrub_stamp":"2026-02-17T05:46:56.467389+0000","last_deep_scrub":"885'3","last_deep_scrub_stamp":"2026-02-17T05:46:56.467389+0000","last_clean_scrub_stamp":"2026-02-17T05:46:56.467389+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:34:51.345782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041922900000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1744,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:56.867612+0000","last_change":"2026-02-17T05:46:56.867612+0000","last_active":"2026-02-17T05:46:56.867612+0000","last_peered":"2026-02-17T05:46:56.867612+0000","last_clean":"2026-02-17T05:46:56.867612+0000","last_became_active":"2026-02-17T05:28:05.736097+0000","last_became_peered":"2026-02-17T05:28:05.736097+0000","last_unstale":"2026-02-17T05:46:56.867612+0000","last_undegraded":"2026-02-17T05:46:56.867612+0000","last_fullsized":"2026-02-17T05:46:56.867612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:56.867560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:56.867560+0000","last_clean_scrub_stamp":"2026-02-17T05:46:56.867560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:04:07.019433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00024946199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1750,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:56.079219+0000","last_change":"2026-02-17T05:46:56.079191+0000","last_active":"2026-02-17T05:46:56.079219+0000","last_peered":"2026-02-17T05:46:56.079219+0000","last_clean":"2026-02-17T05:46:56.079219+0000","last_became_active":"2026-02-17T05:28:05.734843+0000","last_became_peered":"2026-02-17T05:28:05.734843+0000","last_unstale":"2026-02-17T05:46:56.079219+0000","last_undegraded":"2026-02-17T05:46:56.079219+0000","last_fullsized":"2026-02-17T05:46:56.079219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:56.079158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:56.079158+0000","last_clean_scrub_stamp":"2026-02-17T05:46:56.079158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:53:24.192521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029401600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1743,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:55.887581+0000","last_change":"2026-02-17T05:46:55.887581+0000","last_active":"2026-02-17T05:46:55.887581+0000","last_peered":"2026-02-17T05:46:55.887581+0000","last_clean":"2026-02-17T05:46:55.887581+0000","last_became_active":"2026-02-17T05:28:05.735886+0000","last_became_peered":"2026-02-17T05:28:05.735886+0000","last_unstale":"2026-02-17T05:46:55.887581+0000","last_undegraded":"2026-02-17T05:46:55.887581+0000","last_fullsized":"2026-02-17T05:46:55.887581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:55.887537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:55.887537+0000","last_clean_scrub_stamp":"2026-02-17T05:46:55.887537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:21:20.568046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000220318,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1749,"reported_epoch":885,"state":"active+clean","last_fresh":"2026-02-17T05:46:57.066888+0000","last_change":"2026-02-17T05:46:57.066888+0000","last_active":"2026-02-17T05:46:57.066888+0000","last_peered":"2026-02-17T05:46:57.066888+0000","last_clean":"2026-02-17T05:46:57.066888+0000","last_became_active":"2026-02-17T05:28:05.874125+0000","last_became_peered":"2026-02-17T05:28:05.874125+0000","last_unstale":"2026-02-17T05:46:57.066888+0000","last_undegraded":"2026-02-17T05:46:57.066888+0000","last_fullsized":"2026-02-17T05:46:57.066888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:57.066851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:57.066851+0000","last_clean_scrub_stamp":"2026-02-17T05:46:57.066851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:34:22.455624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036165200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640489,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":1947,"kb_used_meta":43044,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1994144,"internal_metadata":44077664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2328,"kb_used_omap":1525,"kb_used_meta":25418,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1562458,"internal_metadata":26028198},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1409,"kb_used_meta":25534,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1442817,"internal_metadata":26147839},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640489,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47336,"kb_used_data":2328,"kb_used_omap":2230,"kb_used_meta":42761,"kb_avail":94324504,"statfs":{"total":96636764160,"available":96588292096,"internally_reserved":0,"allocated":2383872,"data_stored":1310009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2284468,"internal_metadata":43787340},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2332,"kb_used_omap":2358,"kb_used_meta":42633,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2387968,"data_stored":1310028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2415385,"internal_metadata":43656423},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640489,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2908,"kb_used_omap":1359,"kb_used_meta":25584,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2977792,"data_stored":1900377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1391755,"internal_metadata":26198901},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:47:16.676 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T05:47:16.747 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: get_monmap_and_config 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: build_initial_monmap 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: monmap: 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:47:16.738615+0000 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:47:16.738615+0000 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:47:16.748 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-c 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-b 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 1 Processor -- start 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 1 -- start start 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: init 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:47:16.749 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-c con 0x7fda5405d1b0 addr v1:10.20.193.118:6789/0 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.737+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-b con 0x7fda5405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-a con 0x7fda54182720 addr v1:10.20.193.106:6789/0 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5408b060 con 0x7fda54182720 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5405dc90 con 0x7fda5405d1b0 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5408d6a0 con 0x7fda5405dee0 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 10 monclient(hunting): authenticate will time out at 1765.367034s 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda52ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fda5405dee0 0x7fda54181000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42720/0 (socket says 10.20.193.106:42720) 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda52ffd640 1 -- 10.20.193.106:0/339432949 learned_addr learned my addr 10.20.193.106:0/339432949 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:47:16.750 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217891816 0 0) 0x7fda5408d6a0 con 0x7fda5405dee0 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): my global_id is 5567 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda380035e0 con 0x7fda5405dee0 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280458287 0 0) 0x7fda5408b060 con 0x7fda54182720 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): my global_id is 164238 2026-02-17T05:47:16.751 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5408d6a0 con 0x7fda54182720 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.1 v1:10.20.193.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090094940 0 0) 0x7fda5405dc90 con 0x7fda5405d1b0 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient(hunting): my global_id is 134392 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 --> v1:10.20.193.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5408b060 con 0x7fda5405d1b0 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 136219380 0 0) 0x7fda380035e0 con 0x7fda5405dee0 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 >> v1:10.20.193.118:6789/0 conn(0x7fda5405d1b0 legacy=0x7fda5405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 >> v1:10.20.193.106:6789/0 conn(0x7fda54182720 legacy=0x7fda541a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: _finish_hunting 0 2026-02-17T05:47:16.752 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 monclient: found mon.noname-b 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda54057960 con 0x7fda5405dee0 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: _finish_auth 0 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: _check_auth_tickets 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda44002dd0 con 0x7fda5405dee0 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: dump: 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.753 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 5 monclient: authenticate success, global_id 5567 2026-02-17T05:47:16.754 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.2 v1:10.20.193.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda44002fa0 con 0x7fda5405dee0 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 1 -- 10.20.193.106:0/339432949 <== mon.2 v1:10.20.193.106:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda440033b0 con 0x7fda5405dee0 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda527fc640 10 monclient: dump: 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.755 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 10 monclient: get_monmap_and_config success 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 4 set_mon_vals no callback set 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 10 monclient: shutdown 2026-02-17T05:47:16.756 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- 10.20.193.106:0/339432949 >> v1:10.20.193.106:6790/0 conn(0x7fda5405dee0 legacy=0x7fda54181000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- 10.20.193.106:0/339432949 shutdown_connections 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.738+0000 7fda59e1b640 1 -- 10.20.193.106:0/339432949 >> 10.20.193.106:0/339432949 conn(0x7fda540915f0 msgr2=0x7fda540919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 1 -- 10.20.193.106:0/339432949 shutdown_connections 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 1 -- 10.20.193.106:0/339432949 wait complete. 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient: build_initial_monmap 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient: monmap: 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:epoch 0 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T05:47:16.757 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 0.000000 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:created 0.000000 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 0 (unknown) 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 1 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.noname-a 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.noname-b 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.noname-c 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 1 Processor -- start 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 1 -- start start 2026-02-17T05:47:16.758 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient: init 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient: _reopen_session rank -1 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.739+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-a con 0x7fda5405d1b0 addr v1:10.20.193.106:6789/0 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-c con 0x7fda5405dee0 addr v1:10.20.193.106:6790/0 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient(hunting): picked mon.noname-b con 0x7fda54182720 addr v1:10.20.193.118:6789/0 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 1 -- --> v1:10.20.193.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5405e950 con 0x7fda5405d1b0 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 1 -- --> v1:10.20.193.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5410cc90 con 0x7fda54182720 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 1 -- --> v1:10.20.193.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5412c1b0 con 0x7fda5405dee0 2026-02-17T05:47:16.759 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient(hunting): _renew_subs 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient(hunting): authenticate will time out at 1765.369030s 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda52ffd640 1 --1- >> v1:10.20.193.106:6790/0 conn(0x7fda5405dee0 0x7fda5412baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6790/0 says I am v1:10.20.193.106:42728/0 (socket says 10.20.193.106:42728) 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda52ffd640 1 -- 10.20.193.106:0/2082814530 learned_addr learned my addr 10.20.193.106:0/2082814530 (peer_addr_for_me v1:10.20.193.106:0/0) 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda537fe640 1 --1- 10.20.193.106:0/2082814530 >> v1:10.20.193.106:6789/0 conn(0x7fda5405d1b0 0x7fda5412b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.106:6789/0 says I am v1:10.20.193.106:34538/0 (socket says 10.20.193.106:34538) 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295953470 0 0) 0x7fda5412c1b0 con 0x7fda5405dee0 2026-02-17T05:47:16.760 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): my global_id is 5570 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda240035e0 con 0x7fda5405dee0 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.0 v1:10.20.193.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479077803 0 0) 0x7fda5408b060 con 0x7fda5405d1b0 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _negotiate 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): my global_id is 164241 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5412c1b0 con 0x7fda5405d1b0 2026-02-17T05:47:16.761 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 281297613 0 0) 0x7fda240035e0 con 0x7fda5405dee0 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda5408b060 con 0x7fda5405dee0 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda44002ce0 con 0x7fda5405dee0 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): dump: 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.762 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.0 v1:10.20.193.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1050959453 0 0) 0x7fda5412c1b0 con 0x7fda5405d1b0 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda240035e0 con 0x7fda5405d1b0 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.0 v1:10.20.193.106:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda40003090 con 0x7fda5405d1b0 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient(hunting): dump: 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.763 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2812117207 0 0) 0x7fda5408b060 con 0x7fda5405dee0 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 >> v1:10.20.193.118:6789/0 conn(0x7fda54182720 legacy=0x7fda54181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 >> v1:10.20.193.106:6789/0 conn(0x7fda5405d1b0 legacy=0x7fda5412b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.764 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: _finish_hunting 0 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 monclient: found mon.c 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5410be20 con 0x7fda5405dee0 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: _finish_auth 0 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: _check_auth_tickets 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T05:47:16.765 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 5 monclient: authenticate success, global_id 5570 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient: _renew_subs 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda5410a930 con 0x7fda5405dee0 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient: _renew_subs 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fda5410b6c0 con 0x7fda5405dee0 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda44002970 con 0x7fda5405dee0 2026-02-17T05:47:16.766 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 1455049806 0 0) 0x7fda44004d00 con 0x7fda5405dee0 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda2ffff640 10 monclient: dump: 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:epoch 1 2026-02-17T05:47:16.767 INFO:teuthology.orchestra.run.trial106.stderr:fsid f9284388-9cba-4b6a-8ae7-6bff755d8682 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:last_changed 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:created 2026-02-17T05:27:44.165842+0000 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:min_mon_release 20 (tentacle) 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:election_strategy: 3 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:0: v1:10.20.193.106:6789/0 mon.a 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:1: v1:10.20.193.118:6789/0 mon.b 2026-02-17T05:47:16.768 INFO:teuthology.orchestra.run.trial106.stderr:2: v1:10.20.193.106:6790/0 mon.c 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.740+0000 7fda51ffb640 4 set_mon_vals no callback set 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda59e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda59e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda59e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda540008d0 con 0x7fda5405dee0 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 7 ==== mgrmap(e 5) ==== 52792+0+0 (unknown 1484065985 0 0) 0x7fda44011ca0 con 0x7fda5405dee0 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 8 ==== osd_map(885..885 src has 776..885) ==== 3579+0+0 (unknown 2811033400 0 0) 0x7fda4404fcb0 con 0x7fda5405dee0 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.741+0000 7fda537fe640 10 monclient: get_auth_request con 0x7fda24040b30 auth_method 0 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.743+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (unknown 1092875540 0 1738654174) 0x7fda44017540 con 0x7fda5405dee0 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.743+0000 7fda2ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T05:47:16.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.743+0000 7fda2ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T05:47:16.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.845+0000 7fda59e1b640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T05:47:16.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.845+0000 7fda59e1b640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T05:47:16.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.845+0000 7fda59e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.106:6790/0 2026-02-17T05:47:16.848 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.845+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 --> v1:10.20.193.106:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fda5408e3d0 con 0x7fda5405dee0 2026-02-17T05:47:16.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (unknown 3022875181 0 0) 0x7fda44016cf0 con 0x7fda5405dee0 2026-02-17T05:47:16.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda2ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T05:47:16.849 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda2ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T05:47:16.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda2ffff640 1 -- 10.20.193.106:0/2082814530 <== mon.2 v1:10.20.193.106:6790/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fda44016cf0 con 0x7fda5405dee0 2026-02-17T05:47:16.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda2ffff640 10 monclient: handle_config config(1 keys) 2026-02-17T05:47:16.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda517fa640 4 set_mon_vals no callback set 2026-02-17T05:47:16.850 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.847+0000 7fda517fa640 10 set_mon_vals mon_health_to_clog = false 2026-02-17T05:47:16.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 >> v1:10.20.193.118:6812/703720803 conn(0x7fda24040b30 legacy=0x7fda24060fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 10 monclient: shutdown 2026-02-17T05:47:16.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T05:47:16.851 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 >> v1:10.20.193.106:6790/0 conn(0x7fda5405dee0 legacy=0x7fda5412baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T05:47:16.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 shutdown_connections 2026-02-17T05:47:16.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 >> 10.20.193.106:0/2082814530 conn(0x7fda540915f0 msgr2=0x7fda5408b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T05:47:16.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 shutdown_connections 2026-02-17T05:47:16.852 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-17T05:47:16.848+0000 7fda59e1b640 1 -- 10.20.193.106:0/2082814530 wait complete. 2026-02-17T05:47:16.859 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T05:47:16.859 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T05:47:16.859 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T05:47:16.859 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:16.899 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T05:47:16.900 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T05:47:16.900 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:16.972 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T05:47:16.972 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T05:47:16.973 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.042 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T05:47:17.043 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T05:47:17.043 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.088 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T05:47:17.088 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T05:47:17.088 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.165 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T05:47:17.166 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T05:47:17.166 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.239 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T05:47:17.239 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T05:47:17.239 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T05:47:17.240 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.311 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T05:47:17.311 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T05:47:17.311 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:47:17.311 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.323 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:47:17.323 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T05:47:17.323 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.378 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T05:47:17.378 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T05:47:17.379 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:47:17.388 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T05:47:17.388 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T05:47:17.389 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v '\(MON_NETSPLIT)' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T05:47:17.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:47:17.446 DEBUG:teuthology.orchestra.run.trial106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T05:47:17.516 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:47:17.517 DEBUG:teuthology.orchestra.run.trial106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T05:47:17.594 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:47:17.594 DEBUG:teuthology.orchestra.run.trial106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T05:47:17.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:47:17.673 DEBUG:teuthology.orchestra.run.trial118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T05:47:17.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:47:17.711 DEBUG:teuthology.orchestra.run.trial118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T05:47:17.781 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:47:17.781 DEBUG:teuthology.orchestra.run.trial118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T05:47:17.856 INFO:tasks.ceph:Archiving mon data... 2026-02-17T05:47:17.857 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/data/mon.a.tgz 2026-02-17T05:47:17.857 DEBUG:teuthology.orchestra.run.trial106:> mktemp 2026-02-17T05:47:17.876 INFO:teuthology.orchestra.run.trial106.stdout:/tmp/tmp.EAqDc6OCtB 2026-02-17T05:47:17.877 DEBUG:teuthology.orchestra.run.trial106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EAqDc6OCtB 2026-02-17T05:47:17.983 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0666 /tmp/tmp.EAqDc6OCtB 2026-02-17T05:47:18.065 DEBUG:teuthology.orchestra.remote:trial106:/tmp/tmp.EAqDc6OCtB is 419KB 2026-02-17T05:47:18.132 DEBUG:teuthology.orchestra.run.trial106:> rm -fr /tmp/tmp.EAqDc6OCtB 2026-02-17T05:47:18.149 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/data/mon.c.tgz 2026-02-17T05:47:18.149 DEBUG:teuthology.orchestra.run.trial106:> mktemp 2026-02-17T05:47:18.206 INFO:teuthology.orchestra.run.trial106.stdout:/tmp/tmp.YaDfMi074T 2026-02-17T05:47:18.206 DEBUG:teuthology.orchestra.run.trial106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YaDfMi074T 2026-02-17T05:47:18.315 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0666 /tmp/tmp.YaDfMi074T 2026-02-17T05:47:18.397 DEBUG:teuthology.orchestra.remote:trial106:/tmp/tmp.YaDfMi074T is 432KB 2026-02-17T05:47:18.493 DEBUG:teuthology.orchestra.run.trial106:> rm -fr /tmp/tmp.YaDfMi074T 2026-02-17T05:47:18.509 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/data/mon.b.tgz 2026-02-17T05:47:18.509 DEBUG:teuthology.orchestra.run.trial118:> mktemp 2026-02-17T05:47:18.527 INFO:teuthology.orchestra.run.trial118.stdout:/tmp/tmp.dJlVoOVfLo 2026-02-17T05:47:18.528 DEBUG:teuthology.orchestra.run.trial118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dJlVoOVfLo 2026-02-17T05:47:18.636 DEBUG:teuthology.orchestra.run.trial118:> sudo chmod 0666 /tmp/tmp.dJlVoOVfLo 2026-02-17T05:47:18.719 DEBUG:teuthology.orchestra.remote:trial118:/tmp/tmp.dJlVoOVfLo is 422KB 2026-02-17T05:47:18.815 DEBUG:teuthology.orchestra.run.trial118:> rm -fr /tmp/tmp.dJlVoOVfLo 2026-02-17T05:47:18.833 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T05:47:18.833 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T05:47:18.836 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T05:47:18.915 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T05:47:18.954 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T05:47:18.955 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T05:47:18.957 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial106/crash 2026-02-17T05:47:18.958 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T05:47:18.983 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial118/crash 2026-02-17T05:47:18.984 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T05:47:19.018 INFO:tasks.ceph:Compressing logs... 2026-02-17T05:47:19.018 DEBUG:teuthology.orchestra.run.trial106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:47:19.027 DEBUG:teuthology.orchestra.run.trial118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:47:19.049 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T05:47:19.049 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49299.log 2026-02-17T05:47:19.050 INFO:teuthology.orchestra.run.trial106.stderr:gzip/var/log/ceph/ceph-osd.2.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52671.log 2026-02-17T05:47:19.050 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2026-02-17T05:47:19.050 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49299.log.gz 2026-02-17T05:47:19.050 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2026-02-17T05:47:19.050 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52671.log.gz 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49789.log 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48660.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47246.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2026-02-17T05:47:19.051 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49789.log.gz 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55271.log 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46201.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.49052.log -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2026-02-17T05:47:19.052 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55271.log.gz 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52328.log 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr: 88.7%/var/log/ceph/ceph-client.admin.53212.log: -- replaced with /var/log/ceph/ceph-client.admin.49052.log.gz 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52328.log.gz 2026-02-17T05:47:19.053 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51015.log 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51015.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53734.log 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50286.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51015.log.gz 2026-02-17T05:47:19.054 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51360.log 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53734.log.gz 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52720.log 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55613.log 2026-02-17T05:47:19.055 INFO:teuthology.orchestra.run.trial106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51360.log: /var/log/ceph/ceph-client.admin.52720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49152.log 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51360.log.gz 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52720.log.gz 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46390.log 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49152.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55613.log.gz 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54683.log 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49152.log.gz 2026-02-17T05:47:19.056 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46204.log 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48450.log 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54683.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46390.log.gz 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54683.log.gz 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50769.log 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.44734.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48450.log.gz 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2026-02-17T05:47:19.057 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45579.log 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50769.log.gz 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45579.log: -- /var/log/ceph/ceph-client.admin.50531.log 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49544.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45579.log.gz 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2026-02-17T05:47:19.058 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52818.log 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50384.log 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47197.log 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52818.log: /var/log/ceph/ceph-client.admin.50384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50384.log.gz 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52818.log.gz 2026-02-17T05:47:19.059 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47197.log.gz 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48303.log 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52622.log 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gz 2026-02-17T05:47:19.060 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49495.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48303.log.gz 2026-02-17T05:47:19.061 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47960.log 2026-02-17T05:47:19.061 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2026-02-17T05:47:19.061 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46755.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52622.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47960.log: /var/log/ceph/ceph-client.admin.46755.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47960.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46755.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-mon.c.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48709.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2026-02-17T05:47:19.062 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54928.log 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54879.log 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54928.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51868.log 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54928.log.gz 2026-02-17T05:47:19.063 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52475.log 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54879.log.gz 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54398.log 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51868.log.gz 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46200.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52475.log.gz 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2026-02-17T05:47:19.064 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54398.log: /var/log/ceph/ceph-client.admin.55075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51162.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54398.log.gz 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45909.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47344.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51162.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54126.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51162.log.gz 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53163.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47344.log: /var/log/ceph/ceph-client.admin.54126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2026-02-17T05:47:19.065 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47344.log.gz 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53163.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.54126.log.gz -- 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr: /var/log/ceph/ceph-client.admin.53408.log 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51064.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53163.log.gz 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52426.log 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2026-02-17T05:47:19.066 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47491.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50916.log 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52426.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50818.log 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52426.log.gz 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50916.log: /var/log/ceph/ceph-client.admin.50818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55516.log 2026-02-17T05:47:19.067 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46657.log 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50916.log.gz 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50818.log.gz 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55516.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52064.log 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55516.log.gz 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51574.log 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46657.log: /var/log/ceph/ceph-client.admin.52064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55467.log 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46657.log.gz 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51574.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52064.log.gz -5 2026-02-17T05:47:19.068 INFO:teuthology.orchestra.run.trial106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51113.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55566.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51574.log.gz 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr:gzip/var/log/ceph/ceph-client.admin.51113.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55467.log.gz 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49201.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51113.log.gz 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55566.log: /var/log/ceph/ceph-client.admin.54175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49992.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55566.log.gz 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53783.log 2026-02-17T05:47:19.069 INFO:teuthology.orchestra.run.trial106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42746.log 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49201.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53783.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49992.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52524.log 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.42746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47862.log 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53783.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42746.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52524.log.gz 2026-02-17T05:47:19.070 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55124.log 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47862.log.gz 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47049.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55124.log.gz 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2026-02-17T05:47:19.071 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.42544.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53359.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50433.log 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46199.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz --verbose 2026-02-17T05:47:19.072 INFO:teuthology.orchestra.run.trial106.stderr: -- /var/log/ceph/ceph-client.admin.53881.log 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50433.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53587.log 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55418.log 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55418.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.54536.log 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53587.log.gz 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46203.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55418.log.gz 2026-02-17T05:47:19.073 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52113.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54536.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46706.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54536.log.gz 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46706.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52113.log.gz 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47125.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46706.log.gz 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51721.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53930.log 2026-02-17T05:47:19.074 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51721.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53930.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51721.log.gz 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53930.log.gz 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46853.log 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50090.log: /var/log/ceph/ceph-client.admin.48107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46853.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2026-02-17T05:47:19.075 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50482.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46853.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51211.log 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54224.log: /var/log/ceph/ceph-client.admin.51525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51770.log 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 88.5% 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51770.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51211.log.gz 2026-02-17T05:47:19.076 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53016.log 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51310.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51770.log.gz 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53016.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48611.log 2026-02-17T05:47:19.077 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53016.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48254.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48611.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45489.log 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45489.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51819.log 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52377.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45489.log.gz 2026-02-17T05:47:19.078 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51819.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51819.log.gz 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54585.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52279.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2026-02-17T05:47:19.079 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54585.log.gz 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49101.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51623.log 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52279.log.gz 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52769.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gzgzip 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53114.log 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2026-02-17T05:47:19.080 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53114.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51623.log.gz 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53114.log.gz 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2026-02-17T05:47:19.081 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48562.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47000.log 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52573.log 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2026-02-17T05:47:19.082 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45692.log 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.42737.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.0.45692.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2026-02-17T05:47:19.083 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42784.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47000.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48009.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52573.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54322.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51436.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.54322.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55173.log 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2026-02-17T05:47:19.084 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42643.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.42784.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.42643.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42784.log.gz 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42643.log.gz 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph.audit.log.gz /var/log/ceph/ceph-client.admin.42690.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2026-02-17T05:47:19.086 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.42690.log: /var/log/ceph/ceph-client.admin.42831.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47911.log: /var/log/ceph/ceph-client.admin.55173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51966.log 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47442.log 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55173.log.gz 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51966.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47442.log: 86.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51966.log.gz 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2026-02-17T05:47:19.087 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46533.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47442.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49740.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52867.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48513.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49740.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48401.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47813.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49740.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48401.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37670.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48513.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48401.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph.tmp-client.admin.37670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50335.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37670.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47813.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50335.log: gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz -- 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: /var/log/ceph/ceph-client.admin.49397.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46532.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50335.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49397.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53457.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50041.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz 2026-02-17T05:47:19.088 INFO:teuthology.orchestra.run.trial118.stderr: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46532.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53457.log.gzgzip 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50041.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53685.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49642.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53832.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53065.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53685.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54634.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53065.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53832.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50580.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53065.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50580.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54634.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54487.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50580.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46804.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54487.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.55369.log -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2026-02-17T05:47:19.090 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54487.log.gz 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49894.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55369.log.gz 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54028.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz -5 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55222.log: /var/log/ceph/ceph-client.admin.54028.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.51672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54077.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.54028.log.gz 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53261.log 2026-02-17T05:47:19.091 INFO:teuthology.orchestra.run.trial106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55320.log 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46202.log 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54077.log.gz 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54977.log 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53261.log.gz 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46202.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.55320.log.gz 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2026-02-17T05:47:19.092 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53310.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46202.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47639.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54977.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52015.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.53310.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53310.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54781.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52015.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50139.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47124.log 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2026-02-17T05:47:19.093 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54781.log: /var/log/ceph/ceph-client.admin.46951.log 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.47124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49348.log 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54781.log.gz 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.46951.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47124.log.gz 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48856.log 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49348.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48856.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz /var/log/ceph/ceph-client.admin.54830.log 2026-02-17T05:47:19.094 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.55026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48058.log 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48856.log.gz 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.54830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52967.log 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.48058.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54830.log.gz 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.52967.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.48058.log.gz -5 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.50867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52967.log.gz 2026-02-17T05:47:19.095 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.45419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2026-02-17T05:47:19.096 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.admin.49250.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2026-02-17T05:47:19.096 INFO:teuthology.orchestra.run.trial106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2026-02-17T05:47:19.096 INFO:teuthology.orchestra.run.trial106.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T05:47:19.128 INFO:teuthology.orchestra.run.trial118.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.45692.log.gz 2026-02-17T05:47:19.160 INFO:teuthology.orchestra.run.trial118.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T05:47:19.632 INFO:teuthology.orchestra.run.trial106.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T05:47:19.900 INFO:teuthology.orchestra.run.trial118.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T05:47:20.476 INFO:teuthology.orchestra.run.trial106.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T05:47:20.705 INFO:teuthology.orchestra.run.trial106.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T05:47:20.793 INFO:teuthology.orchestra.run.trial118.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T05:47:21.034 INFO:teuthology.orchestra.run.trial118.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T05:47:21.634 INFO:teuthology.orchestra.run.trial106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T05:47:21.746 INFO:teuthology.orchestra.run.trial118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T05:47:21.747 INFO:teuthology.orchestra.run.trial118.stderr: 2026-02-17T05:47:21.748 INFO:teuthology.orchestra.run.trial118.stderr:real 0m2.674s 2026-02-17T05:47:21.748 INFO:teuthology.orchestra.run.trial118.stderr:user 0m6.954s 2026-02-17T05:47:21.748 INFO:teuthology.orchestra.run.trial118.stderr:sys 0m0.321s 2026-02-17T05:47:22.401 INFO:teuthology.orchestra.run.trial106.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T05:47:22.402 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-17T05:47:22.402 INFO:teuthology.orchestra.run.trial106.stderr:real 0m3.361s 2026-02-17T05:47:22.403 INFO:teuthology.orchestra.run.trial106.stderr:user 0m9.183s 2026-02-17T05:47:22.403 INFO:teuthology.orchestra.run.trial106.stderr:sys 0m0.519s 2026-02-17T05:47:22.404 INFO:tasks.ceph:Archiving logs... 2026-02-17T05:47:22.404 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial106/log 2026-02-17T05:47:22.405 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T05:47:23.416 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial118/log 2026-02-17T05:47:23.416 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T05:47:24.048 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T05:47:24.059 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T05:47:24.059 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T05:47:24.061 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T05:47:24.216 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T05:47:24.229 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T05:47:24.229 DEBUG:teuthology.orchestra.run.trial106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:47:24.230 DEBUG:teuthology.orchestra.run.trial118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:47:24.245 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:47:24.247 INFO:teuthology.orchestra.run.trial118.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:=============================================================================== 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:^+ ntp.speculation.org 2 7 377 25 -3283us[-3283us] +/- 54ms 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:^+ 44.190.5.123 2 7 377 27 +1156us[+1269us] +/- 35ms 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:^+ sensei.ruselabs.com 2 7 377 89 -343us[ -233us] +/- 37ms 2026-02-17T05:47:24.275 INFO:teuthology.orchestra.run.trial118.stdout:^* 23.157.160.168 2 7 377 26 +738us[ +850us] +/- 39ms 2026-02-17T05:47:24.281 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:47:24.281 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-17T05:47:24.282 INFO:teuthology.orchestra.run.trial106.stdout:^+ li1150-42.members.linode> 2 7 377 27 +531us[ +507us] +/- 51ms 2026-02-17T05:47:24.282 INFO:teuthology.orchestra.run.trial106.stdout:^* LAX.CALTICK.NET 2 7 377 23 -338us[ -362us] +/- 32ms 2026-02-17T05:47:24.282 INFO:teuthology.orchestra.run.trial106.stdout:^+ sensei.ruselabs.com 2 7 377 26 -765us[ -789us] +/- 37ms 2026-02-17T05:47:24.282 INFO:teuthology.orchestra.run.trial106.stdout:^+ ntp.maxhost.io 2 6 377 154 +225us[ +306us] +/- 56ms 2026-02-17T05:47:24.282 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T05:47:24.295 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T05:47:24.295 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T05:47:24.308 DEBUG:teuthology.orchestra.run.trial106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T05:47:24.378 DEBUG:teuthology.orchestra.run.trial118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T05:47:24.435 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T05:47:24.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:47:24.465 DEBUG:teuthology.orchestra.run.trial118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T05:47:24.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:47:24.491 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T05:47:24.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T05:47:24.522 INFO:teuthology.task.internal:Duration was 1444.002887 seconds 2026-02-17T05:47:24.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T05:47:24.538 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T05:47:24.538 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T05:47:24.541 DEBUG:teuthology.orchestra.run.trial118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T05:47:24.575 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:47:24.578 INFO:teuthology.orchestra.run.trial118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:47:24.904 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T05:47:24.905 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial106.front.sepia.ceph.com 2026-02-17T05:47:24.905 DEBUG:teuthology.orchestra.run.trial106:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T05:47:24.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial118.front.sepia.ceph.com 2026-02-17T05:47:24.926 DEBUG:teuthology.orchestra.run.trial118:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T05:47:24.965 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T05:47:24.965 DEBUG:teuthology.orchestra.run.trial106:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:47:24.967 DEBUG:teuthology.orchestra.run.trial118:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:47:25.065 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T05:47:25.065 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:47:25.068 DEBUG:teuthology.orchestra.run.trial118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:47:25.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:47:25.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:47:25.090 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T05:47:25.090 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:47:25.090 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T05:47:25.091 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:47:25.092 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:47:25.093 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip 0.0% -5 -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz --verbose 2026-02-17T05:47:25.093 INFO:teuthology.orchestra.run.trial118.stderr: -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:47:25.093 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T05:47:25.100 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T05:47:25.102 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T05:47:25.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T05:47:25.122 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T05:47:25.123 DEBUG:teuthology.orchestra.run.trial106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T05:47:25.168 DEBUG:teuthology.orchestra.run.trial118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T05:47:25.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T05:47:25.212 DEBUG:teuthology.orchestra.run.trial106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:47:25.214 DEBUG:teuthology.orchestra.run.trial118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:47:25.237 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = core 2026-02-17T05:47:25.257 INFO:teuthology.orchestra.run.trial118.stdout:kernel.core_pattern = core 2026-02-17T05:47:25.271 DEBUG:teuthology.orchestra.run.trial106:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:47:25.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:47:25.310 DEBUG:teuthology.orchestra.run.trial118:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:47:25.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:47:25.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T05:47:25.344 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T05:47:25.345 DEBUG:teuthology.misc:Transferring archived files from trial106:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial106 2026-02-17T05:47:25.345 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T05:47:25.387 DEBUG:teuthology.misc:Transferring archived files from trial118:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/51002/remote/trial118 2026-02-17T05:47:25.387 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T05:47:25.424 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T05:47:25.424 DEBUG:teuthology.orchestra.run.trial106:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T05:47:25.427 DEBUG:teuthology.orchestra.run.trial118:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T05:47:25.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T05:47:25.492 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T05:47:25.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T05:47:25.509 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T05:47:25.509 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T05:47:25.512 DEBUG:teuthology.orchestra.run.trial118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T05:47:25.528 INFO:teuthology.orchestra.run.trial106.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 05:47 /home/ubuntu/cephtest 2026-02-17T05:47:25.531 INFO:teuthology.orchestra.run.trial118.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 05:47 /home/ubuntu/cephtest 2026-02-17T05:47:25.532 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T05:47:25.550 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T05:47:25.591 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{1M} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects} duration: 1444.0028874874115 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T05:47:25.591 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:47:25.710 INFO:teuthology.run:pass